[TRTLLM-8201][feat] TP sharding of Mamba layers#8548

greg-kwasniewski1 wants to merge 12 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

nv-auto-deploy:gk/sharding_mamba2_originnv-auto-deploy/TensorRT-LLM:gk/sharding_mamba2_originCopy head branch name to clipboard