[TRTLLM-6342][feat] TP Sharding read from the model config - #6972

[TRTLLM-6342][feat] TP Sharding read from the model config#6972

lucaslie merged 37 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

nv-auto-deploy:gk/sharding_config_v6nv-auto-deploy/TensorRT-LLM:gk/sharding_config_v6Copy head branch name to clipboard