[PyT] [Common] add support for enabling cuda graph under thd format in megatron. - #2898

[PyT] [Common] add support for enabling cuda graph under thd format in megatron.#2898

timmoon10 merged 12 commits into

NVIDIA:mainNVIDIA/TransformerEngine:mainfrom

HaochenYuan:thd_cuda_graph_0415HaochenYuan/TransformerEngine:thd_cuda_graph_0415Copy head branch name to clipboard