[PyTorch] Add pad_between_seqs support for non-CP and CP (A2A and P2P) with FA3 + THD (varlen) - #2596

[PyTorch] Add pad_between_seqs support for non-CP and CP (A2A and P2P) with FA3 + THD (varlen)#2596

sudhakarsingh27 merged 32 commits into

NVIDIA:mainNVIDIA/TransformerEngine:mainfrom

sudhakarsingh27:flash_attn_pad_bw_seqssudhakarsingh27/TransformerEngine:flash_attn_pad_bw_seqsCopy head branch name to clipboard