Search results

MTPLossAutoScaler loss scale bugs when cp enabled

bugSomething isn't workingSomething isn't working

community-request

Status: Open.

#3943 In NVIDIA/Megatron-LM;

· Baibaifan opened on Mar 19, 2026

[QUESTION-Qwen3-235B] Under what scenarios does DDP communication overlap work correctly?

community-request

module: moe

questionFurther information is requestedFurther information is requested

Status: Open.

#3931 In NVIDIA/Megatron-LM;

· lkmcl37 opened on Mar 18, 2026

Training argument scatter_gather_tensors_in_pipeline appear unused.

community-request

questionFurther information is requestedFurther information is requested

Status: Open.

#3921 In NVIDIA/Megatron-LM;

· brentgryffindor opened on Mar 18, 2026

gpt3_mcore_te_tp1_pp4_vp1 is failing on checkpoint saving

bugSomething isn't workingSomething isn't working

Status: Open.

#3909 In NVIDIA/Megatron-LM;

· chtruong814 opened on Mar 17, 2026

Possible RoPE frequency format mismatch in MultiLatentAttention when rotary_interleaved=True

bugSomething isn't workingSomething isn't working

community-request

Status: Open.

#3900 In NVIDIA/Megatron-LM;

· xingmingyyj opened on Mar 17, 2026

[dev-branch] gpt3_moe_mcore_te_ep8_resume_torch_dist_muon: KeyError: 'state' in optimizer

bugSomething isn't workingSomething isn't working

Status: Open.

#3885 In NVIDIA/Megatron-LM;

· ko3n1g opened on Mar 16, 2026

RerunStateMachine crashes on resume from RERUNNING_IN_PLACE checkpoint (exit code 17)

bugSomething isn't workingSomething isn't working

community-request

needs-follow-upIssue needs follow-upIssue needs follow-up

Status: Open.

#3884 In NVIDIA/Megatron-LM;

· yezhengmao1 opened on Mar 16, 2026

request GDN to support CP

community-request

enhancementNew feature or requestNew feature or request

needs-follow-upIssue needs follow-upIssue needs follow-up

Status: Open.

#3883 In NVIDIA/Megatron-LM;

· AllenShow opened on Mar 16, 2026

request GDN to support inference

community-request

enhancementNew feature or requestNew feature or request

needs-follow-upIssue needs follow-upIssue needs follow-up

Status: Open.

#3881 In NVIDIA/Megatron-LM;

· AllenShow opened on Mar 16, 2026

Can not capture cudagraph after load checkpoint

bugSomething isn't workingSomething isn't working

community-request

needs-follow-upIssue needs follow-upIssue needs follow-up

Status: Open.

#3871 In NVIDIA/Megatron-LM;

· new-TonyWang opened on Mar 14, 2026

[Feature Request] MOBA：Mixture of Block Attention For Long-context

community-request

enhancementNew feature or requestNew feature or request

needs-follow-upIssue needs follow-upIssue needs follow-up

Status: Open.

#3850 In NVIDIA/Megatron-LM;

· fengxy-03 opened on Mar 13, 2026

Applying NVRx backend to both Megatron-FSDP and non-FSDP paths

enhancementNew feature or requestNew feature or request

Status: Open.

#3839 In NVIDIA/Megatron-LM;

· sbak5 opened on Mar 12, 2026