[https://nvbugs/6029882][test] Unwaive TestDeepSeekR1::test_nvfp4_multi_gpus[throughput_mtp]#15101
[https://nvbugs/6029882][test] Unwaive TestDeepSeekR1::test_nvfp4_multi_gpus[throughput_mtp]#15101tianyuxbear wants to merge 1 commit into
Conversation
…ti_gpus[throughput_mtp] Signed-off-by: Tianyu Xiong <117647511+tianyuxbear@users.noreply.github.com>
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Enterprise Run ID: 📒 Files selected for processing (1)
💤 Files with no reviewable changes (1)
📝 WalkthroughWalkthroughThe PR removes a single test waiver entry from the integration test skip list. The deleted waiver was for ChangesTest Waiver Removal
Possibly related PRs
Suggested reviewers
Estimated code review effort🎯 1 (Trivial) | ⏱️ ~2 minutes 🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✏️ Tip: You can configure your own custom pre-merge checks in the settings. ✨ Finishing Touches🧪 Generate unit tests (beta)
Comment |
|
/bot run --stage-list "GB200-8_GPUs-2_Nodes-PyTorch-2" |
|
PR_Github #52749 [ run ] triggered by Bot. Commit: |
|
PR_Github #52749 [ run ] completed with state
|
|
/bot run --stage-list "GB200-8_GPUs-2_Nodes-PyTorch-2" --disable-reuse-test |
|
PR_Github #53040 [ run ] triggered by Bot. Commit: |
|
PR_Github #53040 [ run ] completed with state
|
Description
Removes the waiver for
accuracy/test_llm_api_pytorch.py::TestDeepSeekR1::test_nvfp4_multi_gpus[throughput_mtp](NVBugs 6029882, also tracked by 6261994).The waiver was added for an intermittent CUDA OOM at executor init (
model.to('cuda')) on the GB200-8_GPUs-2_Nodes stage. Investigation shows this is an environment-driven failure: the model weights nearly fill the GB200 and a foreign process occupying GPU 0 in CI tips it over, rather than a model-memory regression. Local reproduction on a 2-node × 4× GB200 setup (50 runs) did not reproduce the OOM, and repair-bot could not reproduce on B200 either. This matches the same fingerprint seen in the Kimi-K2.5 init-OOM bugs (6248837 / 6260890).Unwaiving to let CI confirm; closing 6029882 and 6261994 on a clean run.
Test Coverage
accuracy/test_llm_api_pytorch.py::TestDeepSeekR1::test_nvfp4_multi_gpus[throughput_mtp]Summary by CodeRabbit
Release Notes