[None][test] Add DeepSeek V4 CI coverage#13988
Conversation
Signed-off-by: Tracin <10434017+Tracin@users.noreply.github.com>
Signed-off-by: Tracin <10434017+Tracin@users.noreply.github.com>
Signed-off-by: Tracin <10434017+Tracin@users.noreply.github.com>
Add GSM8K smoke coverage to DeepSeek V4 Flash auto-dtype tests, keep sparse MLA DSA tests from failing on known background executor threads, and make L0 default to running multi-GPU tests. Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com>
|
/bot run --add-multi-gpu-test --disable-fail-fast |
|
PR_Github #47715 [ run ] triggered by Bot. Commit: |
|
PR_Github #47715 [ run ] completed with state
|
|
/bot run --disable-fail-fast |
|
PR_Github #47743 [ run ] triggered by Bot. Commit: |
|
PR_Github #47743 [ run ] completed with state
|
|
/bot run |
|
PR_Github #47814 [ run ] triggered by Bot. Commit: |
|
PR_Github #47814 [ run ] completed with state
|
|
/bot run --disable-fail-fast |
|
PR_Github #47927 [ run ] triggered by Bot. Commit: |
|
PR_Github #47927 [ run ] completed with state |
Signed-off-by: Tracin <10434017+Tracin@users.noreply.github.com> Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com> Co-authored-by: Tracin <10434017+Tracin@users.noreply.github.com> Co-authored-by: Fanrong Li <lfr-0531@users.noreply.github.com>
Signed-off-by: Tracin <10434017+Tracin@users.noreply.github.com> Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com> Co-authored-by: Tracin <10434017+Tracin@users.noreply.github.com> Co-authored-by: Fanrong Li <lfr-0531@users.noreply.github.com> (cherry picked from commit 8eccf23) Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com>
Signed-off-by: Tracin <10434017+Tracin@users.noreply.github.com> Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com> Co-authored-by: Tracin <10434017+Tracin@users.noreply.github.com> Co-authored-by: Fanrong Li <lfr-0531@users.noreply.github.com> (cherry picked from commit 8eccf23) Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com>
Signed-off-by: Tracin <10434017+Tracin@users.noreply.github.com> Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com> Co-authored-by: Tracin <10434017+Tracin@users.noreply.github.com> Co-authored-by: Fanrong Li <lfr-0531@users.noreply.github.com> (cherry picked from commit 8eccf23) Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com>
Signed-off-by: Tracin <10434017+Tracin@users.noreply.github.com> Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com> Co-authored-by: Tracin <10434017+Tracin@users.noreply.github.com> Co-authored-by: Fanrong Li <lfr-0531@users.noreply.github.com> (cherry picked from commit 8eccf23) Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com>
Signed-off-by: Tracin <10434017+Tracin@users.noreply.github.com> Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com> Co-authored-by: Tracin <10434017+Tracin@users.noreply.github.com> Co-authored-by: Fanrong Li <lfr-0531@users.noreply.github.com>
Signed-off-by: Tracin <10434017+Tracin@users.noreply.github.com> Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com> Co-authored-by: Tracin <10434017+Tracin@users.noreply.github.com> Co-authored-by: Fanrong Li <lfr-0531@users.noreply.github.com>
Signed-off-by: Tracin <10434017+Tracin@users.noreply.github.com> Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com> Co-authored-by: Tracin <10434017+Tracin@users.noreply.github.com> Co-authored-by: Fanrong Li <lfr-0531@users.noreply.github.com>
Signed-off-by: Tracin <10434017+Tracin@users.noreply.github.com> Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com> Co-authored-by: Tracin <10434017+Tracin@users.noreply.github.com> Co-authored-by: Fanrong Li <lfr-0531@users.noreply.github.com> (cherry picked from commit 8eccf23) Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com>
Signed-off-by: Tracin <10434017+Tracin@users.noreply.github.com> Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com> Co-authored-by: Tracin <10434017+Tracin@users.noreply.github.com> Co-authored-by: Fanrong Li <lfr-0531@users.noreply.github.com> (cherry picked from commit 8eccf23) Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com>
Signed-off-by: Tracin <10434017+Tracin@users.noreply.github.com> Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com> Co-authored-by: Tracin <10434017+Tracin@users.noreply.github.com> Co-authored-by: Fanrong Li <lfr-0531@users.noreply.github.com> (cherry picked from commit 8eccf23) Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com>
Signed-off-by: Tracin <10434017+Tracin@users.noreply.github.com> Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com> Co-authored-by: Tracin <10434017+Tracin@users.noreply.github.com> Co-authored-by: Fanrong Li <lfr-0531@users.noreply.github.com> (cherry picked from commit 8eccf23) Signed-off-by: Fanrong Li <lfr-0531@users.noreply.github.com>
Description
This PR updates DeepSeek V4 CI coverage and L0 multi-GPU triggering behavior:
TestDeepSeekV4Flash.test_auto_dtypeandTestDeepSeekV4FlashBase.test_auto_dtype, alongside the existing MMLU smoke checks.pytest-threadleakfor the sparse MLA forward test module becauseDSACacheManagercreates backgroundThreadPoolExecutorthreads, matching the existing DSA short-sequence test behavior.DISABLE_MULTI_GPU_TESToverride.Test Coverage
pre-commit run --files jenkins/L0_MergeRequest.groovy tests/integration/defs/accuracy/test_llm_api_pytorch.py tests/unittest/_torch/attention/sparse/test_sparse_mla_forward.py.venv-3.12/bin/python -m py_compile tests/integration/defs/accuracy/test_llm_api_pytorch.py tests/unittest/_torch/attention/sparse/test_sparse_mla_forward.pyPR Checklist
Please review the following before submitting your PR:
PR description clearly explains what and why. If using CodeRabbit's summary, please make sure it makes sense.
PR Follows TRT-LLM CODING GUIDELINES to the best of your knowledge.
Test cases are provided for new code paths (see test instructions)
Any new dependencies have been scanned for license and vulnerabilities
CODEOWNERS updated if ownership changes
Documentation updated as needed
Update tava architecture diagram if there is a significant design change in PR.
The reviewers assigned automatically/manually are appropriate for the PR.
Please check this after reviewing the above items as appropriate for this PR.
GitHub Bot Help
To see a list of available CI bot commands, please comment
/bot help.