Skip to content

Feat: support MTP for fmha_v2 based MLA kernels. - #4117

Closed
PerkzZheng wants to merge 2 commits into
NVIDIA:mainfrom
PerkzZheng:user/perkzz/mtp
Closed

Feat: support MTP for fmha_v2 based MLA kernels.#4117
PerkzZheng wants to merge 2 commits into
NVIDIA:mainfrom
PerkzZheng:user/perkzz/mtp

Conversation

@PerkzZheng

@PerkzZheng PerkzZheng commented May 7, 2025

Copy link
Copy Markdown
Collaborator

Support MTP for fmha_v2 based MLA kernels.

Description

fmha_v2 commit: a6a16e34780d7ae6608f8a9092ad03c3d1d0e4a9

Test Coverage

GitHub Bot Help

/bot [-h] ['run', 'kill', 'skip', 'reuse-pipeline'] ...

Provide a user friendly way for developers to interact with a Jenkins server.

Run /bot [-h|--help] to print this help message.

See details below for each supported subcommand.

Details

run [--disable-fail-fast --skip-test --stage-list "A10-1, xxx" --gpu-type "A30, H100_PCIe" --add-multi-gpu-test --only-multi-gpu-test --disable-multi-gpu-test --post-merge --extra-stage "H100_PCIe-[Post-Merge]-1, xxx"]

Launch build/test pipelines. All previously running jobs will be killed.

--disable-fail-fast (OPTIONAL) : Disable fail fast on build/tests/infra failures.

--skip-test (OPTIONAL) : Skip all test stages, but still run build stages, package stages and sanity check stages. Note: Does NOT update GitHub check status.

--stage-list "A10-1, xxx" (OPTIONAL) : Only run the specified test stages. Examples: "A10-1, xxx". Note: Does NOT update GitHub check status.

--gpu-type "A30, H100_PCIe" (OPTIONAL) : Only run the test stages on the specified GPU types. Examples: "A30, H100_PCIe". Note: Does NOT update GitHub check status.

--only-multi-gpu-test (OPTIONAL) : Only run the multi-GPU tests. Note: Does NOT update GitHub check status.

--disable-multi-gpu-test (OPTIONAL) : Disable the multi-GPU tests. Note: Does NOT update GitHub check status.

--add-multi-gpu-test (OPTIONAL) : Force run the multi-GPU tests. Will also run L0 pre-merge pipeline.

--post-merge (OPTIONAL) : Run the L0 post-merge pipeline instead of the ordinary L0 pre-merge pipeline.

--extra-stage "H100_PCIe-[Post-Merge]-1, xxx" (OPTIONAL) : Run the ordinary L0 pre-merge pipeline and specified test stages. Examples: --extra-stage "H100_PCIe-[Post-Merge]-1, xxx".

kill

kill

Kill all running builds associated with pull request.

skip

skip --comment COMMENT

Skip testing for latest commit on pull request. --comment "Reason for skipping build/test" is required. IMPORTANT NOTE: This is dangerous since lack of user care and validation can cause top of tree to break.

reuse-pipeline

reuse-pipeline

Reuse a previous pipeline to validate current commit. This action will also kill all currently running builds associated with the pull request. IMPORTANT NOTE: This is dangerous since lack of user care and validation can cause top of tree to break.

@PerkzZheng

Copy link
Copy Markdown
Collaborator Author

/bot run --disable-fail-fast

@PerkzZheng

Copy link
Copy Markdown
Collaborator Author

Please review the changes in this commit. Thanks.

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #4356 [ run ] triggered by Bot

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #4356 [ run ] completed with state FAILURE
/LLM/main/L0_MergeRequest_PR pipeline #3125 completed with status: 'FAILURE'

@PerkzZheng

Copy link
Copy Markdown
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #4365 [ run ] triggered by Bot

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #4365 [ run ] completed with state FAILURE
/LLM/main/L0_MergeRequest_PR pipeline #3132 completed with status: 'FAILURE'

@PerkzZheng

Copy link
Copy Markdown
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #4506 [ run ] triggered by Bot

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #4506 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #3239 completed with status: 'SUCCESS'

@PerkzZheng

Copy link
Copy Markdown
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #4817 [ run ] triggered by Bot

@PerkzZheng

Copy link
Copy Markdown
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #4863 [ run ] triggered by Bot

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #4817 [ run ] completed with state ABORTED

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #4863 [ run ] completed with state FAILURE
/LLM/main/L0_MergeRequest_PR pipeline #3521 completed with status: 'ABORTED'

@PerkzZheng

Copy link
Copy Markdown
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #4882 [ run ] triggered by Bot

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #4882 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #3536 completed with status: 'FAILURE'

@PerkzZheng

Copy link
Copy Markdown
Collaborator Author

/bot run --disable-fail-fast

@PerkzZheng
PerkzZheng requested a review from yuxianq May 13, 2025 06:51
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #4972 [ run ] triggered by Bot

@PerkzZheng

Copy link
Copy Markdown
Collaborator Author

/bot run

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #5219 [ run ] triggered by Bot

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #5219 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #3811 completed with status: 'ABORTED'

@EmmaQiaoCh
EmmaQiaoCh enabled auto-merge (squash) May 15, 2025 06:26
@EmmaQiaoCh

Copy link
Copy Markdown
Collaborator

/bot skip --comment "All tests in previous 3 CIs were passed, and no multi-gpu files changed."

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #5280 [ skip ] triggered by Bot

@EmmaQiaoCh
EmmaQiaoCh disabled auto-merge May 15, 2025 06:36
@EmmaQiaoCh

Copy link
Copy Markdown
Collaborator

/bot run --only-multi-gpu-test

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #5284 [ run ] triggered by Bot

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #5280 [ skip ] completed with state ABORTED

@PerkzZheng

Copy link
Copy Markdown
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #5334 [ run ] triggered by Bot

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #5284 [ run ] completed with state ABORTED

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #5334 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #3889 completed with status: 'FAILURE'

@PerkzZheng

Copy link
Copy Markdown
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #5432 [ run ] triggered by Bot

Signed-off-by: Perkz Zheng <67892460+PerkzZheng@users.noreply.github.com>
Signed-off-by: Perkz Zheng <67892460+PerkzZheng@users.noreply.github.com>
@PerkzZheng

Copy link
Copy Markdown
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #5471 [ run ] triggered by Bot

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #5432 [ run ] completed with state ABORTED

@PerkzZheng

Copy link
Copy Markdown
Collaborator Author

Close this PR as it will be fused into #4291.

@PerkzZheng PerkzZheng closed this May 16, 2025
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #5471 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #3994 completed with status: 'FAILURE'

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants