[https://nvbugs/6490033][fix] Relaxed the assertion to accept both is_eagle3() and… - #16793
[https://nvbugs/6490033][fix] Relaxed the assertion to accept both is_eagle3() and…#16793trtllm-agent wants to merge 2 commits into
is_eagle3() and…#16793Conversation
…assertion Signed-off-by: trtllm-agent <296075020+trtllm-agent@users.noreply.github.com>
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Enterprise Run ID: 📒 Files selected for processing (1)
🚧 Files skipped from review as they are similar to previous changes (1)
WalkthroughTree-decoding validation now accepts Eagle3-one-model mode. Two corresponding Eagle3 quickstart integration tests are removed from the waiver list. ChangesEagle3 tree decoding
Estimated code review effort: 1 (Trivial) | ~5 minutes Possibly related PRs
Suggested reviewers: 🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✨ Finishing Touches🧪 Generate unit tests (beta)
Comment |
|
/bot run --only-qa-verify test test_e2e.py::test_draft_token_tree_quickstart_advanced_eagle3[Llama-3.1-8b-Instruct-llama-3.1-model/Llama-3.1-8B-Instruct-EAGLE3-LLaMA3.1-Instruct-8B] |
|
PR_Github #61276 [ run ] triggered by Bot. Commit: |
|
PR_Github #61276 [ run ] completed with state |
Summary
update_spec_dec_paramonly acceptedEAGLE3mode, butEagle3OneModelSpecMetadatalegitimately setsis_spec_dec_tree=TrueforEAGLE3_ONE_MODELwheneagle_choicesis provided.is_eagle3()andis_eagle3_one_model(); removed the two nvbugs/6490033 waivers inwaives.txt.Test plan
Links
Dev Engineer Review
update_spec_dec_paramto relax the static-tree assertion sospec_metadata.spec_dec_modemay be eitheris_eagle3()oris_eagle3_one_model()(enablesEagle3OneModelSpecMetadata/is_spec_dec_tree=Truebehavior).tests/integration/test_lists/waives.txttied to Eagle3 draft token tree quickstart coverage.QA Engineer Review
tests/integration/test_lists/waives.txttest_e2e.py::test_draft_token_tree_quickstart_advanced_eagle3(Llama-3.1-8B Instruct / Eagle3)test_e2e.py::test_draft_token_tree_quickstart_advanced_eagle3_depth_1_tree(Llama-3.1-8B Instruct / Eagle3)