Skip to content

launcher: Nemotron-120B specdec_bench — kill stale _cells/ reference (post-PR-#1564) #1741

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ChenhanYu merged 1 commit into from
Jun 15, 2026
Merged

launcher: Nemotron-120B specdec_bench — kill stale _cells/ reference (post-PR-#1564) #1741

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 8 additions & 3 deletions ...her/examples/nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16/specdec_bench_dflash_vllm.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,10 +10,15 @@
# H100/A100. Surfaced on OMNIML-4969: tp_size=2 OOMed at model load
# (~80 GB needed per GPU at tp=2, only 79.11 GiB available).
#
# Slurm run on cw_dfw — cells override per-cell runtime_params,
# --save_dir, --block_size, --num_requests via pipeline.task_N.args+=[...]:
# Slurm run on cw_dfw — cells override per-cell knobs via
# pipeline.task_N.args+=[...] CLI flags (post-PR-#1564 convention; no
# per-cell runtime_params file, no _cells/<sweep>.yaml):
#
# uv run slurm.py # --yaml modules/Model-Optimizer/tools/launcher/examples/nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16/specdec_bench_dflash_vllm.yaml # --yes detach=true # pipeline.task_0.args+=["--runtime_params common/specdec_bench/_cells/<sweep_name>.yaml","--save_dir /scratchspace/<sweep>/qualitative","--block_size 4"] # pipeline.task_1.args+=["--runtime_params common/specdec_bench/_cells/<sweep_name>.yaml","--save_dir /scratchspace/<sweep>/throughput_32k","--num_requests 80","--block_size 4"]
# uv run slurm.py \
# --yaml modules/Model-Optimizer/tools/launcher/examples/nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16/specdec_bench_dflash_vllm.yaml \
# --yes detach=true \
# pipeline.task_0.args+=["--save_dir /scratchspace/<sweep>/qualitative","--block_size 4"] \
# pipeline.task_1.args+=["--save_dir /scratchspace/<sweep>/throughput_32k","--num_requests 80","--block_size 4"]
#
# Reference run: cicd_1781024226 (cw_dfw) produced
# qualitative Average_AL = 2.7316 (11-cat breakdown)
Expand Down
Loading