Skip to content

feat(config): hardware-tuned defaults — Blackwell batch + VRAM-scaled concurrency - #10411

Merged
mudler merged 3 commits into
masterfrom
feat/blackwell-ubatch-default
Jun 20, 2026
Merged

feat(config): hardware-tuned defaults — Blackwell batch + VRAM-scaled concurrency#10411
mudler merged 3 commits into
masterfrom
feat/blackwell-ubatch-default

feat(config): default concurrent serving (n_parallel) by GPU VRAM

6715d75
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar