Skip to content

[None][perf] Optimize Gemma4 serving: fused kernels, sync-free FlashInfer plans, CUDA graph padding prealloc - #16033

Closed
kaiyux wants to merge 3 commits into
NVIDIA:mainfrom
kaiyux:perf-optimize/gemma-4-combined-20260706
Closed

[None][perf] Optimize Gemma4 serving: fused kernels, sync-free FlashInfer plans, CUDA graph padding prealloc#16033
kaiyux wants to merge 3 commits into
NVIDIA:mainfrom
kaiyux:perf-optimize/gemma-4-combined-20260706