Skip to content

[None][fix] Make auto host tier sizing rank-aware in KVCacheManagerV2 - #16106

Merged
eopXD merged 4 commits into
NVIDIA:mainfrom
erictsai-nv:fix/kvv2-rank-aware-host-tier
Jul 22, 2026
Merged

[None][fix] Make auto host tier sizing rank-aware in KVCacheManagerV2#16106
eopXD merged 4 commits into
NVIDIA:mainfrom
erictsai-nv:fix/kvv2-rank-aware-host-tier

Address review: add Distributed.local_world_size for backend-agnostic…

e1c95ef
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Jul 17, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO