[TRTLLM-11421][feat] Support better kv cache statistics monitoring#12413

Merged

longlee0622 merged 3 commits into

NVIDIA:mainfrom

eopXD:support-kv-cache-statistics-monitoring

Apr 10, 2026

Commits on Apr 9, 2026

[TRTLLM-11421][feat] Add per-iteration KV cache statistics and Prometheus metrics
eopXD
committed
[TRTLLM-11421][test] Add unit and integration tests for KV cache iteration stats
eopXD
committed
[TRTLLM-11421][fix] Rename per-iteration KV cache counters to avoid Prometheus collision
eopXD
committed