[None][fix] Fix DSACacheManager and RocketCacheManager KV cache estimation ignoring num_layers for draft models#12571

longlee0622 merged 4 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

lancelly:test_kv_cachelancelly/TensorRT-LLM:test_kv_cacheCopy head branch name to clipboard