Skip to content

[TRTLLM-5530][BREAKING CHANGE] refactor: unify KvCacheConfig in LLM class for pytorch backend - #5752

Merged
Superjomn merged 3 commits into
NVIDIA:mainfrom
Superjomn:change-kvcache-config
Jul 16, 2025
Merged

[TRTLLM-5530][BREAKING CHANGE] refactor: unify KvCacheConfig in LLM class for pytorch backend#5752
Superjomn merged 3 commits into
NVIDIA:mainfrom
Superjomn:change-kvcache-config

Commits

Commits on Jul 16, 2025