Skip to content

kv-cache: add LLAMA_STATE_SEQ_FLAGS_APPEND for incremental state restore - #21221

Open
sammshen wants to merge 1 commit into
ggml-org:masterfrom
sammshen:lmcache-append-flag
Open

kv-cache: add LLAMA_STATE_SEQ_FLAGS_APPEND for incremental state restore#21221
sammshen wants to merge 1 commit into
ggml-org:masterfrom
sammshen:lmcache-append-flag

Add LLAMA_STATE_SEQ_FLAGS_APPEND for incremental KV state restore

ce447e2
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

The logs for this run have expired and are no longer available.