kv-cache: add LLAMA_STATE_SEQ_FLAGS_APPEND for incremental state restore - #21221
Open
sammshen wants to merge 1 commit into
Open
kv-cache: add LLAMA_STATE_SEQ_FLAGS_APPEND for incremental state restore#21221sammshen wants to merge 1 commit into
sammshen wants to merge 1 commit into
