Search results

Does it support Qwen2.5?

Status: Open.

#26 In HKUNLP/ChunkLlama;

· bhpugongying opened on Apr 11, 2025

OOM error when inferencing 128k context on 4 GPUs

Status: Open.

#25 In HKUNLP/ChunkLlama;

· HoBeedzc opened on Aug 7, 2024

A Bug in flash_decoding_chunkllama.py

Status: Open.

#24 In HKUNLP/ChunkLlama;

· ZayIsAllYouNeed opened on Jul 19, 2024

A bug when run run_chunkllama_100k with flash decoding

Status: Open.

#23 In HKUNLP/ChunkLlama;

· lwj2001 opened on Jul 19, 2024

Perplexity validation on PG19 error and Passkey Retrieval error

Status: Open.

#19 In HKUNLP/ChunkLlama;

· khfs opened on Jul 1, 2024

Does it support vllm now?

Status: Open.

#18 In HKUNLP/ChunkLlama;

· skykiseki opened on Jun 6, 2024

An error occurred when I used flash_decoding_chunkllama in run_chunkllama_100k.py

Status: Open.

#17 In HKUNLP/ChunkLlama;

· smilelite opened on May 31, 2024

Does it supprts batch inference?

Status: Open.

#16 In HKUNLP/ChunkLlama;

· SkyAndCloud opened on May 23, 2024

finetune error

Status: Open.

#13 In HKUNLP/ChunkLlama;

· MarsMeng1994 opened on Apr 30, 2024

info about compared models in your paper

Status: Open.

#7 In HKUNLP/ChunkLlama;

· Jihuai-wpy opened on Mar 19, 2024

How do I use it in vllm deployment

Status: Open.

#3 In HKUNLP/ChunkLlama;

· jchang98 opened on Mar 5, 2024