Commits

Commits on Aug 19, 2025

enable marlin fp8 blockwise (#8990)
qeternity
authored

Commits on Jul 18, 2025

fix compressed tensors WNA16 imports (#8142)
qeternity
authored

Commits on Apr 21, 2025

check marlin format before attempting conversion (#4675)
qeternity
authored

Commits on Feb 27, 2025

Improve: Support xgrammar 0.1.14 (#3593)
qeternity
authored

Commits on Jan 20, 2025

deepseek v3 and r1 chat template (#3015)
qeternity
authored

Commits on Jan 19, 2025

support regex in xgrammar backend (#2983)
qeternity
authored

Commits on Nov 28, 2024

fix missing launch server import (#2242)
qeternity
authored

Commits on Nov 9, 2024

Initialize model_worker_batch variable (#1973)
qeternity
authored

Commits on Sep 1, 2024

Allow new lines during JSON generation (#1277)
qeternity
authored

Commits on Aug 29, 2024

make json_schema usable from gen (#1254)
qeternity
authored

Commits on Jul 30, 2024

Fix LiteLLM kwargs (#817)
qeternity
authored

Commits on May 9, 2024

Include finish reason in meta info response (#415)
qeternity
authored

Commits on Apr 21, 2024

llama3 instruct template (#372)
qeternity
authored

Commits on Mar 13, 2024

enable marlin kernels (#286)
qeternity
authored

Commits on Feb 24, 2024

fix chatml template (#195)
qeternity
authored