Popular repositories Loading

1. claude-code-proxy claude-code-proxy Public

   Forked from fuergaosi233/claude-code-proxy

   Claude Code to OpenAI API Proxy

   Python

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. LMCache LMCache Public

   Forked from LMCache/LMCache

   Supercharge Your LLM with the Fastest KV Cache Layer

   Python

4. llm-client llm-client Public

   Modular LLM client library with streaming, tool calls, and thinking mode support

   Python

5. disable-thinking-proxy disable-thinking-proxy Public

   禁用思考模式的API代理服务器，自动在转发请求到vLLM时禁用thinking模式

6. llm-compressor llm-compressor Public

   Forked from vllm-project/llm-compressor

   Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

   Python