Fastest LLM gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
-
Updated
Feb 5, 2026 - Go
Fastest LLM gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
Add a description, image, and links to the r-and-d topic page so that developers can more easily learn about it.
To associate your repository with the r-and-d topic, visit your repo's landing page and select "manage topics."