Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Type
/
to search
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
mudler
/
LocalAI
Public
Uh oh!
There was an error while loading.
Please reload this page
.
Notifications
You must be signed in to change notification settings
Fork
4.4k
Star
48.4k
Code
Issues
88
Pull requests
76
Discussions
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Discussions
Actions
Projects
Security and quality
Insights
feat(vllm): parity with llama.cpp backend
- #9328
#9328
Merged
mudler
merged 16 commits into
master
mudler/LocalAI:master
from
feat/vllm-parity
mudler/LocalAI:feat/vllm-parity
Copy head branch name to clipboard
Apr 13, 2026
Conversation
Commits
16
(16)
Checks
Files changed
Merged
feat(vllm): parity with llama.cpp backend
#9328
mudler
merged 16 commits into
master
mudler/LocalAI:master
from
feat/vllm-parity
mudler/LocalAI:feat/vllm-parity
Copy head branch name to clipboard
Commits
Commits on Apr 12, 2026
fix(schema): serialize ToolCallID and Reasoning in Messages.ToProto
Show description for 40b1c6f
mudler
committed
40b1c6f
View commit details
Copy full SHA for 40b1c6f
Browse repository at this point
refactor(config): introduce backend hook system and migrate llama-cpp defaults
Show description for a30719f
mudler
committed
a30719f
View commit details
Copy full SHA for a30719f
Browse repository at this point
feat(config): add vLLM parser defaults hook and importer auto-detection
Show description for 6cf8263
mudler
committed
6cf8263
View commit details
Copy full SHA for 6cf8263
Browse repository at this point
feat(vllm): wire native tool/reasoning parsers + chat deltas + logprobs
Show description for 6786f05
mudler
committed
6786f05
View commit details
Copy full SHA for 6786f05
Browse repository at this point
feat(vllm): CPU support + shared utils + vllm-omni feature parity
Show description for b215843
mudler
committed
b215843
View commit details
Copy full SHA for b215843
Browse repository at this point
fix(vllm): CPU build compatibility with vllm 0.14.1
Show description for c2f73a9
mudler
committed
c2f73a9
View commit details
Copy full SHA for c2f73a9
Browse repository at this point
fix(vllm): tool parser constructor compat + e2e tool calling test
Show description for c99188f
mudler
committed
c99188f
View commit details
Copy full SHA for c99188f
Browse repository at this point
ci(backend): build cpu-vllm container image
Show description for 034a60b
mudler
committed
034a60b
View commit details
Copy full SHA for 034a60b
Browse repository at this point
test(e2e-backends): add tools capability + HF model name support
Show description for e7f4061
mudler
committed
e7f4061
View commit details
Copy full SHA for e7f4061
Browse repository at this point
ci(test-extra): run vllm e2e tests on CPU
Show description for c7f444d
mudler
committed
c7f444d
View commit details
Copy full SHA for c7f444d
Browse repository at this point
fix(vllm): build from source on CI to avoid SIGILL on prebuilt wheel
Show description for 329df11
mudler
committed
329df11
View commit details
Copy full SHA for 329df11
Browse repository at this point
ci(vllm): use bigger-runner instead of source build
Show description for ea2bbab
mudler
committed
ea2bbab
View commit details
Copy full SHA for ea2bbab
Browse repository at this point
ci(vllm): install make + build deps on bigger-runner
Show description for c4dc495
mudler
committed
c4dc495
View commit details
Copy full SHA for c4dc495
Browse repository at this point
ci(vllm): install libnuma1 + libgomp1 on bigger-runner
Show description for 017bdee
mudler
committed
017bdee
View commit details
Copy full SHA for 017bdee
Browse repository at this point
feat(vllm): bundle libnuma/libgomp via package.sh
Show description for d74cd56
mudler
committed
d74cd56
View commit details
Copy full SHA for d74cd56
Browse repository at this point
Commits on Apr 13, 2026
ci(vllm): disable tests-vllm-grpc job (heterogeneous runners)
Show description for cd56a05
mudler
committed
cd56a05
View commit details
Copy full SHA for cd56a05
Browse repository at this point
You can’t perform that action at this time.