-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Open
Labels
good first issueGood for newcomersGood for newcomers
Description
would you be willing to support one of the lm-studio api's? It appears that lm-studio has their own beta rest api (subject to change), but they also have an openai compatibility api. Given you already support openai, i assume it may not be a significant amount of work to interface with their openai api.
LM-Studio OpenAI Compatible API
The reason I want to use LM-Studio is because ollama does not have support for MLX (used in apple silicon), but lm-studio has full support. LM-Studio performs significantly better than ollama on macs as result.
jpholtmeyer and Eyalm321
Metadata
Metadata
Assignees
Labels
good first issueGood for newcomersGood for newcomers