add Msty provider - #916
Conversation
✅ Deploy Preview for continuedev canceled.
|
|
@ashokgelal thanks for the PR! I want to make sure I understand how Msty works before merging: is it using Ollama under the hood, or does it just match its API format? Any reason why not OpenAI? And I assume from the code here that 10000 is the default port? |
|
It is using Ollama under the hood but maintain its own version (we check compatibility issue with the models we support, for an example) and it is also very opaque to users, if you will, as the don't have to worry about installing Ollama as we'll do that for them. 10000 is the default port but if that port is reserved by some other apps, then Msty pickup next available port. |
|
@ashokgelal all makes sense! With the OpenAI question I was just wondering why not use the OpenAI API format, since it seems most people are moving toward that, including Ollama. Would it be easy for you to switch the base branch of this PR from main to preview, and then I'll probably just make a few tweaks? |
|
I just switched the base branch to preview. Feel free to make any necessary tweaks and please let me know if you need anything from my side. |
tgaff
left a comment
There was a problem hiding this comment.
Hi, I'm suggesting some grammar/sentence-structure changes to improve readability.
I did also note that there's a fair bit of what might be considered mild-advertising in some of the text. e.g. "Msty is the simplest way to get started" ... "No fussing around, one-click and you are up and running."
In my opinion that's subjective, and the text would be more succinct if it were cleaned up but I've refrained from suggesting changes around that. (I'm not a maintainer and I have no horse in this race, just a few minutes spare time to read a PR today. I'll also be giving Msty a try in the next few days 😃)
Co-authored-by: tgaff <tgaff@users.noreply.github.com>
Co-authored-by: tgaff <tgaff@users.noreply.github.com>
Co-authored-by: tgaff <tgaff@users.noreply.github.com>
Co-authored-by: tgaff <tgaff@users.noreply.github.com>
c102261 to
bdd6449
Compare
|
@ashokgelal It took me a minute to get around to this, but very excited to have Msty as an official provider! I decided to keep it in just config.json for now because the UI can get overwhelming, but if you have the chance to try this out when we make the next release i'd love to hear how it works for you. If there's any extra update we should make we'll be much faster with a PR |
|
@sestinj Thanks for merging and sounds good. Definitely looking forward to trying it and possibly writing a blog post and a video. |
|
Hi @ashokgelal, yesterday we shared some updates with our contributors about how we're aiming to improve the contribution process. Part of this included the addition of a Contributor License Agreement (CLA) to protect both contributors and the project. We're reaching out to ask that previous contributors sign it. Could you please take a moment to sign, or if you have any questions send me a message? (either here or nate@continue.dev would work) To do so, you just need to post a comment below with the following text: ❤️ Thank you for the work you've done on Continue, and let me know if you have any suggestions on how we can make the project even better! |
|
All contributors have signed the CLA ✍️ ✅ |
|
I have read the CLA Document and I hereby sign the CLA |
This is the app: https://msty.app