Remove lock on stdout#16641
Closed
SilasMarvin wants to merge 1 commit intorust-lang:masterfrom
Closed
Conversation
Member
|
That sounds very odd, and certainly like a problem with llama.cpp. Us taking the lock there is intentional as no one else should be writing to stdout at that point anyways as this would interfere with the protocol. |
Member
|
A backtrace for each thread would be useful here. |
Author
|
Thanks for the quick responses. I'll update with some more data when I get some more time to dig into it |
Contributor
|
☔ The latest upstream changes (presumably #16704) made this pull request unmergeable. Please resolve the merge conflicts. |
Member
|
I'll close this for now as I don't think that the issue lies on our side with this. Do come back to us if your testing says otherwise though! |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
I've been using the
lsp-servercrate to develop a language server. In my crate I've been using bindgen to link with the llama.cpp and was getting undefined behavior on functions called from llama.cpp when first callingConnection::stdio(). For reasons I don't understand, the lock on stdout seems to be causingllama.cppfunctions to freeze with no returned errors. My code is public and available here, but I can highlight or expand on specifics if that is helpful.Removing the lock on stdout does fix the problem. I'm not sure if this is the right way to solve it, but was hoping to understand a little bit more why we are locking stdout.
Thank you! I love and really appreciate the work you all put into the Rust ecosystem.