Skip to content

Use "put_nowait" for event queue#2886

Merged
joeyballentine merged 2 commits intomainfrom
put-nowait-sse
May 20, 2024
Merged

Use "put_nowait" for event queue#2886
joeyballentine merged 2 commits intomainfrom
put-nowait-sse

Conversation

@joeyballentine
Copy link
Member

@joeyballentine joeyballentine commented May 19, 2024

Why wait and waste time when not waiting works?

Based on skimming a trace, this actually does appear to make the SSE requests no longer blocking, I think. I could be entirely wrong though, since put_nowait theoretically doesnt do anything different with an infinite size queue

@RunDevelopment
Copy link
Member

Could you make the functions in the executor that no longer need to be async normal function again?

@joeyballentine joeyballentine merged commit af2f741 into main May 20, 2024
@joeyballentine joeyballentine deleted the put-nowait-sse branch May 20, 2024 12:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants