Skip to content

Rate-limit requests #356

@Alina086

Description

@Alina086

A single user shouldn't be able to blow our OpenAI budget. One straightforward way to do this would be to fail requests that are coming too fast—if the user's last request was too recent, we could fail it with a ratelimit HTTP error code. The client may need to be tweaked to handle this gracefully. This is a bit messy since we don't have clean user tracking right now.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions