Skip to content

Optimize regexes used in tiktoken - #7020

Merged
tarekgh merged 3 commits into
dotnet:mainfrom
stephentoub:regexopt
Feb 23, 2024
Merged

Optimize regexes used in tiktoken#7020
tarekgh merged 3 commits into
dotnet:mainfrom
stephentoub:regexopt

Add comment and consolidate duplicate regex from Roberta

849097e
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs