Skip to content

Add Span support in tokenizer's Model abstraction - #7035

Merged
tarekgh merged 3 commits into
dotnet:mainfrom
tarekgh:AddSpanSupportInTokenikerModelAbstraction
Mar 1, 2024
Merged

Add Span support in tokenizer's Model abstraction#7035
tarekgh merged 3 commits into
dotnet:mainfrom
tarekgh:AddSpanSupportInTokenikerModelAbstraction

Use stackalloc instead of the ArrayPool

40a669f
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs