Batch LLM processing with thread
Part of the llm-cpp toolkit -- 26 single-header C++ libraries for LLM infrastructure. Drop in what you need.
Mattbusel/llm-batch
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
| Name | Name | Last commit date | ||
|---|---|---|---|---|
Batch LLM processing with thread
Part of the llm-cpp toolkit -- 26 single-header C++ libraries for LLM infrastructure. Drop in what you need.