-
-
Notifications
You must be signed in to change notification settings - Fork 47
Support TGI as another alternative backend #72
Copy link
Copy link
Closed
Labels
featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.help wantedExtra attention is neededExtra attention is neededneeds-priorityIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.needs-triageIndicates an issue or PR lacks a label and requires one.Indicates an issue or PR lacks a label and requires one.
Milestone
Metadata
Metadata
Assignees
Labels
featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.help wantedExtra attention is neededExtra attention is neededneeds-priorityIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.needs-triageIndicates an issue or PR lacks a label and requires one.Indicates an issue or PR lacks a label and requires one.
Type
Fields
Give feedbackNo fields configured for issues without a type.
What would you like to be added:
TGI is also a popular inference backend that we should support. More importantly, we should set this as an example once people would like to support another backend in the future.
Why is this needed:
Adopte more backends and make this a reference.
Completion requirements:
This enhancement requires the following artifacts:
The artifacts should be linked in subsequent comments.