🚀 The feature, motivation and pitch
Now that PT LlmArgs have mostly stabilized, let's see if we can more closely align AD LlmArgs with PT LlmArgs:
- Deprecate
AutoDeployConfig as separate class and just move it all into AD's LlmArgs class
- Align any field in AD's LlmArgs if there is a corresponding field in PT
- Consider inheriting from PT's LlmArgs instead of BaseLlmArgs
This help ensuring AD can serve as a drop-in replacement for PT backend where needed and simplify integration management (trtllm-serve, trtllm-bench, dynamo, NIM, ...)
Alternatives
No response
Additional context
No response
Before submitting a new issue...
🚀 The feature, motivation and pitch
Now that PT LlmArgs have mostly stabilized, let's see if we can more closely align AD LlmArgs with PT LlmArgs:
AutoDeployConfigas separate class and just move it all into AD'sLlmArgsclassThis help ensuring AD can serve as a drop-in replacement for PT backend where needed and simplify integration management (trtllm-serve, trtllm-bench, dynamo, NIM, ...)
Alternatives
No response
Additional context
No response
Before submitting a new issue...