SQLBot Version
1.8.0
Run Mode
Is it running in a Docker container or running from source code?
Docker部署
Describe the bug
A clear and concise description of what the bug is.
对接的私有部署模型升级到千问3.6-35B-A3B,然后就无法问数了
To Reproduce
Steps to reproduce the behavior:
- 之前可以问数成功
- **后来it把模型给升级到了Qwen3.6-35B-A3B,其它什么都没变
使用vllm框架对Qwen3.6-35B-A3B进行部署,具体为占用两张A100(80G)的75%的显存资源进行tensor-
parallel的方式部警单副本.
- 问数后得到如下错误:
Expected behavior
能问数成图
Screenshots
见问题复现
Additional context
看起来是新的模型,需要调整一下 提示词
SQLBot Version
1.8.0
Run Mode
Is it running in a Docker container or running from source code?
Docker部署
Describe the bug
A clear and concise description of what the bug is.
对接的私有部署模型升级到千问3.6-35B-A3B,然后就无法问数了
To Reproduce
Steps to reproduce the behavior:
使用vllm框架对Qwen3.6-35B-A3B进行部署,具体为占用两张A100(80G)的75%的显存资源进行tensor-
parallel的方式部警单副本.
Expected behavior
能问数成图
Screenshots
见问题复现
Additional context
看起来是新的模型,需要调整一下 提示词