eosphoros
Replies: 1 comment
-
|
以vllm启动open ai 风格的 api server 。 然后在db-gbt中像引入openai 一样，引入 proxyllm 即可 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
需求：由于资源有限，在GPU上使用VLLM部署了LLM，提供API供多个部门使用。如何将这个API接入DBGPT中使用？需要在哪些地方进行修改？
Beta Was this translation helpful? Give feedback.
All reactions