Enhancement: support LiteLLM service account #4607
stdweird
started this conversation in
Feature Requests & Suggestions
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
What features would you like to see added?
Support LiteLLM service account handling: deploy librechat with an openai style key that is tight to a service account in litellm, and somehow pass the "user" info in the POST. The user value should be obtained after succesful authentication in librechat using eg SSO.
see https://docs.litellm.ai/docs/proxy/service_accounts#3-test-service-account-key (the "succesful call" tab)
More details
I can try to create a patch myself in
api/app/clients/ChatGPTClient.js
(seems like most likely place, at least for the completions; but this in theory for all possible api calls), but i need some guidance how to detect / can be configured this is wanted behaviour and also a some guidance how to retrieve eg the username after login.Which components are impacted by your request?
General
Pictures
No response
Code of Conduct
Beta Was this translation helpful? Give feedback.
All reactions