Enhancement: OpenAI, Anthropic, etc. requests BASE_URL

[kimifish]

What features would you like to see added?

Since I (and I think I'm not the only one) need to route all requests to LLMs, specified in topic subj through a proxy for security reasons, it would be nice to have the ability to specify a URL for requests, especially since this is already implemented in their official APIs, and there should be no particular issues with implementing this feature. Thank you in advance.

More details

I've tried setting OPENAI_API_BASE in .env. No luck

Which components are impacted by your request?

General

Pictures

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

For OpenAI specifically, this is:

OPENAI_REVERSE_PROXY=your-proxy

https://www.librechat.ai/docs/configuration/dotenv#openai

See the docs for other endpoints (Anthropic, etc.).

You can also set a custom endpoint that is OpenAI compatible with specific base URL configuration:

https://www.librechat.ai/docs/quick_start/custom_endpoints

[kimifish]

Oh, I see, thanks. Honestly, the variable name is a bit misleading, though technically correct. Moreover, the documentation doesn't really clarify this either.