Enhancement: Custom Endpoint timeout.

[Originalimoc]

What features would you like to see added?

Sometimes the API will return data from MoA backend then the time might exceed 30s even 1 minutes+ per request.

More details

Add a timeout and stream mode off to custom endpoints.

Which components are impacted by your request?

Endpoints

Pictures

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

There is no timeout configuration, are you running LibreChat in front of NGINX/traefik? In which case, you can set a timeout within those settings, as defaults there are usually 1 minute.

stream mode off to custom endpoints.

already implemented. Add stream under dropParams:

https://www.librechat.ai/docs/configuration/librechat_yaml/object_structure/custom_endpoint#dropparams

[Manouchehri]

Isn't it defined in requestOptions? Azure/azure-sdk-for-js#26243 (comment)

[OrimoB]

Isn't it defined in requestOptions? Azure/azure-sdk-for-js#26243 (comment)

That's on API server side... not LibreChat server side