You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, Makefile defines an environment variable N_DEVICES which is set via shell nvidia-smi -L | wc -l. This leads to a crash on any machine without cuda installed, a reasonable setup for any deployment where the API server is isolated from the ray deployments.
The text was updated successfully, but these errors were encountered:
Description
Currently,
Makefile
defines an environment variableN_DEVICES
which is set viashell nvidia-smi -L | wc -l
. This leads to a crash on any machine without cuda installed, a reasonable setup for any deployment where the API server is isolated from the ray deployments.The text was updated successfully, but these errors were encountered: