Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

self host on runnpod #285

Open
Stealthwriter opened this issue Sep 21, 2023 · 1 comment
Open

self host on runnpod #285

Stealthwriter opened this issue Sep 21, 2023 · 1 comment

Comments

@Stealthwriter
Copy link

Hi, can you please add documentation to self-host on runpod? it offers GPU prices cheaper than aws.
@yixu34
Copy link
Member

yixu34 commented Sep 29, 2023

Hi @Stealthwriter , we currently don't have any plans on supporting runpod. LLM Engine works on k8s, so if runpod supports k8s, then it can almost work - we'd need to find substitutes for S3.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@yixu34 @Stealthwriter