Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ENHANCEMENT] Add the ability to download the model file from HF repo #65

Open
Jiltseb opened this issue Feb 27, 2024 · 1 comment
Open
Labels
enhancement New feature or request

Comments

@Jiltseb
Copy link
Contributor

Jiltseb commented Feb 27, 2024

Enhancement Description

  • Make sure deployment models can be downloaded from local repo, URL or HF repo.

Advantages

  • It will act as a unified function to download the model independent of the type of input (path/URL/HF repo)

Possible Implementation

  • Posting the model in HF repo
  • Modifying the function to download the model
  • Add hashing info in URL and check for sha256 in the hash type.
@ashwinnair14
Copy link
Contributor

For now we only support HF_transformers and VLLM models.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants