Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add support for HuggingFace hosted models #36

Open
cvauclair opened this issue Sep 27, 2024 · 0 comments
Open

feat: Add support for HuggingFace hosted models #36

cvauclair opened this issue Sep 27, 2024 · 0 comments
Labels
model Relevant to new model providers or implementations

Comments

@cvauclair
Copy link
Contributor

Model Provider Integration Request

HuggingFace hosts many open source models (including many fine-tuned models) and provides an API to interact with them.

Resources

Unlike many of the existing providers, the HuggingFace API has many task-specific endpoints (for instance, a text classification endpoint).

However, since Rig does not support task-specific endpoints, the integration would most likely use one of the following generic text completion endpoints:

Note: The HuggingFace API does not endpoints for generating embeddings. The integration would therefore be limited to chat completion only.

@cvauclair cvauclair added feat model Relevant to new model providers or implementations labels Sep 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
model Relevant to new model providers or implementations
Projects
None yet
Development

No branches or pull requests

2 participants