Integrate with rust-bert #111
Labels
enhancement
New feature or request
integration
Integration with AI, database or data providers
rust
Pull requests that update Rust code
As a user I would like to use local libraries to generate embedding. On their website
rust-bert
is introduced as:Rust-native state-of-the-art Natural Language Processing models and pipelines. Port of Hugging Face’s Transformers library, using tch-rs or onnxruntime bindings and pre-processing from rust-tokenizers.
We can use this for classification, summarization or other utilities as well in the future.
The text was updated successfully, but these errors were encountered: