Skip to content

Trying text classification task and testing whether using transformers (eg Bert) as feature extractor or finetuning it is better for this task. And also, to apply what I learned from Natural Language Processing with Transformers Book.

License

Notifications You must be signed in to change notification settings

That1Panda/Text-Classification

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Text Classification with Transformers

This project explores text classification using transformer-based models such as BERT. The primary goal is to compare two approaches:

  1. Using transformers as feature extractors.
  2. Fine-tuning transformer models for specific text classification tasks.

Additionally, this project implements key concepts and techniques from the book Natural Language Processing with Transformers.

What's Inside

All code, experiments, and detailed explanations are available inside the provided notebook. Follow along to see the step-by-step process, from data preparation to model evaluation.

About

Trying text classification task and testing whether using transformers (eg Bert) as feature extractor or finetuning it is better for this task. And also, to apply what I learned from Natural Language Processing with Transformers Book.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published