Document type classification research (problem III)#15

Draft

vitawasalreadytaken wants to merge 11 commits intomainfrom feature/document-type-classifier

+4,618-13

Commits on Jan 8, 2025

Modernise my old document type classification notebook and run it on the latest Fedlex data
Vita Midori
committed

Commits on Jan 13, 2025

Add the rule-based OPD type labeller for comparison with the trained ML model and with manually recorded labels
Vita Midori
committed

Commits on Jan 14, 2025

More work on evaluating the doc type classifiers (ML and rule-based)
Vita Midori
committed
Merge the 4 smallest classes into VARIOUS_TEXT: both models improved a bit
Vita Midori
committed

Commits on Jan 15, 2025

A few more true labels
Vita Midori
committed
Embedding caches can now be read-only (useful for offline work)
Vita Midori
committed
Try adding rule-labelled REPORTs into the training set
Vita Midori
committed

Commits on Jan 27, 2025

Commits on Jan 28, 2025

Fix EmbeddingsCache tests
Vita Midori
committed
Do not allow the external test set (manual labels) to get smaller by moving some docs to the training set. Improve MLflow logging
Vita Midori
committed