Uniitxt 1.4.0
Enhancements
- New random generation mechanism to remove dependency between different random generators @matanor in #414
- New MultipleChoiceTemplate which changes all QA datasets by @elronbandel in #405
- New MAP, MRR, and Retrieval@K metrics by @assaftibm in #422
- New LoadFromKaggle loader which allows direct loading of datasets from Kaggle by @ilyashnil in #413
- New StringContainment metric that if one of the references is contained in the prediction by @ellarabi in #394
- New ConvertToBoolean post processor that changes the predict to either TRUE or FALSE by @ellarabi in #394
- 15 new open source classification datasets by @ilyashnil in #410, #418
- Documentation is now automatically generate in each release (#384)
Bug fixes
- Fixed and improved error checking in multi label F1 by @yoavkatz in #390
- Changed translations to use normalized_sacrebleu by @gitMichal in #426
Non backward compatible changes
- MultipleChoice QA datasets need to move to new MultipleChoiceTemplates
- Translation blue metric is now between 0-1 and not 0-100
- New randomization mechanism may change selects selection of demos , randomized text augmentation, or any other random choice.
What's Changed
- metric and processor related to robustness evaluation by @ellarabi in #394
- Removed variable set in debugging by @yoavkatz in #409
- Adding simple datasets by @ilyashnil in #410
- Add multiple choice template and fix mmlu by @elronbandel in #405
- Fixed error check in multi label F1 by @yoavkatz in #390
- FIX multiple choice template by @perlitz in #416
- example of kaggle loader by @ilyashnil in #413
- Medical abstract by @ilyashnil in #418
- Multilabel and jsons by @ilyashnil in #419
- Improve dataset addition tutorial + Fix auto uploads of the catalog to the web by @elronbandel in #384
- Improve docs by @elronbandel in #420
- Fix docs and docs compilation tests by @elronbandel in #421
- Hard code classes names by @elronbandel in #425
- Retrieval metrics by @assaftibm in #422
- modify to different bleu impl. by @gitMichal in #426
- Improve docs by @elronbandel in #427
- Independent random generators by @matanor in #414
New Contributors
Full Changelog: 1.3.1...1.4.0