Unitxt 1.7.0 #631

Unanswered

elronbandel asked this question in Q&A

elronbandel
Mar 5, 2024
Maintainer

What's Changed

Tweaking Catalog.py some, and fixed some typos. Also in the .rst fixed pages. Generate explanations also for sub-types in the artifact by @dafnapension in Tweaking Catalog.py some, and fixed some typos. Also in the .rst fixed pages. Generate explanations also for sub-types in the artifact #528
Update tests.yml to be activated on pull_request_target by @elronbandel in Update tests.yml to be activated on pull_request_target #537
Update tests.yml by @elronbandel in Update tests.yml #538
Fix parser to allow source name that starts with numeric by @marukaz in Fix parser to allow source name that starts with numeric #530
Avoid race condition when download files to IBM COS cache by @yoavkatz in Avoid race condition when download files to IBM COS cache #536
Updating perplexity computation, to apply exp(-x) by @assaftibm in Updating perplexity computation, to apply exp(-x) #534
UI improvements by @Roni-Friedman in UI improvements #541
Update README.md by @eltociear in Update README.md #540
rename answer_relevance to answer_reward by @assaftibm in rename answer_relevance to answer_reward #539
Support artifact_identifier in Artifact objects by @matanor in Support artifact_identifier in Artifact objects #545
Added table serializers operators and add Wikitq table question answering dataset by @csrajmohan in Added table serializers operators and add Wikitq table question answering dataset #544
fixing the corresponding json files by @ilyashnil in fixing the corresponding json files #543
Set artifact_identifier in GithubCatalog.load() by @matanor in Set artifact_identifier in GithubCatalog.load() #547
Remove set_artifact_identifier by @matanor in Remove set_artifact_identifier #546
avoid duplicate values in UI by @Roni-Friedman in avoid duplicate values in UI #552
changed the test that generated a new entry in the catalog by @dafnapension in changed the test that generated a new entry in the catalog #550
allow imports list for executequery and filterbyquery and rename to ExecuteExpression and FilterByExpression by @dafnapension in allow imports list for executequery and filterbyquery and rename to ExecuteExpression and FilterByExpression #542
Update version to 1.6.2 by @elronbandel in Update version to 1.6.2 #554
Update version to 1.6.3 by @elronbandel in Update version to 1.6.3 #555
Update version to 1.6.4 by @elronbandel in Update version to 1.6.4 #556
Add tests for api by @elronbandel in Add tests for api #558
Fix artifact initialization dict creation to be recursive by @elronbandel in Fix artifact initialization dict creation to be recursive #559
Following Elron's fix, remove all special tweaks by @dafnapension in Following Elron's fix, remove all special tweaks #560
Fix UI and catalog by @elronbandel in Fix UI and catalog #561
Update version to 1.6.5 by @elronbandel in Update version to 1.6.5 #563
Enforce tests to use only local catalogs by @elronbandel in Enforce tests to use only local catalogs #564
Update version to 1.6.6 by @elronbandel in Update version to 1.6.6 #566
add human eval dataset by @OfirArviv in add human eval dataset #509
Extend the function that evaluate with unitxt metric on external data to new types of data by @assaftibm in Extend the function that evaluate with unitxt metric on external data to new types of data #557
Add Kendall's tau metric by @lilacheden in Add Kendall's tau metric #535
Add new table operators for serialization & truncation by @csrajmohan in Add new table operators for serialization & truncation #567
Fix multi label classification template and improve debugging by @yoavkatz in Fix multi label classification template and improve debugging #571
Unitxt should operate with no package requirements by default. This adds some tools to do so. by @elronbandel in Unitxt should operate with no package requirements by default. This adds some tools to do so. #570
Seperate library tests and catalog preperation by @elronbandel in Seperate library tests and catalog preperation #572
Add class for constants handling by @elronbandel in Add class for constants handling #575
Clinc and news by @ilyashnil in Clinc and news #578
Extend use of constants class and fix version inconsistency issues by @elronbandel in Extend use of constants class and fix version inconsistency issues #576
Add code needed for evaluating metrics as models by @lilacheden in Add code needed for evaluating metrics as models #573
Migrate (task-related) Instruction into Template, and introduce (task independent) SystemPrompt by @dafnapension in Migrate (task-related) Instruction into Template, and introduce (task independent) SystemPrompt #565
Improved error message when using TemplateDict by @yoavkatz in Improved error message when using TemplateDict #499
Fix classification code so multi-label metrics are not aware of 'none' by @yoavkatz in Fix classification code so multi-label metrics are not aware of 'none' #580
cards for cohere for ai aya dataset by @dafnapension in cards for cohere for ai aya dataset #579
Add MultiReferenceTemplate import by @perlitz in Add MultiReferenceTemplate import #583
Add uncomitted processor by @elronbandel in Add uncomitted processor #588
Add multi class relation classification task and change nli datasets to use it by @elronbandel in Add multi class relation classification task and change nli datasets to use it #586
Eval metrics by @lilacheden in Eval metrics #587
Add missing processor in catalog by @yoavkatz in Add missing processor in catalog #590
Add ability to load from catalog with arguments overwrite by @elronbandel in Add ability to load from catalog with arguments overwrite #581
Docfix: Fix incorrect artifact names in Adding Dataset doc by @yifanmai in Docfix: Fix incorrect artifact names in Adding Dataset doc #591
fixes to perplexity metric, updates to catalog by @assaftibm in fixes to perplexity metric, updates to catalog #592
Add tab_fact dataset, a dataset for classification of textual entailment from tables by @csrajmohan in Add tab_fact dataset, a dataset for classification of textual entailment from tables #582
Grouped instance metric inherit from InstanceMetrics by @sam-data-guy-iam in Grouped instance metric inherit from InstanceMetrics #452
Rename additional_inputs to task_data and make it a simple json dumped by @elronbandel in Rename additional_inputs to task_data and make it a simple json dumped #595
Improve website by @elronbandel in Improve website #597
Fix datasets and templates by @elronbandel in Fix datasets and templates #599
Fix UI by @elronbandel in Fix UI #600
structured data operators for serializing tablerows, triples and keyvalue pairs added by @csrajmohan in structured data operators for serializing tablerows, triples and keyvalue pairs added #589
Test catalog preperation without hugginface access by @elronbandel in Test catalog preperation without hugginface access #601
Add filtered ffqa dataset by @marukaz in Add filtered ffqa dataset #593
Allow dicts in overwrite args of fetched artifact by @dafnapension in Allow dicts in overwrite args of fetched artifact #598
filter on loading rather than increase loading limit by @dafnapension in filter on loading rather than increase loading limit #584
format instruction same as source in templates by @dafnapension in format instruction same as source in templates #607
Reduce log size by printing less by @elronbandel in Reduce log size by printing less #605
Fixed formats and system prompts by @elronbandel in Fixed formats and system prompts #604
Add scipy to base requirements by @matanor in Add scipy to base requirements #611
Reverese undocumented capitalization in templates by @elronbandel in Reverese undocumented capitalization in templates #616
Fix OptionalField in dataclass by @elronbandel in Fix OptionalField in dataclass #619
suggest new features of Tempate for ffqa by @dafnapension in suggest new features of Tempate for ffqa #613
banking77 needs to be shuffled by @ilyashnil in banking77 needs to be shuffled #603
Support execution of metrics on a remote host by @matanor in Support execution of metrics on a remote host #568
Move test to subdir library by @matanor in Move test to subdir library #623
Add universal_ner by @elronbandel in Add universal_ner #622
Add signatures to dataclasses init for clearer docs by @elronbandel in Add signatures to dataclasses __init__ for clearer docs #624
Eval metrics by @lilacheden in Eval metrics #621
Eval metrics by @lilacheden in Eval metrics #625
Fix problem in process_instance by @yoavkatz in Fix problem in process_instance #628
Add atis dataset by @elronbandel in Add atis dataset #629

New Contributors

@eltociear made their first contribution in Update README.md #540
@csrajmohan made their first contribution in Added table serializers operators and add Wikitq table question answering dataset #544
@yifanmai made their first contribution in Docfix: Fix incorrect artifact names in Adding Dataset doc #591
@sam-data-guy-iam made their first contribution in Grouped instance metric inherit from InstanceMetrics #452

Full Changelog: 1.6.1...1.7.0

This discussion was created from the release Unitxt 1.7.0.

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment