1.6.0
What's Changed
BugFixes:
- FIx errors in datasets by @elronbandel in #495
- Fix manifest to include all files by @elronbandel in #496
- Fix templates for qa datasets by @elronbandel in #501
- Fix attach summarization cards to the summarization task by @arielge in #506
- Fix catalog main entry by @matanor in #520
- Fix ibm cos bucket reader cache returning wrong result when loader limit is set by @yoavkatz in #527
New Assets:
- Add multidoc2dial dataset in its abstractive and extractive forms by @arielge in #504
- Rag metrics by @assaftibm in #508
- Add regression task and fix stsb to use it by @elronbandel in #505
- Add new templates from fm-eval to public unitxt by @OfirArviv in #481
- Add few public datasets cards from IBM internal fmeval project by @OfirArviv in #502
Enhancments
- Enhanced UI by @Roni-Friedman in #511
- Prepare load_dataset and evaluate api to fit the paper by @elronbandel in #510
- Update catalog navigation Index on documentation side menu for easier catalog browsing by @matanor in #518
- Add catalog summary printing functionality by @elronbandel in #519
- add docstrings to some operators and templates, so that they show in the respective catalog cards by @dafnapension in #522
- Added UNITXT_TEST_METRIC_DISABLE to disable test_metric by @yoavkatz in #526
- Update docs introduction and component sections by @matanor in #525
Breaking Changes
- processors are now operators and should be redefined accordingly
- The functionality of unitxt dataset creation moved from dataset to dataset_utils
Full Changelog: 1.5.0...1.6.0