Skip to content

Pull requests: IBM/unitxt

New pull request New
26 Open 1,454 Closed
26 Open 1,454 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add audio support
#1706 opened Apr 1, 2025 by elronbandel • Draft
Updates to the provoq card and related artifacts
#1705 opened Mar 31, 2025 by bnayahu Loading…
Vision bench update
#1704 opened Mar 31, 2025 by alfassy Loading…
update wml llmajj from llama-3-70b to llama-3-1-70b
#1703 opened Mar 31, 2025 by OfirArviv Loading…
2
Text2sql metrics fixes
#1702 opened Mar 28, 2025 by oktie Loading…
@perlitz
Unify llm judges into a single prepare file
#1696 opened Mar 21, 2025 by martinscooper Loading…
1
Fix llm judge artifacts
#1695 opened Mar 20, 2025 by martinscooper Loading…
1
Momentary fix of 'CriteriaWithOptions is not JSON serializable'
#1694 opened Mar 19, 2025 by martinscooper • Draft
Generate summaries in positional bias for direct assessment
#1689 opened Mar 17, 2025 by martinscooper Loading…
Test branch to evaluate impact of different format
#1667 opened Mar 10, 2025 by yoavkatz • Draft
BugFix: Use dumping of task data and source only when dumping
#1661 opened Mar 9, 2025 by elronbandel Loading…
1
Use elaborated cache key and use it for filelock semaphore
#1644 opened Mar 4, 2025 by elronbandel Loading…
7
Performance to report accurate times based on end-to-end time() diffs, rather than accumulate cProfile numbers over methods that seemed relevant.
#1642 opened Mar 2, 2025 by dafnapension Loading…
Add batch size control to Huggingface pipeline based inference engine
#1636 opened Feb 27, 2025 by elronbandel Loading…
Added example of multi-choice QA
#1634 opened Feb 26, 2025 by yoavkatz Loading…
Add prediction variable name customization to LLM as Judge
#1622 opened Feb 21, 2025 by martinscooper • Draft
4
Add breakpoint to every unitxt catalog asset at its core logic
#1595 opened Feb 11, 2025 by elronbandel • Draft
Add Multi Turn Metrics Support
#1579 opened Feb 5, 2025 by elronbandel • Draft
Try re-using huggingface cache in GitHub Actions
#1571 opened Feb 3, 2025 by elronbandel Loading…
Add text2sql blog post
#1558 opened Jan 27, 2025 by perlitz • Draft
3
Add documentation for Settings and Constants management
#1521 opened Jan 19, 2025 by elronbandel Loading…
1
20
Remove IBM GenAI support and moved legacy GenAI metrics to use CrossProviderInferenceEngine
#1508 opened Jan 13, 2025 by yoavkatz Loading…
2
Add new processors and update type hints for response assessment tasks
#1480 opened Jan 6, 2025 by elronbandel • Draft
1
Try new dumping/loading of jsons that can allow artifacts in task data
#1442 opened Dec 16, 2024 by elronbandel Loading…
Allow a serializer per field in template.
#1438 opened Dec 15, 2024 by yoavkatz Loading…
ProTip! Updated in the last three days: updated:>2025-03-29.