Skip to content

Pull requests: mlfoundations/evalchemy

New pull request New
11 Open 103 Closed
11 Open 103 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: add type check and list conversion for LiveCodeBenchs
#137 opened Jul 1, 2025 by dkimds Loading…
1
Add debug mode to 5 benchmarks
#135 opened Jul 1, 2025 by dkimds Loading…
1
Register OpenLM models at startup
#133 opened Jun 27, 2025 by reinhardh Loading…
LCB official scorer instead of skythoughts
#130 opened Jun 13, 2025 by slimfrkha Loading…
Optimize Evaluation Workflow for Better Batching and Model Reuse For benchmarks with n_repeat > 1
#125 opened May 27, 2025 by ihebchaa Loading…
3
update lm-eval-harness version
#124 opened May 12, 2025 by jannalulu Loading…
Fix: truncate model identifier in case model name is too long
#120 opened May 2, 2025 by younesbelkada Loading…
1
Jean/update curator
#115 opened Apr 15, 2025 by jmercat Loading…
Support for Big Bench Extra Hard (General-purpose reasoning eval)
#92 opened Mar 8, 2025 by Hritikbansal Loading…
Adding Arena Hard Auto
#65 opened Jan 28, 2025 by asuvarna31 Loading…
4
Multi-node
#29 opened Nov 22, 2024 by jmercat Loading…
2
ProTip! Add no:assignee to see everything that’s not assigned.