Skip to content

Actions: EleutherAI/lm-evaluation-harness

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
3,355 workflow runs
3,355 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

[AIME24 | AIME25] Enable Multiple Generation Repeats with Pass@k and Majority@k Metrics Unit Tests #5542: Pull request #3351 synchronize by ihebchaa
Action required ihebchaa:aime-repeat
ihebchaa:aime-repeat
Action required
Replace deprecated torch_dtype parameter with dtype (#3415) Tasks Modified #5568: Commit 7ddb2b1 pushed by baberabb
11s main
main
11s
Replace deprecated torch_dtype parameter with dtype (#3415) Unit Tests #5541: Commit 7ddb2b1 pushed by baberabb
5m 37s main
main
5m 37s
Fix descriptions in the Moral Stories and Histoires Morales tasks. (#… Tasks Modified #5567: Commit 2caff2b pushed by baberabb
2m 1s main
main
2m 1s
Fix descriptions in the Moral Stories and Histoires Morales tasks. (#… Unit Tests #5540: Commit 2caff2b pushed by baberabb
5m 17s main
main
5m 17s
Fix lambada_multilingual_stablelm (#3294) Tasks Modified #5566: Commit 54e606f pushed by baberabb
2m 3s main
main
2m 3s
Fix lambada_multilingual_stablelm (#3294) Unit Tests #5539: Commit 54e606f pushed by baberabb
5m 34s main
main
5m 34s
Fix lambada_multilingual_stablelm Tasks Modified #5565: Pull request #3294 synchronize by baberabb
1m 51s jmichaelov:patch-4
jmichaelov:patch-4
1m 51s
Fix lambada_multilingual_stablelm Unit Tests #5538: Pull request #3294 synchronize by baberabb
5m 6s jmichaelov:patch-4
jmichaelov:patch-4
5m 6s
Fix lambada_multilingual_stablelm Unit Tests #5537: Pull request #3294 synchronize by baberabb
5m 36s jmichaelov:patch-4
jmichaelov:patch-4
5m 36s
Fix lambada_multilingual_stablelm Tasks Modified #5564: Pull request #3294 synchronize by baberabb
1m 46s jmichaelov:patch-4
jmichaelov:patch-4
1m 46s
fix(tasks):pin correct MMLUSR version (#3350) Unit Tests #5536: Commit 187d0e9 pushed by baberabb
5m 22s main
main
5m 22s
fix(tasks):pin correct MMLUSR version (#3350) Tasks Modified #5563: Commit 187d0e9 pushed by baberabb
1m 59s main
main
1m 59s
bugfix additional_config parsing (#3393) Unit Tests #5535: Commit 5d2bc54 pushed by baberabb
4m 49s main
main
4m 49s
bugfix additional_config parsing (#3393) Tasks Modified #5562: Commit 5d2bc54 pushed by baberabb
1m 56s main
main
1m 56s
Add MATH500 (#3311) Unit Tests #5534: Commit 82e84ce pushed by baberabb
5m 25s main
main
5m 25s
Add MATH500 (#3311) Tasks Modified #5561: Commit 82e84ce pushed by baberabb
2m 0s main
main
2m 0s
fix: resolve duplicate task names and add safeguards. (#3394) Tasks Modified #5560: Commit e45ed6e pushed by baberabb
1m 56s main
main
1m 56s
fix: resolve duplicate task names and add safeguards. (#3394) Unit Tests #5533: Commit e45ed6e pushed by baberabb
4m 50s main
main
4m 50s
[MMLU redux] Do not use samples which do not have error_type="ok" (… Tasks Modified #5559: Commit b529c19 pushed by baberabb
4m 35s main
main
4m 35s
[MMLU redux] Do not use samples which do not have error_type="ok" (… Unit Tests #5532: Commit b529c19 pushed by baberabb
5m 8s main
main
5m 8s
Replace deprecated torch_dtype parameter with dtype Unit Tests #5531: Pull request #3415 opened by AbdulmalikDS
5m 6s AbdulmalikDS:fix-torch-dtype-deprecation
AbdulmalikDS:fix-torch-dtype-deprecation
5m 6s
Replace deprecated torch_dtype parameter with dtype Tasks Modified #5558: Pull request #3415 opened by AbdulmalikDS
10s AbdulmalikDS:fix-torch-dtype-deprecation
AbdulmalikDS:fix-torch-dtype-deprecation
10s
[MMLU redux] Do not use samples which do not have error_type="ok" Unit Tests #5530: Pull request #3410 synchronize by fxmarty-amd
5m 14s fxmarty-amd:fix-mmlu-redux-data
fxmarty-amd:fix-mmlu-redux-data
5m 14s
[MMLU redux] Do not use samples which do not have error_type="ok" Tasks Modified #5557: Pull request #3410 synchronize by fxmarty-amd
2m 56s fxmarty-amd:fix-mmlu-redux-data
fxmarty-amd:fix-mmlu-redux-data
2m 56s