Skip to content

Actions: EleutherAI/lm-evaluation-harness

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
3,355 workflow runs
3,355 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

New Task: Add CNN-DailyMail (3.0.0) Unit Tests #5557: Pull request #3426 opened by preordinary
5m 5s preordinary:summarization_datasets
preordinary:summarization_datasets
5m 5s
New Task: Add CNN-DailyMail (3.0.0) Tasks Modified #5584: Pull request #3426 opened by preordinary
2m 10s preordinary:summarization_datasets
preordinary:summarization_datasets
2m 10s
Fix reading custom task configs Tasks Modified #5583: Pull request #3425 opened by SkyR0ver
12s SkyR0ver:main
SkyR0ver:main
12s
Fix reading custom task configs Unit Tests #5556: Pull request #3425 opened by SkyR0ver
5m 29s SkyR0ver:main
SkyR0ver:main
5m 29s
Update SGLang installation and documentation links Unit Tests #5555: Pull request #3422 opened by Bobchenyx
5m 10s Bobchenyx:patch-1
Bobchenyx:patch-1
5m 10s
Update SGLang installation and documentation links Tasks Modified #5582: Pull request #3422 opened by Bobchenyx
13s Bobchenyx:patch-1
Bobchenyx:patch-1
13s
[AIME24 | AIME25] Enable Multiple Generation Repeats with Pass@k and Majority@k Metrics Tasks Modified #5578: Pull request #3351 synchronize by ihebchaa
Action required ihebchaa:aime-repeat
ihebchaa:aime-repeat
Action required
[AIME24 | AIME25] Enable Multiple Generation Repeats with Pass@k and Majority@k Metrics Unit Tests #5551: Pull request #3351 synchronize by ihebchaa
Action required ihebchaa:aime-repeat
ihebchaa:aime-repeat
Action required
[fix] Fix mmlu_redux not displaying summary table + display to the user the tasks / yaml that are actually pulled Tasks Modified #5577: Pull request #3406 synchronize by fxmarty-amd
2m 48s fxmarty-amd:fix-mmlu-redux
fxmarty-amd:fix-mmlu-redux
2m 48s
[fix] Fix mmlu_redux not displaying summary table + display to the user the tasks / yaml that are actually pulled Unit Tests #5550: Pull request #3406 synchronize by fxmarty-amd
5m 31s fxmarty-amd:fix-mmlu-redux
fxmarty-amd:fix-mmlu-redux
5m 31s
[fix] Fix mmlu_redux not displaying summary table + display to the user the tasks / yaml that are actually pulled Unit Tests #5549: Pull request #3406 synchronize by fxmarty-amd
5m 16s fxmarty-amd:fix-mmlu-redux
fxmarty-amd:fix-mmlu-redux
5m 16s
[fix] Fix mmlu_redux not displaying summary table + display to the user the tasks / yaml that are actually pulled Tasks Modified #5576: Pull request #3406 synchronize by fxmarty-amd
2m 58s fxmarty-amd:fix-mmlu-redux
fxmarty-amd:fix-mmlu-redux
2m 58s
Add task dynamic_ifeval Tasks Modified #5575: Pull request #3149 synchronize by davideguidobene
Action required davideguidobene:dynamic-ifeval
davideguidobene:dynamic-ifeval
Action required
Add task dynamic_ifeval Unit Tests #5548: Pull request #3149 synchronize by davideguidobene
Action required davideguidobene:dynamic-ifeval
davideguidobene:dynamic-ifeval
Action required
[fix] Fix mmlu_redux not displaying summary table + display to the user the tasks / yaml that are actually pulled Tasks Modified #5574: Pull request #3406 synchronize by fxmarty-amd
2m 44s fxmarty-amd:fix-mmlu-redux
fxmarty-amd:fix-mmlu-redux
2m 44s
[fix] Fix mmlu_redux not displaying summary table + display to the user the tasks / yaml that are actually pulled Unit Tests #5547: Pull request #3406 synchronize by fxmarty-amd
5m 13s fxmarty-amd:fix-mmlu-redux
fxmarty-amd:fix-mmlu-redux
5m 13s
[fix] Fix mmlu_redux not displaying summary table + display to the user the tasks / yaml that are actually pulled Tasks Modified #5573: Pull request #3406 synchronize by fxmarty-amd
3m 1s fxmarty-amd:fix-mmlu-redux
fxmarty-amd:fix-mmlu-redux
3m 1s
[fix] Fix mmlu_redux not displaying summary table + display to the user the tasks / yaml that are actually pulled Unit Tests #5546: Pull request #3406 synchronize by fxmarty-amd
5m 18s fxmarty-amd:fix-mmlu-redux
fxmarty-amd:fix-mmlu-redux
5m 18s
Rename the conflicting environment variable LOGLEVEL to LMEVAL_LOG_LEVEL Unit Tests #5545: Pull request #3418 opened by fxmarty-amd
5m 19s fxmarty-amd:fix-LOGLEVEL-variable
fxmarty-amd:fix-LOGLEVEL-variable
5m 19s
Rename the conflicting environment variable LOGLEVEL to LMEVAL_LOG_LEVEL Tasks Modified #5572: Pull request #3418 opened by fxmarty-amd
12s fxmarty-amd:fix-LOGLEVEL-variable
fxmarty-amd:fix-LOGLEVEL-variable
12s
Add task dynamic_ifeval Tasks Modified #5571: Pull request #3149 synchronize by davideguidobene
Action required davideguidobene:dynamic-ifeval
davideguidobene:dynamic-ifeval
Action required
Add task dynamic_ifeval Unit Tests #5544: Pull request #3149 synchronize by davideguidobene
Action required davideguidobene:dynamic-ifeval
davideguidobene:dynamic-ifeval
Action required
[AIME24 | AIME25] Enable Multiple Generation Repeats with Pass@k and Majority@k Metrics Tasks Modified #5570: Pull request #3351 synchronize by ihebchaa
Action required ihebchaa:aime-repeat
ihebchaa:aime-repeat
Action required
[AIME24 | AIME25] Enable Multiple Generation Repeats with Pass@k and Majority@k Metrics Unit Tests #5543: Pull request #3351 synchronize by ihebchaa
Action required ihebchaa:aime-repeat
ihebchaa:aime-repeat
Action required
[AIME24 | AIME25] Enable Multiple Generation Repeats with Pass@k and Majority@k Metrics Tasks Modified #5569: Pull request #3351 synchronize by ihebchaa
Action required ihebchaa:aime-repeat
ihebchaa:aime-repeat
Action required