Skip to content

Actions: EleutherAI/lm-evaluation-harness

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
3,355 workflow runs
3,355 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

New Task: Add CNN-DailyMail (3.0.0) Tasks Modified #5597: Pull request #3426 synchronize by baberabb
1m 51s preordinary:summarization_datasets
preordinary:summarization_datasets
1m 51s
Fix reading custom task configs (#3425) Unit Tests #5569: Commit 08495a0 pushed by baberabb
5m 14s main
main
5m 14s
Fix reading custom task configs (#3425) Tasks Modified #5596: Commit 08495a0 pushed by baberabb
13s main
main
13s
Update SGLang installation and documentation links (#3422) Tasks Modified #5595: Commit b7a8cf7 pushed by baberabb
13s main
main
13s
Update SGLang installation and documentation links (#3422) Unit Tests #5568: Commit b7a8cf7 pushed by baberabb
5m 46s main
main
5m 46s
Rename the conflicting environment variable LOGLEVEL to `LM_EVAL_LO… Tasks Modified #5594: Commit a7da456 pushed by baberabb
8s main
main
8s
Rename the conflicting environment variable LOGLEVEL to `LM_EVAL_LO… Unit Tests #5567: Commit a7da456 pushed by baberabb
5m 28s main
main
5m 28s
Rename the conflicting environment variable LOGLEVEL to LMEVAL_LOG_LEVEL Tasks Modified #5593: Pull request #3418 synchronize by baberabb
13s fxmarty-amd:fix-LOGLEVEL-variable
fxmarty-amd:fix-LOGLEVEL-variable
13s
Rename the conflicting environment variable LOGLEVEL to LMEVAL_LOG_LEVEL Unit Tests #5566: Pull request #3418 synchronize by baberabb
5m 30s fxmarty-amd:fix-LOGLEVEL-variable
fxmarty-amd:fix-LOGLEVEL-variable
5m 30s
[fix] Fix mmlu_redux not displaying summary table + display to the us… Unit Tests #5565: Commit c1d2747 pushed by baberabb
5m 42s main
main
5m 42s
[fix] Fix mmlu_redux not displaying summary table + display to the us… Tasks Modified #5592: Commit c1d2747 pushed by baberabb
3m 26s main
main
3m 26s
[fix] Fix mmlu_redux not displaying summary table + display to the user the tasks / yaml that are actually pulled Tasks Modified #5591: Pull request #3406 synchronize by baberabb
3m 24s fxmarty-amd:fix-mmlu-redux
fxmarty-amd:fix-mmlu-redux
3m 24s
[fix] Fix mmlu_redux not displaying summary table + display to the user the tasks / yaml that are actually pulled Unit Tests #5564: Pull request #3406 synchronize by baberabb
5m 40s fxmarty-amd:fix-mmlu-redux
fxmarty-amd:fix-mmlu-redux
5m 40s
Refactor TaskManager Unit Tests #5563: Pull request #3432 synchronize by baberabb
6m 6s taskmanager_
taskmanager_
6m 6s
Refactor TaskManager Tasks Modified #5590: Pull request #3432 synchronize by baberabb
2m 6s taskmanager_
taskmanager_
2m 6s
Refactor TaskManager Unit Tests #5562: Pull request #3432 opened by baberabb
5m 59s taskmanager_
taskmanager_
5m 59s
Refactor TaskManager Tasks Modified #5589: Pull request #3432 opened by baberabb
1m 42s taskmanager_
taskmanager_
1m 42s
Lazy registry; lightweight core Tasks Modified #5588: Pull request #3428 synchronize by baberabb
2m 32s registry_
registry_
2m 32s
Lazy registry; lightweight core Unit Tests #5561: Pull request #3428 synchronize by baberabb
5m 22s registry_
registry_
5m 22s
Refactor: Decouple ContextSampler from Task; build_qa_turn Unit Tests #5560: Pull request #3429 opened by baberabb
5m 25s fewshotsampler_
fewshotsampler_
5m 25s
Refactor: Decouple ContextSampler from Task; build_qa_turn Tasks Modified #5587: Pull request #3429 opened by baberabb
2m 5s fewshotsampler_
fewshotsampler_
2m 5s
Lazy registry; lightweight core Unit Tests #5559: Pull request #3428 synchronize by baberabb
5m 36s registry_
registry_
5m 36s
Lazy registry; lightweight core Tasks Modified #5586: Pull request #3428 synchronize by baberabb
1m 46s registry_
registry_
1m 46s
Lazy registry; lightweight core Tasks Modified #5585: Pull request #3428 opened by baberabb
1m 40s registry_
registry_
1m 40s
Lazy registry; lightweight core Unit Tests #5558: Pull request #3428 opened by baberabb
5m 54s registry_
registry_
5m 54s