Skip to content

Actions: EleutherAI/lm-evaluation-harness

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
3,355 workflow runs
3,355 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Fix PIL image hashing to use actual bytes instead of object repr (#3331) Unit Tests #5529: Commit 29a0765 pushed by baberabb
5m 20s main
main
5m 20s
Fix PIL image hashing to use actual bytes instead of object repr (#3331) Tasks Modified #5556: Commit 29a0765 pushed by baberabb
11s main
main
11s
Avoid errors in extraction filters (#3395) Unit Tests #5528: Commit 7ddd966 pushed by baberabb
5m 11s main
main
5m 11s
Avoid errors in extraction filters (#3395) Tasks Modified #5555: Commit 7ddd966 pushed by baberabb
11s main
main
11s
Unit Tests Unit Tests #5527: by baberabb
5m 49s main
main
5m 49s
Tasks Modified Tasks Modified #5554: by baberabb
11s main
main
11s
Resolve deprecation of vllm.utils.get_open_port (#3398) Unit Tests #5526: Commit 2bb3aee pushed by baberabb
5m 29s main
main
5m 29s
Resolve deprecation of vllm.utils.get_open_port (#3398) Tasks Modified #5553: Commit 2bb3aee pushed by baberabb
12s main
main
12s
merge Boda branch with latest poetry analysis tasks Tasks Modified #5552: Pull request #3413 opened by bodasadallah
1m 44s Anwarvic:boda
Anwarvic:boda
1m 44s
merge Boda branch with latest poetry analysis tasks Unit Tests #5525: Pull request #3413 opened by bodasadallah
2m 13s Anwarvic:boda
Anwarvic:boda
2m 13s
Adding pisa task Unit Tests #5524: Pull request #3412 synchronize by HallerPatrick
5m 14s HallerPatrick:pisa
HallerPatrick:pisa
5m 14s
Adding pisa task Tasks Modified #5551: Pull request #3412 synchronize by HallerPatrick
1m 56s HallerPatrick:pisa
HallerPatrick:pisa
1m 56s
Adding pisa task Unit Tests #5523: Pull request #3412 synchronize by HallerPatrick
5m 17s HallerPatrick:pisa
HallerPatrick:pisa
5m 17s
Adding pisa task Tasks Modified #5550: Pull request #3412 synchronize by HallerPatrick
1m 46s HallerPatrick:pisa
HallerPatrick:pisa
1m 46s
Adding pisa task Unit Tests #5522: Pull request #3412 opened by HallerPatrick
5m 11s HallerPatrick:pisa
HallerPatrick:pisa
5m 11s
Adding pisa task Tasks Modified #5549: Pull request #3412 opened by HallerPatrick
1m 46s HallerPatrick:pisa
HallerPatrick:pisa
1m 46s
Fix gsm8k_platinum description Tasks Modified #5548: Pull request #3411 opened by fxmarty-amd
1m 55s fxmarty-amd:fix-description-gsm8k-platinum
fxmarty-amd:fix-description-gsm8k-platinum
1m 55s
Fix gsm8k_platinum description Unit Tests #5521: Pull request #3411 opened by fxmarty-amd
5m 36s fxmarty-amd:fix-description-gsm8k-platinum
fxmarty-amd:fix-description-gsm8k-platinum
5m 36s
[MMLU redux] Do not use samples which do not have error_type="ok" Tasks Modified #5547: Pull request #3410 opened by fxmarty-amd
2m 5s fxmarty-amd:fix-mmlu-redux-data
fxmarty-amd:fix-mmlu-redux-data
2m 5s
[MMLU redux] Do not use samples which do not have error_type="ok" Unit Tests #5520: Pull request #3410 opened by fxmarty-amd
5m 6s fxmarty-amd:fix-mmlu-redux-data
fxmarty-amd:fix-mmlu-redux-data
5m 6s
Trim whitespace in remove_whitespace filter Tasks Modified #5546: Pull request #3408 opened by ziqing-huang
10s ziqing-huang:remove_whitespace
ziqing-huang:remove_whitespace
10s
Trim whitespace in remove_whitespace filter Unit Tests #5519: Pull request #3408 opened by ziqing-huang
5m 45s ziqing-huang:remove_whitespace
ziqing-huang:remove_whitespace
5m 45s
Fix wrong gpqa_diamond_generative_n_shot answer template Tasks Modified #5545: Pull request #3407 opened by fxmarty-amd
2m 8s fxmarty-amd:fix-gpqa-diamond
fxmarty-amd:fix-gpqa-diamond
2m 8s
Fix wrong gpqa_diamond_generative_n_shot answer template Unit Tests #5518: Pull request #3407 opened by fxmarty-amd
5m 17s fxmarty-amd:fix-gpqa-diamond
fxmarty-amd:fix-gpqa-diamond
5m 17s
[fix] Fix mmlu_redux not displaying summary table + display to the user the tasks / yaml that are actually pulled Unit Tests #5517: Pull request #3406 synchronize by fxmarty-amd
4m 56s fxmarty-amd:fix-mmlu-redux
fxmarty-amd:fix-mmlu-redux
4m 56s