Skip to content

Issues: OpenGPTX/lm-evaluation-harness

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

MegatronLMClient expects cache usage
#106 opened Jan 22, 2024 by janEbert
Upstreaming contributions?
#81 opened Apr 30, 2023 by StellaAthena
Add evaluations for anli_de
#71 opened Jan 26, 2023 by katrinklug
Add evaluations for miam
#67 opened Jan 16, 2023 by katrinklug
Add evaluations for germandpr
#65 opened Jan 16, 2023 by katrinklug
Add evaluation for fairlex
#64 opened Jan 16, 2023 by katrinklug
Add evaluations for lextreme
#63 opened Jan 16, 2023 by katrinklug
Add evaluation for germEval14
#46 opened Nov 10, 2022 by katrinklug
Evaluation for German LER task
#44 opened Nov 4, 2022 by malteos
Multi GPU Evaluation task
#42 opened Nov 3, 2022 by Lena-Jurkschat
Results for xnli_de,pawsx_de,xquad_de
#31 opened Aug 17, 2022 by malteos
Evaluation for XGLUE Task task
#27 opened Aug 16, 2022 by malteos
ProTip! Adding no:label will show everything without a label.