Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Yaml crowspairs tasks #2488

Open
wants to merge 24 commits into
base: main
Choose a base branch
from
Open

Yaml crowspairs tasks #2488

wants to merge 24 commits into from
+19,768 −26

Conversation

NAM00
Copy link

@NAM00 NAM00 commented Nov 14, 2024

No description provided.

KlaudiaTH and others added 24 commits March 13, 2024 09:55
@KlaudiaTH
Tokenizer handling
3393c84
@KlaudiaTH
Added ogx gsm8k implementation
47c3c4a
@KlaudiaTH
Added multilingual arc, hellaswag, mmlu and truthfulqa from EleutherA…
cf9e190 
…I upstream
@KlaudiaTH
Added ogx hellaswagx task
8fa981d
@KlaudiaTH
Added ogx arcx tasks
25f0b25
@KlaudiaTH
Task fixes
93f549c
@jjbuschhoff
added truthfulqax yaml configs
f96e585
@KlaudiaTH
Task fixes
2fcfe02
@jjbuschhoff
added mmlux task configs
bcb4104
@jjbuschhoff
Merge branch 'yaml_multilingual_tasks' of https://github.com/OpenGPTX…
e8d9f38 
…/lm-evaluation-harness into yaml_multilingual_tasks
@KlaudiaTH
Task corrections: MMLU and GSM8k
521504e
@jjbuschhoff
added generation templates
3a0035c
@jjbuschhoff
Merge branch 'yaml_multilingual_tasks' of https://github.com/OpenGPTX…
de88d6b 
…/lm-evaluation-harness into yaml_multilingual_tasks
@KlaudiaTH
Corrected task names ogx_thruthfulqa_* to ogx_truthfulqa_*
4900eff
@KlaudiaTH
Tasks corrections: MMLU and GSM8k
4fe393c
@KlaudiaTH
Added --bootstrap_iters command line argument
f6663f2
@KlaudiaTH
Preliminary implementation of flores and belebele
28bf93f
@KlaudiaTH
Added flores nll fix
f8e00f7
@KlaudiaTH
Added missing nll metric implementation
7447360
@jjbuschhoff
added latvian flores200 configs
485acdd
@jjbuschhoff
added lvs config for belebele, also renamed config files
6092ac5
@KlaudiaTH
FLORES-200: Added missing Latvian and removed unnecessary Irish, Malt…
6b544a9 
…ese and Croatian tasks
@KlaudiaTH
HF model: Added 'nccl_timeout' model arg
6cc3360
@NAM00
Crowspairs task yaml
1bd5e6a
@CLAassistant
Copy link

CLAassistant commented Nov 14, 2024 •
edited
Loading

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
0 out of 3 committers have signed the CLA.

❌ jjbuschhoff
❌ KlaudiaTH
❌ NAM00
You have signed the CLA already but the status is still pending? Let us recheck it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@baberabb baberabb Awaiting requested review from baberabb baberabb is a code owner

@lintangsutawika lintangsutawika Awaiting requested review from lintangsutawika lintangsutawika is a code owner

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@NAM00 @CLAassistant @KlaudiaTH @jjbuschhoff