Skip to content

Commit 54e606f

Browse files
jmichaelovbaberabb
andauthored
Fix lambada_multilingual_stablelm (#3294)
* Correct `lambada_multilingual_stablelm` task names in README * trust remote code (required for dataset to work) * use parquet ds * remove trust --------- Co-authored-by: Baber <[email protected]>
1 parent 187d0e9 commit 54e606f

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

lm_eval/tasks/lambada_multilingual_stablelm/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -40,7 +40,7 @@ Homepage: https://zenodo.org/record/2630551#.X4Xzn5NKjUI
4040

4141
#### Tasks
4242

43-
* `lambada_mt_stablelm_{en, fr, de, it, es}`: Machine-translated versions of OpenAI's Lambada variant as reported in "Stable LM 2 1.6 B Technical Report" (Bellagente et. al.).
43+
* `lambada_openai_mt_stablelm_{en, fr, de, it, es}`: Machine-translated versions of OpenAI's Lambada variant as reported in "Stable LM 2 1.6 B Technical Report" (Bellagente et. al.).
4444

4545
### Checklist
4646

lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
tag: lambada_multilingual_stablelm
22
task: lambada_openai_mt_stablelm_en
3-
dataset_path: marcob/lambada_multilingual
3+
dataset_path: EleutherAI/lambada_multilingual_stablelm
44
dataset_name: en
55
output_type: loglikelihood
66
test_split: test

0 commit comments

Comments
 (0)