-
Notifications
You must be signed in to change notification settings - Fork 1.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
mmlu translated professionally by OpenAI #2312
base: main
Are you sure you want to change the base?
mmlu translated professionally by OpenAI #2312
Commits on Sep 17, 2024
-
Configuration menu - View commit details
-
Copy full SHA for ca2dd8b - Browse repository at this point
Copy the full SHA ca2dd8bView commit details
Commits on Sep 27, 2024
-
Update README.md (EleutherAI#2297)
* Update README.md I encounter some Git buffer size limits when trying to download all commits history of the repository, such as: ```error: RPC failed; curl 18 transfer closed with outstanding read data remaining error: 5815 bytes of body are still expected fetch-pack: unexpected disconnect while reading sideband packet fatal: early EOF``` therefore the installation is faster and there are not errors when I download only the last version of the repository * Fix linting issue
Configuration menu - View commit details
-
Copy full SHA for bad44e7 - Browse repository at this point
Copy the full SHA bad44e7View commit details -
Configuration menu - View commit details
-
Copy full SHA for b1aedcd - Browse repository at this point
Copy the full SHA b1aedcdView commit details -
Update neuron backend (EleutherAI#2314)
* feat(neuron): align with latest optimum-neuron * feat(neuron): support pre-exported neuron models * fix(neuron): correctly use max_length * fix(neuron): adapt loglikelihood The evaluation of log likelihood was not working for neuron models using continuous batching, such as all cached neuron LLama models. * refactor(neuron): remove dead code
Configuration menu - View commit details
-
Copy full SHA for a0d66fb - Browse repository at this point
Copy the full SHA a0d66fbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5be4d01 - Browse repository at this point
Copy the full SHA 5be4d01View commit details -
Configuration menu - View commit details
-
Copy full SHA for b59b9b9 - Browse repository at this point
Copy the full SHA b59b9b9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 81b13e4 - Browse repository at this point
Copy the full SHA 81b13e4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2476ad3 - Browse repository at this point
Copy the full SHA 2476ad3View commit details -
Treat tags in python tasks the same as yaml tasks (EleutherAI#2288)
* Treat python tasks same as yaml tasks. * Add tests. * Re-add fixture decorators. * Fix typing specification error for Python 3.9.
Configuration menu - View commit details
-
Copy full SHA for bebc227 - Browse repository at this point
Copy the full SHA bebc227View commit details -
Configuration menu - View commit details
-
Copy full SHA for e6726a7 - Browse repository at this point
Copy the full SHA e6726a7View commit details -
change glianorex to test split (EleutherAI#2332)
* change glianorex to test set * nit * fix test; doc_to_target can be str for multiple_choice * nit
Configuration menu - View commit details
-
Copy full SHA for 969ea42 - Browse repository at this point
Copy the full SHA 969ea42View commit details -
mmlu-pro: add newlines to task descriptions (not leaderboard) (Eleuth…
…erAI#2334) * add newlines to task descriptions; increment versions * fix task tests (with groups) * Apply suggestions from code review --------- Co-authored-by: Hailey Schoelkopf <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 4ca6f35 - Browse repository at this point
Copy the full SHA 4ca6f35View commit details -
Added TurkishMMLU to LM Evaluation Harness (EleutherAI#2283)
* Added TurkishMMLU to LM Evaluation Harness * Fixed COT name * Fixed COT name * Updated Readme * Fixed Test issues * Completed Scan for changed tasks * Updated Readme * Update README.md * fixup task naming casing + ensure yaml template stubs aren't registered --------- Co-authored-by: Hailey Schoelkopf <[email protected]> Co-authored-by: haileyschoelkopf <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 641411f - Browse repository at this point
Copy the full SHA 641411fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0bb44af - Browse repository at this point
Copy the full SHA 0bb44afView commit details -
openai: better error messages; fix greedy matching (EleutherAI#2327)
* better error message; fix greedy matching * Update lm_eval/models/openai_completions.py Co-authored-by: Hailey Schoelkopf <[email protected]> * Update lm_eval/models/openai_completions.py Co-authored-by: Hailey Schoelkopf <[email protected]> * pre-commit --------- Co-authored-by: Hailey Schoelkopf <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for c51deda - Browse repository at this point
Copy the full SHA c51dedaView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0e5ef9d - Browse repository at this point
Copy the full SHA 0e5ef9dView commit details -
Configuration menu - View commit details
-
Copy full SHA for ad1ce4e - Browse repository at this point
Copy the full SHA ad1ce4eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6f58636 - Browse repository at this point
Copy the full SHA 6f58636View commit details -
Configuration menu - View commit details
-
Copy full SHA for d685ed5 - Browse repository at this point
Copy the full SHA d685ed5View commit details -
Configuration menu - View commit details
-
Copy full SHA for b6f2fe3 - Browse repository at this point
Copy the full SHA b6f2fe3View commit details -
Configuration menu - View commit details
-
Copy full SHA for a2a9e8e - Browse repository at this point
Copy the full SHA a2a9e8eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4fff660 - Browse repository at this point
Copy the full SHA 4fff660View commit details
Commits on Oct 1, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 41e8a92 - Browse repository at this point
Copy the full SHA 41e8a92View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6807c19 - Browse repository at this point
Copy the full SHA 6807c19View commit details
Commits on Oct 8, 2024
-
Configuration menu - View commit details
-
Copy full SHA for c8ca981 - Browse repository at this point
Copy the full SHA c8ca981View commit details