We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Describe the bug/ 问题描述 目前正在测试mindnlp.trl,但大量偏好数据集正常加载后无法读取,已经尝试过的数据集包括:trl-internal-testing/hh-rlhf-helpful-base-trl-style, HuggingFaceH4/ultrafeedback_binarized, argilla/ultrafeedback-binarized-preferences-cleaned, princeton-nlp/llama3-ultrafeedback-armorm, argilla/distilabel-intel-orca-dpo-pairs,Intel/orca_dpo_pairs . . .
mindnlp.trl
trl-internal-testing/hh-rlhf-helpful-base-trl-style
HuggingFaceH4/ultrafeedback_binarized
argilla/ultrafeedback-binarized-preferences-cleaned
princeton-nlp/llama3-ultrafeedback-armorm
argilla/distilabel-intel-orca-dpo-pairs
Intel/orca_dpo_pairs
目前尝试过的仅有 Anthropic/hh-rlhf 能够正常打印
Anthropic/hh-rlhf
Software Environment / 软件环境: --os:WSL Ubuntu-22.04 --python 3.10.14 --mindspore 2.3.1 --mindnlp 0.4.1 --numpy 1.26.3
os
python
mindspore
mindnlp
numpy
To Reproduce / 重现步骤
from mindnlp.dataset import load_dataset ds=load_dataset("HuggingFaceH4/ultrafeedback_binarized", split="train_prefs") print(next(ds.create_dict_iterator()))
Screenshots/ 日志 / 截图
The text was updated successfully, but these errors were encountered:
确定是GeneratorDataset的问题,我先去和minddata同事交流下
Sorry, something went wrong.
您好,请问此Bug是否有修复计划
No branches or pull requests
Describe the bug/ 问题描述
目前正在测试
mindnlp.trl
,但大量偏好数据集正常加载后无法读取,已经尝试过的数据集包括:trl-internal-testing/hh-rlhf-helpful-base-trl-style
,HuggingFaceH4/ultrafeedback_binarized
,argilla/ultrafeedback-binarized-preferences-cleaned
,princeton-nlp/llama3-ultrafeedback-armorm
,argilla/distilabel-intel-orca-dpo-pairs
,Intel/orca_dpo_pairs
. . .目前尝试过的仅有
Anthropic/hh-rlhf
能够正常打印Software Environment / 软件环境:
--
os
:WSL Ubuntu-22.04--
python
3.10.14--
mindspore
2.3.1--
mindnlp
0.4.1--
numpy
1.26.3To Reproduce / 重现步骤
Screenshots/ 日志 / 截图
The text was updated successfully, but these errors were encountered: