Search results

[Bug]:./tools/preprocess/dataset_split_by_language.py:52行报错Typeerror:DatasetBuild.load_dataset() takes 1 positional argument but 2 were given

bugSomething isn't workingSomething isn't working

Status: Open.

#750 In modelscope/data-juicer;

· feiyang-yin opened on Jul 30, 2025

后续是否会为DefaultExecutor提供stop方法

dj:coreissues/PRs about the core functions of Data-Juicerissues/PRs about the core functions of Data-Juicer

questionFurther information is requestedFurther information is requested

Status: Open.

#747 In modelscope/data-juicer;

· HunterLG opened on Jul 24, 2025

Reaching out from the Ray Team!

enhancementNew feature or requestNew feature or request

Status: Open.

#742 In modelscope/data-juicer;

· richardliaw opened on Jul 18, 2025

How to reduce the memory overhead when processing millions of samples ?

questionFurther information is requestedFurther information is requested

Status: Open.

#734 In modelscope/data-juicer;

· DonaldRR opened on Jul 9, 2025

什么时候data-juicer支持使用对象存储的数据集？

questionFurther information is requestedFurther information is requested

Status: Open.

#732 In modelscope/data-juicer;

· wangpi26 opened on Jul 9, 2025

为什么 RayExecutor 没有作为 API 服务暴露出来？

questionFurther information is requestedFurther information is requested

Status: Open.

#731 In modelscope/data-juicer;

· Young-zj opened on Jul 7, 2025

Data-juicer 1.0论文中，用的是哪个yaml文件跑的Redpajama的book3的数据集？

questionFurther information is requestedFurther information is requested

Status: Open.

#729 In modelscope/data-juicer;

· tuninger opened on Jul 4, 2025

多个算子要操作的数据域不一样如何设置？

questionFurther information is requestedFurther information is requested

Status: Open.

#728 In modelscope/data-juicer;

· edc3000 opened on Jul 4, 2025

FileNotFoundError: [Errno 2] No such file or directory: '/data-juicer/outputs/demo-process/log/export_demo-processed.jsonl_time_20250624035731_ERROR.txt'

questionFurther information is requestedFurther information is requested

Status: Open.

#718 In modelscope/data-juicer;

· Young-zj opened on Jun 24, 2025

dj 算子运行时有参数支持显示 CPU 数和内存么

enhancementNew feature or requestNew feature or request

Status: Open.

#716 In modelscope/data-juicer;

· xiedeyantu opened on Jun 24, 2025

[Bug]: 一个算子不能多次使用，只有最后一个生效，例如python_lambda_mapper

bugSomething isn't workingSomething isn't working

Status: Open.

#711 In modelscope/data-juicer;

· SWEENEYHE opened on Jun 19, 2025

使用demos中的例子时，碰到cfg有点问题

bugSomething isn't workingSomething isn't working

Status: Open.

#708 In modelscope/data-juicer;

· calledice opened on Jun 18, 2025