Search results

请问当模型在一个GPU上放不下时，如何使用zero3？

bugSomething isn't workingSomething isn't working

Status: Open.

#478 In shibing624/MedicalGPT;

· yongwwww opened on Jan 26, 2026

老师您好，请问ppo和grpo训练代码中为什么没有显式设置padding_side='left'？请问不加这个会影响模型训练效果吗？

Status: Open.

#475 In shibing624/MedicalGPT;

· clementine-ing opened on Dec 28, 2025

老师您好，grpo-qlora训练时报错RuntimeError: expected scalar type Float but found BFloat16

bugSomething isn't workingSomething isn't working

Status: Open.

#474 In shibing624/MedicalGPT;

· clementine-ing opened on Dec 24, 2025

老师您好，请教一下做SFT和RLHF时数据量大小一般如何选择？另外通用与垂域知识的配比一般是多少呢？

questionFurther information is requestedFurther information is requested

Status: Open.

#473 In shibing624/MedicalGPT;

· yanho824 opened on Nov 4, 2025

推理时tokenizer.chat_template未指定

bugSomething isn't workingSomething isn't working

Status: Open.

#471 In shibing624/MedicalGPT;

· Telogen opened on Sep 2, 2025

老师您好，请问对一个可以输出思维链的模型，在进行增量预训练的时候，需要考虑模型的思维链的部分吗？是让模型不输出<think>..</think>部分，还是不用考虑模型输不输出思维链直接做增量训练？

questionFurther information is requestedFurther information is requested

Status: Open.

#468 In shibing624/MedicalGPT;

· GEHAH opened on Aug 13, 2025

grpo量化配置两个分支怎么一样呢

bugSomething isn't workingSomething isn't working

Status: Open.

#467 In shibing624/MedicalGPT;

· cqray1990 opened on Aug 2, 2025

老师您好，想请教您个问题。就是给大模型灌输垂直领域的知识，采用PT的效果好还是sft的效果好呀。数据量大约只有1.5GB的量。

questionFurther information is requestedFurther information is requested

Status: Open.

#466 In shibing624/MedicalGPT;

· mingzhang798 opened on Jul 28, 2025

训练时如何保证较好的效果

questionFurther information is requestedFurther information is requested

Status: Open.

#465 In shibing624/MedicalGPT;

· zty-king opened on Jul 6, 2025

老师您好，请问本项目是否支持多机多卡的分布式训练，是否有SFT的多机多卡Demo

questionFurther information is requestedFurther information is requested

Status: Open.

#462 In shibing624/MedicalGPT;

· luckyzcw opened on May 13, 2025

您好，对Deepseek-R1进行增量预训练，输出重复，而且也不思考了

questionFurther information is requestedFurther information is requested

Status: Open.

#461 In shibing624/MedicalGPT;

· GEHAH opened on Apr 28, 2025

dpo 的continue pretrain用使用的是中文天龙八部小说部分文本和英文书籍部分文本 ，这对医疗没作用吧?

bugSomething isn't workingSomething isn't working

Status: Open.

#460 In shibing624/MedicalGPT;

· cqray1990 opened on Apr 24, 2025