Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

transformers & mindnlp.transformers加载推理生成的结果差异大 #1855

Open
Copilot-X opened this issue Dec 3, 2024 · 1 comment
Open
Labels
bug Something isn't working

Comments

@Copilot-X
Copy link

Describe the bug/ 问题描述 (Mandatory / 必填)
A clear and concise description of what the bug is.

  • Hardware Environment(Ascend/GPU/CPU) / 硬件环境:
    -显卡:GPU

  • Software Environment / 软件环境 (Mandatory / 必填):
    --mindnlp 0.4.1(代码编译)
    -- MindSpore version 2.4.0
    -- Python version 3.10.10
    -- OS platform and distribution Ubuntu 20.04
    -- GCC/Compiler version 9.4.0

加载mistral-v0.3-7b模型推理

8acf9716fe2512f298c853d4651a339
2a88b4975cef0f9aad4309f85f94f15

Expected behavior / 预期结果 (Mandatory / 必填)
transformers & mind.transformers方式生成的结果相近

Screenshots/ 日志 / 截图 (Mandatory / 必填)
image

Additional context / 备注 (Optional / 选填)
Add any other context about the problem here.

@Copilot-X Copilot-X added the bug Something isn't working label Dec 3, 2024
@qhzhuang
Copy link

能否给一下代码?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants