New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

encoder中出现nan问题 #94

Open

lxiaohaung opened this issue Oct 12, 2024 · 0 comments

lxiaohaung commented Oct 12, 2024

在预训练的时候，我在过transformer的encoder的时候,output 会出现nan，我看您的代码里也曾经检查过这个问题，想问问是怎么解决的

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment