Skip to content

Issues: huawei-noah/Pretrained-Language-Model

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

98 Open 103 Closed
98 Open 103 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

When will the source code of bert2BERT be released?
#247 opened Feb 26, 2024 by vibhamasti
Is the TinyBERT_General_4L_312D published on huggingface pure English LM or En-CN-Mixed LM?
#246 opened Jan 23, 2024 by JohnHerry
运行WuKong的官方测试代码
#242 opened Dec 6, 2023 by sore-2001
请教一下大家，4层tinybert和6层tinybert加载到显存中，占用了多大的显存
#241 opened Nov 21, 2023 by louiss007
你好，请问能否分享一下pytorch版nezha的NEZHA-Base-WWM/model.ckpt文件，谢谢
#240 opened Sep 5, 2023 by 258508
TernaryBERT如何实现模型size降低的
#238 opened May 16, 2023 by saggitarxm
复现TinyBERT需要pre-train的wiki语料，另是否开源tinybert-cased模型
#237 opened May 11, 2023 by hppy139
How does BinaryBERT store the 1 bit weight?
#236 opened May 8, 2023 by jzhang38
TinyBERT实验到底用哪个enwiki-latest-pages-articles数据集？
#230 opened Dec 11, 2022 by ra225
tinybert 在mnli任务不能复现
#229 opened Dec 10, 2022 by iMountTai
4
使用nezha_base_www模型，得到的嵌入向量为nan
#227 opened Dec 7, 2022 by yixiu00001
wmt数据下载
#226 opened Nov 29, 2022 by 0-KaiKai-0
1
TinyBERT's Google resource 404
#223 opened Nov 15, 2022 by xxysocute
3
想问下tinybert Task-specific Distillation第一步中间层蒸馏的评价指标
#222 opened Nov 11, 2022 by wsh2836741
2
CeMAT预训练模型下载?
#221 opened Nov 2, 2022 by Vincent131499
3
For BinaryBERT, what is the value of config.dyna_hidden_size?
#220 opened Oct 31, 2022 by Phuoc-Hoan-Le
2
For BinaryBERT, Is 2 epochs used to fine tune both the ternary BERT and binary BERT with data augmentation?
#219 opened Oct 31, 2022 by Phuoc-Hoan-Le
关于filip的训练中损失降低的问题？
#217 opened Oct 8, 2022 by Soulscb
wukong-为什么以ILSVRC作为验证集，模型不是在中文数据集上的训练的吗？
#215 opened Sep 29, 2022 by ghost
1
请问nezha的pytorch模型在哪里下载呢
#212 opened Sep 6, 2022 by zyx214
when the code of "bert2BERT" can be released?
#211 opened Sep 4, 2022 by leoozy
关于悟空大模型
#210 opened Sep 2, 2022 by Soulscb
1
询问AutoTinyBert的数据集
#209 opened Sep 2, 2022 by AlchemistZoro
请问bert2BERT什么时候能公开代码呢？
#208 opened Aug 25, 2022 by iscshuai
tinybert linear transformation sharing
#205 opened Aug 5, 2022 by sh0416
ProTip! no:milestone will show everything without a milestone.