Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于预训练pretrain_bert的问题 #2

Open
KyrieXDL opened this issue Feb 27, 2021 · 1 comment
Open

关于预训练pretrain_bert的问题 #2

KyrieXDL opened this issue Feb 27, 2021 · 1 comment

Comments

@KyrieXDL
Copy link

你好，我刚学在这个很多不是很懂，请问你这个预训练是从头开始训练吗？如果是想在bert已有的预训练模型基础再在自己的数据上进行训练，怎么做呢，初始权重直接用网上的预训练权重吗？
@MM-IR
Copy link
Owner

MM-IR commented Jun 14, 2021

您好，我这个是从头开始训练的。如果是已有的模型就是直接用网上的weights

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@KyrieXDL @MM-IR