New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

想调用未内置的模型的请进 #72

Open

Tongjilibo opened this issue Nov 18, 2022 · 0 comments

Owner

Tongjilibo commented Nov 18, 2022

首先感谢并且欢迎给出宝贵建议的大佬们~，有的issue是关于想用的预训练模型没有内置，解释如下

原因：有的模型的影响力没有那么大，个人开发精力有限，只能先维护好常用模型
建议方案：bert4torch是支持加载transformers的模型的，此时bert4torch只是相当于一个trainer，具体的网络结构还是在transformers中，但是训练过程和callback的调用和原来一致，使用教程如下tutorials_load_transformers_model.py
完美方案：可以尝试自己用bert4torch实现，然后提pull request成为contributor，一起为社区做贡献

Tongjilibo pinned this issue

Tongjilibo unpinned this issue

Tongjilibo pinned this issue

Tongjilibo unpinned this issue

Tongjilibo pinned this issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment