Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于指标 #35

Open
suchenyang2023 opened this issue Oct 16, 2024 · 1 comment
Open

关于指标 #35

suchenyang2023 opened this issue Oct 16, 2024 · 1 comment

Comments

@suchenyang2023
Copy link

你好，请问在bert模型上的指标是accuracy，在llama这种擅长生成的模型上的指标是什么了？ exact match rogue1 rogueL的平均吗？ 非常感谢
@qwpyyx
Copy link

qwpyyx commented Oct 17, 2024 •
edited
Loading

+1,比较好奇论文table2中的指标是什么的平均？同时想请问一下，假设我当前时按order1顺序训练，最后一个任务是dbpedia，训练完后我得到“predict_exact_match”以及“predict_exact_match_for_dbpedia”的分数，请问这两个有什么区别？谢谢
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@qwpyyx @suchenyang2023