Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NQ-Tables test set evaluation #39

Open
yhifny opened this issue Mar 16, 2023 · 2 comments
Open

NQ-Tables test set evaluation #39

yhifny opened this issue Mar 16, 2023 · 2 comments

Comments

@yhifny
Copy link

yhifny commented Mar 16, 2023

Hi,

What is the best SKG-trained model to evaluate the natural questions tables (NQ-Tables) test set? Is it "from_all_T5_large_prefix_wikitq2"?

Thanks,

Yasser

@Timothyxxx
Copy link
Member

Hi, sorry for the delay, I guess yes, the from_all_T5_large_prefix_wikitq2 is trained on all SKG tasks data and further trained on the wikitablequestions dataset, but if you can further train it if you have more data

@Timothyxxx
Copy link
Member

For now, I think it is better to use bigger model, the study was done a few years ago, there are lots of better models for you to choose now, also optimized for structured knowledge grounding tasks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants