Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to discover new intents? #3

Open
Ritali opened this issue Apr 14, 2020 · 1 comment
Open

How to discover new intents? #3

Ritali opened this issue Apr 14, 2020 · 1 comment

Comments

@Ritali
Copy link

Ritali commented Apr 14, 2020

What the meaning of ”discover new intents“?
"we set BookRestaurant and SearchCreativeWork as unknown in training set. Our method is still able to find out these intents."
As shown in the paper, the two unknown intents also need to know their label name? If there is a query with intent which is totally different from any known and unknown intents in the training data, which the predicted intent will be? It will be one in the training data?

@HanleiZhang
Copy link
Member

Q1) In this work, discovering new intents means finding new categories rather than new labels. It is because we do not know the true label of new intents in real-world scenarios. However, it is also valuable to discover new group of samples with the same intent, which is helpful to save time and human-labour to anotate the new label.
We hope to use known intent labeled data for learning pair-wise similarities and transfer the knowledge to group the unlabeled known and new intents. We only use the true labels for evaluating the performance of the clustering during testing.

Q2) Each query will be assigned to its corresponding cluster by learning pair-wise similarities. We mainly focus on the meaningful intents with a group of samples, so a single anomalous sample does not matter.

Hope this answer is helpful to you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants