Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Strange and chaotic results on LRS2 #25

Open
wcycqjy opened this issue Jul 24, 2024 · 0 comments
Open

Strange and chaotic results on LRS2 #25

wcycqjy opened this issue Jul 24, 2024 · 0 comments

Comments

@wcycqjy
Copy link

wcycqjy commented Jul 24, 2024

Hello. I trained on LRS2 by following the recipe of auto_avsr and using the pretrained LRS3 AVSR model avsr_trlrwlrs2lrs3vox2avsp_base.pth. The LRS2 dataset is processed by following your instructions. But the results is strange:WER is above 1. Even if I use avsr_trlrwlrs2lrs3vox2avsp_base.pth, the WER is still above 1. And the predicted sentence is not correct, like the truth is "And for me the surprise was", but the predicted one is "It's time for the final round which".

Do you have any idea about this? Thank you in advance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant