Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Why the bias of config in train scripts doesn't aligning at infererence? #141

Open
870572761 opened this issue Oct 8, 2024 · 1 comment

Comments

@870572761
Copy link

When training, I found the bias doesn't align with the config.
This file is in the EAGLE3/eagle/train/main.py.
image
I think if do that, the result will produce the bias in "fc" layer due to following the default.
image
Maybe you should edit it because I find the model_state_dict of your official model doesn't have the fc.bias.

@870572761
Copy link
Author

image I raise this question because I find Model follow this json.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant