Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cSOM collapses weight with certain training length values #27

Open
LuisSanchez25 opened this issue Aug 28, 2024 · 0 comments
Open

cSOM collapses weight with certain training length values #27

LuisSanchez25 opened this issue Aug 28, 2024 · 0 comments

Comments

@LuisSanchez25
Copy link
Collaborator

This is a MAJOR issue and should be fixed ASAP

As previously mentioned, wither certain values of learning rate, at least for the 4 gaussian clusters example, some of the weights in the cSOM seem to all collapse into one point for unknown reasons. Example:

image

As you can see a few weights seem to all be pointing to the same point. When we zoom in we see the points are slightly different from each other but this configuration still does not make sense as these points are too attracted to each other and this seems to happen along the course of the training for certain n_iter value, in particular, a similar issue seems to happen for values: 10000, 20000, 30000, 40000, 50000 however this issue did NOT happen for values: 35000, 35001, 25001, etc... This bug is a complete mystery to me but should be addressed ASAP. I suspect is something deep underlying random numbers but I cant be too sure.
image

This could be the result of the learning parameters but that would not explain why certain values of n_iter cause this issue and others do not.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant