UnboundLocalError: local variable 'batch_outputs' referenced before assignment

[Spartan859]

Epoch 150/150
42/42 [==============================] - 13s 321ms/step - loss: 5.8465e-05
Traceback (most recent call last):
File "/home/xuchun/.conda/envs/dannce/bin/com-train", line 33, in
sys.exit(load_entry_point('dannce', 'console_scripts', 'com-train')())
File "/home/xuchun/dannce/dannce/cli.py", line 42, in com_train_cli
com_train(params)
File "/home/xuchun/dannce/dannce/interface.py", line 661, in com_train
write_debug(trainData=False)
File "/home/xuchun/dannce/dannce/interface.py", line 624, in write_debug
label_out = model.predict(ims_valid, batch_size=1)
File "/home/xuchun/.conda/envs/dannce/lib/python3.7/site-packages/tensorflow/python/keras/engine/training.py", line 130, in _method_wrapper
return method(self, *args, **kwargs)
File "/home/xuchun/.conda/envs/dannce/lib/python3.7/site-packages/tensorflow/python/keras/engine/training.py", line 1614, in predict
all_outputs = nest.map_structure_up_to(batch_outputs, concat, outputs)
UnboundLocalError: local variable 'batch_outputs' referenced before assignment

When I finished training COM-finder, this happened.

How can I fix this?

[Spartan859]

By the way, this only happened when num_validation_per_exp is set to 0.
When I change it to 2, there is no errors.

[Spartan859]

However, the more validation samples you use, the fewer samples you can use for the actual training. We recommend using num_validation_per_exp: 0 unless you are using over 100 samples per animal.

According to this in ur wiki.

[Spartan859]

Maybe this is because of the debug: True in com_config?

[spoonsso]

Yes, sorry. It is trying to save the predictions on the validation images when debug: True, but your ims_valid was empty because num_validation_per_exp.

[SwathiSheshadri]

I ran into the same issue after running several epochs of dannce-train. Would setting debug: False in the config file be sufficient to resolve this?

[spoonsso]

Yes, set debug to False.

…

On Wed, Sep 15, 2021, 11:37 AM Swathi Sheshadri ***@***.***> wrote: I ran into the same issue after running several epochs of dannce-train. Would setting debug: False in the config file be sufficient to resolve this? — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#66 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAW2P47XTR4QSJWYJDYZOITUCC4SFANCNFSM5CNKEBMA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.