You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello, I want to load the training_arg.bin of zephyr-7b-beta and pass it to DPOTrainer of trl to compute the implicit rewards and logps conveniently, but it seems lack some private modules.
Hello, I want to load the
training_arg.bin
of zephyr-7b-beta and pass it toDPOTrainer
oftrl
to compute the implicit rewards and logps conveniently, but it seems lack some private modules.ModuleNotFoundError: No module named 'h4'
The text was updated successfully, but these errors were encountered: