Multiple GPU device

[vahidAK]

Hi @marcus1487 ,

I was wondering is it possible to specify multiple GPU devices for Remora during training? like --device 0 1 2

Thanks,
Vahid

[marcus1487]

This is not currently possible, but would likely not be too large a change to the code as it is simply using the pytorch backend. This is not a huge priority internally though as the models generally train very quickly (on the order to an hour or 2 a the most).

[vahidAK]

Thanks a lot @marcus1487