Provide API to query if jax.distributed
has been initialised
#26009
Labels
enhancement
New feature or request
jax.distributed
has been initialised
#26009
It would be useful for library authors to be able to query whether the distributed runtime has been initialised.
I think that right now, a workaround is to check for example whether the length of global devices does not match the local devices, but would be of course better to have something like
jax.distributed.is_initialised
or something like that.The text was updated successfully, but these errors were encountered: