get_global_rank#
- composer.utils.dist.get_global_rank(group=None)[source]#
Returns the global rank of the current process in the input PG, which is on
[0; group.WORLD_SIZE - 1]
.- Parameters
group (ProcessGroup, optional) โ The process group. If
None
, it will return env_varRANK
- Returns
int โ The global rank in input process group.