- class streaming.base.world.World#
Information about the nodes, ranks and workers of this run.
Be careful as to whether this object was initialized in a worker (if workers are used) or in a rank (which will claim one worker per rank).
In this World object, the counts (num_nodes, num_ranks, num_workers) are global – not to be confused with DataLoader num_workers, which is per rank.
Nodes are all assumed to contain the same number of devices (via local_world_size).
node / num_nodes
rank / num_ranks
rank_of_node / ranks_per_node
worker / num_workers
worker_of_node / workers_per_node
worker_of_rank / workers_per_rank