barrier#

composer.utils.dist.barrier(group=None)[source]#

Synchronizes all processes.

This function blocks until all processes reach this function.

Parameters

group (ProcessGroup, optional) โ€“ The process group to work on. If None, the default process group will be used. Default is None.