ParallelismType

class composer.utils.ParallelismType(value)

Enum class for different parallelism types in the device mesh.

DATA_PARALLEL_SHARD

Data parallel shard dimension.

DATA_PARALLEL_REPLICATE

Data parallel replicate dimension.

TENSOR_PARALLEL

Tensor parallel dimension.