composer.core.precision#
Enum class for the numerical precision to be used by the model.
Classes
Enum class for the numerical precision to be used by the model. |
- class composer.core.precision.Precision(value)[source]#
Bases:
composer.utils.string_enum.StringEnum
Enum class for the numerical precision to be used by the model.
- AMP#
Use
torch.cuda.amp
. Only compatible with GPUs.
- FP16#
Use 16-bit floating-point precision. Currently only compatible with GPUs on DeepSpeed.
- FP32#
Use 32-bit floating-point precision. Compatible with CPUs and GPUs.
- BF16#
Use 16-bit BFloat mixed precision. Requires PyTorch 1.10. Compatible with CPUs and GPUs.