Contents Menu Expand Light mode Dark mode Auto light/dark mode
Composer
Light Logo Dark Logo
Star

Getting Started

  • ๐Ÿ’พ Installation
  • ๐Ÿš€ Quick Start
  • ๐Ÿ““ Notebooks
  • ๐ŸšŒ Welcome Tour

Adding Speedup Methods

  • ๐Ÿค– Algorithms
  • ฦ’() Functional

Trainer

  • โš™๏ธ Using the Trainer
  • ๐Ÿ›ป ComposerModel
  • ๐Ÿ’ฟ DataLoaders
  • ๐Ÿ“Š Evaluation
  • ๐Ÿ“‰ Schedulers
  • โŒ› Time
  • ๐Ÿ“† Events
  • โœ… Checkpointing
  • ๐Ÿชต Logging
  • โ˜Ž๏ธ Callbacks
  • ๐Ÿ‘จโ€๐Ÿ‘ฉโ€๐Ÿ‘งโ€๐Ÿ‘ฆ Distributed Training
  • ๐Ÿ”ข Numerics
  • ๐ŸŽ๏ธ Performance
    • โฑ๏ธ Performance Profiling
    • ๐Ÿฅฝ Analyzing Traces

Methods Library

  • ๐Ÿƒ Methods Overview
  • ๐Ÿฅธ ALiBi
  • ๐ŸŽจ AugMix
  • ๐ŸŠ BlurPool
  • ๐Ÿ“บ Channels Last
  • ๐Ÿ›๏ธ ColOut
  • โœ‚๏ธ CutMix
  • ๐ŸŽƒ Cutout
  • โž— Factorize
  • ๐Ÿ‘ป Ghost BatchNorm
  • ๐Ÿงˆ Label Smoothing
  • โ„๏ธ Layer Freezing
  • ๐Ÿฅฃ MixUp
  • ๐Ÿž๏ธ Progressive Image Resizing
  • ๐ŸŽฒ RandAugment
  • ๐Ÿ”๏ธ Sharpness Aware Minimization (SAM)
  • ๐Ÿ—œ๏ธ Scale Schedule
  • โฎ๏ธ Selective Backprop
  • ๐Ÿ”† Sequence Length Warmup
  • ๐Ÿซ€ Squeeze-and-Excitation
  • ๐ŸงŠ Stochastic Depth (Block)
  • ๐ŸŽฐ Stochastic Depth (Sample)
  • ๐Ÿงฉ Stochastic Weight Averaging

Model Library

  • ๐Ÿ‘€ CIFAR ResNet
  • ๐Ÿ•ธ๏ธ EfficientNet
  • ๐Ÿ“š GPT-2
  • ๐Ÿ™๏ธ ResNet
  • โ†ฉ๏ธ UNet

API Reference

  • ๐ŸŽฑ API Reference
    • composer.algorithms
      • composer.algorithms.algorithm_hparams
      • composer.algorithms.algorithm_registry
      • composer.algorithms.alibi
        • composer.algorithms.alibi.alibi
      • composer.algorithms.augmix
        • composer.algorithms.augmix.augmix
      • composer.algorithms.blurpool
        • composer.algorithms.blurpool.blurpool
        • composer.algorithms.blurpool.blurpool_layers
      • composer.algorithms.channels_last
        • composer.algorithms.channels_last.channels_last
      • composer.algorithms.colout
        • composer.algorithms.colout.colout
      • composer.algorithms.cutmix
        • composer.algorithms.cutmix.cutmix
      • composer.algorithms.cutout
        • composer.algorithms.cutout.cutout
      • composer.algorithms.factorize
        • composer.algorithms.factorize.factorize
        • composer.algorithms.factorize.factorize_core
        • composer.algorithms.factorize.factorize_modules
      • composer.algorithms.ghost_batchnorm
        • composer.algorithms.ghost_batchnorm.ghost_batchnorm
      • composer.algorithms.hparams
      • composer.algorithms.label_smoothing
        • composer.algorithms.label_smoothing.label_smoothing
      • composer.algorithms.layer_freezing
        • composer.algorithms.layer_freezing.layer_freezing
      • composer.algorithms.mixup
        • composer.algorithms.mixup.mixup
      • composer.algorithms.no_op_model
        • composer.algorithms.no_op_model.no_op_model
      • composer.algorithms.progressive_resizing
        • composer.algorithms.progressive_resizing.progressive_resizing
      • composer.algorithms.randaugment
        • composer.algorithms.randaugment.randaugment
      • composer.algorithms.sam
        • composer.algorithms.sam.sam
      • composer.algorithms.scale_schedule
        • composer.algorithms.scale_schedule.scale_schedule
      • composer.algorithms.selective_backprop
        • composer.algorithms.selective_backprop.selective_backprop
      • composer.algorithms.seq_length_warmup
        • composer.algorithms.seq_length_warmup.seq_length_warmup
      • composer.algorithms.squeeze_excite
        • composer.algorithms.squeeze_excite.squeeze_excite
      • composer.algorithms.stochastic_depth
        • composer.algorithms.stochastic_depth.sample_stochastic_layers
        • composer.algorithms.stochastic_depth.stochastic_depth
        • composer.algorithms.stochastic_depth.stochastic_layers
      • composer.algorithms.swa
        • composer.algorithms.swa.swa
      • composer.algorithms.utils
        • composer.algorithms.utils.augmentation_common
        • composer.algorithms.utils.augmentation_primitives
      • composer.algorithms.warnings
    • composer.callbacks
      • composer.callbacks.callback_hparams
      • composer.callbacks.checkpoint_saver
      • composer.callbacks.grad_monitor
      • composer.callbacks.lr_monitor
      • composer.callbacks.memory_monitor
      • composer.callbacks.speed_monitor
    • composer.core
      • composer.core.algorithm
      • composer.core.callback
      • composer.core.data_spec
      • composer.core.engine
      • composer.core.evaluator
      • composer.core.event
      • composer.core.precision
      • composer.core.serializable
      • composer.core.state
      • composer.core.time
      • composer.core.types
    • composer.datasets
      • composer.datasets.ade20k
      • composer.datasets.brats
      • composer.datasets.c4
      • composer.datasets.cifar
      • composer.datasets.coco
      • composer.datasets.dataloader
      • composer.datasets.dataset_registry
      • composer.datasets.evaluator
      • composer.datasets.ffcv_utils
      • composer.datasets.glue
      • composer.datasets.hparams
      • composer.datasets.imagenet
      • composer.datasets.lm_datasets
      • composer.datasets.mnist
      • composer.datasets.synthetic
      • composer.datasets.synthetic_lm
      • composer.datasets.utils
      • composer.datasets.webdataset_utils
    • composer.functional
    • composer.loggers
      • composer.loggers.file_logger
      • composer.loggers.in_memory_logger
      • composer.loggers.logger
      • composer.loggers.logger_destination
      • composer.loggers.logger_hparams
      • composer.loggers.object_store_logger
      • composer.loggers.progress_bar_logger
      • composer.loggers.wandb_logger
    • composer.models
      • composer.models.base
      • composer.models.bert
        • composer.models.bert.bert_hparams
        • composer.models.bert.model
      • composer.models.classify_mnist
        • composer.models.classify_mnist.mnist_hparams
        • composer.models.classify_mnist.model
      • composer.models.deeplabv3
        • composer.models.deeplabv3.deeplabv3
        • composer.models.deeplabv3.deeplabv3_hparams
      • composer.models.efficientnetb0
        • composer.models.efficientnetb0.efficientnetb0_hparams
        • composer.models.efficientnetb0.efficientnets
        • composer.models.efficientnetb0.model
      • composer.models.gpt2
        • composer.models.gpt2.gpt2_hparams
        • composer.models.gpt2.model
      • composer.models.initializers
      • composer.models.model_hparams
      • composer.models.resnet
        • composer.models.resnet.model
        • composer.models.resnet.resnet_hparams
      • composer.models.resnet_cifar
        • composer.models.resnet_cifar.model
        • composer.models.resnet_cifar.resnet_cifar_hparams
        • composer.models.resnet_cifar.resnets
      • composer.models.ssd
        • composer.models.ssd.base_model
        • composer.models.ssd.ssd
        • composer.models.ssd.ssd300
        • composer.models.ssd.ssd_hparams
        • composer.models.ssd.utils
      • composer.models.tasks
        • composer.models.tasks.classification
      • composer.models.timm
        • composer.models.timm.model
        • composer.models.timm.timm_hparams
      • composer.models.transformer_hparams
      • composer.models.transformer_shared
      • composer.models.unet
        • composer.models.unet.model
        • composer.models.unet.unet
        • composer.models.unet.unet_hparams
      • composer.models.vit_small_patch16
        • composer.models.vit_small_patch16.hparams
        • composer.models.vit_small_patch16.model
    • composer.optim
      • composer.optim.decoupled_weight_decay
      • composer.optim.optimizer_hparams
      • composer.optim.scheduler
      • composer.optim.scheduler_hparams
    • composer.profiler
      • composer.profiler.dataloader_profiler
      • composer.profiler.json_trace_handler
      • composer.profiler.json_trace_merger
      • composer.profiler.marker
      • composer.profiler.profiler
      • composer.profiler.profiler_action
      • composer.profiler.profiler_hparams
      • composer.profiler.profiler_schedule
      • composer.profiler.system_profiler
      • composer.profiler.torch_profiler
      • composer.profiler.trace_handler
    • composer.trainer
      • composer.trainer.ddp
      • composer.trainer.devices
        • composer.trainer.devices.device
        • composer.trainer.devices.device_cpu
        • composer.trainer.devices.device_gpu
        • composer.trainer.devices.device_hparams
      • composer.trainer.trainer
      • composer.trainer.trainer_hparams
    • composer.utils
      • composer.utils.checkpoint
      • composer.utils.dist
      • composer.utils.file_helpers
      • composer.utils.import_helpers
      • composer.utils.iter_helpers
      • composer.utils.module_surgery
      • composer.utils.object_store
      • composer.utils.reproducibility
      • composer.utils.string_enum
Back to top

composer.trainer.devices.device_cpu#

The CPU device used for training.

Classes

DeviceCPU

An extension of Device for CPUs.
class composer.trainer.devices.device_cpu.DeviceCPU[source]#

Bases: composer.trainer.devices.device.Device

An extension of Device for CPUs.

This class takes no arguments.

Next
composer.trainer.devices.device_gpu
Previous
composer.trainer.devices.device
Copyright © 2022, MosaicML, Inc.
Made with Sphinx and @pradyunsg's Furo