build_synthetic_imagenet_dataloader#

composer.datasets.build_synthetic_imagenet_dataloader(global_batch_size, num_unique_samples=100, device='cpu', memory_format=MemoryFormat.CONTIGUOUS_FORMAT, is_train=True, crop_size=224, drop_last=True, shuffle=True, **dataloader_kwargs)[source]#

Builds a synthetic ImageNet dataloader.

Parameters

  • global_batch_size (int) โ€“ Global batch size.

  • num_unique_samples (int) โ€“ number of unique samples in synthetic dataset. Default: 100.

  • device (str) โ€“ device with which to load the dataset. Default: cpu.

  • memory_format (composer.core.MemoryFormat) โ€“ memory format of the tensors. Default: CONTIGUOUS_FORMAT.

  • is_train (bool) โ€“ Whether to load the training data or validation data. Default: True.

  • size (crop) โ€“ The crop size to use. Default: 224.

  • drop_last (bool) โ€“ whether to drop last samples. Default: True.

  • shuffle (bool) โ€“ whether to shuffle the dataset. Default: True.

  • **dataloader_kwargs (Dict[str, Any]) โ€“ Additional settings for the dataloader (e.g. num_workers, etc.)