class composer.datasets.StreamingADE20k(remote, local, split, shuffle, base_size=512, min_resize_scale=0.5, max_resize_scale=2.0, final_size=512, batch_size=None)[source]#

Implementation of the ADE20k dataset using StreamingDataset.

  • remote (str) โ€“ Remote directory (S3 or local filesystem) where dataset is stored.

  • local (str) โ€“ Local filesystem directory where dataset is cached during operation.

  • split (str) โ€“ The dataset split to use, either โ€˜trainโ€™ or โ€˜valโ€™.

  • shuffle (bool) โ€“ Whether to shuffle the samples in this dataset.

  • base_size (int) โ€“ initial size of the image and target before other augmentations. Default: 512.

  • min_resize_scale (float) โ€“ the minimum value the samples can be rescaled. Default: 0.5.

  • max_resize_scale (float) โ€“ the maximum value the samples can be rescaled. Default: 2.0.

  • final_size (int) โ€“ the final size of the image and target. Default: 512.

  • batch_size (Optional[int]) โ€“ Hint the batch_size that will be used on each deviceโ€™s DataLoader. Default: None.