streaming.base.shuffle#

Shuffle epochs of samples from different shards across worker partitions.

Functions

get_shuffle

Get the shuffled global ordering of samples for an epoch.

get_shuffle_naive

Get the shuffled global ordering of samples for an epoch.

get_shuffle_py1b

Get the shuffled global ordering of samples for an epoch.

get_shuffle_py1br

Get the shuffled global ordering of samples for an epoch.

get_shuffle_py1e

Get the shuffled global ordering of samples for an epoch.

get_shuffle_py1s

Get the shuffled global ordering of samples for an epoch.

get_shuffle_py2s

Get the shuffled global ordering of samples for an epoch.

Classes

NDArray

alias of numpy.ndarray[Any, numpy.dtype[numpy._typing._array_like._ScalarType_co]]