StepScheduler

class composer.optim.StepScheduler(step_size, gamma=0.1)

Decays the learning rate discretely at fixed intervals.

See also

This scheduler is based on StepLR from PyTorch.

Decays the learning rate by a factor of gamma periodically, with a frequency determined by step_size.

Specifically, the learning rate multiplier $\alpha$ can be expressed as:

$$\alpha(t) = \gamma ^ {\text{floor}(t / \rho)}$$

Where $\rho$ represents the time between changes to the learning rate (the step size), and $\gamma$ represents the multiplicative decay factor.

Parameters

• step_size (str | Time) – Time between changes to the learning rate.

• gamma (float) – Multiplicative decay factor. Default = 0.1.