ExponentialScheduler

class composer.optim.ExponentialScheduler(gamma, decay_period='1ep')

Decays the learning rate exponentially.

See also

This scheduler is based on ExponentialLR from PyTorch.

Exponentially decays the learning rate such that it decays by a factor of gamma every decay_period time.

Specifically, the learning rate multiplier $\alpha$ can be expressed as:

$$\alpha(t) = \gamma ^ {t / \rho}$$

Where $\rho$ represents the decay period, and $\gamma$ represents the multiplicative decay factor.

Parameters

• decay_period (str | Time) – Decay period. Default = "1ep".

• gamma (float) – Multiplicative decay factor.