| Interface | Description |
|---|---|
| LearningRate |
Provides an interface for different methods of learning rate decay schedules.
|
| Class | Description |
|---|---|
| ConstantLR |
A class for specifying a constant learning rate that never changes.
|
| ExponentialDecayLR |
This class provides a learning rate that decays exponentially with time according to r^t, where r is in [0,1] and t is the time step, from an initial
learning rate.
|
| SoftTimeInverseDecayLR |
Implements a learning rate decay schedule where the learning rate at time t is alpha_0 * (n_0 + 1) / (n_0 + t), where alpha_0 is the initial learning rate and n_0 is a parameter.
|