Alpha learning rate mathematical notation

Alpha learning rate is a recurring research-paper notation family. Commonly denotes the positive base step size in Adam and other optimization algorithms before adaptive coordinate scaling.

Alpha learning rate: Commonly denotes the positive base step size in Adam and other optimization algorithms before adaptive coordinate scaling. Example: Alpha controls the overall size of Adam's parameter movement.