Momentum estimate mathematical notation

Momentum estimate is a recurring research-paper notation family. Smooths noisy gradients by combining the previous moving average with the current gradient using a decay coefficient.

Momentum estimate: Smooths noisy gradients by combining the previous moving average with the current gradient using a decay coefficient. Example: Blend past direction with the current gradient.