Activation memory mathematical notation

Activation memory is a recurring research-paper notation family. Counts storage for intermediate tensors produced by forward computation and sometimes retained for backward differentiation.

Activation memory: Counts storage for intermediate tensors produced by forward computation and sometimes retained for backward differentiation. Example: Larger batches, contexts, depth, or hidden size increase stored intermediates.