Broadcasting mathematical notation
Broadcasting is a recurring research-paper notation family. Aligns trailing axes and conceptually expands size-one dimensions so elementwise operations can combine differently shaped tensors.
Broadcasting: Aligns trailing axes and conceptually expands size-one dimensions so elementwise operations can combine differently shaped tensors. Example: Add the same feature vector to every batch item and token.