Transformer feed-forward network mathematical notation

Transformer feed-forward network is a recurring research-paper notation family. Applies learned feature expansion, nonlinear activation, and feature projection independently at each token position.

Transformer feed-forward network: Applies learned feature expansion, nonlinear activation, and feature projection independently at each token position. Example: Expand each token's features, transform them nonlinearly, then project back.