Positional encoding mathematical notation

Positional encoding is a recurring research-paper notation family. Maps a token position to features that let an otherwise permutation-insensitive attention stack represent order.

Positional encoding: Maps a token position to features that let an otherwise permutation-insensitive attention stack represent order. Example: Add information about what the token is and where it occurs.