Attention mask mathematical notation

Attention mask is a recurring research-paper notation family. Marks query-key pairs that attention may use, often by adding zero to allowed scores and negative infinity to blocked scores.

Attention mask: Marks query-key pairs that attention may use, often by adding zero to allowed scores and negative infinity to blocked scores. Example: Blocked score positions receive effectively zero probability after softmax.