Attention score matrix mathematical notation

Attention score matrix is a recurring research-paper notation family. Contains every query-key dot product before scaling, masking, and normalization.

Attention score matrix: Contains every query-key dot product before scaling, masking, and normalization. Example: Entry i j measures how strongly query position i matches key position j.