Causal attention mask mathematical notation

Causal attention mask is a recurring research-paper notation family. Prevents a token position from attending to future positions so autoregressive predictions cannot use unavailable information.

Causal attention mask: Prevents a token position from attending to future positions so autoregressive predictions cannot use unavailable information. Example: Future-token scores vanish after softmax.