Sliding-window attention mathematical notation

Sliding-window attention is a recurring research-paper notation family. Restricts each query to key positions within a bounded local window to reduce attention work and cache access.

Sliding-window attention: Restricts each query to key positions within a bounded local window to reduce attention work and cache access. Example: Each token sees only nearby token positions.