RoPE relative-position identity mathematical notation
RoPE relative-position identity is a recurring research-paper notation family. Shows that the dot product of separately rotated queries and keys depends on their position difference through a relative rotation.
RoPE relative-position identity: Shows that the dot product of separately rotated queries and keys depends on their position difference through a relative rotation. Example: Absolute rotations combine into a score determined by relative distance.