Key projection mathematical notation
Key projection is a recurring research-paper notation family. Projects token representations into key vectors against which queries are compared to form attention scores.
Key projection: Projects token representations into key vectors against which queries are compared to form attention scores. Example: Transform every token representation into key vectors used for matching.