Attention head dimension mathematical notation

Attention head dimension is a recurring research-paper notation family. Names the feature width assigned to each attention head's query, key, and often value vectors.

Attention head dimension: Names the feature width assigned to each attention head's query, key, and often value vectors. Example: Each token in each head carries d h query features.