---
title: "Attention head dimension mathematical notation"
description: "Attention head dimension is a recurring research-paper notation family. Names the feature width assigned to each attention head's query, key, and often…"
canonical_url: "https://fanout.sh/labs/math-decoder/symbol/attention-head-dimension"
md_url: "https://fanout.sh/labs/math-decoder/symbol/attention-head-dimension.md"
last_updated: "2026-08-09"
access: "public"
---

# Attention head dimension mathematical notation

Attention head dimension is a recurring research-paper notation family. Names the feature width assigned to each attention head's query, key, and often…

## Public overview

Attention head dimension is a recurring research-paper notation family. Names the feature width assigned to each attention head's query, key, and often value vectors.

Attention head dimension: Names the feature width assigned to each attention head's query, key, and often value vectors. Example: Each token in each head carries d h query features.

---
This representation contains public Fanout content only. Protected Pro lessons, account data, billing, checkout, and pricing are not included.

Browse the public content map: https://fanout.sh/sitemap.md