---
title: "Key-value head count mathematical notation"
description: "Key-value head count is a recurring research-paper notation family. Counts independently stored key and value heads per layer, which may be smaller than…"
canonical_url: "https://fanout.sh/labs/math-decoder/symbol/kv-cache-head-count"
md_url: "https://fanout.sh/labs/math-decoder/symbol/kv-cache-head-count.md"
last_updated: "2026-08-09"
access: "public"
---

# Key-value head count mathematical notation

Key-value head count is a recurring research-paper notation family. Counts independently stored key and value heads per layer, which may be smaller than…

## Public overview

Key-value head count is a recurring research-paper notation family. Counts independently stored key and value heads per layer, which may be smaller than the number of query heads in grouped-query attention.

Key-value head count: Counts independently stored key and value heads per layer, which may be smaller than the number of query heads in grouped-query attention. Example: Each active sequence stores one key vector per KV head and token.

---
This representation contains public Fanout content only. Protected Pro lessons, account data, billing, checkout, and pricing are not included.

Browse the public content map: https://fanout.sh/sitemap.md