---
title: "Grouped-query attention mathematical notation"
description: "Grouped-query attention is a recurring research-paper notation family. Partitions query heads into groups whose members share one key and value head,…"
canonical_url: "https://fanout.sh/labs/math-decoder/symbol/grouped-query-attention"
md_url: "https://fanout.sh/labs/math-decoder/symbol/grouped-query-attention.md"
last_updated: "2026-08-09"
access: "public"
---

# Grouped-query attention mathematical notation

Grouped-query attention is a recurring research-paper notation family. Partitions query heads into groups whose members share one key and value head,…

## Public overview

Grouped-query attention is a recurring research-paper notation family. Partitions query heads into groups whose members share one key and value head, interpolating between multi-head and multi-query attention.

Grouped-query attention: Partitions query heads into groups whose members share one key and value head, interpolating between multi-head and multi-query attention. Example: Assign several query heads to each stored key-value head.

---
This representation contains public Fanout content only. Protected Pro lessons, account data, billing, checkout, and pricing are not included.

Browse the public content map: https://fanout.sh/sitemap.md