---
title: "Multi-head concatenation mathematical notation"
description: "Multi-head concatenation is a recurring research-paper notation family. Joins independently computed attention-head features along their feature axis…"
canonical_url: "https://fanout.sh/labs/math-decoder/symbol/multi-head-concatenation"
md_url: "https://fanout.sh/labs/math-decoder/symbol/multi-head-concatenation.md"
last_updated: "2026-08-09"
access: "public"
---

# Multi-head concatenation mathematical notation

Multi-head concatenation is a recurring research-paper notation family. Joins independently computed attention-head features along their feature axis…

## Public overview

Multi-head concatenation is a recurring research-paper notation family. Joins independently computed attention-head features along their feature axis before an output projection.

Multi-head concatenation: Joins independently computed attention-head features along their feature axis before an output projection. Example: Place every head's features side by side and mix them with W O.

---
This representation contains public Fanout content only. Protected Pro lessons, account data, billing, checkout, and pricing are not included.

Browse the public content map: https://fanout.sh/sitemap.md