---
title: "Dot Products, Softmax & Attention Math"
description: "Build the attention formula by hand from three moves: score pairs of vectors with dot products, turn scores into weights with softmax, then sum."
canonical_url: "https://fanout.sh/inference-eng/curriculum/00-03"
md_url: "https://fanout.sh/inference-eng/curriculum/00-03.md"
access: "public"
---

# Dot Products, Softmax & Attention Math

Build the attention formula by hand from three moves: score pairs of vectors with dot products, turn scores into weights with softmax, then sum.

---
This representation contains public Fanout content only. Protected Pro lessons, account data, billing, checkout, and pricing are not included.

Browse the public content map: https://fanout.sh/sitemap.md