---
title: "Trace the Transformer Forward Pass"
description: "Follow one generation step through a transformer at tensor level: from text to token IDs, through the stack of blocks, to the logits for the next token."
canonical_url: "https://fanout.sh/inference-eng/curriculum/02-01"
md_url: "https://fanout.sh/inference-eng/curriculum/02-01.md"
access: "public"
---

# Trace the Transformer Forward Pass

Follow one generation step through a transformer at tensor level: from text to token IDs, through the stack of blocks, to the logits for the next token.

---
This representation contains public Fanout content only. Protected Pro lessons, account data, billing, checkout, and pricing are not included.

Browse the public content map: https://fanout.sh/sitemap.md