---
title: "Pipeline Parallelism"
description: "Split a model between layers instead of within them: what each stage holds, what crosses the boundary, one request through two stages, filling the pipe."
canonical_url: "https://fanout.sh/inference-eng/curriculum/18-06"
md_url: "https://fanout.sh/inference-eng/curriculum/18-06.md"
access: "pro-preview"
---

# Pipeline Parallelism

Split a model between layers instead of within them: what each stage holds, what crosses the boundary, one request through two stages, filling the pipe.

- Access: Fanout Pro (public preview)

## Public preview

Between layer 15 and layer 16 of the course model, one pair of tensors leaves and nothing else does. Give that boundary to a cable and the model runs on two devices, each holding whole layers, with far fewer bytes crossing per step than the within-layer division in the tensor parallelism lesson needed. What the cable costs is order: the…

## In this lesson

- The partition rule
- What each stage holds
- What crosses the boundary
- One request through two stages
- Filling the pipe

## Continue learning

Pro unlocks the complete lesson, video, practice, and code where available.

---
This representation contains public Fanout content only. Protected Pro lessons, account data, billing, checkout, and pricing are not included.

Browse the public content map: https://fanout.sh/sitemap.md