---
title: "Vectors, Matrices & Tensor Shapes"
description: "How to read the tensor shapes inside an LLM such as Llama 3.1 8B: parameters and activations, the cost of a matrix multiply, and fixing shape errors."
canonical_url: "https://fanout.sh/inference-eng/curriculum/00-02"
md_url: "https://fanout.sh/inference-eng/curriculum/00-02.md"
access: "public"
---

# Vectors, Matrices & Tensor Shapes

How to read the tensor shapes inside an LLM such as Llama 3.1 8B: parameters and activations, the cost of a matrix multiply, and fixing shape errors.

---
This representation contains public Fanout content only. Protected Pro lessons, account data, billing, checkout, and pricing are not included.

Browse the public content map: https://fanout.sh/sitemap.md