---
title: "TensorFlow: A System for Large-Scale Machine Learning"
description: "TensorFlow made one machine-learning program portable across heterogeneous hardware by representing primitive computation, mutable state, and update rules in one deferred dataflow graph. Follow how the runtime prunes, places, partitions, and connects that graph across CPU, GPU, TPU, and machine boundaries."
canonical_url: "https://fanout.sh/daily/2026-11-02-tensorflow-large-scale-machine-learning"
md_url: "https://fanout.sh/daily/2026-11-02-tensorflow-large-scale-machine-learning.md"
last_updated: "2026-11-02"
access: "public"
---

# TensorFlow: A System for Large-Scale Machine Learning

TensorFlow made one machine-learning program portable across heterogeneous hardware by representing primitive computation, mutable state, and update rules in one deferred dataflow graph. Follow how the runtime prunes, places, partitions, and connects that graph across CPU, GPU, TPU, and machine boundaries.

## Paper details

- Authors: Martín Abadi et al.

- Venue: OSDI 2016

- Track: Systems

- Difficulty: Medium

- Reading time: 13 min

- Original paper: https://www.usenix.org/conference/osdi16/technical-sessions/presentation/abadi

## What you will learn

- Why putting mutable Variables and their update operations inside the graph was more flexible than a fixed parameter-server interface.

- How feeds and fetches select a subgraph, placement assigns operations to devices, and cross-device edges become Send and Recv operations.

- What the 2016 performance evidence establishes, and why static graphs, weak checkpoint consistency, and incomplete placement policy bound the result.

## Continue exploring

[Compare tensor parallel training](https://fanout.sh/daily/2026-10-27-megatron-lm-tensor-parallelism): Contrast TensorFlow's general placement substrate with Megatron-LM's paper-specific decision to split Transformer matrix multiplications across GPUs.

---
This representation contains public Fanout content only. Protected Pro lessons, account data, billing, checkout, and pricing are not included.

Browse the public content map: https://fanout.sh/sitemap.md