---
title: "Robust Speech Recognition via Large-Scale Weak Supervision"
description: "Whisper trains a standard encoder-decoder Transformer on 680,000 hours of diverse web audio and represents language, transcription, translation, silence, and timestamps with decoder tokens. Read it to see why cross-dataset zero-shot evaluation changes the robustness story, what dataset scale buys, and where long-form generation can still fail."
canonical_url: "https://fanout.sh/daily/2026-10-25-whisper-large-scale-weak-supervision"
md_url: "https://fanout.sh/daily/2026-10-25-whisper-large-scale-weak-supervision.md"
last_updated: "2026-10-25"
access: "public"
---

# Robust Speech Recognition via Large-Scale Weak Supervision

Whisper trains a standard encoder-decoder Transformer on 680,000 hours of diverse web audio and represents language, transcription, translation, silence, and timestamps with decoder tokens. Read it to see why cross-dataset zero-shot evaluation changes the robustness story, what dataset scale buys, and where long-form generation can still fail.

## Paper details

- Authors: Alec Radford et al.

- Venue: ICML 2023

- Track: AI Research

- Difficulty: Medium

- Reading time: 9 min

- Original paper: https://arxiv.org/abs/2212.04356v1

## What you will learn

- How one decoder prefix specifies language, task, silence, and timestamp behavior for a fixed audio representation.

- Why matching two systems on clean LibriSpeech exposes a much larger robustness gap across other speech distributions.

- How uneven language data, thirty-second windows, decoding heuristics, and hallucinations bound the result.

## Continue exploring

[Start with audio fingerprints](https://fanout.sh/daily/2026-08-19-shazam-audio-search): Review how time-frequency structure represents audio before moving from sparse landmarks to learned speech features.

---
This representation contains public Fanout content only. Protected Pro lessons, account data, billing, checkout, and pricing are not included.

Browse the public content map: https://fanout.sh/sitemap.md