---
title: "Neural Ordinary Differential Equations"
description: "Neural ODEs replace a fixed stack of hidden layers with a learned derivative field and an adaptive differential-equation solver. Follow the solver contract, the reverse-time adjoint, the continuous normalizing flow, and the numerical limits hidden by the continuous-depth metaphor."
canonical_url: "https://fanout.sh/daily/2026-11-03-neural-ordinary-differential-equations"
md_url: "https://fanout.sh/daily/2026-11-03-neural-ordinary-differential-equations.md"
last_updated: "2026-11-03"
access: "public"
---

# Neural Ordinary Differential Equations

Neural ODEs replace a fixed stack of hidden layers with a learned derivative field and an adaptive differential-equation solver. Follow the solver contract, the reverse-time adjoint, the continuous normalizing flow, and the numerical limits hidden by the continuous-depth metaphor.

## Paper details

- Authors: Ricky T. Q. Chen et al.

- Venue: NeurIPS 2018 Best Paper

- Track: AI Research

- Difficulty: Hard

- Reading time: 13 min

- Original paper: https://proceedings.neurips.cc/paper/2018/hash/69386f6bb1dfed68692a24c8686939b9-Abstract.html

## What you will learn

- How a residual update becomes a continuous-time derivative field integrated by a black-box adaptive solver.

- Why the adjoint method can avoid storing the forward solver trajectory, and where numerical reconstruction complicates that promise.

- What the MNIST, continuous-flow, and irregular-time-series evidence establishes without implying that Neural ODEs replace ordinary residual networks.

## Continue exploring

[Compare residual networks](https://fanout.sh/daily/2026-07-11-deep-residual-learning): Contrast a fixed sequence of learned residual steps with a shared derivative field whose evaluation points are chosen by a numerical solver.

---
This representation contains public Fanout content only. Protected Pro lessons, account data, billing, checkout, and pricing are not included.

Browse the public content map: https://fanout.sh/sitemap.md