<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
  <channel>
    <title>Fanout Daily papers</title>
    <link>https://fanout.sh/daily</link>
    <description>Daily technical papers with concise reading notes across AI research, systems, inference, and ML mathematics.</description>
    <language>en-US</language>
    <lastBuildDate>Tue, 25 Aug 2026 12:00:00 GMT</lastBuildDate>
    <atom:link href="https://fanout.sh/feed.xml" rel="self" type="application/rss+xml" />
    <item>
      <title>Segment Anything</title>
      <link>https://fanout.sh/daily/2026-08-25-segment-anything</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-25-segment-anything</guid>
      <pubDate>Tue, 25 Aug 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Kirillov et al. · ICCV 2023 · 35 min. Segment Anything asks whether one vision model can turn a point, box, or rough mask into the pixels of a reasonable object, even on unfamiliar images. Read it to see how one reusable image embedding, a lightweight prompt decoder, ambiguity-aware mask candidates, and a model-in-the-loop data engine make segmentation feel like an interface rather than a fixed label set.</description>
    </item>
    <item>
      <title>Large-scale cluster management at Google with Borg</title>
      <link>https://fanout.sh/daily/2026-08-24-google-borg-cluster-management</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-24-google-borg-cluster-management</guid>
      <pubDate>Mon, 24 Aug 2026 12:00:00 GMT</pubDate>
      <category>Systems</category>
      <description>Verma et al. · EuroSys 2015 · 40 min. Borg asks how one fleet can run latency-sensitive services and opportunistic batch work without wasting the space between their peaks. Read it to see how cells, jobs, tasks, priorities, limits, reservations, placement scoring, and a continuously repaired control plane turn heterogeneous machines into shared infrastructure.</description>
    </item>
    <item>
      <title>Learning Transferable Visual Models From Natural Language Supervision</title>
      <link>https://fanout.sh/daily/2026-08-23-clip-natural-language-supervision</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-23-clip-natural-language-supervision</guid>
      <pubDate>Sun, 23 Aug 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Radford et al. · ICML 2021 · 35 min. CLIP asks how an image model can recognize categories described in words without training a new classifier for every task. Read it to see how two encoders turn a batch into an all-pairs similarity matrix, how the true image-text pairs teach a shared embedding space, and why prompts make zero-shot recognition flexible but not automatically reliable.</description>
    </item>
    <item>
      <title>Development of the Domain Name System</title>
      <link>https://fanout.sh/daily/2026-08-22-development-domain-name-system</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-22-development-domain-name-system</guid>
      <pubDate>Sat, 22 Aug 2026 12:00:00 GMT</pubDate>
      <category>Systems</category>
      <description>Mockapetris and Dunlap · SIGCOMM 1988 · 30 min. This paper asks how the Internet can keep one usable naming system without making every machine download one global host file. Read it to see how DNS cuts a name tree into delegated zones, follows referrals toward the server responsible for one branch, and uses time-limited caching to make repeated lookups local.</description>
    </item>
    <item>
      <title>End-to-End Arguments in System Design</title>
      <link>https://fanout.sh/daily/2026-08-21-end-to-end-arguments</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-21-end-to-end-arguments</guid>
      <pubDate>Fri, 21 Aug 2026 12:00:00 GMT</pubDate>
      <category>Systems</category>
      <description>Saltzer, Reed, and Clark · ACM TOCS, 1984 · 30 min. This paper asks where a system should place reliability, delivery, security, and duplicate-suppression guarantees. Read it to see why a lower layer can make failures rarer yet still cannot certify the application result, and why the final check belongs at the endpoints that understand what success means.</description>
    </item>
    <item>
      <title>Toolformer: Language Models Can Teach Themselves to Use Tools</title>
      <link>https://fanout.sh/daily/2026-08-20-toolformer</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-20-toolformer</guid>
      <pubDate>Thu, 20 Aug 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Schick et al. · NeurIPS 2023 · 40 min. Toolformer asks how a language model can learn when and how to call external tools without a large hand-labeled tool-use dataset. Read it to see how the model proposes calls inside ordinary text, executes them, and keeps only those whose returned result lowers continuation loss enough to become a training example.</description>
    </item>
    <item>
      <title>An Industrial-Strength Audio Search Algorithm</title>
      <link>https://fanout.sh/daily/2026-08-19-shazam-audio-search</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-19-shazam-audio-search</guid>
      <pubDate>Wed, 19 Aug 2026 12:00:00 GMT</pubDate>
      <category>Systems</category>
      <description>Avery Li-Chun Wang · ISMIR 2003 · 30 min. This is the paper behind Shazam: how a phone can name a song from ten noisy seconds in a pub. Read it to see how a track is reduced to a constellation of spectrogram peaks, how pairing peaks into 32-bit hashes makes lookup about ten thousand times faster, and why a match is declared only when the surviving hashes agree on one time offset.</description>
    </item>
    <item>
      <title>Chain-of-Thought Prompting Elicits Reasoning in Large Language Models</title>
      <link>https://fanout.sh/daily/2026-08-18-chain-of-thought</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-18-chain-of-thought</guid>
      <pubDate>Tue, 18 Aug 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Wei, Wang, Schuurmans, Bosma, Ichter, Xia, Chi, Le, and Zhou · NeurIPS 2022 · 30 min. This paper asks why showing a language model a few worked examples of step-by-step reasoning unlocks problems that direct prompting cannot touch. Read it to see how eight hand-written exemplars lifted PaLM 540B from 17.9% to 56.9% on grade-school math, why meaningless filler tokens explain none of the gain, and why the same prompt actively hurts smaller models.</description>
    </item>
    <item>
      <title>Space/Time Trade-offs in Hash Coding with Allowable Errors</title>
      <link>https://fanout.sh/daily/2026-08-17-bloom-filter</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-17-bloom-filter</guid>
      <pubDate>Mon, 17 Aug 2026 12:00:00 GMT</pubDate>
      <category>Systems</category>
      <description>Burton H. Bloom · Communications of the ACM, 1970 · 30 min. Bloom&apos;s paper asks how a compact in-memory screen can reject missing keys before an expensive exact lookup. Read it to see why one zero bit proves absence, why all-one evidence means only possibly present, and how shared hash positions trade memory for a controlled false-positive path.</description>
    </item>
    <item>
      <title>Tor: The Second-Generation Onion Router</title>
      <link>https://fanout.sh/daily/2026-08-16-tor-onion-router</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-16-tor-onion-router</guid>
      <pubDate>Sun, 16 Aug 2026 12:00:00 GMT</pubDate>
      <category>Systems</category>
      <description>Dingledine, Mathewson, and Syverson · USENIX Security 2004 · 35 min. This paper asks how a browser can cross several volunteer relays without handing any one relay the complete route. Read it to see how the client extends a circuit one hop at a time, wraps each fixed-size cell in a different session key for every relay, and why those layers still cannot defeat an observer who can correlate traffic at both ends.</description>
    </item>
    <item>
      <title>Mastering the game of Go with deep neural networks and tree search</title>
      <link>https://fanout.sh/daily/2026-08-15-alphago-neural-tree-search</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-15-alphago-neural-tree-search</guid>
      <pubDate>Sat, 15 Aug 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Silver et al. · Nature 2016 · 35 min. This paper asks how a computer can choose a strong Go move when the game tree is far too large to enumerate. Read it to see how a learned policy concentrates search on promising moves, how a value network estimates who is ahead before a game ends, and how Monte Carlo tree search turns those estimates into professional-level play under a large compute budget.</description>
    </item>
    <item>
      <title>Bitcoin: A Peer-to-Peer Electronic Cash System</title>
      <link>https://fanout.sh/daily/2026-08-14-bitcoin-proof-of-work</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-14-bitcoin-proof-of-work</guid>
      <pubDate>Fri, 14 Aug 2026 12:00:00 GMT</pubDate>
      <category>Systems</category>
      <description>Satoshi Nakamoto · Bitcoin white paper, 2008 · 35 min. This paper asks how two people can agree that a digital payment happened first without asking a central mint to keep the ledger. Read it to see why signatures prove ownership but not uniqueness, how hash-linked proof of work makes one public history costly to rewrite, and why every confirmation still depends on an honest-compute majority assumption.</description>
    </item>
    <item>
      <title>Congestion Avoidance and Control</title>
      <link>https://fanout.sh/daily/2026-08-13-congestion-avoidance-control</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-13-congestion-avoidance-control</guid>
      <pubDate>Thu, 13 Aug 2026 12:00:00 GMT</pubDate>
      <category>Systems</category>
      <description>Van Jacobson · SIGCOMM 1988 · 35 min. This paper asks how TCP can keep a busy network useful when delay, packet loss, and retransmission tempt every sender to add even more traffic. Read it to see how acknowledgements become a clock, how slow start fills an empty path without a full-window burst, and why a congestion signal should make the sender retreat quickly before probing capacity again.</description>
    </item>
    <item>
      <title>Stealing Reasoning Traces from Proprietary LLM APIs</title>
      <link>https://fanout.sh/daily/2026-08-12-stolen-reasoning-traces</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-12-stolen-reasoning-traces</guid>
      <pubDate>Wed, 12 Aug 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Panfilov, Schmotz, Shumailov, Beurer-Kellner, Schaeffer, Prabhu, Geiping, and Andriushchenko · arXiv, 2026 · 35 min. This paper asks what happens when an API gives encrypted reasoning state to the client and later accepts that opaque state again. Read it to see why confidentiality and integrity do not automatically bind a reasoning block to one user, session, or model, how the authors tested compatible weaker decoders, and what the resulting privacy evidence means after responsible disclosure.</description>
    </item>
    <item>
      <title>The PageRank Citation Ranking: Bringing Order to the Web</title>
      <link>https://fanout.sh/daily/2026-08-11-pagerank</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-11-pagerank</guid>
      <pubDate>Tue, 11 Aug 2026 12:00:00 GMT</pubDate>
      <category>Systems</category>
      <description>Page, Brin, Motwani, and Winograd · Stanford InfoLab, 1999 · 35 min. PageRank asks how a search engine can estimate which web pages matter before it even sees a query. Read it to see how every page divides its authority among outgoing links, how repeated link-weight transfer settles into a global ranking, and why teleportation, incomplete crawls, and manipulation keep that score from being a synonym for truth.</description>
    </item>
    <item>
      <title>ReAct: Synergizing Reasoning and Acting in Language Models</title>
      <link>https://fanout.sh/daily/2026-08-10-react-reasoning-acting</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-10-react-reasoning-acting</guid>
      <pubDate>Mon, 10 Aug 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Yao, Zhao, Yu, Du, Shafran, Narasimhan, and Cao · ICLR 2023 · 35 min. ReAct gives language-model agents a simple working rhythm: reason about the current situation, take a bounded action, observe what the environment returns, and revise the next move. Read it for the durable idea behind many tool-using agent harnesses and for an honest look at why better grounding can still fail when tools return weak evidence or the agent gets stuck in a loop.</description>
    </item>
    <item>
      <title>Ring Attention with Blockwise Transformers for Near-Infinite Context</title>
      <link>https://fanout.sh/daily/2026-08-09-ring-attention</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-09-ring-attention</guid>
      <pubDate>Sun, 09 Aug 2026 12:00:00 GMT</pubDate>
      <category>Systems</category>
      <description>Liu, Zaharia, and Abbeel · ICLR 2024 · 50 min. Ring Attention asks how exact Transformer context can grow across devices without gathering the whole sequence on each one. Read it to see how stationary query blocks, circulating key-value blocks, and compute-transfer overlap turn a device ring into aggregate context capacity while keeping per-host activation memory independent of total sequence length.</description>
    </item>
    <item>
      <title>FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning</title>
      <link>https://fanout.sh/daily/2026-08-08-flashattention-2</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-08-flashattention-2</guid>
      <pubDate>Sat, 08 Aug 2026 12:00:00 GMT</pubDate>
      <category>Inference</category>
      <description>Tri Dao · ICLR 2024 · 50 min. FlashAttention-2 asks why an exact, I/O-aware attention kernel can still leave much of an A100 idle. Read it to see how reducing non-matmul work, parallelizing along sequence tiles, and giving each warp disjoint query and output rows improves GPU utilization without changing the attention result.</description>
    </item>
    <item>
      <title>Mamba: Linear-Time Sequence Modeling with Selective State Spaces</title>
      <link>https://fanout.sh/daily/2026-08-07-mamba-selective-state-spaces</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-07-mamba-selective-state-spaces</guid>
      <pubDate>Fri, 07 Aug 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Gu and Dao · COLM 2024 · 55 min. Mamba asks how a recurrent model with a fixed-size state can decide what information deserves to survive. Read it to see how input-dependent state-space parameters create content-aware persistence and reset, and how a fused parallel scan makes the resulting time-varying recurrence practical on GPUs.</description>
    </item>
    <item>
      <title>Root Mean Square Layer Normalization</title>
      <link>https://fanout.sh/daily/2026-08-06-rmsnorm</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-06-rmsnorm</guid>
      <pubDate>Thu, 06 Aug 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Zhang and Sennrich · NeurIPS 2019 · 35 min. RMSNorm asks whether LayerNorm needs to subtract the mean as well as control activation scale. Read it to see how dividing by a vector&apos;s root mean square preserves global rescaling invariance with less normalization work, while deliberately giving up re-centering invariance.</description>
    </item>
    <item>
      <title>ZeRO: Memory Optimizations Toward Training Trillion Parameter Models</title>
      <link>https://fanout.sh/daily/2026-08-05-zero-memory-optimization</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-05-zero-memory-optimization</guid>
      <pubDate>Wed, 05 Aug 2026 12:00:00 GMT</pubDate>
      <category>Systems</category>
      <description>Rajbhandari et al. · SC 2020 · 50 min. ZeRO asks why adding data-parallel workers does not make a model easier to fit when every worker keeps the same training state. Read it to see how partitioning optimizer states, gradients, and parameters turns aggregate cluster memory into usable model capacity while preserving the data-parallel computation.</description>
    </item>
    <item>
      <title>Orca: A Distributed Serving System for Transformer-Based Generative Models</title>
      <link>https://fanout.sh/daily/2026-08-04-orca-continuous-batching</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-04-orca-continuous-batching</guid>
      <pubDate>Tue, 04 Aug 2026 12:00:00 GMT</pubDate>
      <category>Inference</category>
      <description>Yu et al. · OSDI 2022 · 45 min. Orca moves LLM serving from fixed request batches to iteration-level scheduling. Read it to see how a scheduler can reconsider the active batch after every generated token, and how selective batching preserves efficient shared GPU work even when requests have different sequence lengths and lifetimes.</description>
    </item>
    <item>
      <title>GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints</title>
      <link>https://fanout.sh/daily/2026-08-03-grouped-query-attention</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-03-grouped-query-attention</guid>
      <pubDate>Mon, 03 Aug 2026 12:00:00 GMT</pubDate>
      <category>Inference</category>
      <description>Ainslie et al. · EMNLP 2023 · 35 min. Grouped-query attention finds a practical middle ground between multi-head attention&apos;s quality and multi-query attention&apos;s decoding speed. Read it to see how sharing key-value heads within groups shrinks the KV cache, and how an existing multi-head checkpoint can be converted with only a small amount of additional pretraining.</description>
    </item>
    <item>
      <title>DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models</title>
      <link>https://fanout.sh/daily/2026-08-02-deepseekmath-grpo</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-02-deepseekmath-grpo</guid>
      <pubDate>Sun, 02 Aug 2026 12:00:00 GMT</pubDate>
      <category>ML Math</category>
      <description>Shao et al. · arXiv 2024 · 55 min. DeepSeekMath shows how targeted data and reinforcement learning can turn a compact open model into a strong mathematical reasoner. Read it for the data-selection pipeline behind its 120 billion math tokens and for GRPO, a PPO variant that removes the separate critic model by learning from relative rewards within groups of sampled answers.</description>
    </item>
    <item>
      <title>Proximal Policy Optimization Algorithms</title>
      <link>https://fanout.sh/daily/2026-08-01-proximal-policy-optimization</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-08-01-proximal-policy-optimization</guid>
      <pubDate>Sat, 01 Aug 2026 12:00:00 GMT</pubDate>
      <category>ML Math</category>
      <description>Schulman et al. · arXiv 2017 · 55 min. Proximal Policy Optimization shows how to reuse on-policy experience for several minibatch updates without letting the policy move too far in one step. Read it to understand the clipped surrogate objective behind a practical reinforcement-learning algorithm that later became central to RLHF pipelines.</description>
    </item>
    <item>
      <title>Training Language Models to Follow Instructions with Human Feedback</title>
      <link>https://fanout.sh/daily/2026-07-31-instructgpt</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-31-instructgpt</guid>
      <pubDate>Fri, 31 Jul 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Ouyang et al. · NeurIPS 2022 · 45 min. InstructGPT shows why a larger language model is not automatically better at following a user&apos;s intent. Read it to see how demonstrations, preference rankings, a learned reward model, and reinforcement learning turn human judgments into a practical post-training pipeline for more helpful instruction following.</description>
    </item>
    <item>
      <title>Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity</title>
      <link>https://fanout.sh/daily/2026-07-30-switch-transformers</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-30-switch-transformers</guid>
      <pubDate>Thu, 30 Jul 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Fedus, Zoph, and Shazeer · JMLR 2022 · 50 min. Switch Transformers shows how to grow a model&apos;s capacity without activating every parameter for every token. Read it to see how top-1 expert routing, load balancing, and expert capacity turn mixture-of-experts into a simpler scaling recipe while keeping per-token computation roughly constant.</description>
    </item>
    <item>
      <title>Distilling the Knowledge in a Neural Network</title>
      <link>https://fanout.sh/daily/2026-07-29-knowledge-distillation</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-29-knowledge-distillation</guid>
      <pubDate>Wed, 29 Jul 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Hinton, Vinyals, and Dean · NIPS 2014 Deep Learning Workshop · 30 min. Knowledge distillation turns an expensive ensemble or large teacher into a smaller, deployable student. Read it to see why the full pattern of class probabilities carries more useful structure than hard labels alone, and how temperature-scaled soft targets transfer that structure during training.</description>
    </item>
    <item>
      <title>The Tail at Scale</title>
      <link>https://fanout.sh/daily/2026-07-28-tail-at-scale</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-28-tail-at-scale</guid>
      <pubDate>Tue, 28 Jul 2026 12:00:00 GMT</pubDate>
      <category>Systems</category>
      <description>Dean and Barroso · Communications of the ACM 2013 · 30 min. The Tail at Scale explains why rare slowdowns become routine user-visible delays when one request fans out across many machines. Read it for a practical systems lesson: large services need techniques that tolerate latency variability, not only faster average components.</description>
    </item>
    <item>
      <title>Fast Inference from Transformers via Speculative Decoding</title>
      <link>https://fanout.sh/daily/2026-07-27-speculative-decoding</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-27-speculative-decoding</guid>
      <pubDate>Mon, 27 Jul 2026 12:00:00 GMT</pubDate>
      <category>Inference</category>
      <description>Leviathan, Kalman, and Matias · ICML 2023 · 40 min. Speculative decoding makes autoregressive generation faster without changing the target model&apos;s output distribution. Read it to see how a small draft model, parallel verification, and a corrected sampling rule turn extra compute into lower decoding latency without retraining the models.</description>
    </item>
    <item>
      <title>Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks</title>
      <link>https://fanout.sh/daily/2026-07-26-retrieval-augmented-generation</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-26-retrieval-augmented-generation</guid>
      <pubDate>Sun, 26 Jul 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Lewis et al. · NeurIPS 2020 · 40 min. Retrieval-Augmented Generation gives a language model an explicit, updateable memory outside its parameters. Read it to see how a neural retriever and a sequence generator work together, and why grounding generation in retrieved evidence can improve factual, knowledge-intensive answers.</description>
    </item>
    <item>
      <title>Denoising Diffusion Probabilistic Models</title>
      <link>https://fanout.sh/daily/2026-07-25-denoising-diffusion-probabilistic-models</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-25-denoising-diffusion-probabilistic-models</guid>
      <pubDate>Sat, 25 Jul 2026 12:00:00 GMT</pubDate>
      <category>ML Math</category>
      <description>Ho, Jain, and Abbeel · NeurIPS 2020 · 50 min. Denoising Diffusion Probabilistic Models turns generation into a sequence of small denoising steps. Read it to connect variational learning, Gaussian noise, and score matching to the practical recipe that became the foundation of modern diffusion image models.</description>
    </item>
    <item>
      <title>Auto-Encoding Variational Bayes</title>
      <link>https://fanout.sh/daily/2026-07-24-auto-encoding-variational-bayes</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-24-auto-encoding-variational-bayes</guid>
      <pubDate>Fri, 24 Jul 2026 12:00:00 GMT</pubDate>
      <category>ML Math</category>
      <description>Kingma and Welling · ICLR 2014 · 55 min. Auto-Encoding Variational Bayes makes latent-variable models trainable with ordinary backpropagation. Read it to see how the evidence lower bound, amortized inference, and the reparameterization trick turn an intractable posterior problem into a practical stochastic-optimization recipe.</description>
    </item>
    <item>
      <title>Dropout: A Simple Way to Prevent Neural Networks from Overfitting</title>
      <link>https://fanout.sh/daily/2026-07-23-dropout</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-23-dropout</guid>
      <pubDate>Thu, 23 Jul 2026 12:00:00 GMT</pubDate>
      <category>ML Math</category>
      <description>Srivastava et al. · JMLR 2014 · 35 min. Dropout is a compact lesson in turning randomness into regularization. Read it to see how masking neurons during training discourages brittle co-adaptation and approximates an ensemble without paying the cost of running many networks at inference time.</description>
    </item>
    <item>
      <title>Direct Preference Optimization: Your Language Model is Secretly a Reward Model</title>
      <link>https://fanout.sh/daily/2026-07-22-direct-preference-optimization</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-22-direct-preference-optimization</guid>
      <pubDate>Wed, 22 Jul 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Rafailov et al. · NeurIPS 2023 · 40 min. DPO turns language-model alignment from a multi-stage reinforcement-learning pipeline into a direct preference-learning objective. Read it to see how one mathematical reparameterization can remove the separate reward model and make preference tuning much simpler to train.</description>
    </item>
    <item>
      <title>Efficient Memory Management for Large Language Model Serving with PagedAttention</title>
      <link>https://fanout.sh/daily/2026-07-21-pagedattention</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-21-pagedattention</guid>
      <pubDate>Tue, 21 Jul 2026 12:00:00 GMT</pubDate>
      <category>Inference</category>
      <description>Kwon et al. · SOSP 2023 · 55 min. PagedAttention connects a familiar systems idea—virtual-memory paging—to one of LLM serving&apos;s hardest constraints: a large, dynamic KV cache. Read it to see how memory layout, sharing, and allocation policy turn directly into higher batching capacity and serving throughput.</description>
    </item>
    <item>
      <title>From Tensor Buffer to Distributed Memory Hierarchy</title>
      <link>https://fanout.sh/daily/2026-07-20-kv-cache-management-survey</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-20-kv-cache-management-survey</guid>
      <pubDate>Mon, 20 Jul 2026 12:00:00 GMT</pubDate>
      <category>Inference</category>
      <description>Li, Wang, and Chen · arXiv 2026 · 50 min. This survey treats the KV cache as a distributed memory-management problem, not just a temporary tensor. It is a useful July 20 pick for understanding why LLM serving depends on locality, lifetime, ownership, substrate, and the tradeoffs behind paged, shared, disaggregated, and tiered cache designs.</description>
    </item>
    <item>
      <title>Attention Is All You Need</title>
      <link>https://fanout.sh/daily/2026-07-19-attention-is-all-you-need</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-19-attention-is-all-you-need</guid>
      <pubDate>Sun, 19 Jul 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Vaswani et al. · NeurIPS 2017 · 45 min. The Transformer paper replaced recurrence with attention and made sequence modeling easier to parallelize. Read it for the architectural move that turned token-to-token routing into the core primitive behind modern language models.</description>
    </item>
    <item>
      <title>FlashAttention</title>
      <link>https://fanout.sh/daily/2026-07-18-flashattention</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-18-flashattention</guid>
      <pubDate>Sat, 18 Jul 2026 12:00:00 GMT</pubDate>
      <category>Inference</category>
      <description>Dao et al. · NeurIPS 2022 · 55 min. FlashAttention keeps exact attention but changes the memory traffic pattern. It is a clean example of why practical model speed often comes from respecting hardware limits rather than changing the math.</description>
    </item>
    <item>
      <title>Scaling Laws for Neural Language Models</title>
      <link>https://fanout.sh/daily/2026-07-17-scaling-laws</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-17-scaling-laws</guid>
      <pubDate>Fri, 17 Jul 2026 12:00:00 GMT</pubDate>
      <category>ML Math</category>
      <description>Kaplan et al. · arXiv 2020 · 50 min. The scaling-laws paper turns model size, data, and compute into a quantitative tradeoff. It is useful when you want to reason about progress curves instead of treating bigger training runs as folklore.</description>
    </item>
    <item>
      <title>Training Compute-Optimal Large Language Models</title>
      <link>https://fanout.sh/daily/2026-07-16-chinchilla</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-16-chinchilla</guid>
      <pubDate>Thu, 16 Jul 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Hoffmann et al. · arXiv 2022 · 45 min. Chinchilla is the scaling paper that made data budget feel as important as parameter count. It is a good daily pick for learning why a smaller model trained on more tokens can beat a larger undertrained one.</description>
    </item>
    <item>
      <title>Dynamo: Amazon&apos;s Highly Available Key-value Store</title>
      <link>https://fanout.sh/daily/2026-07-15-dynamo</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-15-dynamo</guid>
      <pubDate>Wed, 15 Jul 2026 12:00:00 GMT</pubDate>
      <category>Systems</category>
      <description>DeCandia et al. · SOSP 2007 · 60 min. Dynamo is the classic availability-first storage paper. It is worth reading for how partitioning, quorums, hinted handoff, vector clocks, and application-level conflict resolution combine into a product-shaped system.</description>
    </item>
    <item>
      <title>MapReduce</title>
      <link>https://fanout.sh/daily/2026-07-14-mapreduce</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-14-mapreduce</guid>
      <pubDate>Tue, 14 Jul 2026 12:00:00 GMT</pubDate>
      <category>Systems</category>
      <description>Dean and Ghemawat · OSDI 2004 · 40 min. MapReduce shows how a constrained programming model can hide distribution, retries, shuffling, and locality. Read it for the system-design lesson that an API can be an operational strategy.</description>
    </item>
    <item>
      <title>In Search of an Understandable Consensus Algorithm</title>
      <link>https://fanout.sh/daily/2026-07-13-raft</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-13-raft</guid>
      <pubDate>Mon, 13 Jul 2026 12:00:00 GMT</pubDate>
      <category>Systems</category>
      <description>Ongaro and Ousterhout · USENIX ATC 2014 · 45 min. Raft is the consensus paper to read before discussing leader election, replicated logs, or metadata coordination. It is intentionally structured for understandability, which makes it a strong beginner systems paper.</description>
    </item>
    <item>
      <title>LoRA: Low-Rank Adaptation of Large Language Models</title>
      <link>https://fanout.sh/daily/2026-07-12-lora</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-12-lora</guid>
      <pubDate>Sun, 12 Jul 2026 12:00:00 GMT</pubDate>
      <category>Inference</category>
      <description>Hu et al. · ICLR 2022 · 35 min. LoRA is the cleanest first paper for understanding efficient model adaptation. It turns fine-tuning into small low-rank update matrices, which connects directly to Fanout&apos;s model training and serving material.</description>
    </item>
    <item>
      <title>BERT: Pre-training of Deep Bidirectional Transformers</title>
      <link>https://fanout.sh/daily/2026-07-11-bert</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-11-bert</guid>
      <pubDate>Sat, 11 Jul 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Devlin et al. · NAACL 2019 · 45 min. BERT is the pretrain-then-fine-tune paper that made bidirectional Transformer encoders the default for many language understanding tasks. It is useful for separating encoder intuition from decoder-only LLM intuition.</description>
    </item>
    <item>
      <title>Batch Normalization</title>
      <link>https://fanout.sh/daily/2026-07-10-batch-normalization</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-10-batch-normalization</guid>
      <pubDate>Fri, 10 Jul 2026 12:00:00 GMT</pubDate>
      <category>ML Math</category>
      <description>Ioffe and Szegedy · ICML 2015 · 35 min. BatchNorm is a compact paper for learning how activation statistics, optimization stability, and architecture design interact. It is a good bridge between practical deep learning and the math of normalization.</description>
    </item>
    <item>
      <title>Deep Residual Learning for Image Recognition</title>
      <link>https://fanout.sh/daily/2026-07-09-resnet</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-09-resnet</guid>
      <pubDate>Thu, 09 Jul 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>He et al. · CVPR 2016 · 35 min. ResNet is the skip-connection paper that makes depth trainable in practice. It is beginner-friendly because the core idea is simple: learn a residual change instead of relearning the whole representation.</description>
    </item>
    <item>
      <title>Efficient Estimation of Word Representations in Vector Space</title>
      <link>https://fanout.sh/daily/2026-07-08-word2vec</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-08-word2vec</guid>
      <pubDate>Wed, 08 Jul 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Mikolov et al. · ICLR Workshop 2013 · 30 min. The Word2Vec paper is still one of the best first reads for representation learning. It shows how simple prediction tasks can turn words into vectors with useful geometric structure.</description>
    </item>
    <item>
      <title>Sequence to Sequence Learning with Neural Networks</title>
      <link>https://fanout.sh/daily/2026-07-07-sequence-to-sequence</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-07-sequence-to-sequence</guid>
      <pubDate>Tue, 07 Jul 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Sutskever et al. · NeurIPS 2014 · 35 min. Seq2Seq is the clean predecessor to attention and Transformers. It is a good beginner paper because the encoder-decoder contract is easy to visualize and still appears in translation, summarization, and agents.</description>
    </item>
    <item>
      <title>Adam: A Method for Stochastic Optimization</title>
      <link>https://fanout.sh/daily/2026-07-06-adam</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-06-adam</guid>
      <pubDate>Mon, 06 Jul 2026 12:00:00 GMT</pubDate>
      <category>ML Math</category>
      <description>Kingma and Ba · ICLR 2015 · 30 min. Adam is the optimizer paper learners meet constantly in code before they understand it. The first pass is approachable: it combines momentum-like gradient averages with squared-gradient adaptation.</description>
    </item>
    <item>
      <title>Dremel: Interactive Analysis of Web-Scale Datasets</title>
      <link>https://fanout.sh/daily/2026-07-05-dremel</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-05-dremel</guid>
      <pubDate>Sun, 05 Jul 2026 12:00:00 GMT</pubDate>
      <category>Systems</category>
      <description>Melnik et al. · VLDB 2010 · 45 min. Dremel is a strong systems pick for understanding columnar analytics, nested data, and query serving at scale. It connects directly to Fanout&apos;s storage and analytics material without becoming a database-product tour.</description>
    </item>
    <item>
      <title>Bigtable: A Distributed Storage System for Structured Data</title>
      <link>https://fanout.sh/daily/2026-07-04-bigtable</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-04-bigtable</guid>
      <pubDate>Sat, 04 Jul 2026 12:00:00 GMT</pubDate>
      <category>Systems</category>
      <description>Chang et al. · OSDI 2006 · 45 min. Bigtable is the beginner-friendly bridge from simple key-value stores to distributed sorted maps. It teaches rows, tablets, locality, metadata, and why storage shape follows access patterns.</description>
    </item>
    <item>
      <title>The Google File System</title>
      <link>https://fanout.sh/daily/2026-07-03-google-file-system</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-03-google-file-system</guid>
      <pubDate>Fri, 03 Jul 2026 12:00:00 GMT</pubDate>
      <category>Systems</category>
      <description>Ghemawat et al. · SOSP 2003 · 40 min. GFS is a useful first distributed storage paper because the assumptions are explicit: large files, append-heavy workloads, commodity failures, and a master that keeps metadata tractable.</description>
    </item>
    <item>
      <title>A Mathematical Theory of Communication</title>
      <link>https://fanout.sh/daily/2026-07-02-mathematical-theory-of-communication</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-02-mathematical-theory-of-communication</guid>
      <pubDate>Thu, 02 Jul 2026 12:00:00 GMT</pubDate>
      <category>ML Math</category>
      <description>Claude Shannon · Bell System Technical Journal 1948 · 65 min. Shannon&apos;s information theory paper is hard but worth anchoring early in the calendar. Entropy, bits, uncertainty, and channel capacity sit underneath compression, coding, language modeling, and evaluation intuition.</description>
    </item>
    <item>
      <title>The Perceptron</title>
      <link>https://fanout.sh/daily/2026-07-01-perceptron</link>
      <guid isPermaLink="true">https://fanout.sh/daily/2026-07-01-perceptron</guid>
      <pubDate>Wed, 01 Jul 2026 12:00:00 GMT</pubDate>
      <category>AI Research</category>
      <description>Frank Rosenblatt · Psychological Review 1958 · 30 min. The Perceptron is a good July 1 starting point because it gives learners the original linear-classifier idea before modern depth, attention, or scale enter the story.</description>
    </item>
  </channel>
</rss>
