Cache eviction policies

The core idea

Eviction removes a cached item to make room for another.

The next request for the removed item must fetch it again, so the policy is making a prediction: which saved answer will be least useful next?

In this lesson

  • Recent use or repeated use?
  • Step through the disagreement
  • History consumes memory and work
  • Decide what gets in
  • Eligibility and the real budget

Continue reading

Pro unlocks video lessons, visual walkthroughs, full notes, diagrams, case studies, and implementations across the System Design archive.