Draft Models, Target Models & Parallel Verification

The sequential decode lesson left a decode step able to score several positions for roughly the price of one, and left two questions with it. The positions have to come from somewhere, and whatever produces them will sometimes be wrong.

In this lesson

  • Where the candidates come from
  • The rule at temperature zero
  • The rule when the model samples
  • Accepted, recovered, and bonus
  • What lossless means

Continue learning

Pro unlocks the complete lesson, video, practice, and code where available.