Softmax Probabilities

Core AI Intuitions

A glimpse of Softmax Probabilities

A model gives three possible answers the scores [2, 1, 0]. The scores tell us their order, but they are not probabilities: they do not add to one, and scores could also be negative.

We want a probability for each answer while preserving that order. Softmax first turns each score into a positive weight, then divides each weight by their total.

Continue learning

Pro unlocks guided learning, complete notes, practical walkthroughs, exercises, and every AI Research lesson.