Autoregressive factorization mathematical notation
Autoregressive factorization is a recurring research-paper notation family. Decomposes a sequence's joint probability into a product of next-token conditional probabilities in left-to-right order.
Autoregressive factorization: Decomposes a sequence's joint probability into a product of next-token conditional probabilities in left-to-right order. Example: Score the whole sequence by multiplying every next-token probability.