Cross-entropy mathematical notation

Cross-entropy is a recurring research-paper notation family. Measures the average negative log probability that model distribution q assigns to outcomes from p.

Cross-entropy: Measures the average negative log probability that model distribution q assigns to outcomes from p. Example: Penalize q when it gives low probability to outcomes weighted by p.