KL divergence mathematical notation

KL divergence is a recurring research-paper notation family. Measures the expected log density ratio from a reference distribution p to a comparison distribution q.

KL divergence: Measures the expected log density ratio from a reference distribution p to a comparison distribution q. Example: Under samples from p, average the log probability gap between p and q.