Mutual information mathematical notation

Mutual information is a recurring research-paper notation family. Measures how much knowing either random variable reduces uncertainty about the other through a KL divergence from independence.

Mutual information: Measures how much knowing either random variable reduces uncertainty about the other through a KL divergence from independence. Example: Compare the true joint behavior with what independence would predict.