Bellman expectation equation mathematical notation

Bellman expectation equation is a recurring research-paper notation family. Expresses a policy's state value recursively as expected immediate reward plus the discounted value of the next state.

Bellman expectation equation: Expresses a policy's state value recursively as expected immediate reward plus the discounted value of the next state. Example: Break long-term value into one step now and the remaining value later.