Policy value-advantage decomposition mathematical notation

Policy value-advantage decomposition is a recurring research-paper notation family. Separates action value into the policy's baseline value for the state and the action's relative advantage.

Policy value-advantage decomposition: Separates action value into the policy's baseline value for the state and the action's relative advantage. Example: Compare this action's value with the policy's usual value in the same state.