Action-value function mathematical notation

Action-value function is a recurring research-paper notation family. Returns the expected future return after taking one action in a state and then continuing according to a policy.

Action-value function: Returns the expected future return after taking one action in a state and then continuing according to a policy. Example: Average future return after committing to action a in state s.