Pathwise derivative estimator mathematical notation

Pathwise derivative estimator is a recurring research-paper notation family. Differentiates through a deterministic transformation of parameter-free noise to estimate gradients of expectations over samples.

Pathwise derivative estimator: Differentiates through a deterministic transformation of parameter-free noise to estimate gradients of expectations over samples. Example: Move parameter dependence into a smooth sampling transformation before differentiating.