Steer an optimizer down the loss curve