Automatic differentiation. For any DAG with a scalar output, it allows calculating its partial derivative wrt the input parameters.