A Differentiable finite horizon planner that can also use sparse sampling over the transition dynamics when the transition function is very large or infinite.
A tuple for storing Q-values and their gradients.
A tuple for storing a state value and its gradient.
A class for performing dynamic programming based planning with a differentiable value backup operator.
Performs Differentiable Value Iteration using the Boltzmann backup operator and a