burlap.behavior.singleagent.planning.stochastic

Class DynamicProgramming.StaticVFPlanner

java.lang.Object

burlap.behavior.singleagent.MDPSolver

burlap.behavior.singleagent.planning.stochastic.DynamicProgramming

burlap.behavior.singleagent.planning.stochastic.DynamicProgramming.StaticVFPlanner

All Implemented Interfaces:

MDPSolverInterface, QFunction, ValueFunction

Enclosing class:

DynamicProgramming

public static class DynamicProgramming.StaticVFPlanner
extends DynamicProgramming

This class is used to store tabular value function values that can be manipulated with the DynamicProgramming methods. It has no planning method defined and will throw a runtime exception if you try to call it. When you pass it a seed value function (represented as a Map), it copies the values into its internal stored value function so that changes to the original value function may be made without affecting this objects values.

Nested Class Summary

Nested classes/interfaces inherited from class burlap.behavior.singleagent.planning.stochastic.DynamicProgramming

DynamicProgramming.StaticVFPlanner

Nested classes/interfaces inherited from interface burlap.behavior.valuefunction.QFunction

QFunction.QFunctionHelper

Field Summary

Fields inherited from class burlap.behavior.singleagent.planning.stochastic.DynamicProgramming

transitionDynamics, useCachedTransitions, valueFunction, valueInitializer

Fields inherited from class burlap.behavior.singleagent.MDPSolver

actions, debugCode, domain, gamma, hashingFactory, mapToStateIndex, rf, tf

Constructor Summary

Constructors

Constructor and Description
DynamicProgramming.StaticVFPlanner(Domain domain, RewardFunction rf, double gamma, HashableStateFactory hashingFactory, java.util.List<Action> allActions, java.util.Map<HashableState,java.lang.Double> srcValueFunction) Initializes.

Method Summary

Methods inherited from class burlap.behavior.singleagent.planning.stochastic.DynamicProgramming

computeQ, computeQ, DPPInit, getActionsTransitions, getAllStates, getCopyOfValueFunction, getDefaultValue, getQ, getQ, getQs, getValueFunctionInitialization, hasComputedValueFor, initializeOptionsForExpectationComputations, performBellmanUpdateOn, performBellmanUpdateOn, performFixedPolicyBellmanUpdateOn, performFixedPolicyBellmanUpdateOn, resetSolver, setValueFunctionInitialization, toggleUseCachedTransitionDynamics, value, value

Methods inherited from class burlap.behavior.singleagent.MDPSolver

addNonDomainReferencedAction, getActions, getAllGroundedActions, getDebugCode, getDomain, getGamma, getHashingFactory, getRf, getRF, getTf, getTF, setActions, setDebugCode, setDomain, setGamma, setHashingFactory, setRf, setTf, solverInit, stateHash, toggleDebugPrinting, translateAction

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DynamicProgramming.StaticVFPlanner

public DynamicProgramming.StaticVFPlanner(Domain domain,
                                  RewardFunction rf,
                                  double gamma,
                                  HashableStateFactory hashingFactory,
                                  java.util.List<Action> allActions,
                                  java.util.Map<HashableState,java.lang.Double> srcValueFunction)

Initializes. The source value function will be *copied* into this objects value function so that changes to the source will not affect this object. The action list will also be copied.

Parameters:

domain - the planning domain

rf - the reward function

gamma - the discount factor

hashingFactory - the state hashing factory used to index states

allActions - the set of actions for computing Q-values

srcValueFunction - the source value function to copy.