burlap.tutorials.cpl

Class VITutorial

java.lang.Object

burlap.behavior.singleagent.MDPSolver

burlap.tutorials.cpl.VITutorial

All Implemented Interfaces:

MDPSolverInterface, Planner, QFunction, ValueFunction

public class VITutorial
extends MDPSolver
implements Planner, QFunction

Nested Class Summary

Nested classes/interfaces inherited from interface burlap.behavior.valuefunction.QFunction

QFunction.QFunctionHelper

Field Summary

Fields

Modifier and Type	Field and Description
protected int	numIterations
protected java.util.Map<HashableState,java.lang.Double>	valueFunction
protected ValueFunctionInitialization	vinit

Fields inherited from class burlap.behavior.singleagent.MDPSolver

actions, debugCode, domain, gamma, hashingFactory, mapToStateIndex, rf, tf

Constructor Summary

Constructors

Constructor and Description
VITutorial(Domain domain, RewardFunction rf, TerminalFunction tf, double gamma, HashableStateFactory hashingFactory, ValueFunctionInitialization vinit, int numIterations)

Method Summary

Methods

Modifier and Type	Method and Description
protected double	bellmanEquation(State s)
QValue	getQ(State s, AbstractGroundedAction a) Returns the QValue for the given state-action pair.
java.util.List<QValue>	getQs(State s) Returns a List of QValue objects for ever permissible action for the given input state.
static void	main(java.lang.String[] args)
void	performReachabilityFrom(State seedState)
GreedyQPolicy	planFromState(State initialState) This method will cause the Planner to begin planning from the specified initial State.
void	resetSolver() This method resets all solver results so that a solver can be restarted fresh as if had never solved the MDP.
double	value(State s) Returns the value function evaluation of the given state.

Methods inherited from class burlap.behavior.singleagent.MDPSolver

addNonDomainReferencedAction, getActions, getAllGroundedActions, getDebugCode, getDomain, getGamma, getHashingFactory, getRf, getRF, getTf, getTF, setActions, setDebugCode, setDomain, setGamma, setHashingFactory, setRf, setTf, solverInit, stateHash, toggleDebugPrinting, translateAction

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface burlap.behavior.singleagent.MDPSolverInterface

addNonDomainReferencedAction, getActions, getDebugCode, getDomain, getGamma, getHashingFactory, getRf, getRF, getTf, getTF, setActions, setDebugCode, setDomain, setGamma, setHashingFactory, setRf, setTf, solverInit, toggleDebugPrinting

Field Detail

valueFunction

protected java.util.Map<HashableState,java.lang.Double> valueFunction

vinit

protected ValueFunctionInitialization vinit

numIterations

protected int numIterations

Constructor Detail

VITutorial

public VITutorial(Domain domain,
          RewardFunction rf,
          TerminalFunction tf,
          double gamma,
          HashableStateFactory hashingFactory,
          ValueFunctionInitialization vinit,
          int numIterations)

Method Detail

value

public double value(State s)

Description copied from interface: ValueFunction

Returns the value function evaluation of the given state. If the value is not stored, then the default value specified by the ValueFunctionInitialization object of this class is returned.

Specified by:

value in interface ValueFunction

Parameters:

s - the state to evaluate.

Returns:

the value function evaluation of the given state.

getQs

public java.util.List<QValue> getQs(State s)

Description copied from interface: QFunction

Returns a List of QValue objects for ever permissible action for the given input state.

Specified by:

getQs in interface QFunction

Parameters:

s - the state for which Q-values are to be returned.

Returns:

a List of QValue objects for ever permissible action for the given input state.

getQ

public QValue getQ(State s,
          AbstractGroundedAction a)

Description copied from interface: QFunction

Returns the QValue for the given state-action pair.

Specified by:

getQ in interface QFunction

Parameters:

s - the input state

a - the input action

Returns:

the QValue for the given state-action pair.

bellmanEquation

protected double bellmanEquation(State s)

planFromState

public GreedyQPolicy planFromState(State initialState)

Description copied from interface: Planner

This method will cause the Planner to begin planning from the specified initial State. It will then return an appropriate Policy object that captured the planning results. Note that typically you can use a variety of different Policy objects in conjunction with this Planner to get varying behavior and the returned Policy is not required to be used.

Specified by:

planFromState in interface Planner

Parameters:

initialState - the initial state of the planning problem

Returns:

a Policy that captures the planning results from input State.

resetSolver

public void resetSolver()

Description copied from interface: MDPSolverInterface

This method resets all solver results so that a solver can be restarted fresh as if had never solved the MDP.

Specified by:

resetSolver in interface MDPSolverInterface

Specified by:

resetSolver in class MDPSolver

performReachabilityFrom

public void performReachabilityFrom(State seedState)

main

public static void main(java.lang.String[] args)