burlap.tutorials.cpl

Class QLTutorial

java.lang.Object

burlap.behavior.singleagent.MDPSolver

burlap.tutorials.cpl.QLTutorial

All Implemented Interfaces:

LearningAgent, MDPSolverInterface, QFunction, ValueFunction

public class QLTutorial
extends MDPSolver
implements LearningAgent, QFunction

Nested Class Summary

Nested classes/interfaces inherited from interface burlap.behavior.valuefunction.QFunction

QFunction.QFunctionHelper

Field Summary

Fields inherited from class burlap.behavior.singleagent.MDPSolver

actions, debugCode, domain, gamma, hashingFactory, mapToStateIndex, rf, tf

Constructor Summary

Constructors

Constructor and Description
QLTutorial(Domain domain, double gamma, HashableStateFactory hashingFactory, ValueFunctionInitialization qinit, double learningRate, double epsilon)

Method Summary

Methods

Modifier and Type	Method and Description
QValue	getQ(State s, AbstractGroundedAction a) Returns the QValue for the given state-action pair.
java.util.List<QValue>	getQs(State s) Returns a List of QValue objects for ever permissible action for the given input state.
static void	main(java.lang.String[] args)
void	resetSolver() This method resets all solver results so that a solver can be restarted fresh as if had never solved the MDP.
EpisodeAnalysis	runLearningEpisode(Environment env)
EpisodeAnalysis	runLearningEpisode(Environment env, int maxSteps)
double	value(State s) Returns the value function evaluation of the given state.

Methods inherited from class burlap.behavior.singleagent.MDPSolver

addNonDomainReferencedAction, getActions, getAllGroundedActions, getDebugCode, getDomain, getGamma, getHashingFactory, getRf, getRF, getTf, getTF, setActions, setDebugCode, setDomain, setGamma, setHashingFactory, setRf, setTf, solverInit, stateHash, toggleDebugPrinting, translateAction

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

QLTutorial

public QLTutorial(Domain domain,
          double gamma,
          HashableStateFactory hashingFactory,
          ValueFunctionInitialization qinit,
          double learningRate,
          double epsilon)

Method Detail

runLearningEpisode

public EpisodeAnalysis runLearningEpisode(Environment env)

Specified by:

runLearningEpisode in interface LearningAgent

runLearningEpisode

public EpisodeAnalysis runLearningEpisode(Environment env,
                                 int maxSteps)

Specified by:

runLearningEpisode in interface LearningAgent

resetSolver

public void resetSolver()

Description copied from interface: MDPSolverInterface

This method resets all solver results so that a solver can be restarted fresh as if had never solved the MDP.

Specified by:

resetSolver in interface MDPSolverInterface

Specified by:

resetSolver in class MDPSolver

getQs

public java.util.List<QValue> getQs(State s)

Description copied from interface: QFunction

Returns a List of QValue objects for ever permissible action for the given input state.

Specified by:

getQs in interface QFunction

Parameters:

s - the state for which Q-values are to be returned.

Returns:

a List of QValue objects for ever permissible action for the given input state.

getQ

public QValue getQ(State s,
          AbstractGroundedAction a)

Description copied from interface: QFunction

Returns the QValue for the given state-action pair.

Specified by:

getQ in interface QFunction

Parameters:

s - the input state

a - the input action

Returns:

the QValue for the given state-action pair.

value

public double value(State s)

Description copied from interface: ValueFunction

Returns the value function evaluation of the given state. If the value is not stored, then the default value specified by the ValueFunctionInitialization object of this class is returned.

Specified by:

value in interface ValueFunction

Parameters:

s - the state to evaluate.

Returns:

the value function evaluation of the given state.

main

public static void main(java.lang.String[] args)