burlap.domain.singleagent.mountaincar

Class MountainCar.MCModel

java.lang.Object

burlap.domain.singleagent.mountaincar.MountainCar.MCModel

All Implemented Interfaces:

FullStateModel, SampleStateModel

Enclosing class:

MountainCar

public static class MountainCar.MCModel
extends java.lang.Object
implements FullStateModel

Nested Class Summary

Nested classes/interfaces inherited from interface burlap.mdp.singleagent.model.statemodel.FullStateModel

FullStateModel.Helper

Field Summary

Fields

Modifier and Type	Field and Description
protected MountainCar.MCPhysicsParams	physParams

Constructor Summary

Constructors

Constructor and Description
MCModel(MountainCar.MCPhysicsParams physParams)

Method Summary

Modifier and Type	Method and Description
protected int	dir(java.lang.String actionName)
State	move(State s, int dir) Changes the agents position in the provided state using car engine acceleration in the specified direction.
State	sample(State s, Action a) Samples and returns a State from a state transition function.
java.util.List<StateTransitionProb>	stateTransitions(State s, Action a) Returns the set of possible transitions when Action is applied in State s.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

physParams

protected MountainCar.MCPhysicsParams physParams

Constructor Detail

MCModel

public MCModel(MountainCar.MCPhysicsParams physParams)

Method Detail

stateTransitions

public java.util.List<StateTransitionProb> stateTransitions(State s,
                                                            Action a)

Description copied from interface: FullStateModel

Returns the set of possible transitions when Action is applied in State s. The returned list only needs to include transitions that have non-zero probability of occurring.

Specified by:

stateTransitions in interface FullStateModel

Parameters:

s - the source state

a - the action to be applied in the source state

Returns:

the probability distribution of the state transition function specified as a list of StateTransitionProb objects.

sample

public State sample(State s,
                    Action a)

Description copied from interface: SampleStateModel

Samples and returns a State from a state transition function.

Specified by:

sample in interface SampleStateModel

Parameters:

s - the source state

a - the action to be executed in the source state

Returns:

a sample State

move

public State move(State s,
                  int dir)

Changes the agents position in the provided state using car engine acceleration in the specified direction. dir=+1 indicates forward acceleration; -1 backwards acceleration; 0 no acceleration (coast).

Parameters:

s - the state in which the agents position should be modified

dir - the direction of acceleration

Returns:

the modified state s

dir

protected int dir(java.lang.String actionName)