burlap.behavior.singleagent.learnfromdemo

Class CustomRewardModel

java.lang.Object

burlap.behavior.singleagent.learnfromdemo.CustomRewardModel

All Implemented Interfaces:

FullModel, SampleModel

Direct Known Subclasses:

RewardValueProjection.CustomRewardNoTermModel

public class CustomRewardModel
extends java.lang.Object
implements FullModel

Author:

James MacGlashan.

Nested Class Summary

Nested classes/interfaces inherited from interface burlap.mdp.singleagent.model.FullModel

FullModel.Helper

Field Summary

Fields

Modifier and Type	Field and Description
protected SampleModel	model
protected RewardFunction	rewardFunction

Constructor Summary

Constructors

Constructor and Description
CustomRewardModel(SampleModel model, RewardFunction rewardFunction)

Method Summary

Modifier and Type	Method and Description
protected EnvironmentOutcome	modifyOutcome(EnvironmentOutcome eo)
EnvironmentOutcome	sample(State s, Action a) Samples a transition from the transition distribution and returns it.
boolean	terminal(State s) Indicates whether a state is a terminal state (i.e., no more action occurs and zero reward received from there on out)
java.util.List<TransitionProb>	transitions(State s, Action a) Returns the set of possible transitions when Action is applied in State s.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

model

protected SampleModel model

rewardFunction

protected RewardFunction rewardFunction

Constructor Detail

CustomRewardModel

public CustomRewardModel(SampleModel model,
                         RewardFunction rewardFunction)

Method Detail

transitions

public java.util.List<TransitionProb> transitions(State s,
                                                  Action a)

Description copied from interface: FullModel

Returns the set of possible transitions when Action is applied in State s. The returned list only needs to include transitions that have non-zero probability of occurring.

Specified by:

transitions in interface FullModel

Parameters:

s - the source State

a - the Action applied in the source state

Returns:

the probability distribution over possible transitions.

sample

public EnvironmentOutcome sample(State s,
                                 Action a)

Description copied from interface: SampleModel

Samples a transition from the transition distribution and returns it.

Specified by:

sample in interface SampleModel

Parameters:

s - the source state

a - the action taken in the source state

Returns:

and EnvironmentOutcome describing the sampled transition

terminal

public boolean terminal(State s)

Description copied from interface: SampleModel

Indicates whether a state is a terminal state (i.e., no more action occurs and zero reward received from there on out)

Specified by:

terminal in interface SampleModel

Parameters:

s - the input state to test

Returns:

true if the state is a terminal state, false if it is not.

modifyOutcome

protected EnvironmentOutcome modifyOutcome(EnvironmentOutcome eo)