burlap.behavior.singleagent.learning.actorcritic.critics

Class TimeIndexedTDLambda.StateTimeElibilityTrace

java.lang.Object

burlap.behavior.singleagent.learning.actorcritic.critics.TDLambda.StateEligibilityTrace

burlap.behavior.singleagent.learning.actorcritic.critics.TimeIndexedTDLambda.StateTimeElibilityTrace

Enclosing class:

TimeIndexedTDLambda

public static class TimeIndexedTDLambda.StateTimeElibilityTrace
extends TDLambda.StateEligibilityTrace

Extends the standard TDLambda.StateEligibilityTrace to include time/depth information.

Author:

James MacGlashan

Field Summary

Fields

Modifier and Type	Field and Description
int	timeIndex The time/depth of the state this eligibility represents.

Fields inherited from class burlap.behavior.singleagent.learning.actorcritic.critics.TDLambda.StateEligibilityTrace

eligibility, sh, v

Constructor Summary

Constructors

Constructor and Description
TimeIndexedTDLambda.StateTimeElibilityTrace(HashableState sh, int time, double eligibility, burlap.behavior.singleagent.learning.actorcritic.critics.TDLambda.VValue v) Initializes with hashed state, eligibility value, time/depth of the state, and the value function value associated with the state.

Method Summary

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

timeIndex

public int timeIndex

The time/depth of the state this eligibility represents.

Constructor Detail

TimeIndexedTDLambda.StateTimeElibilityTrace

public TimeIndexedTDLambda.StateTimeElibilityTrace(HashableState sh,
                                           int time,
                                           double eligibility,
                                           burlap.behavior.singleagent.learning.actorcritic.critics.TDLambda.VValue v)

Initializes with hashed state, eligibility value, time/depth of the state, and the value function value associated with the state.

Parameters:

sh - the hashed input state for this eligibility

time - the time/depth of the state at which it was first visited.

eligibility - the eligibility of the state

v - the value function value for the state.