burlap.behavior.singleagent.learning.actorcritic.critics

Class TDLambda.StateEligibilityTrace

java.lang.Object

burlap.behavior.singleagent.learning.actorcritic.critics.TDLambda.StateEligibilityTrace

Direct Known Subclasses:

TimeIndexedTDLambda.StateTimeElibilityTrace

Enclosing class:

TDLambda

public static class TDLambda.StateEligibilityTrace
extends java.lang.Object

A data structure for storing the elements of an eligibility trace.

Author:

James MacGlashan

Field Summary

Fields

Modifier and Type	Field and Description
double	eligibility The eligibility value
HashableState	sh The hashed state with which the eligibility value is associated.
burlap.behavior.singleagent.learning.actorcritic.critics.TDLambda.VValue	v The value associated with the state.

Constructor Summary

Constructors

Constructor and Description
StateEligibilityTrace(HashableState sh, double eligibility, burlap.behavior.singleagent.learning.actorcritic.critics.TDLambda.VValue v) Initializes with hashed state, eligibility value and the value function value associated with the state.

Method Summary

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

eligibility

public double eligibility

The eligibility value

sh

public HashableState sh

The hashed state with which the eligibility value is associated.

v

public burlap.behavior.singleagent.learning.actorcritic.critics.TDLambda.VValue v

The value associated with the state.

Constructor Detail

StateEligibilityTrace

public StateEligibilityTrace(HashableState sh,
                             double eligibility,
                             burlap.behavior.singleagent.learning.actorcritic.critics.TDLambda.VValue v)

Initializes with hashed state, eligibility value and the value function value associated with the state.

Parameters:

sh - the hashed input state for this eligibility

eligibility - the eligibility of the state

v - the value function value for the state.