burlap.behavior.singleagent.learning.tdmethods

Class SarsaLam.EligibilityTrace

java.lang.Object

burlap.behavior.singleagent.learning.tdmethods.SarsaLam.EligibilityTrace

Enclosing class:

SarsaLam

public static class SarsaLam.EligibilityTrace
extends java.lang.Object

A data structure for maintaining eligibility trace values

Author:

James MacGlashan

Field Summary

Fields

Modifier and Type	Field and Description
double	eligibility The eligibility value
double	initialQ The initial numeric Q-value for this trace when it was created.
QValue	q The current Q-value info for this trace (contains the action reference)
HashableState	sh The state for this trace

Constructor Summary

Constructors

Constructor and Description
EligibilityTrace(HashableState sh, QValue q, double elgigbility) Creates a new eligibility trace to track for an episode.

Method Summary

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

eligibility

public double eligibility

The eligibility value

sh

public HashableState sh

The state for this trace

q

public QValue q

The current Q-value info for this trace (contains the action reference)

initialQ

public double initialQ

The initial numeric Q-value for this trace when it was created.

Constructor Detail

EligibilityTrace

public EligibilityTrace(HashableState sh,
                        QValue q,
                        double elgigbility)

Creates a new eligibility trace to track for an episode.

Parameters:

sh - the state of the trace

q - the q-value (containing the action reference) of the trace

elgigbility - the eligibility value