burlap.behavior.singleagent.learning.tdmethods.vfa

Class GradientDescentSarsaLam.EligibilityTraceVector

java.lang.Object

burlap.behavior.singleagent.learning.tdmethods.vfa.GradientDescentSarsaLam.EligibilityTraceVector

Enclosing class:

GradientDescentSarsaLam

public static class GradientDescentSarsaLam.EligibilityTraceVector
extends java.lang.Object

An object for keeping track of the eligibility traces within an episode for each VFA weight

Author:

James MacGlashan

Field Summary

Fields

Modifier and Type	Field and Description
double	eligibilityValue The eligibility value
double	initialWeightValue The value of the weight when the trace started
int	weight The VFA weight being traced

Constructor Summary

Constructors

Constructor and Description
EligibilityTraceVector(int weight, double weightValue, double eligibilityValue) Creates a trace for the given weight with the given eligibility value

Method Summary

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

weight

public int weight

The VFA weight being traced

eligibilityValue

public double eligibilityValue

The eligibility value

initialWeightValue

public double initialWeightValue

The value of the weight when the trace started

Constructor Detail

EligibilityTraceVector

public EligibilityTraceVector(int weight,
                              double weightValue,
                              double eligibilityValue)

Creates a trace for the given weight with the given eligibility value

Parameters:

weight - the VFA weight

weightValue - the initial weight value

eligibilityValue - the eligibility to assign to it.