| Class | Description |
|---|---|
| TDLambda |
An implementation of TDLambda that can be used as a critic for
ActorCritic algorithms [1]. |
| TDLambda.StateEligibilityTrace |
A data structure for storing the elements of an eligibility trace.
|
| TimeIndexedTDLambda |
An implementation of TDLambda that can be used as a critic for
ActorCritic algorithms [1], except
that this class treats states at different depths as unique states. |
| TimeIndexedTDLambda.StateTimeElibilityTrace |
Extends the standard
TDLambda.StateEligibilityTrace to include time/depth information. |