burlap.behavior.functionapproximation.dense

Class DenseStateActionLinearVFA

java.lang.Object

burlap.behavior.functionapproximation.dense.DenseStateActionLinearVFA

All Implemented Interfaces:

DifferentiableStateActionValue, ParametricFunction, ParametricFunction.ParametricStateActionFunction

public class DenseStateActionLinearVFA
extends java.lang.Object
implements DifferentiableStateActionValue

Author:

James MacGlashan.

Nested Class Summary

Nested classes/interfaces inherited from interface burlap.behavior.functionapproximation.ParametricFunction

ParametricFunction.ParametricStateActionFunction, ParametricFunction.ParametricStateFunction

Field Summary

Fields

Modifier and Type	Field and Description
protected double[]	currentFeatures
protected FunctionGradient	currentGradient
protected double	currentValue
protected double	defaultWeight A default weight value for the functions weights.
protected DenseStateActionFeatures	features
protected State	lastState
protected double[]	stateActionWeights The function weights when performing Q-value function approximation.

Constructor Summary

Constructors

Constructor and Description
DenseStateActionLinearVFA(DenseStateActionFeatures features, double defaultWeight)
DenseStateActionLinearVFA(DenseStateActionFeatures features, double[] stateActionWeights, double defaultWeight)

Method Summary

Modifier and Type	Method and Description
DenseStateActionLinearVFA	copy() Returns a copy of this ParametricFunction.
double	evaluate(State s, Action a) Sets the input of this function to the given State and Action and returns the value of it.
double	getParameter(int i) Returns the value of the ith parameter value
FunctionGradient	gradient(State s, Action a) Returns the gradient of this function.
int	numParameters() Returns the number of parameters defining this function.
void	resetParameters() Resets the parameters of this function to default values.
void	setParameter(int i, double p) Sets the value of the ith parameter to given value

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

features

protected DenseStateActionFeatures features

stateActionWeights

protected double[] stateActionWeights

The function weights when performing Q-value function approximation.

defaultWeight

protected double defaultWeight

A default weight value for the functions weights.

currentFeatures

protected double[] currentFeatures

currentValue

protected double currentValue

currentGradient

protected FunctionGradient currentGradient

lastState

protected State lastState

Constructor Detail

DenseStateActionLinearVFA

public DenseStateActionLinearVFA(DenseStateActionFeatures features,
                                 double defaultWeight)

DenseStateActionLinearVFA

public DenseStateActionLinearVFA(DenseStateActionFeatures features,
                                 double[] stateActionWeights,
                                 double defaultWeight)

Method Detail

gradient

public FunctionGradient gradient(State s,
                                 Action a)

Description copied from interface: DifferentiableStateActionValue

Returns the gradient of this function.

Specified by:

gradient in interface DifferentiableStateActionValue

Parameters:

s - the input State

a - the input Action

Returns:

the FunctionGradient of this function at the input

evaluate

public double evaluate(State s,
                       Action a)

Description copied from interface: ParametricFunction.ParametricStateActionFunction

Sets the input of this function to the given State and Action and returns the value of it.

Specified by:

evaluate in interface ParametricFunction.ParametricStateActionFunction

Parameters:

s - the input State

a - the input action

Returns:

the value of this function evaluated on the State and Action

numParameters

public int numParameters()

Description copied from interface: ParametricFunction

Returns the number of parameters defining this function. Note that some implementations my have a dynamic number of parameters that grows or shrinks over time. Consult the documentation for the specific implementation for more information.

Specified by:

numParameters in interface ParametricFunction

Returns:

the number of parameters defining this function.

getParameter

public double getParameter(int i)

Description copied from interface: ParametricFunction

Returns the value of the ith parameter value

Specified by:

getParameter in interface ParametricFunction

Parameters:

i - the parameter index

Returns:

the double value of the ith parameter

setParameter

public void setParameter(int i,
                         double p)

Description copied from interface: ParametricFunction

Sets the value of the ith parameter to given value

Specified by:

setParameter in interface ParametricFunction

Parameters:

i - the index of the parameter to set

p - the parameter value to which it should be set

resetParameters

public void resetParameters()

Description copied from interface: ParametricFunction

Resets the parameters of this function to default values.

Specified by:

resetParameters in interface ParametricFunction

copy

public DenseStateActionLinearVFA copy()

Description copied from interface: ParametricFunction

Returns a copy of this ParametricFunction.

Specified by:

copy in interface ParametricFunction

Returns:

a copy of this ParametricFunction.