burlap.behavior.valuefunction

Class QProvider.Helper

java.lang.Object

burlap.behavior.valuefunction.QProvider.Helper

Enclosing interface:

QProvider

public static class QProvider.Helper
extends java.lang.Object

A class of helper static methods that may be commonly used by code that uses a QFunction instance. In particular, methods for computing the value function of a state, given the Q-values (the max Q-value or policy weighted value).

Method Summary

Modifier and Type	Method and Description
static double	maxQ(QProvider qSource, State s) Returns the optimal state value function for a state given a QProvider.
static double	policyValue(QProvider qSource, State s, EnumerablePolicy p) Returns the state value under a given policy for a state and QProvider.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

maxQ

public static double maxQ(QProvider qSource,
                          State s)

Returns the optimal state value function for a state given a QProvider. The optimal value is the max Q-value. If no actions are permissible in the input state, then zero is returned.

Parameters:

qSource - the QProvider capable of producing Q-values.

s - the query State for which the value should be returned.

Returns:

the max Q-value for all possible Q-values in the state.

policyValue

public static double policyValue(QProvider qSource,
                                 State s,
                                 EnumerablePolicy p)

Returns the state value under a given policy for a state and QProvider. The value is the expected Q-value under the input policy action distribution. If no actions are permissible in the input state, then zero is returned.

Parameters:

qSource - the QProvider capable of producing Q-values.

s - the query State for which the value should be returned.

p - the policy defining the action distribution.

Returns:

the expected Q-value under the input policy action distribution