burlap.behavior.stochasticgames.agents.madp

Class MADPPlannerFactory.MAVIPlannerFactory

java.lang.Object

burlap.behavior.stochasticgames.agents.madp.MADPPlannerFactory.MAVIPlannerFactory

All Implemented Interfaces:

MADPPlannerFactory

Enclosing interface:

MADPPlannerFactory

public static class MADPPlannerFactory.MAVIPlannerFactory
extends java.lang.Object
implements MADPPlannerFactory

Factory for generating multi-agent value iteration planners (MAValueIteration).

Author:

James MacGlashan

Nested Class Summary

Nested classes/interfaces inherited from interface burlap.behavior.stochasticgames.agents.madp.MADPPlannerFactory

MADPPlannerFactory.ConstantMADPPlannerFactory, MADPPlannerFactory.MAVIPlannerFactory

Field Summary

Fields

Modifier and Type	Field and Description
protected java.util.List<SGAgentType>	agentDefinitions The agent definitions for which planning is performed.
protected SGBackupOperator	backupOperator The backup operating defining the solution concept to use.
protected double	discount The discount factor in [0, 1]
protected SGDomain	domain The domain in which planning is to be performed
protected HashableStateFactory	hashingFactory The state hashing factory used to query the value function for individual states
protected JointModel	jointModel The joint action model to use in planning.
protected JointRewardFunction	jointRewardFunction The joint reward function
protected double	maxDelta The threshold that will cause VI to terminate when the max change in Q-value for is less than it
protected int	maxIterations The maximum allowable number of iterations until VI termination
protected QFunction	qInit The Q-value initialization function to use.
protected TerminalFunction	terminalFunction The state terminal function.

Constructor Summary

Constructors

Constructor and Description
MAVIPlannerFactory(SGDomain domain, JointModel jointModel, JointRewardFunction jointRewardFunction, TerminalFunction terminalFunction, double discount, HashableStateFactory hashingFactory, double qInit, SGBackupOperator backupOperator, double maxDelta, int maxIterations) Initializes.
MAVIPlannerFactory(SGDomain domain, JointModel jointModel, JointRewardFunction jointRewardFunction, TerminalFunction terminalFunction, double discount, HashableStateFactory hashingFactory, QFunction qInit, SGBackupOperator backupOperator, double maxDelta, int maxIterations) Initializes.
MAVIPlannerFactory(SGDomain domain, java.util.List<SGAgentType> agentDefinitions, JointModel jointModel, JointRewardFunction jointRewardFunction, TerminalFunction terminalFunction, double discount, HashableStateFactory hashingFactory, QFunction qInit, SGBackupOperator backupOperator, double maxDelta, int maxIterations) Initializes.

Method Summary

Modifier and Type	Method and Description
MADynamicProgramming	getPlannerInstance() returns an MADynamicProgramming reference to use for planning.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

domain

protected SGDomain domain

The domain in which planning is to be performed

agentDefinitions

protected java.util.List<SGAgentType> agentDefinitions

The agent definitions for which planning is performed.

jointModel

protected JointModel jointModel

The joint action model to use in planning.

jointRewardFunction

protected JointRewardFunction jointRewardFunction

The joint reward function

terminalFunction

protected TerminalFunction terminalFunction

The state terminal function.

discount

protected double discount

The discount factor in [0, 1]

hashingFactory

protected HashableStateFactory hashingFactory

The state hashing factory used to query the value function for individual states

qInit

protected QFunction qInit

The Q-value initialization function to use.

backupOperator

protected SGBackupOperator backupOperator

The backup operating defining the solution concept to use.

maxDelta

protected double maxDelta

The threshold that will cause VI to terminate when the max change in Q-value for is less than it

maxIterations

protected int maxIterations

The maximum allowable number of iterations until VI termination

Constructor Detail

MAVIPlannerFactory

public MAVIPlannerFactory(SGDomain domain,
                          JointModel jointModel,
                          JointRewardFunction jointRewardFunction,
                          TerminalFunction terminalFunction,
                          double discount,
                          HashableStateFactory hashingFactory,
                          double qInit,
                          SGBackupOperator backupOperator,
                          double maxDelta,
                          int maxIterations)

Initializes.

Parameters:

domain - the domain in which to perform planing

jointModel - the joint action model

jointRewardFunction - the joint reward function

terminalFunction - the terminal state function

discount - the discount

hashingFactory - the hashing factory to use for storing states

qInit - the default Q-value to initialize all values to

backupOperator - the backup operator that defines the solution concept being solved

maxDelta - the threshold that causes VI to terminate when the max Q-value change is less than it

maxIterations - the maximum number of iterations allowed

MAVIPlannerFactory

public MAVIPlannerFactory(SGDomain domain,
                          JointModel jointModel,
                          JointRewardFunction jointRewardFunction,
                          TerminalFunction terminalFunction,
                          double discount,
                          HashableStateFactory hashingFactory,
                          QFunction qInit,
                          SGBackupOperator backupOperator,
                          double maxDelta,
                          int maxIterations)

Initializes.

Parameters:

domain - the domain in which to perform planing

jointModel - the joint action model

jointRewardFunction - the joint reward function

terminalFunction - the terminal state function

discount - the discount

hashingFactory - the hashing factory to use for storing states

qInit - the q-value initialization function to use.

backupOperator - the backup operator that defines the solution concept being solved

maxDelta - the threshold that causes VI to terminate when the max Q-value change is less than it

maxIterations - the maximum number of iterations allowed

MAVIPlannerFactory

public MAVIPlannerFactory(SGDomain domain,
                          java.util.List<SGAgentType> agentDefinitions,
                          JointModel jointModel,
                          JointRewardFunction jointRewardFunction,
                          TerminalFunction terminalFunction,
                          double discount,
                          HashableStateFactory hashingFactory,
                          QFunction qInit,
                          SGBackupOperator backupOperator,
                          double maxDelta,
                          int maxIterations)

Initializes.

Parameters:

domain - the domain in which to perform planing

agentDefinitions - the definitions of the agent types

jointModel - the joint action model

jointRewardFunction - the joint reward function

terminalFunction - the terminal state function

discount - the discount

hashingFactory - the hashing factory to use for storing states

qInit - the q-value initialization function to use.

backupOperator - the backup operator that defines the solution concept being solved

maxDelta - the threshold that causes VI to terminate when the max Q-value change is less than it

maxIterations - the maximum number of iterations allowed

Method Detail

getPlannerInstance

public MADynamicProgramming getPlannerInstance()

Description copied from interface: MADPPlannerFactory

returns an MADynamicProgramming reference to use for planning.

Specified by:

getPlannerInstance in interface MADPPlannerFactory

Returns:

an MADynamicProgramming reference to use for planning.