burlap.behavior.stochasticgames.madynamicprogramming

Class AgentQSourceMap.MAQLControlledQSourceMap

java.lang.Object

burlap.behavior.stochasticgames.madynamicprogramming.AgentQSourceMap.MAQLControlledQSourceMap

All Implemented Interfaces:

AgentQSourceMap

Enclosing interface:

AgentQSourceMap

public static class AgentQSourceMap.MAQLControlledQSourceMap
extends java.lang.Object
implements AgentQSourceMap

An implementation of the AgentQSourceMap in which different agent objects each maintain their own personal Q-source. This is useful if all agents are implementing the same multi-agent learning algorithm so that each agent doesn't have to replicate the learned Q-values for all other agents; instead only one copy will be kept for each agent. For example, this can be useful when all agents implement CoCo-Q learning.

Author:

James MacGlashan

Nested Class Summary

Nested classes/interfaces inherited from interface burlap.behavior.stochasticgames.madynamicprogramming.AgentQSourceMap

AgentQSourceMap.HashMapAgentQSourceMap, AgentQSourceMap.MAQLControlledQSourceMap

Field Summary

Fields

Modifier and Type	Field and Description
protected java.util.Map<java.lang.Integer,MultiAgentQLearning>	qSourceMapping

Constructor Summary

Constructors

Constructor and Description
MAQLControlledQSourceMap(java.util.List<SGAgent> agents) Initializes with the list of agents that each keep their own Q-source.

Method Summary

Modifier and Type	Method and Description
QSourceForSingleAgent	agentQSource(int agentNum) Returns a QSource which can be used to query the Q-values of a given agent.
void	setAgents(java.util.List<MultiAgentQLearning> agents) Initializes with a list of agents that each keep their own Q_source.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

qSourceMapping

protected java.util.Map<java.lang.Integer,MultiAgentQLearning> qSourceMapping

Constructor Detail

MAQLControlledQSourceMap

public MAQLControlledQSourceMap(java.util.List<SGAgent> agents)

Initializes with the list of agents that each keep their own Q-source. Agent instances are expected to be of type MultiAgentQLearning. This constructor accepts a list of regular agents, however, to make construction easier. An exception will be thrown if all of all of the agents are not of the right type.

Parameters:

agents - a list of SGAgent objects, each which is an instance MultiAgentQLearning.

Method Detail

setAgents

public void setAgents(java.util.List<MultiAgentQLearning> agents)

Initializes with a list of agents that each keep their own Q_source.

Parameters:

agents - a list of MultiAgentQLearning agents/

agentQSource

public QSourceForSingleAgent agentQSource(int agentNum)

Description copied from interface: AgentQSourceMap

Returns a QSource which can be used to query the Q-values of a given agent.

Specified by:

agentQSource in interface AgentQSourceMap

Parameters:

agentNum - the agent for whom the qSource is to be provided

Returns:

A QSourceForSingleAgent object that allows the Q-values for a single agent to be queried.