burlap.behavior.stochasticgames.agents.twoplayer.repeatedsinglestage

Class TitForTat

java.lang.Object

burlap.mdp.stochasticgames.agent.SGAgentBase

burlap.behavior.stochasticgames.agents.twoplayer.repeatedsinglestage.TitForTat

All Implemented Interfaces:

SGAgent

public class TitForTat
extends SGAgentBase

A class for an agent that plays tit-for-tat. The agent starts by playing a "cooperate" action. If their opponent "defects" on them, then this agent plays their "defect" action in the next turn. If their opponent "cooperates" again, then this agent will cooperate in the next turn. The corresponding "cooperate" and "defect" actions for each agent need to be specified. When a new game starts, this agent will reset to trying cooperate.

Author:

James MacGlashan

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TitForTat.TitForTatAgentFactory An agent factory for a TitForTat player.

Field Summary

Fields

Modifier and Type	Field and Description
protected int	agentNum
protected Action	lastOpponentMove The last opponent's move
protected Action	myCoop This agent's cooperate action
protected Action	myDefect This agent's defect action
protected Action	opponentCoop The opponent's cooperate action
protected Action	opponentDefect The opponent's defect action
protected int	otherNum

Fields inherited from class burlap.mdp.stochasticgames.agent.SGAgentBase

agentType, domain, internalRewardFunction, world, worldAgentName

Constructor Summary

Constructors

Constructor and Description
TitForTat(SGDomain domain, Action coop, Action defect) Initializes with the specified cooperate and defect actions for both players.
TitForTat(SGDomain domain, Action myCoop, Action myDefect, Action opponentCoop, Action opponentDefect) Initializes with differently specified cooperate and defect actions for both players.

Method Summary

Modifier and Type	Method and Description
Action	action(State s) This method is called by the world when it needs the agent to choose an action
void	gameStarting(World w, int agentNum) This method is called by the world when a new game is starting.
void	gameTerminated() This method is called by the world when a game has ended.
void	observeOutcome(State s, JointAction jointAction, double[] jointReward, State sprime, boolean isTerminal) This method is called by the world when every agent in the world has taken their action.

Methods inherited from class burlap.mdp.stochasticgames.agent.SGAgentBase

agentName, agentType, getInternalRewardFunction, init, init, setAgentDetails, setInternalRewardFunction

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

myCoop

protected Action myCoop

This agent's cooperate action

myDefect

protected Action myDefect

This agent's defect action

opponentCoop

protected Action opponentCoop

The opponent's cooperate action

opponentDefect

protected Action opponentDefect

The opponent's defect action

lastOpponentMove

protected Action lastOpponentMove

The last opponent's move

agentNum

protected int agentNum

otherNum

protected int otherNum

Constructor Detail

TitForTat

public TitForTat(SGDomain domain,
                 Action coop,
                 Action defect)

Initializes with the specified cooperate and defect actions for both players.

Parameters:

domain - the domain in which this agent will play.

coop - the cooperate action for both players

defect - the defect action for both players

TitForTat

public TitForTat(SGDomain domain,
                 Action myCoop,
                 Action myDefect,
                 Action opponentCoop,
                 Action opponentDefect)

Initializes with differently specified cooperate and defect actions for both players.

Parameters:

domain - the domain in which this agent will play

myCoop - this agent's cooperate action

myDefect - this agent's defect action

opponentCoop - the opponent's cooperate action

opponentDefect - the opponent's defect action

Method Detail

gameStarting

public void gameStarting(World w,
                         int agentNum)

Description copied from interface: SGAgent

This method is called by the world when a new game is starting.

Parameters:

w - the world in which the game is starting

agentNum - the agent number of the agent in the world

action

public Action action(State s)

Description copied from interface: SGAgent

This method is called by the world when it needs the agent to choose an action

Parameters:

s - the current state of the world

Returns:

the action this agent wishes to take

observeOutcome

public void observeOutcome(State s,
                           JointAction jointAction,
                           double[] jointReward,
                           State sprime,
                           boolean isTerminal)

Description copied from interface: SGAgent

This method is called by the world when every agent in the world has taken their action. It conveys the result of the joint action.

Parameters:

s - the state in which the last action of each agent was taken

jointAction - the joint action of all agents in the world

jointReward - the joint reward of all agents in the world

sprime - the next state to which the agent transitioned

isTerminal - whether the new state is a terminal state

gameTerminated

public void gameTerminated()

Description copied from interface: SGAgent

This method is called by the world when a game has ended.