burlap.oomdp.singleagent.pomdp

Class BeliefAgent

java.lang.Object

burlap.oomdp.singleagent.pomdp.BeliefAgent

Direct Known Subclasses:

BeliefPolicyAgent

public abstract class BeliefAgent
extends java.lang.Object

An agent that interacts with a POMDP environment. This class contains methods for acting until environment termination or some fixed number of steps and recording the results in an EpisodeAnalysis object. These methods will automatically update this agent's BeliefState, specified by the curBelief data member, as observations are made. Before beginning, the agent's initial BeliefState will need to be specified with the setBeliefState(burlap.oomdp.singleagent.pomdp.beliefstate.BeliefState) method. Different agents can be specified by subclassing and implementing the getAction(burlap.oomdp.singleagent.pomdp.beliefstate.BeliefState) method.

Field Summary

Fields

Modifier and Type	Field and Description
protected BeliefState	curBelief The agent's current BeliefState
protected Environment	environment The POMDP environment.
protected PODomain	poDomain The POMDP Domain defining the environment mechanics.

Constructor Summary

Constructors

Constructor and Description
BeliefAgent(PODomain poDomain, Environment environment) Initializes

Method Summary

Methods

Modifier and Type	Method and Description
EpisodeAnalysis	actUntilTerminal() Causes the agent to act until the environment reaches a termination condition.
EpisodeAnalysis	actUntilTerminalOrMaxSteps(int maxSteps) Causes the agent to act for some fixed number of steps.
abstract GroundedAction	getAction(BeliefState curBelief) Returns the action the agent should take for the input BeliefState.
void	setBeliefState(BeliefState beliefState) Sets this agent's current belief
void	setEnvironment(Environment environment) Sets the POMDP environment

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

environment

protected Environment environment

The POMDP environment.

curBelief

protected BeliefState curBelief

The agent's current BeliefState

poDomain

protected PODomain poDomain

The POMDP Domain defining the environment mechanics.

Constructor Detail

BeliefAgent

public BeliefAgent(PODomain poDomain,
           Environment environment)

Initializes

Parameters:

poDomain - the POMDP domain defining the mechanics of the environment

environment - the environment in which the agent will be interacting.

Method Detail

setEnvironment

public void setEnvironment(Environment environment)

Sets the POMDP environment

Parameters:

environment - the POMDP environment

setBeliefState

public void setBeliefState(BeliefState beliefState)

Sets this agent's current belief

Parameters:

beliefState - the agent' current belief

actUntilTerminal

public EpisodeAnalysis actUntilTerminal()

Causes the agent to act until the environment reaches a termination condition. The agent's belief is automatically updated by this method using the the current BeliefState's BeliefState.getUpdatedBeliefState(burlap.oomdp.core.states.State, burlap.oomdp.singleagent.GroundedAction) method. The agent's action selection for the current belief state is defend by the getAction(burlap.oomdp.singleagent.pomdp.beliefstate.BeliefState) method. The observation, action, and reward sequence is saved and EpisodeAnalysis object and returned.

Returns:

and EpisodeAnalysis that recorded the observation, action, and reward sequence.

actUntilTerminalOrMaxSteps

public EpisodeAnalysis actUntilTerminalOrMaxSteps(int maxSteps)

Causes the agent to act for some fixed number of steps. The agent's belief is automatically updated by this method using the the current BeliefState's BeliefState.getUpdatedBeliefState(burlap.oomdp.core.states.State, burlap.oomdp.singleagent.GroundedAction) method. The agent's action selection for the current belief state is defend by the getAction(burlap.oomdp.singleagent.pomdp.beliefstate.BeliefState) method. The observation, action, and reward sequence is saved and EpisodeAnalysis object and returned.

Returns:

and EpisodeAnalysis that recorded the observation, action, and reward sequence.

getAction

public abstract GroundedAction getAction(BeliefState curBelief)

Returns the action the agent should take for the input BeliefState.

Parameters:

curBelief - the BeliefState in which the agent must make a decision.

Returns:

A GroundedAction specifying the agent's decision for the input BeliefState.