Outline

Deterministic, fully observable

Stochastic, fully observable, discrete states/actions

(MDPs)

Stochastic, partially observable, discrete

(POMDPs, Augmented MDPs)

Stochastic, partially observable, continuous

(Monte Carlo POMDPs)

Previous slide

Next slide

Back to first slide

View graphic version