Environments

Environment Types

Accessible vs. inaccessible

  • Sensors give access to complete state of the environment.

Deterministic vs. nondeterministic

  • The next state can be determined based on the current state and the action

Episodic vs. non-episodic

  • Episode: each perceive and action pairs
  • The quality of action does not depend on the previous episode.

Static vs. dynamic

  • Dynamic if the environment changes during deliberation

Discrete vs. continuous

  • Think chess vs. driving
EnvironmentAccessibleDeterministicEpisodicStaticDiscrete
Operating SystemYesYesNoNoYes
Virtual RealityYesYesYes/NoNoYes/No
Office EnvironmentNoNoNoNoNo
MarsNoSemiNoSemiNo