Partially observable Markov decision processGeneralization of Markov Decision Process.POMDP models an agent decision process where system dynamics are assumed to be determined by MDP, but the agent cannot directly observe the underlying state.