Irreducibility

A Markov chain is irreducible if every state can be reached from any other state with a nonzero probability in some finite number of steps.