Linear AlgebraHardMarkov Chains & Long-Run Behavior
Markov Chains & Long-Run Behavior · Hard problem
A -state Markov chain has this rule: state always moves to state , and state always moves back to state ; state is absorbing; state moves to state or to state , each with probability ; state moves to state or to state , each with probability . How many of the states are recurrent (that is, once the chain is in one of them, it is certain to return to it)?