MathCastle
Linear AlgebraChallengeMarkov Chains & Long-Run Behavior

Markov Chains & Long-Run Behavior · Challenge problem

A Markov chain on the states 0,1,2,30, 1, 2, 3 moves as follows. From 00 it moves to 11 with probability 12\tfrac12 and otherwise stays at 00. From 11 it moves to 00, stays at 11, or moves to 22, each with probability 13\tfrac13. From 22 it moves to 11 with probability 12\tfrac12, stays with probability 14\tfrac14, and moves to 33 with probability 14\tfrac14. From 33 it always moves to 22. What is the steady-state probability of state 33? Express your answer as a common fraction.