MathCastle
Linear AlgebraChallengeMarkov Chains & Long-Run Behavior

Markov Chains & Long-Run Behavior · Challenge problem

A walker moves on {0,1,2,3,4}\{0, 1, 2, 3, 4\}. From 11, 22 or 33 it steps to either neighbour with probability 1/21/2 each; from 44 it always steps to 33; state 00 is absorbing. Starting at 22, what is the expected number of steps until the walker reaches 00?