Linear AlgebraChallengeMarkov Chains & Long-Run Behavior
Markov Chains & Long-Run Behavior · Challenge problem
A walker moves on . From , or it steps to either neighbour with probability each; from it always steps to ; state is absorbing. Starting at , what is the expected number of steps until the walker reaches ?