MathCastle
Linear AlgebraChallengeMarkov Chains & Long-Run Behavior

Markov Chains & Long-Run Behavior · Challenge problem

A fair random walk on {0,1,2,3,4,5}\{0, 1, 2, 3, 4, 5\} moves ±1\pm1 with probability 1/21/2 each and is absorbed at 00 and at 55. Starting at 22, what is the expected number of times the walk is at state 33 before absorption? Use the fundamental matrix N=(I−Q)−1N = (I - Q)^{-1}. Express your answer as a common fraction.