MathCastle
Linear AlgebraHardMarkov Chains & Long-Run Behavior

Markov Chains & Long-Run Behavior · Hard problem

A chain has transition matrix M=(0.60.30.40.7)M = \begin{pmatrix} 0.6 & 0.3 \\ 0.4 & 0.7 \end{pmatrix}, where MijM_{ij} is the probability of moving to state ii from state jj. Compare starting in state 11 to starting in state 22: after 22 steps, which start gives the higher probability of being in state 11, and what is the positive difference between the two probabilities? Express your answer as a common fraction.