MathCastle
Linear AlgebraEasyMarkov Chains & Long-Run Behavior

Markov Chains & Long-Run Behavior · Easy problem

A chain on states 1, 2, 3 has transition matrix M=(01/21/21/201/21/21/20)M = \begin{pmatrix} 0 & 1/2 & 1/2 \\ 1/2 & 0 & 1/2 \\ 1/2 & 1/2 & 0 \end{pmatrix}, where MijM_{ij} is the probability of moving to state ii from state jj. Starting in state 1, what is the probability of being in state 1 again after exactly two steps? Express your answer as a common fraction.