MathCastle
Linear AlgebraEasyMarkov Chains & Long-Run Behavior

Markov Chains & Long-Run Behavior · Easy problem

A three-state chain has transition matrix M=(1/201/31/41/21/31/41/21/3)M = \begin{pmatrix} 1/2 & 0 & 1/3 \\ 1/4 & 1/2 & 1/3 \\ 1/4 & 1/2 & 1/3 \end{pmatrix} (MijM_{ij} is the probability of moving to state ii from state jj) and starting distribution x0=(1/201/2)\mathbf x_0 = \begin{pmatrix} 1/2 \\ 0 \\ 1/2 \end{pmatrix}. What is the probability of being in state 2 after one step? Express your answer as a common fraction.