MathCastle
Linear AlgebraEasyMarkov Chains & Long-Run Behavior

Markov Chains & Long-Run Behavior · Easy problem

A two-state chain has transition matrix M=(1/21/31/22/3)M = \begin{pmatrix} 1/2 & 1/3 \\ 1/2 & 2/3 \end{pmatrix} (columns sum to 11; MijM_{ij} is the probability of moving to ii from jj). In its steady state, what is the probability of state 1? Express your answer as a common fraction.