MathCastle
Linear AlgebraSuperchallengeMarkov Chains & Long-Run Behavior

Markov Chains & Long-Run Behavior · Superchallenge problem

A chain on states 1, 2, 3 has these off-diagonal transition probabilities: P(1→2)=1/4P(1 \to 2) = 1/4, P(1→3)=1/2P(1 \to 3) = 1/2, P(2→3)=1/3P(2 \to 3) = 1/3, P(2→1)=xP(2 \to 1) = x, P(3→1)=1/6P(3 \to 1) = 1/6, P(3→2)=1/2P(3 \to 2) = 1/2; the remaining probability at each state is for staying put. The chain is reversible, meaning its steady state satisfies πiP(i→j)=πjP(j→i)\pi_i P(i \to j) = \pi_j P(j \to i) for all i,ji, j. What is π1\pi_1? Express your answer as a common fraction.