MathCastle
Linear AlgebraHardMarkov Chains & Long-Run Behavior

Markov Chains & Long-Run Behavior · Hard problem

A two-state chain has transition matrix M(p)=(2p−0.20.41.2−2p0.6)M(p) = \begin{pmatrix} 2p - 0.2 & 0.4 \\ 1.2 - 2p & 0.6 \end{pmatrix}, where MijM_{ij} is the probability of moving to state ii from state jj. What is the SMALLEST value of pp for which M(p)M(p) is a valid transition matrix, and, using that value of pp, what is the steady-state probability of state 11? Express your answer as a common fraction.