Linear AlgebraHardMarkov Chains & Long-Run Behavior
Markov Chains & Long-Run Behavior · Hard problem
A two-state chain has transition matrix , where is the probability of moving to state from state . What is the SMALLEST value of for which is a valid transition matrix, and, using that value of , what is the steady-state probability of state ? Express your answer as a common fraction.