Linear AlgebraChallengeMarkov Chains & Long-Run Behavior
Markov Chains & Long-Run Behavior · Challenge problem
A two-state Markov chain with unknown transition matrix starts in state 1. The probability of being in state 1 is after one step and after two steps. What is the long-run probability of state 1? Express your answer as a common fraction.