Linear AlgebraChallengeMarkov Chains & Long-Run Behavior
Markov Chains & Long-Run Behavior · Challenge problem
A two-state chain has transition matrix and starts in state 1. Let be the probability that it is in state 1 after steps. What is the smallest with ?