Linear AlgebraChallengeMarkov Chains & Long-Run Behavior
Markov Chains & Long-Run Behavior · Challenge problem
A Markov chain on the states moves as follows. From it moves to with probability and otherwise stays at . From it moves to , stays at , or moves to , each with probability . From it moves to with probability , stays with probability , and moves to with probability . From it always moves to . What is the steady-state probability of state ? Express your answer as a common fraction.