Linear AlgebraEasyMarkov Chains & Long-Run Behavior
Markov Chains & Long-Run Behavior · Easy problem
A three-state Markov chain has steady-state distribution and is irreducible. Starting in state 3, what is the expected number of steps until the chain first returns to state 3?