Linear AlgebraHardMarkov Chains & Long-Run Behavior
Markov Chains & Long-Run Behavior · Hard problem
A particle sits at position of . From it moves to or to , each with probability ; from it always moves to , and from it always moves to . What is the expected number of steps until the particle has visited BOTH and at least once?