MathCastle
Linear AlgebraChallengeMarkov Chains & Long-Run Behavior

Markov Chains & Long-Run Behavior · Challenge problem

A token sits on one of three vertices. Each step it stays where it is with probability 1/21/2 and otherwise moves to one of the other two vertices, each with probability 1/41/4. Using the eigenvalues of the transition matrix, find the probability that after exactly 33 steps the token is back on its starting vertex. Express your answer as a common fraction.