MathCastle
Linear AlgebraSuperchallengeMarkov Chains & Long-Run Behavior

Markov Chains & Long-Run Behavior · Superchallenge problem

A token moves on the four corners of a square. Each step it stays put with probability 12\tfrac12, and otherwise it moves to one of the two neighbouring corners, each with probability 14\tfrac14. Let MM be the 4×44\times4 transition matrix. What is the smallest positive integer nn such that every entry of MnM^n is within 0.010.01 of 14\tfrac14?