MathCastle
Linear AlgebraChallengeMarkov Chains & Long-Run Behavior

Markov Chains & Long-Run Behavior · Challenge problem

A lamp always holds one bulb, whose age in days is 11, 22, 33 or 44. A bulb of age kk burns out at the end of the day with probability k/4k/4 (so a bulb of age 44 always burns out); a burnt-out bulb is replaced overnight by a new bulb, of age 11 the next day, and otherwise the bulb's age goes up by 11. In the long run, on what fraction of days does the bulb burn out? Express your answer as a common fraction.