Linear AlgebraEasyMarkov Chains & Long-Run Behavior
Markov Chains & Long-Run Behavior · Easy problem
A machine in a Markov model stays in the state Idle with probability each minute and leaves it with probability . Starting in Idle, what is the expected number of minutes until it first leaves Idle (counting the minute in which it leaves)?