© 2014, International Linear Algebra Society. All rights reserved. Consider a homogeneous Markov chain with discrete time and with a finite set of states E0, . . . ,En such that the state E0 is absorbing and states E1, . ...