In this paper, we consider $C^*$-algebrasgenerated by Markov operators induced by aprobabilistic dynamical system. It is shown that in some cases thesealgebras are isomorphic to Toeplitz, Cuntz, and Cuntz–Toeplitzalgebras. ...