Abstract
Assume the sequence of random variables x0, x1, x2, ··· forms a two-state, homogeneous Markov chain with transition probabilities and initial probabilities