Sequential Analysis of Observational Data Using Markov Chains