Markov analysis of qualitative dynamics