An excursion into Markov chains