Examples In Markov Decision Processes