Markov Decision Processes with Applications to Finance