Markov Processes and Applications