Markov Processes for Stochastic Modeling

This book presents an algebraic development of the theory of countable state space Markov chains with discrete and continuous time parameters. It emphasizes time-dependent behavior, including first passage times of Markov chains, and provides numerous examples from queueing, reliability, and other models.