Numerical Methods for Controlled Stochastic Delay Systems

The Markov chain approximation methods are widely used for the numerical solution of nonlinear stochastic control problems in continuous time. This book extends the methods to stochastic systems with delays. It is the first book on the subject.