Download table of contents, and appendix on Markov models
Download pre-publication draft
Presentations: Workload relaxations, Markov tutorial, MaxWeight policies, TD Learning
Published December 2007. For more information go to Cambridge University, or your favorite retailer.
 |
More on simulation can be found in Glynn & Asmussen's Stochastic Simulation: Algorithms and Analysis |
Sean Meyn’s text is a wonderful piece of work... It progresses through a series of important topics, running the gamut from modern control techniques for queueing system analysis, to optimization of deterministic network models, to computer simulation methods; and all the while, it provides rigorous mathematical foundations alongside a variety of clever, practical applications. The lively writing style and apt examples keep everything interesting, and I believe that readers will greatly appreciate and benefit from this unique book.' David M. Goldsman, Georgia Institute of Technology
'Sean Meyn’s earlier book with Tweedie is the bible for economists who use Markov models to do everything from formulating asset pricing models to constructing Bayesian posteriors for dynamic models. This book is a gold mine of useful new ideas. I predict that the ideas in chapter 11 alone will have a big impact on the way we think about computing rational expectations equilibria.' Thomas Sargent, New York University
'The first comprehensive account of some major strands of research in modeling, approximation, stability analysis and optimization of stochastic networks, from a leader in the field...Notable among these are its coverage of deterministic fluid limits, controlled random walk models, approximation via workload relaxation, and implications of these to stability and optimization of networks. Several important special instances are worked out in detail. A valuable resource for both researchers and practitioners.' Vivek S. Borkar, Tata Institute of Fundamental Research
