Markov Decision Processes

by Martin L. Puterman

2005 680 pages eng

The past decade has seen considerable theoretical and applied research on Markov decision processes, as well as the growing use of these models in ecology, economics, communications engineering, and other fields where outcomes are uncertain and sequential decision-making processes are needed. A tim…