By Warren B. Powell
Praise for the First Edition
"Finally, a ebook dedicated to dynamic programming and written utilizing the language of operations examine (OR)! this pretty booklet fills a spot within the libraries of OR experts and practitioners."
This re-creation showcases a spotlight on modeling and computation for complicated periods of approximate dynamic programming problems
Understanding approximate dynamic programming (ADP) is essential as a way to improve sensible and top quality options to advanced commercial difficulties, quite whilst these difficulties contain making judgements within the presence of uncertainty. Approximate Dynamic Programming, moment version uniquely integrates 4 distinctive disciplines—Markov determination strategies, mathematical programming, simulation, and statistics—to display how you can effectively process, version, and remedy quite a lot of real-life difficulties utilizing ADP.
The ebook keeps to bridge the space among laptop technological know-how, simulation, and operations learn and now adopts the notation and vocabulary of reinforcement studying in addition to stochastic seek and simulation optimization. the writer outlines the basic algorithms that function a place to begin within the layout of sensible strategies for actual difficulties. the 3 curses of dimensionality that effect complicated difficulties are brought and particular insurance of implementation demanding situations is equipped. The Second Edition additionally features:*
A new bankruptcy describing 4 basic periods of guidelines for operating with assorted stochastic optimization difficulties: myopic guidelines, look-ahead guidelines, coverage functionality approximations, and regulations in line with worth functionality approximations*
A new bankruptcy on coverage seek that brings jointly stochastic seek and simulation optimization thoughts and introduces a brand new type of optimum studying concepts*
Updated insurance of the exploration exploitation challenge in ADP, now together with a lately built procedure for doing lively studying within the presence of a actual kingdom, utilizing the idea that of the information gradient*
A new series of chapters describing statistical equipment for approximating price features, estimating the price of a set coverage, and cost functionality approximation whereas looking for optimum policies
The awarded assurance of ADP emphasizes types and algorithms, concentrating on comparable functions and computation whereas additionally discussing the theoretical facet of the subject that explores proofs of convergence and fee of convergence. A comparable site gains an ongoing dialogue of the evolving fields of approximation dynamic programming and reinforcement studying, in addition to extra readings, software program, and datasets.
Requiring just a simple figuring out of information and chance, Approximate Dynamic Programming, moment version is a wonderful ebook for business engineering and operations study classes on the upper-undergraduate and graduate degrees. It additionally serves as a priceless reference for researchers and execs who make the most of dynamic programming, stochastic programming, and keep watch over thought to resolve difficulties of their daily paintings.