Simulation-Based Algorithms for Markov Decision Processes - Hyeong Soo Chang,Steven I. Marcus,Jiaqiao Hu,Michael C. Fu
-20% with code BOOKS
Shipping in 17-23 days
30-day return policy
Markov decision process (MDP) models are widely used for modeling sequential decision-making problems that arise in engineering, economics, computer science, and the social sciences. Many real-world problems modeled by MDPs have huge state and/or action spaces, giving an opening to the curse of dimensionality and so making practical solution of the resulting models intractable. In other cases, the system ... Full description
You May Also Like
TOP
The Demon-Haunted World: Science as a Candle in the Dark
-20% with code BOOKS
In stock at our supplier
TOP
How Africa Works: Success and Failure on the World's Last Developmental Frontier
-20% with code BOOKS
In stock at our supplier
TOP
Many Faces, One Purpose: A Managers Handbook on Women in Firefighting
U. S. Fire Administration, Homeland Security
-20% with code BOOKS
Out of stock
TOP
The Gulf Moment: Arab Relations Since 2011
Florence Gaub, U. S. Army War College, Strategic Studies Institute
-20% with code BOOKS
Out of stock
TOP
Medizinisches Englisch pocket
-20% with code BOOKS
In stock at our supplier
TOP
The Code Book: The Science of Secrecy from Ancient Egypt to Quantum Cryptography
-20% with code BOOKS
In stock at our supplier
TOP
Introduction to Algorithms
Ronald L. Rivest, Charles E. Leiserson, Clifford Stein, Thomas H. Cormen
-20% with code BOOKS
In stock at our supplier
TOP
Skin in the Game: Hidden Asymmetries in Daily Life
-20% with code BOOKS
In stock at our supplier
TOP
Dinosaurs and Prehistoric Life: The Definitive Visual Guide to Prehistoric Animals
-20% with code BOOKS
In stock at our supplier
TOP
The Unaccountability Machine: Why Big Systems Make Terrible Decisions
-20% with code BOOKS
In stock at our supplier
TOP
Thinking in Systems: International Bestseller
-20% with code BOOKS
In stock at our supplier
TOP
Crossing Borders: About the birth of the Consortium of European Research Libraries, the organisation's early years and its path to maturity, spanning the period from the late twentieth century to the first decades of the twenty-first century
-20% with code BOOKS
In stock at our supplier
TOP
Cybernetics: Second Edition: Or the Control and Communication in the Animal and the Machine
-20% with code BOOKS
In stock at our supplier
TOP
101 Things I Learned in Architecture School
-20% with code BOOKS
In stock at our supplier
TOP
Einhundert Zitate Female Edition: Ein Postkartenbuch mit 100 Zitaten
-20% with code BOOKS
In stock at our supplier
Cook This Book: Techniques That Teach and Recipes to Repeat: A Cookbook
-20% with code BOOKS
In stock at our supplier
The Last Shah: America, Iran, and the Fall of the Pahlavi Dynasty
-20% with code BOOKS
In stock at our supplier
Description
Markov decision process (MDP) models are widely used for modeling sequential decision-making problems that arise in engineering, economics, computer science, and the social sciences. Many real-world problems modeled by MDPs have huge state and/or action spaces, giving an opening to the curse of dimensionality and so making practical solution of the resulting models intractable. In other cases, the system of interest is too complex to allow explicit specification of some of the MDP model parameters, but simulation samples are readily available (e.g., for random transitions and costs). For these settings, various sampling and population-based algorithms have been developed to overcome the difficulties of computing an optimal solution in terms of a policy and/or value function. Specific approaches include adaptive sampling, evolutionary policy iteration, evolutionary random policy search, and model reference adaptive search. This substantially enlarged new edition reflects the latest developments in novel algorithms and their underpinning theories, and presents an updated account of the topics that have emerged since the publication of the first edition. Includes: innovative material on MDPs, both in constrained settings and with uncertain transition properties; game-theoretic method for solving MDPs; theories for developing roll-out based algorithms; and details of approximation stochastic annealing, a population-based on-line simulation-based algorithm. The self-contained approach of this book will appeal not only to researchers in MDPs, stochastic modeling, and control, and simulation but will be a valuable source of tuition and reference for students of control and operations research.
More Information
| Author | Hyeong Soo Chang, Steven I. Marcus, Jiaqiao Hu, Michael C. Fu |
|---|---|
| Publisher | Springer London |
| Series | Communications and Control Engineering |
| Release year | 2013 |
| Cover type | Hardcover |
| EAN | 9781447150213 |