From the Publisher:
"Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning introduces the evolving area of simulation-based optimization. Since it became possible to analyze random systems using computers, scientists and engineers have sought the means to optimize systems using simulation models. Only recently, however, has this objective had success in practice. Cutting-edge work in computational operations research, including non-linear programming (simultaneous perturbation), dynamic programming (reinforcement learning), and game theory (learning automata) has made it possible to use simulation in conjunction with optimization techniques. As a result, this research has given simulation added dimensions and power that it did not have in the recent past." "The book's objective is two-fold: (1) It examines the mathematical governing principles of simulation-based optimization, thereby providing the reader with the ability to model relevant real-life problems using these techniques. (2) It outlines the computational technology underlying these methods. Taken together, these two aspects demonstrate that the mathematical and computational methods discussed in this book do work." "Broadly speaking, the book has two parts: (1) parametric (static) optimization and (2) control (dynamic) optimization. Some of the book's special features are: an accessible introduction to reinforcement learning and parametric-optimization techniques; a step-by-step description of several algorithms of simulation-based optimization; a clear and simple introduction to the methodology of neural networks; a gentle introduction to convergence analysis of some of the methods enumerated above; and Computer programs for many algorithms of simulation-based optimization." This book is written for students and researchers in the fields of engineering (electrical, industrial and computer), computer science, operations research, management science, and applied mathematics.
Cited By
- Rivera-Gómez H, Gharbi A, Kenné J, Montaño-Arango O and Corona-Armenta J (2022). Joint optimization of production and maintenance strategies considering a dynamic sampling strategy for a deteriorating system, Computers and Industrial Engineering, 140:C, Online publication date: 1-Feb-2020.
- Horesh N, Bäck T and Shir O Predict or screen your expensive assay Proceedings of the Genetic and Evolutionary Computation Conference, (274-284)
- Krauß D, Paus F, Vahrenkamp N, Asfour T and Andelfinger P Evaluating and optimizing component-based robot architectures using network simulation Proceedings of the 2018 Winter Simulation Conference, (1061-1072)
- Shah A, Ganesan R, Jajodia S and Cam H (2018). Dynamic Optimization of the Level of Operational Effectiveness of a CSOC Under Adverse Conditions, ACM Transactions on Intelligent Systems and Technology, 9:5, (1-20), Online publication date: 30-Sep-2018.
- Moradi A and Dariane A (2017). Evolving neural networks and fuzzy clustering for multireservoir operations, Neural Computing and Applications, 28:5, (1149-1162), Online publication date: 1-May-2017.
- Kiourt C, Pavlidis G, Koutsoudis A and Kalles D (2017). Realistic Simulation of Cultural Heritage, International Journal of Computational Methods in Heritage Science, 1:1, (10-40), Online publication date: 1-Jan-2017.
- Peirleitner A, Altendorfer K and Felberbauer T A simulation approach for multi-stage supply chain optimization to analyze real world transportation effects Proceedings of the 2016 Winter Simulation Conference, (2272-2283)
- Ganesan R, Jajodia S, Shah A and Cam H (2016). Dynamic Scheduling of Cybersecurity Analysts for Minimizing Risk Using Reinforcement Learning, ACM Transactions on Intelligent Systems and Technology, 8:1, (1-21), Online publication date: 3-Oct-2016.
- Babbar-Sebens M, Mukhopadhyay S, Singh V and Piemonti A (2015). A web-based software tool for participatory optimization of conservation practices in watersheds, Environmental Modelling & Software, 69:C, (111-127), Online publication date: 1-Jul-2015.
- Grinberg Y, Precup D and Gendreau M Optimizing energy production using policy search and predictive state representations Proceedings of the 28th International Conference on Neural Information Processing Systems - Volume 2, (2969-2977)
- Borkar V and Mathkar A Reinforcement Learning for Matrix Computations Proceedings of the 10th International Conference on Distributed Computing and Internet Technology - Volume 8337, (14-24)
- Gosavi A Relative value iteration for average reward semi-Markov control via simulation Proceedings of the 2013 Winter Simulation Conference: Simulation: Making Decisions in a Complex World, (623-630)
- Syberfeldt A and Lidberg S Real-world simulation-based manufacturing optimization using Cuckoo search Proceedings of the Winter Simulation Conference, (1-12)
- Ma L and Forouraghi B A modified particle swarm optimizer for engineering design Proceedings of the 25th international conference on Industrial Engineering and Other Applications of Applied Intelligent Systems: advanced research in applied artificial intelligence, (187-196)
- Bertsekas D and Yu H (2012). Q-Learning and Enhanced Policy Iteration in Discounted Dynamic Programming, Mathematics of Operations Research, 37:1, (66-94), Online publication date: 1-Feb-2012.
- Mattila V and Virtanen K Scheduling fighter aircraft maintenance with reinforcement learning Proceedings of the Winter Simulation Conference, (2540-2551)
- Okamura H, Dohi T and Trivedi K On-line adaptive algorithms in autonomic restart control Proceedings of the 7th international conference on Autonomic and trusted computing, (32-46)
- Jung H and Pedram M (2010). Supervised learning based power management for multicore processors, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 29:9, (1395-1408), Online publication date: 1-Sep-2010.
- Wang J and Tropper C Using genetic algorithms to limit the optimism in time warp Winter Simulation Conference, (1180-1188)
- Kabirian A and Olafsson S Simulation optimization with hybrid golden region search Winter Simulation Conference, (551-562)
- Gosavi A Reinforcement learning for model building and variance-penalized control Winter Simulation Conference, (373-379)
- Gueta L, Chiba R, Arai T, Ueyama T and Ota J Compact design of work cell with robot arm and positioning table under a task completion time constraint Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems, (807-813)
- Hutchison D and Spall J Stopping small-sample stochastic approximation Proceedings of the 2009 conference on American Control Conference, (26-31)
- Gueta L, Chiba R, Arai T, Ueyama T and Ota J Hybrid design for multiple-goal task realization of robot arm with rotating table Proceedings of the 2009 IEEE international conference on Robotics and Automation, (4200-4205)
- Gosavi A (2009). Reinforcement Learning, INFORMS Journal on Computing, 21:2, (178-192), Online publication date: 1-Apr-2009.
- Deng G and Ferris M (2009). Variable-Number Sample-Path Optimization, Mathematical Programming: Series A and B, 117:1-2, (81-109), Online publication date: 1-Mar-2009.
- Lev B (2018). Book Reviews, Interfaces, 39:2, (172-178), Online publication date: 1-Mar-2009.
- Leng J, Fyfe C and Jain L (2018). Simulation and reinforcement learning with soccer agents, Multiagent and Grid Systems, 4:4, (415-436), Online publication date: 1-Dec-2008.
- Jung H and Pedram M Resilient dynamic power management under uncertainty Proceedings of the conference on Design, automation and test in Europe, (224-229)
- Wang J and Tropper C Optimizing time warp simulation with reinforcement learning techniques Proceedings of the 39th conference on Winter simulation: 40 years! The best is yet to come, (577-584)
- Kabirian A and Olafsson S Allocation of simulation runs for simulation optimization Proceedings of the 39th conference on Winter simulation: 40 years! The best is yet to come, (363-371)
- Kotsiantis S Supervised Machine Learning Proceedings of the 2007 conference on Emerging Artificial Intelligence Applications in Computer Engineering: Real Word AI Systems with Applications in eHealth, HCI, Information Retrieval and Pervasive Technologies, (3-24)
- Subramaniam G and Gosavi A Simulation-based optimization for material dispatching in a retailer network Proceedings of the 36th conference on Winter simulation, (1412-1417)
Index Terms
- Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning