Overview
Simulation Optimization focuses on optimize systems whose performance is estimated by simulation. In the map of OR, it connects Ranking & selection, Response surfaces, SAA to decisions that must be modeled, solved, explained, and revised as evidence changes.
Simulation optimization uses ranking and selection, response surfaces, stochastic approximation, and Bayesian optimization to choose policies in noisy models. The practical use case is clearest in Call centers, Hospitals, Warehouses, Manufacturing lines, where the method helps turn constraints and tradeoffs into a decision artifact someone can inspect.
Core ideas
Ranking & selection
Ranking & selection is a core checkpoint for Simulation Optimization: define it concretely, attach units or rules where possible, and test whether stakeholders interpret it the same way.
Response surfaces
Response surfaces is a core checkpoint for Simulation Optimization: define it concretely, attach units or rules where possible, and test whether stakeholders interpret it the same way.
SAA
SAA is a core checkpoint for Simulation Optimization: define it concretely, attach units or rules where possible, and test whether stakeholders interpret it the same way.
Bayesian optimization
Bayesian optimization is a core checkpoint for Simulation Optimization: define it concretely, attach units or rules where possible, and test whether stakeholders interpret it the same way.
How to use it
- 1Start with Call centers: write the decision, time horizon, actors, and objective in operational language.
- 2Translate the problem into Ranking & selection, Response surfaces, and SAA; define units and data sources for each one.
- 3Build a small instance of Simulation Optimization that can be solved or simulated by hand inspection before using full production data.
- 4Compare the recommendation against a baseline policy, not just against mathematical optimality.
- 5Document assumptions, sensitivity results, and the conditions under which the recommendation should be revisited.
Applications
- Call centers: compare feasible policies, quantify the operating tradeoffs, and make the assumptions behind the recommendation visible.
- Hospitals: compare feasible policies, quantify the operating tradeoffs, and make the assumptions behind the recommendation visible.
- Warehouses: compare feasible policies, quantify the operating tradeoffs, and make the assumptions behind the recommendation visible.
- Manufacturing lines: compare feasible policies, quantify the operating tradeoffs, and make the assumptions behind the recommendation visible.
Common pitfalls
- Applying Simulation Optimization because the label sounds appropriate while leaving the actual decision boundary vague.
- Treating Ranking & selection as a technical detail instead of a modeling choice that affects the recommendation.
- Reporting one answer without showing sensitivity to demand, capacity, costs, or behavioral assumptions.
- Ignoring implementation details such as data quality, explainability, ownership, and how users will override bad recommendations.
Resources
- Winter Simulation Conference
Topic-specific source curated for Simulation Optimization.
- SimPy Documentation
Process-based discrete-event simulation framework for Python.
- Algorithms for Decision Making
Open book covering planning, MDPs, reinforcement learning, and decision algorithms.