Abstract
The aim of this paper is to establish the optimality of a hedging-point control policy in a multistate Markovian failure-prone manufacturing system with a risk-averse criterion that is defined as the conditional value-at-risk (CVaR) of the steady-state instantaneous running cost, where the system is subject to a constant single-product demand rate. An explicit expression for the optimal control policy is also obtained for the two-state case. The results are important from both theoretical and practical viewpoints. Indeed, the paper extends the well-known classical theoretical result on the optimality of hedging-point control policies under risk-neutral criteria, which are typically given by long-run average costs, and it develops a flexible and practical method for incorporating risk aversion into cost criteria. The approach presented here can be used to specify optimal control policies in similar manufacturing systems with CVaR criteria.
Similar content being viewed by others
References
Kimemia, J., Gershwin, S.B.: An algorithm for the computer control of a flexible manufacturing system. IEEE Trans. Autom. Control 15, 353–362 (1983)
Akella, R., Kumar, P.R.: Optimal control of production rate in a failure-prone manufacturing system. IEEE Trans. Autom. Control 31, 116–126 (1986)
Bielecki, T.R., Kumar, P.R.: Optimality of zero-inventory policies for unreliable manufacturing systems. Oper. Res. 36, 532–541 (1988)
Sethi, S.P., Yan, H., Zhang, H., Zhang, Q.: Optimal and hierarchical controls in dynamic stochastic manufacturing systems: a survey. Manuf. Serv. Oper. Manag. 4, 133–170 (2002)
Zhang, Q.: Risk sensitive production planning of stochastic manufacturing systems: a singular perturbation approach. SIAM J. Control Optim. 33, 498–527 (1995)
Ahmadi-Javid, A., Malhamé, R.P.: Optimality of a hedging-point control policy for a failure-prone manufacturing system under a probabilistic cost criterion. In: Proceedings of 50th IEEE Conference on Decision and Control, December 2011, pp. 5887–5892, Orlando, FL (2011)
Artzner, Ph, Delbaen, F., Eber, J.M., Heath, D.: Coherent risk measures. Math. Finance 9, 203–228 (1999)
Ruszczyski, A., Shapiro, A.: Optimization of convex risk functions. Math. Oper. Res. 31, 433–452 (2006)
Rockafellar, R.T., Uryasev, S.: Conditional value-at-risk for general loss distributions. J. Banking Finance 26, 1443–1471 (2002)
Shapiro, A., Dentcheva, D., Ruszczynski, A.: Lectures on Stochastic Programming: Modeling and Theory. MPS/SIAM, Philadelphia, PA (2009)
Sethi, S.P., Suo, W., Taksar, M.I., Zhang, Q.: Optimal production planning in a stochastic manufacturing system with long-run average cost. J. Optim. Theory Appl. 92, 161–188 (1997)
Malhamé, R.P.: Ergodicity of hedging control policies in single-part multiple-state manufacturing systems. IEEE Trans. Autom. Control 38, 340–343 (1993)
Gürkan, G., Karaesmen, F., Özdemir, Ö.: Optimal threshold levels in stochastic fluid models via simulation-based optimization. Discret. Event Dyn. Syst. 17, 53–97 (2007)
Sharifnia, A.: Production control of a manufacturing system with multiple machine states. IEEE Trans. Autom. Control 33, 620–625 (1988)
Liberopoulos, G., Hu, J.-Q.: On the ordering of optimal hedging points in a class of manufacturing flow control models. IEEE Trans. Autom. Control 40, 282–286 (1995)
Brémaud, P., Malhamé, R.P., Massoulié, L.: A manufacturing system with general stationary failure process: Stability and IPA of hedging control policies. IEEE Trans. Autom. Control 42, 155–170 (1997)
Hu, J.Q.: Production rate control for failure-prone production systems with no-backlog permitted. IEEE Trans. Autom. Control 40, 291–295 (1995)
Martinelli, F., Valigi, P.: Hedging point policies remain optimal under limited backlog and inventory space. Automatic Control, IEEE Trans. Autom. Control 49, 1863–1871 (2004)
Gershwin, S.B., Tan, B., Veatch, M.H.: Production control with backlog-dependent demand. IIE Trans. 41, 511–523 (2009)
Martinelli, F.: Optimality of a two-threshold feedback control for a manufacturing system with a production dependent failure rate. IEEE Trans. Autom. Control 52, 1937–1942 (2007)
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by James R. Luedtke.
Rights and permissions
About this article
Cite this article
Ahmadi-Javid, A., Malhamé, R. Optimal Control of a Multistate Failure-Prone Manufacturing System under a Conditional Value-at-Risk Cost Criterion. J Optim Theory Appl 167, 716–732 (2015). https://doi.org/10.1007/s10957-014-0668-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-014-0668-6
Keywords
- Stochastic optimal control
- Failure-prone manufacturing system
- Conditional value-at-risk
- Hedging-point control policy
- Production control
- Long-run average cost
- Risk-averse criterion