[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.5555/3320516.3320749acmconferencesArticle/Chapter ViewAbstractPublication PageswscConference Proceedingsconference-collections
research-article

Data-driven ranking and selection: high-dimensional covariates and general dependence

Published: 09 December 2018 Publication History

Abstract

This paper considers the problem of ranking and selection with covariates and aims to identify a decision rule that stipulates the best alternative as a function of the observable covariates. We propose a general data-driven framework to accommodate (i) high-dimensional covariates and (ii) general (nonlinear) dependence between the mean performance of an alternative and the covariates. For both scenarios, we design new selection procedures and provide certain statistical guarantees, by leveraging the data-intensive environment and various statistical learning tools. The performances of our procedures are exhibited through simulation experiments.

References

[1]
Aggarwal, C. C., Y. Zhao, and S. Y. Philip. 2014. "On the Use of Side Information for Mining Text Data". IEEE Transactions on Knowledge and Data Engineering 26(6):1415--1429.
[2]
Bastani, H., and M. Bayati. 2015. "Online Decision-Making with High-Dimensional Covariates". Working Paper.
[3]
Bechhofer, R. 1954. "A Single-Sample Multiple Decision Procedure for Ranking Means of Normal Populations with Known Variances". The Annals of Mathematical Statistics 25(1):16--39.
[4]
Bickel, P. J., Y. Ritov, and A. B. Tsybakov. 2009. "Simultaneous Analysis of Lasso and Dantzig Selector". The Annals of Statistics 37(4):1705--1732.
[5]
Breiman, L. 2001. "Random Forests". Machine Learning 45(1):5--32.
[6]
Bühlmann, P., and S. van de Geer. 2011. Statistics for High-Dimensional Data: Methods, Theory and Applications. Berlin Heidelberg: Springer-Verlag.
[7]
Candes, E. J., J. K. Romberg, and T. Tao. 2006. "Stable Signal Recovery from Incomplete and Inaccurate Measurements". Communications on Pure and Applied Mathematics 59(8):1207--1223.
[8]
Chen, C.-H. 1996. "A Lower Bound for the Correct Subset-Selection Probability and Its Application to Discrete-event System Simulations". IEEE Transactions on Automatic Control 41(8):1227--1231.
[9]
Chen, C.-H., S. E. Chick, L. H. Lee, and N. A. Pujowidianto. 2015. "Ranking and Selection: Efficient Simulation Budget Allocation". In Handbook of Simulation Optimization, edited by M. C. Fu, Chapter 3, 45--80. New York: Springer-Verlag.
[10]
Chen, Q., Z. Song, Y. Hua, Z. Huang, and S. Yan. 2012. "Hierarchical Matching with Side Information for Image Classification". In 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2012), 3426--3433. Red Hook, New York: Curran Associates Inc.
[11]
Chick, S. E., and P. Frazier. 2012. "Sequential Sampling with Economics of Selection Procedures". Management Science 58(3):550--569.
[12]
Chick, S. E., and K. Inoue. 2001. "New Two-Stage and Sequential Procedures for Selecting the Best Simulated System". Operations Research 49(5):732--743.
[13]
Fan, W., L. J. Hong, and B. L. Nelson. 2016. "Indifference-Zone-Free Selection of the Best". Operations Research 64(6):1499--1514.
[14]
Frazier, P., W. Powell, and S. Dayanik. 2008. "A Knowledge-Gradient Policy for Sequential Information Collection". SIAM Journal on Control and Optimization 47(5):2410--2439.
[15]
Hong, L. J., and B. L. Nelson. 2007. "Selecting the Best System when Systems Are Revealed Sequentially". IIE Transactions 39(7):723--734.
[16]
Hunter, S. R., and B. L. Nelson. 2017. "Parallel Ranking and Selection". In Advances in Modeling and Simulation: Seminal Research from 50 Years of Winter Simulation Conferences, edited by A. Tolk et al., 249--275. Basel, Switzerland: Springer International Publishing AG.
[17]
Kamiński, B., and P. Szufel. 2018. "On parallel policies for ranking and selection problems". Journal of Applied Statistics 45(9):1690--1713.
[18]
Kim, S.-H., and B. L. Nelson. 2001. "A Fully Sequential Procedure for Indifference-Zone Selection in Simulation". ACM Transactions on Modeling and Computer Simulation 11(3):251--273.
[19]
Kim, S.-H., and B. L. Nelson. 2006. "Selecting the Best System". In Handbooks in Operations Research and Management Science, edited by S. G. Henderson and B. L. Nelson, Volume 13, 501--534. Elsevier.
[20]
Lu, T., D. Pál, and M. Pál. 2010. "Contextual Multi-Armed Bandits". In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, edited by Y. W. Teh et al., Volume 9, 485--492: PMLR.
[21]
Luo, J., L. J. Hong, B. L. Nelson, and Y. Wu. 2015. "Fully Sequential Procedures for Large-Scale Ranking-and-Selection Problems in Parallel Computing Environments". Operations Research 63(5):1177--1194.
[22]
Nelson, B. L. 2016. "'Some Tactical Problems in Digital Simulation' for the Next 10 Years". Journal of Simulation 10(1):2--11.
[23]
Ni, E. C., D. F. Ciocan, S. G. Henderson, and S. R. Hunter. 2017. "Efficient Ranking and Selection in Parallel Computing Environments". Operations Research 65(3):821--836.
[24]
Rinott, Y. 1978. "On Two-Stage Selection Procedures and Related Probability-Inequalities". Communications in Statistics-Theory and Methods 7(8):799--811.
[25]
Robbins, H. 1952. "Some Aspects of the Sequential Design of Experiments". Bulletin of the American Mathematical Society 58(5):527--535.
[26]
Shen, H., L. J. Hong, and X. Zhang. 2017. "Ranking and Selection with Covariates". In Proceedings of the 2017 Winter Simulation Conference, edited by W. K. V. Chan et al., 2137--2148. Piscataway, New Jersey: IEEE.
[27]
Tibshirani, R. 1996. "Regression Shrinkage and Selection via the Lasso". Journal of the Royal Statistical Society. Series B (Methodological) 58(1):267--288.
[28]
Vapnik, V. N. 1998. Statistical Learning Theory. New York: John Wiley & Sons, Inc.
[29]
Xu, M., R. Jin, and Z.-H. Zhou. 2013. "Speedup Matrix Completion with Side Information: Application to Multi-Label Learning". In Proceedings of the 26th International Conference on Neural Information Processing Systems (NIPS 2013), edited by C. J. C. Burges et al., 2301--2309. Red Hook, New York: Curran Associates Inc.

Cited By

View all
  • (2020)Context-dependent ranking and selection under a bayesian frameworkProceedings of the Winter Simulation Conference10.5555/3466184.3466419(2060-2070)Online publication date: 14-Dec-2020
  1. Data-driven ranking and selection: high-dimensional covariates and general dependence

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    WSC '18: Proceedings of the 2018 Winter Simulation Conference
    December 2018
    4298 pages
    ISBN:978153866570

    Sponsors

    Publisher

    IEEE Press

    Publication History

    Published: 09 December 2018

    Check for updates

    Qualifiers

    • Research-article

    Conference

    WSC '18
    Sponsor:
    WSC '18: Winter Simulation Conference
    December 9 - 12, 2018
    Gothenburg, Sweden

    Acceptance Rates

    WSC '18 Paper Acceptance Rate 183 of 260 submissions, 70%;
    Overall Acceptance Rate 3,413 of 5,075 submissions, 67%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)1
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 28 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2020)Context-dependent ranking and selection under a bayesian frameworkProceedings of the Winter Simulation Conference10.5555/3466184.3466419(2060-2070)Online publication date: 14-Dec-2020

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media