Revisiting Subset Selection

Research output: Chapter in Book/Report/Conference proceedingConference contribution


In the subset-selection approach to ranking and selection, a decision-maker seeks a subset of simulated systems that contains the best with high probability. We present a new, generalized framework for constructing these subsets and demonstrate that some existing subset-selection procedures are situated within this framework. The subsets are built by calculating, for each system, a minimum standardized discrepancy between the observed performances and the space of problem instances for which that system is the best. A system's minimum standardized discrepancy is then compared to a cutoff to determine whether the system is included in the subset. We examine the problem of finding the tightest statistically valid cutoff for each system and draw connections between our approach and other subset-selection methodologies. Simulation experiments demonstrate how the screening power and subset size are affected by the choice of standardized discrepancy.

Original languageEnglish (US)
Title of host publicationProceedings of the 2020 Winter Simulation Conference, WSC 2020
EditorsK.-H. Bae, B. Feng, S. Kim, S. Lazarova-Molnar, Z. Zheng, T. Roeder, R. Thiesing
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages12
ISBN (Electronic)9781728194998
StatePublished - Dec 14 2020
Event2020 Winter Simulation Conference, WSC 2020 - Orlando, United States
Duration: Dec 14 2020Dec 18 2020

Publication series

NameProceedings - Winter Simulation Conference
ISSN (Print)0891-7736


Conference2020 Winter Simulation Conference, WSC 2020
Country/TerritoryUnited States

ASJC Scopus subject areas

  • Software
  • Modeling and Simulation
  • Computer Science Applications


Dive into the research topics of 'Revisiting Subset Selection'. Together they form a unique fingerprint.

Cite this