Scalable objective-driven batch sampling in simulation-based design for models with heteroscedastic noise

Anton Van Beek, Umar Farooq Ghumman, Joydeep Munshi, Siyu Tao, Teyu Chien, Ganesh Balasubramanian, Matthew Plumlee, Daniel Apley, Wei Chen*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

Objective-driven adaptive sampling is a widely used tool for the optimization of deterministic black-box functions. However, the optimization of stochastic simulation models as found in the engineering, biological, and social sciences is still an elusive task. In this work, we propose a scalable adaptive batch sampling scheme for the optimization of stochastic simulation models with input-dependent noise. The developed algorithm has two primary advantages: (i) by recommending sampling batches, the designer can benefit from parallel computing capabilities, and (ii) by replicating of previously observed sampling locations the method can be scaled to higher-dimensional and more noisy functions. Replication improves numerical tractability as the computational cost of Bayesian optimization methods is known to grow cubicly with the number of unique sampling locations. Deciding when to replicate and when to explore depends on what alternative minimizes the posterior prediction accuracy at and around the spatial locations expected to contain the global optimum. The algorithm explores a new sampling location to reduce the interpolation uncertainty and replicates to improve the accuracy of the mean prediction at a single sampling location. Through the application of the proposed sampling scheme to two numerical test functions and one real engineering problem, we show that we can reliably and efficiently find the global optimum of stochastic simulation models with input-dependent noise.

Original languageEnglish (US)
Title of host publication46th Design Automation Conference (DAC)
PublisherAmerican Society of Mechanical Engineers (ASME)
ISBN (Electronic)9780791884010
DOIs
StatePublished - 2020
EventASME 2020 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC-CIE 2020 - Virtual, Online
Duration: Aug 17 2020Aug 19 2020

Publication series

NameProceedings of the ASME Design Engineering Technical Conference
Volume11B-2020

Conference

ConferenceASME 2020 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC-CIE 2020
CityVirtual, Online
Period8/17/208/19/20

ASJC Scopus subject areas

  • Mechanical Engineering
  • Computer Graphics and Computer-Aided Design
  • Computer Science Applications
  • Modeling and Simulation

Fingerprint

Dive into the research topics of 'Scalable objective-driven batch sampling in simulation-based design for models with heteroscedastic noise'. Together they form a unique fingerprint.

Cite this