TY - JOUR

T1 - Shapley effects for global sensitivity analysis

T2 - Theory and computation

AU - Song, Eunhye

AU - Nelson, Barry L.

AU - Staum, Jeremy

N1 - Funding Information:
∗Received by the editors November 12, 2015; accepted for publication (in revised form) July 18, 2016; published electronically September 7, 2016. http://www.siam.org/journals/juq/4/M104807.html Funding: This research was partially supported by National Science Foundation grant CMMI-1068473 and GOALI sponsor Simio LLC. †IEMS, Northwestern University, Evanston, IL 60208 (eunhyesong2016@u.northwestern.edu, nelsonb@ northwestern.edu, j-staum@northwestern.edu).
Publisher Copyright:
© 2016 Sharif Rahman.

PY - 2016

Y1 - 2016

N2 - Variance-based global sensitivity analysis decomposes the variance of the output of a computer model, resulting from uncertainty about the model's inputs, into variance components associated with each input's contribution. The two most common variance-based sensitivity measures, the first-order effects and the total effects, may fail to sum to the total variance. They are often used together in sensitivity analysis, because neither of them adequately deals with interactions in the way the inputs affect the output. Therefore Owen proposed an alternative sensitivity measure, based on the concept of the Shapley value in game theory, and showed it always sums to the correct total variance if inputs are independent. We analyze Owen's measure, which we call the Shapley effect, in the case of dependent inputs. We show empirically how the first-order and total effects, even when used together, may fail to appropriately measure how sensitive the output is to uncertainty in the inputs when there is probabilistic dependence or structural interaction among the inputs. Because they involve all subsets of the inputs, Shapley effects could be expensive to compute if the number of inputs is large. We propose a Monte Carlo algorithm that makes accurate approximation of Shapley effects computationally affordable, and we discuss efficient allocation of the computation budget in this algorithm.

AB - Variance-based global sensitivity analysis decomposes the variance of the output of a computer model, resulting from uncertainty about the model's inputs, into variance components associated with each input's contribution. The two most common variance-based sensitivity measures, the first-order effects and the total effects, may fail to sum to the total variance. They are often used together in sensitivity analysis, because neither of them adequately deals with interactions in the way the inputs affect the output. Therefore Owen proposed an alternative sensitivity measure, based on the concept of the Shapley value in game theory, and showed it always sums to the correct total variance if inputs are independent. We analyze Owen's measure, which we call the Shapley effect, in the case of dependent inputs. We show empirically how the first-order and total effects, even when used together, may fail to appropriately measure how sensitive the output is to uncertainty in the inputs when there is probabilistic dependence or structural interaction among the inputs. Because they involve all subsets of the inputs, Shapley effects could be expensive to compute if the number of inputs is large. We propose a Monte Carlo algorithm that makes accurate approximation of Shapley effects computationally affordable, and we discuss efficient allocation of the computation budget in this algorithm.

KW - Computer experiments

KW - Global sensitivity

KW - Shapley value

UR - http://www.scopus.com/inward/record.url?scp=85033580123&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85033580123&partnerID=8YFLogxK

U2 - 10.1137/15M1048070

DO - 10.1137/15M1048070

M3 - Article

AN - SCOPUS:85033580123

VL - 4

SP - 1060

EP - 1083

JO - SIAM-ASA Journal on Uncertainty Quantification

JF - SIAM-ASA Journal on Uncertainty Quantification

SN - 2166-2525

IS - 1

ER -