Probabilistic sensitivity measures as information value

Emanuele Borgonovo*, Gordon B. Hazen, Victor Richmond R. Jose, Elmar Plischke

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Decision makers increasingly rely on forecasts or predictions generated by quantitative models. Best practices recommend that a forecast report be accompanied by a sensitivity analysis. A wide variety of probabilistic sensitivity measures have been suggested; however, model inputs may be ranked differently by different sensitivity measures. Is there some way to reduce this disparity by identifying what probabilistic sensitivity measures are most appropriate for a given reporting context? We address this question by postulating that importance rankings of model inputs generated by a sensitivity measure should correspond to the information value for those inputs in the problem of constructing an optimal report based on some proper scoring rule. While some sensitivity measures have already been identified as information value under proper scoring rules, we identify others and provide some generalizations. We address the general question of when a sensitivity measure has this property, presenting necessary and sufficient conditions. We directly examine whether sensitivity measures retain important properties such as transformation invariance and compliance with Renyi's Postulate D for measures of statistical dependence. These results provide a means for selecting the most appropriate sensitivity measures for a particular reporting context and provide the analyst reasonable justifications for that selection. We illustrate these ideas using a large scale probabilistic safety assessment case study used to support decision making in the design and planning of a lunar space mission.

Original languageEnglish (US)
Pages (from-to)595-610
Number of pages16
JournalEuropean Journal of Operational Research
Volume289
Issue number2
DOIs
StateAccepted/In press - 2020

Keywords

  • Decision support systems
  • Information value
  • Probabilistic sensitivity analysis
  • Renyi's postulates

ASJC Scopus subject areas

  • Computer Science(all)
  • Modeling and Simulation
  • Management Science and Operations Research
  • Information Systems and Management

Fingerprint Dive into the research topics of 'Probabilistic sensitivity measures as information value'. Together they form a unique fingerprint.

Cite this