False discovery rate-adjusted multiple confidence intervals for selected parameters

Yoav Benjamini, Daniel Yekutieli, Don Edwards, Juliet Popper Shaffer, Ajit C. Tamhane, Peter H. Westfall, Burt Holland, Yoav Benjamini, Daniel Yekutieli

Research output: Contribution to journalReview articlepeer-review

276 Scopus citations

Abstract

Often in applied research, confidence intervals (CIs) are constructed or reported only for parameters selected after viewing the data. We show that such selected intervals fail to provide the assumed coverage probability. By generalizing the false discovery rate (FDR) approach from multiple testing to selected multiple CIs, we suggest the false coverage-statement rate (FCR) as a measure of interval coverage following selection. A general procedure is then introduced, offering FCR control at level q under any selection rule. The procedure constructs a marginal CI for each selected parameter, but instead of the confidence level 1 - q being used marginally, q is divided by the number of parameters considered and multiplied by the number selected. If we further use the FDR controlling testing procedure of Benjamini and Hochberg for selecting the parameters, the newly suggested procedure offers CIs that are dual to the testing procedure and are shown to be optimal in the independent case. Under the positive regression dependency condition of Benjamini and Yekutieli, the FCR is controlled for one-sided tests and CIs, as well as for a modification for two-sided testing. Results for general dependency are also given. Finally, using the equivalence of the CIs to testing, we prove that the procedure of Benjamini and Hochberg offers directional FDR control as conjectured.

Original languageEnglish (US)
Pages (from-to)71-81
Number of pages11
JournalJournal of the American Statistical Association
Volume100
Issue number469
DOIs
StatePublished - Mar 2005

Keywords

  • Directional decision
  • False discovery rate
  • Multiple comparison procedure
  • Positive regression dependency
  • Simultaneous confidence interval
  • Type III error

ASJC Scopus subject areas

  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Fingerprint Dive into the research topics of 'False discovery rate-adjusted multiple confidence intervals for selected parameters'. Together they form a unique fingerprint.

Cite this