Abstract
Distribution estimation for noisy data via density deconvolution is a notoriously difficult problem, especially for typical noise distributions like Gaussian. We develop a density deconvolution estimator based on quadratic programming (QP) that can achieve better estimation than kernel density deconvolution methods. The QP approach appears to have a more favorable regularization tradeoff between oversmoothing versus oscillation, especially at the tails of the distribution. An additional advantage is that it is straightforward to incorporate a number of common density constraints such as nonnegativity, integration-to-one, unimodality, tail convexity, tail monotonicity, and support constraints. We demonstrate that the QP approach has favorable estimation performance relative to existing methods. Its performance is superior when only the universally applicable nonnegativity and integration-to-one constraints are incorporated, and incorporating additional common constraints when applicable (e.g., nonnegative support, unimodality, tail monotonicity or convexity, etc.) can further substantially improve the estimation. Supplementary materials for this article are available online and include R code, the R package QPdecon, a vignette for the QPdecon package, the sodium dataset that is used as an example, and appendices with a proof and additional figures.
Original language | English (US) |
---|---|
Pages (from-to) | 580-591 |
Number of pages | 12 |
Journal | Journal of Computational and Graphical Statistics |
Volume | 29 |
Issue number | 3 |
DOIs | |
State | Published - Jul 2 2020 |
Keywords
- Additive error model
- Gaussian and Laplace distributed noise
- Nonparametric density estimation
- Shape constraints
ASJC Scopus subject areas
- Statistics and Probability
- Discrete Mathematics and Combinatorics
- Statistics, Probability and Uncertainty
Fingerprint
Dive into the research topics of 'Density Deconvolution With Additive Measurement Errors Using Quadratic Programming'. Together they form a unique fingerprint.Datasets
-
Density Deconvolution With Additive Measurement Errors Using Quadratic Programming
Yang, R. (Creator), Apley, D. (Creator), Staum, J. (Creator) & Ruppert, D. (Creator), Taylor & Francis, 2020
DOI: 10.6084/m9.figshare.11396871, https://tandf.figshare.com/articles/Density_Deconvolution_with_Additive_Measurement_Errors_using_Quadratic_Programming_revision_/11396871
Dataset
-
Density Deconvolution With Additive Measurement Errors Using Quadratic Programming
Yang, R. (Creator), Apley, D. (Creator), Staum, J. (Creator) & Ruppert, D. (Creator), Taylor & Francis, 2021
DOI: 10.6084/m9.figshare.11396871.v3, https://tandf.figshare.com/articles/dataset/Density_Deconvolution_with_Additive_Measurement_Errors_using_Quadratic_Programming_revision_/11396871/3
Dataset
-
Density Deconvolution With Additive Measurement Errors Using Quadratic Programming
Yang, R. (Creator), Apley, D. (Creator), Staum, J. (Creator) & Ruppert, D. (Creator), Taylor & Francis, 2020
DOI: 10.6084/m9.figshare.11396871.v2, https://tandf.figshare.com/articles/dataset/Density_Deconvolution_with_Additive_Measurement_Errors_using_Quadratic_Programming_revision_/11396871/2
Dataset