High-dimensional Varying Index Coefficient Models via Stein’s Identity

Sen Na, Zhuoran Yang, Zhaoran Wang, Mladen Kolar

Research output: Contribution to journalArticlepeer-review

11 Scopus citations

Abstract

We study the parameter estimation problem for a varying index coefficient model in high dimensions. Unlike the most existing works that iteratively estimate the parameters and link functions, based on the generalized Stein’s identity, we propose computationally efficient estimators for the high-dimensional parameters without estimating the link functions. We consider two different setups where we either estimate each sparse parameter vector individually or estimate the parameters simultaneously as a sparse or low-rank matrix. For all these cases, our estimators are shown to achieve optimal statistical rates of convergence (up to logarithmic terms in the low-rank setting). Moreover, throughout our analysis, we only require the covariate to satisfy certain moment conditions, which is significantly weaker than the Gaussian or elliptically symmetric assumptions that are commonly made in the existing literature. Finally, we conduct extensive numerical experiments to corroborate the theoretical results.

Original languageEnglish (US)
JournalJournal of Machine Learning Research
Volume20
StatePublished - Oct 1 2019

Funding

This work was completed in part with resources provided by the University of Chicago Research Computing Center. We thank Kenji Fukumizu and two anonymous reviewers for helpful comments.

Keywords

  • High-dimensional estimation
  • Semiparametric modeling
  • Stein’s identity
  • Varying index coefficient model

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Software
  • Statistics and Probability
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'High-dimensional Varying Index Coefficient Models via Stein’s Identity'. Together they form a unique fingerprint.

Cite this