TY - JOUR
T1 - Fitting the additive model by recursion on dimension
AU - Staniswalis, Joan G.
AU - Severini, Thomas A.
N1 - Funding Information:
Dr. Staniswalis acknowledges the support of NIH Grant S06GM08012.
PY - 2000
Y1 - 2000
N2 - We consider estimation for the homoscedastic additive model for multiple regression. A recursion is proposed in Opsomer (1999), and independently by the authors, for obtaining the estimators that solve the normal equations given by Hastie and Tibshirani (1990). The recursion can be exploited to obtain the asymptotic bias and variance expressions of the estimators for any p > 2 (Opsomer 1999) using repeated application of Opsomer and Ruppert (1997). Opsomer and Ruppert (1997) provide asymptotic bias and variance for the estimators when p = 2. Opsomer (1999) also uses the recursion to provide sufficient conditions for convergence of the backfitting algorithm to a unique solution of the normal equations. However, since explicit expressions for the solution to the normal equations are not given, he states , "The lemma does not provide a practical way of evaluating the existence and uniqueness of the backfitting estimators ... ". In this paper, explicit expressions for the estimators are derived. The explicit solution requires inverses of n x n matrices to solve the np x np system of normal equations. These matrix inverses are feasible to implement for moderate sample sizes and can be used in place of the backfitting algorithm.
AB - We consider estimation for the homoscedastic additive model for multiple regression. A recursion is proposed in Opsomer (1999), and independently by the authors, for obtaining the estimators that solve the normal equations given by Hastie and Tibshirani (1990). The recursion can be exploited to obtain the asymptotic bias and variance expressions of the estimators for any p > 2 (Opsomer 1999) using repeated application of Opsomer and Ruppert (1997). Opsomer and Ruppert (1997) provide asymptotic bias and variance for the estimators when p = 2. Opsomer (1999) also uses the recursion to provide sufficient conditions for convergence of the backfitting algorithm to a unique solution of the normal equations. However, since explicit expressions for the solution to the normal equations are not given, he states , "The lemma does not provide a practical way of evaluating the existence and uniqueness of the backfitting estimators ... ". In this paper, explicit expressions for the estimators are derived. The explicit solution requires inverses of n x n matrices to solve the np x np system of normal equations. These matrix inverses are feasible to implement for moderate sample sizes and can be used in place of the backfitting algorithm.
KW - Backfitting
KW - Marginal integration
KW - Nonparametric regression
UR - http://www.scopus.com/inward/record.url?scp=31244433261&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=31244433261&partnerID=8YFLogxK
M3 - Article
AN - SCOPUS:31244433261
SN - 0361-0926
VL - 29
SP - 689
EP - 701
JO - Communications in Statistics - Theory and Methods
JF - Communications in Statistics - Theory and Methods
IS - 3
ER -