Automatic model selection for partially linear models

JOURNAL OF MULTIVARIATE ANALYSIS

卷:100

Article

Ni, Xiao¹  Zhang, Hao Helen¹  Zhang, Daowen¹ 

[1] N Carolina State Univ, Dept Stat, Raleigh, NC 27695 USA

关键词: Semiparametric regression;    Smoothing splines;    Smoothly clipped absolute deviation;    Variable selection;   

DOI  :  10.1016/j.jmva.2009.06.009

来源: Elsevier

【 摘 要 】

We propose and study a unified procedure for variable selection in partially linear models. A new type of double-penalized least squares is formulated, using the smoothing spline to estimate the nonparametric part and applying a shrinkage penalty on parametric components to achieve model parsimony. Theoretically we show that, with proper choices of the smoothing and regularization parameters, the proposed procedure can be as efficient as the oracle estimator [J. Fan, R. Li, Variable selection via nonconcave penalized likelihood and its oracle properties, journal of American Statistical Association 96 (2001) 1348-1360]. We also study the asymptotic properties of the estimator when the number of parametric effects diverges with the sample size. Frequentist and Bayesian estimates of the covariance and confidence intervals are derived for the estimators. One great advantage of this procedure is its linear mixed model (LMM) representation, which greatly facilitates its implementation by using standard statistical software. Furthermore, the LMM framework enables one to treat the smoothing parameter as a variance component and hence conveniently estimate it together with other regression coefficients. Extensive numerical studies are conducted to demonstrate the effective performance of the proposed procedure. (C) 2009 Elsevier Inc. All rights reserved.

【 授权许可】

Free