Estimation of Error Variance in Regularized Regression Models via Adaptive Lasso

Mathematics

Xin Wang¹  Lingchen Kong¹  Liqun Wang² 

[1] Department of Applied Mathematics, Beijing Jiaotong University, Beijing 100044, China;Department of Statistics, University of Manitoba, Winnipeg, MB R3T 2N2, Canada;

关键词: high-dimensional linear model;    variance estimation;    natural adaptive lasso;    mean squared error bound;    regularized regression;   

DOI  :  10.3390/math10111937

来源: DOAJ

【 摘 要 】

Estimation of error variance in a regression model is a fundamental problem in statistical modeling and inference. In high-dimensional linear models, variance estimation is a difficult problem, due to the issue of model selection. In this paper, we propose a novel approach for variance estimation that combines the reparameterization technique and the adaptive lasso, which is called the natural adaptive lasso. This method can, simultaneously, select and estimate the regression and variance parameters. Moreover, we show that the natural adaptive lasso, for regression parameters, is equivalent to the adaptive lasso. We establish the asymptotic properties of the natural adaptive lasso, for regression parameters, and derive the mean squared error bound for the variance estimator. Our theoretical results show that under appropriate regularity conditions, the natural adaptive lasso for error variance is closer to the so-called oracle estimator than some other existing methods. Finally, Monte Carlo simulations are presented, to demonstrate the superiority of the proposed method.

【 授权许可】

Unknown