Screening and selection for quantile regression using an alternative measure of variable importance

JOURNAL OF MULTIVARIATE ANALYSIS

卷:173

Article

Kong, Yinfei¹  Li, Yujie²  Zerom, Dawit¹ 

[1] Calif State Univ Fullerton, Dept Informat Syst & Decis Sci, Fullerton, CA 92634 USA

[2] Shandong Univ Finance & Econ, Jinan, Shandong, Peoples R China

关键词: Categorical data;    Continuous data;    Partial quantile utility;    Quantile regression;    Screening;    Selection;   

DOI  :  10.1016/j.jmva.2019.04.007

来源: Elsevier

【 摘 要 】

We propose a variable importance measure called partial quantile utility (PQU). We then introduce a quantile forward regression algorithm (QFR) that uses PQU-based ranking to screen important variables from a potential set whose dimension can be substantially larger than the sample size. We prove that QFR-based screening can identify all the important variables in a small number of steps. To remove noise variables from the screening step, we further implement variable selection by adopting a modified Bayesian information criterion. We show that the smaller selected set also contains all the important variables with overwhelming probability. Using simulation designs that are intentionally chosen to show its capability in identifying jointly but not marginally important variables and detecting heterogeneous associations, we extensively investigate its finite-sample performance with regard to screening, selection and out-of-sample prediction. To further illustrate the merit of our proposal, we provide an application to the problem of identifying risk factors that are associated with childhood malnutrition in India. Published by Elsevier Inc.

【 授权许可】

Free