Test for conditional independence with application to conditional screening

JOURNAL OF MULTIVARIATE ANALYSIS

卷:175

Article

Zhou, Yeqing¹  Liu, Jingyuan^2,3  Zhu, Liping⁴ 

[1] Tongji Univ, Sch Math Sci, Shanghai 200092, Peoples R China

[2] Xiamen Univ, Wang Yanan Inst Studies Econ, Sch Econ, MOE Key Lab Econometr,Dept Stat, 422 Siming South Rd, Xiamen 361005, Peoples R China

[3] Xiamen Univ, Fujian Key Lab Stat Sci, 422 Siming South Rd, Xiamen 361005, Peoples R China

[4] Renmin Univ China, Inst Stat & Big Data, Ctr Appl Stat, Beijing 100872, Peoples R China

关键词: Conditional independence;    Feature screening;    High dimensional data;    Independence;    Sure screening property;   

DOI  :  10.1016/j.jmva.2019.104557

来源: Elsevier

【 摘 要 】

Measuring and testing conditional dependence are fundamental problems in statistics. Imposing mild conditions on Rosenblatt transformations (Rosenblatt, 1952), we establish an equivalence between the conditional and unconditional independence, which appears to be entirely irrelevant at the first glance. Such an equivalence allows us to convert the problem of testing conditional independence into the problem of testing unconditional independence. We further adopt the Blum-Kiefer-Rosenblatt correlation (Blum et al., 1961) to develop a test for conditional independence, which is powerful to capture nonlinear dependence and is robust to heavy-tailed errors. We obtain explicit forms for the asymptotic null distribution which involves no unknown tunings, rendering fast and easy implementation of our test for conditional independence. With this conditional independence test, we further propose a conditional screening method for high dimensional data to identify truly important covariates whose effects may vary with exposure variables. We use the false discovery rate to determine the screening cutoff. This screening approach possesses both the sure screening and the ranking consistency properties. We illustrate the finite sample performances through simulation studies and an application to the gene expression microarray dataset. (C) 2019 Elsevier Inc. All rights reserved.

【 授权许可】

Free