On Stein's lemma, dependent covariates and functional monotonicity in multi-dimensional modeling

JOURNAL OF MULTIVARIATE ANALYSIS

卷:99

Article

Zhang, Chunming¹  Li, Jialiang²  Meng, Jingci¹ 

[1] Univ Wisconsin, Dept Stat, Med Sci Ctr, Madison, WI 53706 USA

[2] Natl Univ Singapore, Dept Stat & Appl Probabil, Singapore 117546, Singapore

关键词: Additive model;    Nonparametric regression;    Partially monotone function;    Similarly ordered;    Stein's Lemma;    Support vector machine;   

DOI  :  10.1016/j.jmva.2008.02.018

来源: Elsevier

【 摘 要 】

Tracking the correct directions of monotonicity in multi-dimensional modeling plays an important role in interpreting functional associations. In the presence of multiple predictors, we provide empirical evidence that the observed monotone directions via parametric, nonparametric or semiparametric fit of commonly used multi-dimensional models may entirely violate the actual directions of monotonicity. This breakdown is caused primarily by the dependence structure of covariates, with negligible influence from the bias of function estimation. To examine the linkage between the dependent covariates and monotone directions, we first generalize Stein's Lemma for random variables which are mutually independent Gaussian to two important cases: dependent Gaussian, and independent non-Gaussian. We show that in both two cases, there is an explicit one-to-one correspondence between the monotone directions of a multi-dimensional function and the signs of a deterministic surrogate vector. Moreover, we demonstrate that the second case can be extended to accommodate a class of dependent covariates. This generalization further enables us to develop a de-correlation transform for arbitrarily dependent covariates. The transformed covariates preserve modeling interpretability with little loss in modeling efficiency. The simplicity and effectiveness of the proposed method are illustrated via simulation studies and real data application. (C) 2008 Elsevier Inc. All fights reserved.

【 授权许可】

Free