A three-step approach for the derivation and validation of high-performing predictive models using an operational dataset: congestive heart failure readmission case study

BMC Medical Informatics and Decision Making

Research Article

Mingyuan Zhang¹  Kensaku Kawamoto¹  Samir E AbdelRahman²  Bruce E Bray³ 

[1] Department of Biomedical Informatics, University of Utah, 615 Arapeen Way, Suite 208, 84092, Salt Lake City, UT, USA;Department of Biomedical Informatics, University of Utah, 615 Arapeen Way, Suite 208, 84092, Salt Lake City, UT, USA;Computer Science Department, Faculty of Computers and Information, Cairo University, Cairo, Egypt;Departments of Biomedical Informatics and Internal Medicine, University of Utah, 84092, Salt Lake City, UT, USA;

关键词: Predictive analytics;    Congestive heart failure readmission;    Voting classifiers;    Feature selection;    Discretization method;    Feature ranking strategies;   

DOI  :  10.1186/1472-6947-14-41

 received in 2013-12-21, accepted in 2014-05-06,  发布年份 2014

来源: Springer

【 摘 要 】

BackgroundThe aim of this study was to propose an analytical approach to develop high-performing predictive models for congestive heart failure (CHF) readmission using an operational dataset with incomplete records and changing data over time.MethodsOur analytical approach involves three steps: pre-processing, systematic model development, and risk factor analysis. For pre-processing, variables that were absent in >50% of records were removed. Moreover, the dataset was divided into a validation dataset and derivation datasets which were separated into three temporal subsets based on changes to the data over time. For systematic model development, using the different temporal datasets and the remaining explanatory variables, the models were developed by combining the use of various (i) statistical analyses to explore the relationships between the validation and the derivation datasets; (ii) adjustment methods for handling missing values; (iii) classifiers; (iv) feature selection methods; and (iv) discretization methods. We then selected the best derivation dataset and the models with the highest predictive performance. For risk factor analysis, factors in the highest-performing predictive models were analyzed and ranked using (i) statistical analyses of the best derivation dataset, (ii) feature rankers, and (iii) a newly developed algorithm to categorize risk factors as being strong, regular, or weak.ResultsThe analysis dataset consisted of 2,787 CHF hospitalizations at University of Utah Health Care from January 2003 to June 2013. In this study, we used the complete-case analysis and mean-based imputation adjustment methods; the wrapper subset feature selection method; and four ranking strategies based on information gain, gain ratio, symmetrical uncertainty, and wrapper subset feature evaluators. The best-performing models resulted from the use of a complete-case analysis derivation dataset combined with the Class-Attribute Contingency Coefficient discretization method and a voting classifier which averaged the results of multi-nominal logistic regression and voting feature intervals classifiers. Of 42 final model risk factors, discharge disposition, discretized age, and indicators of anemia were the most significant. This model achieved a c-statistic of 86.8%.ConclusionThe proposed three-step analytical approach enhanced predictive model performance for CHF readmissions. It could potentially be leveraged to improve predictive model performance in other areas of clinical medicine.

【 授权许可】

CC BY   
© AbdelRahman et al.; licensee BioMed Central Ltd. 2014