Learning to improve medical decision making from imbalanced data without a priori cost

BMC Medical Informatics and Decision Making

Research Article

William K Cheung¹  Xiang Wan¹  Jiming Liu¹  Tiejun Tong² 

[1] Department of Computer Science and Institute of Computational and Theoretical Studies, Hong Kong Baptist University, Kowloon Tong, Hong Kong;Department of Mathematics, Hong Kong Baptist University, Kowloon Tong, Hong Kong;

关键词: Medical decision making;    Imbalanced data;    Classification;    Partial ranking;   

DOI  :  10.1186/s12911-014-0111-9

 received in 2014-08-01, accepted in 2014-11-11,  发布年份 2014

来源: Springer

【 摘 要 】

BackgroundIn a medical data set, data are commonly composed of a minority (positive or abnormal) group and a majority (negative or normal) group and the cost of misclassifying a minority sample as a majority sample is highly expensive. This is the so-called imbalanced classification problem. The traditional classification functions can be seriously affected by the skewed class distribution in the data. To deal with this problem, people often use a priori cost to adjust the learning process in the pursuit of optimal classification function. However, this priori cost is often unknown and hard to estimate in medical decision making.MethodsIn this paper, we propose a new learning method, named RankCost, to classify imbalanced medical data without using a priori cost. Instead of focusing on improving the class-prediction accuracy, RankCost is to maximize the difference between the minority class and the majority class by using a scoring function, which translates the imbalanced classification problem into a partial ranking problem. The scoring function is learned via a non-parametric boosting algorithm.ResultsWe compare RankCost to several representative approaches on four medical data sets varying in size, imbalanced ratio, and dimension. The experimental results demonstrate that unlike the currently available methods that often perform unevenly with different priori costs, RankCost shows comparable performance in a consistent manner.ConclusionsIt is a challenging task to learn an effective classification model based on imbalanced data in medical data analysis. The traditional approaches often use a priori cost to adjust the learning of the classification function. This work presents a novel approach, namely RankCost, for learning from medical imbalanced data sets without using a priori cost. The experimental results indicate that RankCost performs very well in imbalanced data classification and can be a useful method in real-world applications of medical decision making.

【 授权许可】

CC BY   
© Wan et al.; licensee BioMed Central Ltd. 2014