Conversion of adverse data corpus to shrewd output using sampling metrics

Visual Computing for Industry, Biomedicine, and Art

Tauqeer Ahmed¹  Shahzad Ashraf¹  Sehrish Saleem²  Durr Muhammad³  Zeeshan Aslam⁴ 

[1] College of Internet of Things Engineering, Hohai University, 210032, Changzhou, Jiangsu, China;Muhammad Nawaz Sharif University of Engineering & Technology, 66000, Multan, Pakistan;Pakistan Steel Mills Karachi, 75200, Karachi, Pakistan;Petroweld Kurdistan Region, 42002, Erbil, Iraq;

关键词: Classification;    Machine learning;    Spread subsampling;    Class imbalance;   

DOI  :  10.1186/s42492-020-00055-9

来源: Springer

【 摘 要 】

An imbalanced dataset is commonly found in at least one class, which are typically exceeded by the other ones. A machine learning algorithm (classifier) trained with an imbalanced dataset predicts the majority class (frequently occurring) more than the other minority classes (rarely occurring). Training with an imbalanced dataset poses challenges for classifiers; however, applying suitable techniques for reducing class imbalance issues can enhance classifiers’ performance. In this study, we consider an imbalanced dataset from an educational context. Initially, we examine all shortcomings regarding the classification of an imbalanced dataset. Then, we apply data-level algorithms for class balancing and compare the performance of classifiers. The performance of the classifiers is measured using the underlying information in their confusion matrices, such as accuracy, precision, recall, and F measure. The results show that classification with an imbalanced dataset may produce high accuracy but low precision and recall for the minority class. The analysis confirms that undersampling and oversampling are effective for balancing datasets, but the latter dominates.

【 授权许可】

CC BY