Microcanonical Annealing and Threshold Accepting for Parameter Determination and Feature Selection of Support Vector Machines

Journal of computing and information technology

Saadi, Tamazouzt Ait²  Benyettou, Abdelkader³  Ouali, Mohammed⁴  Medjahed, Seyyid Ahmed⁴ 

[1] Computer Science Department, University of Sherbrooke, Canada;Oran Mohamed Boudiaf, Algérie;University of Le Havre, France;Université des Sciences et de la Technologie d'

关键词: support vector Machines;    microcanonical annealing;    threshold acceptance;    parameter determination;    feature selection;   

DOI  :  10.20532/cit.2016.1003342

学科分类：计算机科学（综合）

来源: Sveuciliste u Zagrebu

【 摘 要 】

Support vector machine (SVM) is a popular classification technique with many diverse applications. Parameter determination and feature selection significantly influences the classification accuracy rate and the SVM model quality. This paper proposes two novel approaches based on Microcanonical Annealing (MA-SVM) and Threshold Accepting (TA-SVM) to determine the optimal value parameter and the relevant features subset, without reducing SVM classification accuracy. In order to evaluate the performance of MA-SVM and TA-SVM, several public datasets are employed to compute the classification accuracy rate. The proposed approaches were tested in the context of medical diagnosis. Also, we tested the approaches on DNA microarray datasets used for cancer diagnosis. The results obtained by the MA-SVM and TA-SVM algorithms are shown to be superior and have given a good performance in the DNA microarray dana sets which are characterized by the large number of features. Therefore, the MA-SVM and TA-SVM approaches are well suited for parameter determination and feature selection in SVM.

【 授权许可】

CC BY