Softmax Model as Generalization upon Logistic Discrimination Suffers from Overfitting

Journal of Data Science

article

F. Mohammadi Basatini¹  Rahim Chinipardaz² 

[1] Deartment of Statistics, Shoushtar Branch, Islamic Azad University.;Deartment of Statistics, Shahid Chamran Universityn.

关键词: Neural network model;    Softmax model;    logistic discrimination;   

DOI  :  10.6339/JDS.201410_12(4).0002

学科分类：土木及结构工程学

来源: JDS

【 摘 要 】

The motivation behind this paper is to investigate the use of Softmax model for classification. We show that Softmax model is a nonlinear generalization for the logistic discrimination, that can approximate the posterior probabilities of classes where other Artificial neural network (ANN) models don't have this ability. We show that Softmax model has more flexibility than logistic discrimination in terms of correct classification. To show the performance of Softmax model a medical data set on thyroid gland state is used. The result is that Softmax model may suffer from overfitting.

【 授权许可】

CC BY