On hybrid classification using model assisted posterior estimates

PATTERN RECOGNITION

卷:45

Article

Ghosh, Anil K.¹  Godtliebsen, Fred² 

[1] Indian Stat Inst, Theoret Stat & Math Unit, Kolkata 700108, India

[2] Univ Tromso, Dept Math & Stat, N-9037 Tromso, Norway

关键词: Bayes rule;    Cross-validation;    LDA;    Misclassification rates;    Multiscale analysis;    Nearest neighbor classification;    QDA;    Stacking;   

DOI  :  10.1016/j.patcog.2011.12.002

来源: Elsevier

【 摘 要 】

Traditional parametric and nonparametric classifiers used for statistical pattern recognition have their own strengths and limitations. While parametric methods assume some specific parametric models for density functions or posterior probabilities of competing classes, nonparametric methods are free from such assumptions. So, when these model assumptions are correct, parametric methods outperform nonparametric classifiers, especially when the training sample is small. But, violations of these assumptions often lead to poor performance by parametric classifiers, where nonparametric methods work well. In this article, we make an attempt to overcome these limitations of parametric and nonparametric approaches and combine their strengths. The resulting classifiers, denoted the hybrid classifiers, perform like parametric classifiers when the model assumptions are valid, but unlike parametric classifiers, they also provide safeguards against possible deviations from parametric model assumptions. In this article, we propose some multiscale methods for hybrid classification, and their performance is evaluated using several simulated and benchmark data sets. (C) 2011 Elsevier Ltd. All rights reserved.

【 授权许可】

Free