Support Vector Machines and Generalisation in HEP

17th International Workshop on Advanced Computing and Analysis Techniques in Physics Research

物理学;计算机科学

Bethani, A.^1 ; Bevan, A.J.^2 ; Hays, J.^2 ; Stevenson, T.J.^2

LPSC, Grenoble, France^1

Queen Mary University of London, London, United Kingdom^2

关键词: Cross validation;    Generalisation;    Multi variate analysis;    Over trainings;    Overfitting;    Support vector machine (SVMs);    SVM algorithm;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/762/1/012052/pdf
DOI  :  10.1088/1742-6596/762/1/012052

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

We review the concept of support vector machines (SVMs) and discuss examples of their use. One of the benefits of SVM algorithms, compared with neural networks and decision trees is that they can be less susceptible to over fitting than those other algorithms are to over training. This issue is related to the generalisation of a multivariate algorithm (MVA); a problem that has often been overlooked in particle physics. We discuss cross validation and how this can be used to improve the generalisation of a MVA in the context of High Energy Physics analyses. The examples presented use the Toolkit for Multivariate Analysis (TMVA) based on ROOT and describe our improvements to the SVM functionality and new tools introduced for cross validation within this framework.