High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning

PATTERN RECOGNITION

卷:58

Article

Erfani, Sarah M.¹  Rajasegarar, Sutharshan^1,2  Karunasekera, Shanika¹  Leckie, Christopher¹ 

[1] Univ Melbourne, NICTA Victoria Res Lab, Dept Comp & Informat Syst, Room 7-14,Dough MacDonell Bldg, Melbourne, Vic 3010, Australia

[2] Deakin Univ, Sch Informat Technol, Geelong, Vic 3217, Australia

关键词: Anomaly detection;    Outlier detection;    High-dimensional data;    Deep belief net;    Deep learning;    One-class SVM;    Feature extraction;   

DOI  :  10.1016/j.patcog.2016.03.028

来源: Elsevier

【 摘 要 】

High-dimensional problem domains pose significant challenges for anomaly detection. The presence of irrelevant features can conceal the presence of anomalies. This problem, known as the 'curse of dimensionality', is an obstacle for many anomaly detection techniques. Building a robust anomaly detection model for use in high-dimensional spaces requires the combination of an unsupervised feature extractor and an anomaly detector. While one-class support vector machines are effective at producing decision surfaces from well-behaved feature vectors, they can be inefficient at modelling the variation in large, high-dimensional datasets. Architectures such as deep belief networks (DBNs) are a promising technique for learning robust features. We present a hybrid model where an unsupervised DBN is trained to extract generic underlying features, and a one-class SVM is trained from the features learned by the DBN. Since a linear kernel can be substituted for nonlinear ones in our hybrid model without loss of accuracy, our model is scalable and computationally efficient. The experimental results show that our proposed model yields comparable anomaly detection performance with a deep autoencoder, while reducing its training and testing time by a factor of 3 and 1000, respectively. (C) 2016 Elsevier Ltd. All rights reserved.

【 授权许可】

Free