Modified Autoencoder Training and Scoring for Robust Unsupervised Anomaly Detection in Deep Learning

IEEE Access

Nicholas Merrill¹  Azim Eskandarian¹ 

[1] Department of Mechanical Engineering, Virginia Tech, Blacksburg, VA, USA;

关键词: Hyperspectral;    HSI;    deep learning;    anomaly detection;    unsupervised;    autoencoder;   

DOI  :  10.1109/ACCESS.2020.2997327

来源: DOAJ

【 摘 要 】

The autoencoder (AE) is a fundamental deep learning approach to anomaly detection. AEs are trained on the assumption that abnormal inputs will produce higher reconstruction errors than normal ones. In practice, however, this assumption is unreliable in the unsupervised case, where the training data may contain anomalous examples. Given sufficient capacity and training time, an AE can generalize to such an extent that it reliably reconstructs anomalies. Consequently, the ability to distinguish anomalies via reconstruction errors is diminished. We respond to this limitation by introducing three new methods to more reliably train AEs for unsupervised anomaly detection: cumulative error scoring (CES), percentile loss (PL), and early stopping via knee detection. We demonstrate significant improvements over conventional AE training on image, remote-sensing, and cybersecurity datasets.

【 授权许可】

Unknown