Contextual Anomaly Detection in Text Data

Algorithms

Amogh Mahapatra¹  Nisheeth Srivastava² 

[1] Department of Computer Science, University of Minnesota, 200 Union St SE, Minneapolis 55455, USA;

关键词: context detection;    topic modeling;    anomaly detection;   

DOI  :  10.3390/a5040469

来源: mdpi

【 摘 要 】

We propose using side information to further inform anomaly detection algorithms of the semantic context of the text data they are analyzing, thereby considering both divergence from the statistical pattern seen in particular datasets and divergence seen from more general semantic expectations. Computational experiments show that our algorithm performs as expected on data that reflect real-world events with contextual ambiguity, while replicating conventional clustering on data that are either too specialized or generic to result in contextual information being actionable. These results suggest that our algorithm could potentially reduce false positive rates in existing anomaly detection systems.

【 授权许可】

CC BY   
© 2012 by the authors; licensee MDPI, Basel, Switzerland.