| Journal of Big Data | |
| Anomaly detection and community detection in networks | |
| Research | |
| Hadiseh Safdari1  Caterina De Bacco1  | |
| [1] Max Planck Institute for Intelligent Systems, Cyber Valley, 72076, Tübingen, Germany; | |
| 关键词: Probabilistic models; Latent variable models; Community detection; Anomaly detection; | |
| DOI : 10.1186/s40537-022-00669-1 | |
| received in 2022-05-11, accepted in 2022-11-29, 发布年份 2022 | |
| 来源: Springer | |
PDF
|
|
【 摘 要 】
Anomaly detection is a relevant problem in the area of data analysis. In networked systems, where individual entities interact in pairs, anomalies are observed when pattern of interactions deviates from patterns considered regular. Properly defining what regular patterns entail relies on developing expressive models for describing the observed interactions. It is crucial to address anomaly detection in networks. Among the many well-known models for networks, latent variable models—a class of probabilistic models—offer promising tools to capture the intrinsic features of the data. In this work, we propose a probabilistic generative approach that incorporates domain knowledge, i.e., community membership, as a fundamental model for regular behavior, and thus flags potential anomalies deviating from this pattern. In fact, community membership serves as the building block of a null model to identify the regular interaction patterns. The structural information is included in the model through latent variables for community membership and anomaly parameter. The algorithm aims at inferring these latent parameters and then output the labels identifying anomalies on the network edges.
【 授权许可】
CC BY
© The Author(s) 2022
【 预 览 】
| Files | Size | Format | View |
|---|---|---|---|
| RO202305066248861ZK.pdf | 2418KB | ||
| Fig. 6 | 702KB | Image | |
| 13731_2022_257_Article_IEq4.gif | 1KB | Image | |
| MediaObjects/12888_2022_4395_MOESM1_ESM.xlsx | 128KB | Other | |
| 13731_2022_257_Article_IEq12.gif | 1KB | Image | |
| Fig. 3 | 330KB | Image | |
| MediaObjects/40249_2022_1047_MOESM1_ESM.docx | 26KB | Other | |
| Fig. 1 | 331KB | Image | |
| MediaObjects/12888_2022_4475_MOESM1_ESM.docx | 15KB | Other | |
| 40249_2022_1045_Article_IEq1.gif | 1KB | Image | |
| Fig. 1 | 62KB | Image | |
| MediaObjects/12888_2022_4457_MOESM1_ESM.docx | 57KB | Other | |
| 40249_2022_1045_Article_IEq9.gif | 1KB | Image | |
| 40249_2022_1045_Article_IEq10.gif | 1KB | Image | |
| 40249_2022_1045_Article_IEq11.gif | 1KB | Image | |
| 40249_2022_1045_Article_IEq12.gif | 1KB | Image | |
| 40249_2022_1045_Article_IEq13.gif | 1KB | Image | |
| 40249_2022_1045_Article_IEq14.gif | 1KB | Image | |
| 40249_2022_1045_Article_IEq15.gif | 1KB | Image | |
| Fig. 1 | 1143KB | Image | |
| 40249_2022_1045_Article_IEq16.gif | 1KB | Image | |
| 40249_2022_1045_Article_IEq17.gif | 1KB | Image | |
| MediaObjects/12888_2022_4439_MOESM1_ESM.docx | 669KB | Other | |
| 40249_2022_1045_Article_IEq20.gif | 1KB | Image | |
| 40249_2022_1045_Article_IEq21.gif | 1KB | Image | |
| 40249_2022_1045_Article_IEq22.gif | 1KB | Image | |
| 40249_2022_1045_Article_IEq23.gif | 1KB | Image | |
| 40249_2022_1045_Article_IEq24.gif | 1KB | Image | |
| 40249_2022_1045_Article_IEq25.gif | 1KB | Image | |
| Fig. 5 | 1362KB | Image | |
| 40249_2022_1045_Article_IEq27.gif | 1KB | Image | |
| MediaObjects/40249_2022_1045_MOESM1_ESM.docx | 23KB | Other | |
| MediaObjects/40249_2022_1045_MOESM2_ESM.docx | 27KB | Other | |
| Fig. 1 | 88KB | Image | |
| Fig. 5 | 102KB | Image | |
| MediaObjects/12937_2022_825_MOESM1_ESM.docx | 159KB | Other | |
| Fig. 2 | 603KB | Image | |
| MediaObjects/41408_2022_759_MOESM3_ESM.pdf | 1219KB | ||
| 41408_2022_764_Article_IEq1.gif | 1KB | Image | |
| Fig. 1 | 106KB | Image | |
| 41408_2022_764_Article_IEq3.gif | 1KB | Image | |
| Fig. 2 | 106KB | Image | |
| MediaObjects/12888_2022_4468_MOESM4_ESM.docx | 39KB | Other | |
| 41408_2022_764_Article_IEq6.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq7.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq8.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq9.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq10.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq11.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq12.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq13.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq14.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq15.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq16.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq17.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq18.gif | 1KB | Image | |
| Fig. 1 | 93KB | Image | |
| 41408_2022_764_Article_IEq19.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq20.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq21.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq22.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq23.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq24.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq25.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq26.gif | 1KB | Image | |
| Fig. 1 | 171KB | Image | |
| 41408_2022_764_Article_IEq28.gif | 1KB | Image | |
| MediaObjects/12888_2022_4414_MOESM1_ESM.docx | 50KB | Other | |
| 41408_2022_764_Article_IEq30.gif | 1KB | Image | |
| 41408_2022_764_Article_IEq31.gif | 1KB | Image | |
| MediaObjects/41408_2022_764_MOESM1_ESM.docx | 1560KB | Other | |
| Fig. 6 | 234KB | Image | |
| Fig. 3 | 2829KB | Image | |
| MediaObjects/12944_2022_1748_MOESM1_ESM.pptx | 1468KB | Other | |
| Fig. 1 | 134KB | Image | |
| Fig. 3 | 251KB | Image | |
| 12864_2022_9026_Article_IEq55.gif | 1KB | Image | |
| Fig. 1 | 189KB | Image | |
| Table 1 | 79KB | Table | |
| 12864_2022_9026_Article_IEq57.gif | 1KB | Image | |
| Fig. 1 | 1034KB | Image | |
| 12864_2022_9026_Article_IEq59.gif | 1KB | Image | |
| Fig. 6 | 963KB | Image | |
| Fig. 1 | 66KB | Image | |
| MediaObjects/12944_2022_1748_MOESM2_ESM.docx | 69KB | Other | |
| Fig.1 | 1033KB | Image | |
| Fig. 1 | 2694KB | Image | |
| Fig. 1 | 752KB | Image | |
| MediaObjects/12902_2022_1256_MOESM1_ESM.tiff | 35161KB | Other | |
| Fig. 1 | 3432KB | Image | |
| Fig. 2 | 751KB | Image | |
| Fig. 1 | 752KB | Image | |
| Fig. 4 | 2444KB | Image | |
| Fig. 1 | 2451KB | Image | |
| MediaObjects/41408_2022_759_MOESM5_ESM.pdf | 799KB | ||
| Fig. 1 | 187KB | Image | |
| Fig. 3 | 737KB | Image | |
| Fig. 2 | 851KB | Image | |
| Scheme 1 | 3066KB | Image | |
| Fig. 1 | 536KB | Image | |
| MediaObjects/12974_2022_2684_MOESM3_ESM.jpg | 188KB | Other | |
| MediaObjects/12974_2022_2622_MOESM2_ESM.docx | 8KB | Other | |
| Fig. 4 | 320KB | Image | |
| Fig. 1 | 147KB | Image | |
| Fig. 3 | 694KB | Image | |
| Fig. 2 | 1566KB | Image | |
| MediaObjects/13690_2022_994_MOESM1_ESM.docx | 42KB | Other | |
| Fig. 1 | 477KB | Image | |
| MediaObjects/13690_2022_994_MOESM2_ESM.docx | 43KB | Other | |
| MediaObjects/13046_2022_2563_MOESM7_ESM.xlsx | 9KB | Other | |
| Fig. 1 | 174KB | Image | |
| Fig. 2 | 970KB | Image | |
| Fig. 2 | 1100KB | Image | |
| Fig. 1 | 74KB | Image | |
| 12864_2022_9026_Article_IEq78.gif | 1KB | Image | |
| Fig. 1 | 557KB | Image | |
| Fig. 2 | 2670KB | Image | |
| Fig. 3 | 66KB | Image | |
| Fig. 3 | 168KB | Image | |
| Fig. 4 | 75KB | Image | |
| Fig. 2 | 2492KB | Image | |
| MediaObjects/12902_2022_1215_MOESM1_ESM.docx | 25KB | Other | |
| MediaObjects/12902_2022_1215_MOESM2_ESM.docx | 14KB | Other | |
| Fig. 2 | 94KB | Image | |
| MediaObjects/12902_2022_1215_MOESM4_ESM.docx | 11KB | Other | |
| Fig. 1 | 119KB | Image | |
| Fig. 1 | 879KB | Image | |
| MediaObjects/41408_2022_759_MOESM8_ESM.xlsx | 43KB | Other | |
| MediaObjects/41408_2022_759_MOESM9_ESM.xls | 851KB | Other | |
| MediaObjects/12888_2022_4461_MOESM2_ESM.pdf | 658KB | ||
| Fig. 2 | 1694KB | Image | |
| MediaObjects/12951_2022_1742_MOESM1_ESM.docx | 891KB | Other | |
| MediaObjects/12902_2022_1215_MOESM10_ESM.docx | 12KB | Other | |
| Fig. 8 | 956KB | Image | |
| Fig. 7 | 2325KB | Image | |
| MediaObjects/41408_2022_759_MOESM10_ESM.txt | 57KB | Other | |
| MediaObjects/41408_2022_759_MOESM11_ESM.xlsx | 13KB | Other | |
| MediaObjects/41408_2022_759_MOESM12_ESM.xlsx | 11KB | Other | |
| Fig. 2 | 361KB | Image | |
| Fig. 2 | 1229KB | Image |
【 图 表 】
Fig. 2
Fig. 2
Fig. 7
Fig. 8
Fig. 2
Fig. 1
Fig. 1
Fig. 2
Fig. 2
Fig. 4
Fig. 3
Fig. 3
Fig. 2
Fig. 1
12864_2022_9026_Article_IEq78.gif
Fig. 1
Fig. 2
Fig. 2
Fig. 1
Fig. 1
Fig. 2
Fig. 3
Fig. 1
Fig. 4
Fig. 1
Scheme 1
Fig. 2
Fig. 3
Fig. 1
Fig. 1
Fig. 4
Fig. 1
Fig. 2
Fig. 1
Fig. 1
Fig. 1
Fig.1
Fig. 1
Fig. 6
12864_2022_9026_Article_IEq59.gif
Fig. 1
12864_2022_9026_Article_IEq57.gif
Fig. 1
12864_2022_9026_Article_IEq55.gif
Fig. 3
Fig. 1
Fig. 3
Fig. 6
41408_2022_764_Article_IEq31.gif
41408_2022_764_Article_IEq30.gif
41408_2022_764_Article_IEq28.gif
Fig. 1
41408_2022_764_Article_IEq26.gif
41408_2022_764_Article_IEq25.gif
41408_2022_764_Article_IEq24.gif
41408_2022_764_Article_IEq23.gif
41408_2022_764_Article_IEq22.gif
41408_2022_764_Article_IEq21.gif
41408_2022_764_Article_IEq20.gif
41408_2022_764_Article_IEq19.gif
Fig. 1
41408_2022_764_Article_IEq18.gif
41408_2022_764_Article_IEq17.gif
41408_2022_764_Article_IEq16.gif
41408_2022_764_Article_IEq15.gif
41408_2022_764_Article_IEq14.gif
41408_2022_764_Article_IEq13.gif
41408_2022_764_Article_IEq12.gif
41408_2022_764_Article_IEq11.gif
41408_2022_764_Article_IEq10.gif
41408_2022_764_Article_IEq9.gif
41408_2022_764_Article_IEq8.gif
41408_2022_764_Article_IEq7.gif
41408_2022_764_Article_IEq6.gif
Fig. 2
41408_2022_764_Article_IEq3.gif
Fig. 1
41408_2022_764_Article_IEq1.gif
Fig. 2
Fig. 5
Fig. 1
40249_2022_1045_Article_IEq27.gif
Fig. 5
40249_2022_1045_Article_IEq25.gif
40249_2022_1045_Article_IEq24.gif
40249_2022_1045_Article_IEq23.gif
40249_2022_1045_Article_IEq22.gif
40249_2022_1045_Article_IEq21.gif
40249_2022_1045_Article_IEq20.gif
40249_2022_1045_Article_IEq17.gif
40249_2022_1045_Article_IEq16.gif
Fig. 1
40249_2022_1045_Article_IEq15.gif
40249_2022_1045_Article_IEq14.gif
40249_2022_1045_Article_IEq13.gif
40249_2022_1045_Article_IEq12.gif
40249_2022_1045_Article_IEq11.gif
40249_2022_1045_Article_IEq10.gif
40249_2022_1045_Article_IEq9.gif
Fig. 1
40249_2022_1045_Article_IEq1.gif
Fig. 1
Fig. 3
13731_2022_257_Article_IEq12.gif
13731_2022_257_Article_IEq4.gif
Fig. 6
【 参考文献 】
- [1]
- [2]
- [3]
- [4]
- [5]
- [6]
- [7]
- [8]
- [9]
- [10]
- [11]
- [12]
- [13]
- [14]
- [15]
- [16]
- [17]
- [18]
- [19]
- [20]
- [21]
- [22]
- [23]
- [24]
- [25]
- [26]
- [27]
- [28]
- [29]
- [30]
- [31]
- [32]
- [33]
- [34]
- [35]
- [36]
- [37]
PDF