Interactive Analysis of Large Network Data Collections UsingQuery-Driven Visualization

Bethel, E. Wes ; Campbell, Scott ; Dart, Eli ; Lee, Jason ; Smith,Steven A. ; Stockinger, Kurt ; Tierney, Brian ; Wu, Kesheng

Lawrence Berkeley National Laboratory

关键词: Data Analysis;    Testing Interactive Data Exploration And Discovery Multivariatevisualization Security Traffic Analysis Query-Drivenvisualization;    Management;    Interactive Data Exploration And Discovery Multivariatevisualization Security Traffic Analysis Query-Drivenvisualization;    99 General And Miscellaneous//Mathematics, Computing, And Information Science;   

DOI  :  10.2172/891627
RP-ID  :  LBNL--59166
RP-ID  :  DE-AC02-05CH11231
RP-ID  :  891627

美国|英语

来源: UNT Digital Library

【 摘 要 】

Realizing operational analytics solutions where large and complex data must be analyzed in a time-critical fashion entails integrating many different types of technology. Considering the extreme scale of contemporary datasets, one significant challenge is to reduce the duty cycle in the analytics discourse process. This paper focuses on an interdisciplinary combination of scientific data management and visualization/analysis technologies targeted at reducing the duty cyclein hypothesis testing and knowledge discovery. We present an application of such a combination in the problem domain of network traffic data analysis. Our performance experiment results, including both serial and parallel scalability tests, show that the combination can dramatically decrease the analytics duty cycle for this particular application. The combination is effectively applied to the analysis of network traffic data to detect slow and distributed scans, which is a difficult-to-detect form of cyber attack. Our approach is sufficiently general to be applied to a diverse set of data understanding problems as well as used in conjunction with a diverse set of analysis and visualization tools.