A DDoS Attack Detection System Based on Spark Framework

Computer Science and Information Systems

Dezhi Han¹ 

[1] College of Information Engineering, Shanghai Maritime University

关键词: Distributed Denial of Service (DDoS);    Early Warn;    Attack Detection;    Spark framework;    K-Means Algorithm;   

DOI  :  10.2298/CSIS161217028H

学科分类：社会科学、人文和艺术（综合）

来源: Computer Science and Information Systems

【 摘 要 】

There are many problems in traditional Distributed Denial of Service (DDoS) attack detection such as low accuracy, low detection speed and so on, which is not suitable for the real time detecting and processing of DDoS attacks in big data environment. This paper proposed a novel DDoS attack detection system based on Spark framework including 3 main algorithms. Based on information entropy, the first one can effectively warn all kinds of DDoS attacks in advance according to the information entropy change of data stream source IP address and destination IP address; With the help of designed dynamic sampling K-Means algorithm, this new detection system improves the attack detection accuracy effectively; Through running dynamic sampling K-Means parallelization algorithm, which can quickly and effectively detect a variety of DDoS attacks in big data environment. The experiment results show that this system can not only early warn DDoS attacks effectively, but also can detect all kinds of DDoS attacks in real time, with low false rate.

【 授权许可】

CC BY-NC-ND