Big Data Cleaning Algorithms in Cloud Computing

International Journal of Online Engineering

Dong-Sheng Xu¹  Feng Zhang²  Yong-Heng Zhang¹  Hui-Feng Xue¹  Fei You¹ 

[1]School of Information Engineering, Yulin University, Yulin, 719000,ChinaSchool of Information Engineering, Yulin University, Yulin, 719000,ChinaSchool of Information Engineering, Yulin University, Yulin, 719000,China

关键词: big data;    cleaning algorithms;    cloud computing;    data cleaning;    Map-Reduce;   

DOI  :  

学科分类：社会科学、人文和艺术（综合）

来源: International Association of Online Engineering

【 摘 要 】

Big data cleaning is one of the important research issues in cloud computing theory. The existing data cleaning algorithms assume all the data can be loaded into the main memory at one-time, which are infeasible for big data. To this end, based on the knowledge base, a data cleaning algorithm is proposed in cloud computing by Map-Reduce. It extracts atomic knowledge of the selected nodes firstly, then analyzes their relations, deletes the same objects, builds an atomic knowledge sequence based on weights, lastly cleans data according to the sequence. The experimental results show that the cloud computing environment big data algorithm is effective and feasible, and has better expansibility.

【 授权许可】

Unknown