BDPS: An Efficient Spark-Based Big Data Processing Scheme for Cloud Fog-IoT Orchestration

Information

Rakib Hossen¹  Mohammed Nasir Uddin¹  Md. Jahidul Islam¹  Mehdi Sookhak²  Md. Julkar Nayeen Mahi³  Nuruzzaman Faruqui³  Md Whaiduzzaman³  Alistair Barros⁴ 

[1] Department of Computer Science and Engineering, Jagannath University, Dhaka 1100, Bangladesh;Department of Computer Science, Texas AM University, Corpus Christ, TX 78412, USA;Institute of Information Technology, Jahangirnagar University, Dhaka 1342, Bangladesh;School of Information Systems, Queensland University of Technology, Brisbane 4000, Australia;

关键词: efficient data processing;    depth-first search;    map reduction;    in-memory accelerator;    spark;   

DOI  :  10.3390/info12120517

来源: DOAJ

【 摘 要 】

The Internet of Things (IoT) has seen a surge in mobile devices with the market and technical expansion. IoT networks provide end-to-end connectivity while keeping minimal latency. To reduce delays, efficient data delivery schemes are required for dispersed fog-IoT network orchestrations. We use a Spark-based big data processing scheme (BDPS) to accelerate the distributed database (RDD) delay efficient technique in the fogs for a decentralized heterogeneous network architecture to reinforce suitable data allocations via IoTs. We propose BDPS based on Spark-RDD in fog-IoT overlay architecture to address the performance issues across the network orchestration. We evaluate data processing delays from fog-IoT integrated parts using a depth-first-search-based shortest path node finding configuration, which outperforms the existing shortest path algorithms in terms of algorithmic (i.e., depth-first search) efficiency, including the Bellman–Ford (BF) algorithm, Floyd–Warshall (FW) algorithm, Dijkstra algorithm (DA), and Apache Hadoop (AH) algorithm. The BDPS exhibits low latency in packet deliveries as well as low network overhead uplink activity through a map-reduced resilient data distribution mechanism, better than in BF, DA, FW, and AH. The overall BDPS scheme supports efficient data delivery across the fog-IoT orchestration, outperforming faster node execution while proving effective results, compared to DA, BF, FW and AH, respectively.

【 授权许可】

Unknown