DESIGN AND VERIFICATION OF REMOTE SENSING IMAGE DATA CENTER STORAGE ARCHITECTURE BASED ON HADOOP

International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences

Zhou, X.^2¹  Tang, D.^1² 

[1] Beijing Institute of Remote Sensing Information,100192, Haidian District , Beijing, China^2;National Geomatics Center of China, 100830,28# Lianhuachi West Road, BeiJing, China^1

关键词: Data center;    Storage strategy;    Parallel processing;    Hadoop;    HBase;   

DOI  :  10.5194/isprs-archives-XLII-3-1639-2018

学科分类：地球科学(综合)

来源: Copernicus Publications

【 摘 要 】

The data center is a new concept of data processing and application proposed in recent years. It is a new method of processing technologies based on data, parallel computing, and compatibility with different hardware clusters. While optimizing the data storage management structure, it fully utilizes cluster resource computing nodes and improves the efficiency of data parallel application. This paper used mature Hadoop technology to build a large-scale distributed image management architecture for remote sensing imagery. Using MapReduce parallel processing technology, it called many computing nodes to process image storage blocks and pyramids in the background to improve the efficiency of image reading and application and sovled the need for concurrent multi-user high-speed access to remotely sensed data. It verified the rationality, reliability and superiority of the system design by testing the storage efficiency of different image data and multi-users and analyzing the distributed storage architecture to improve the application efficiency of remote sensing images through building an actual Hadoop service system.

【 授权许可】

CC BY