Harmony: Bringing Data Together by Bringing Services Together

Quinn, Patrick

关键词: CLOUD COMPUTING;    COMPUTER NETWORKS;    DATA PROCESSING;    DATA STORAGE;    EARTH OBSERVATIONS (FROM SPACE);    EOS DATA AND INFORMATION SYSTEM;    SCIENTIFIC SATELLITES;    SERVICE ORIENTED ARCHITECTURE;    WEB SERVICES;   

RP-ID  :  GSFC-E-DAA-TN75231,IN13C-0735

美国|英语

来源: NASA Technical Reports Server

【 摘 要 】

As Earth observation data volume, velocity, and variety continues to accelerate, so do the challenges of working with those data. The computation, storage, and network transfer requirements for multi-petabyte datasets demand solutions that allow users to process, store, and move fewer bytes while still finding the valuable insights they seek. Our cloud-based data transformation framework, Harmony, tackles these challenges by providing consistent, standards-based interface to multiple disparate backend processors collocated with NASA EOSDIS data. It allows data scientists to perform data processing and harmonization activities across many datasets through familiar tooling. Simultaneously, it provides a clear, consistent interface for data providers to expose new or customized backend services for their data. This talk will discuss Harmony, its architecture and interface, and the path forward for cloud-based NASA EOSDIS data harmonization services.