How NASA is Building a Petabyte Scale Geospatial Archive in the Cloud

Pilone, Dan ; Quinn, Patrick ; Jazayeri, Alireza ; Baynes, Kathleen ; Murphy, Kevin J

关键词: CLOUD COMPUTING;    DATA BASES;    DATA INTEGRATION;    DATA STORAGE;    DATA SYSTEMS;    EARTH SCIENCES;    EOS DATA AND INFORMATION SYSTEM;    MANAGEMENT SYSTEMS;    ARCHITECTURE (COMPUTERS);    CALIBRATING;    EVOLUTION (DEVELOPMENT);    MIGRATION;    MULTIVARIATE STATISTICAL ANALYSIS;    SERVICE ORIENTED ARCHITECTURE;   

RP-ID  :  GSFC-E-DAA-TN56268

美国|英语

来源: NASA Technical Reports Server

【 摘 要 】

NASA's Earth Observing System Data and Information System (EOSDIS) is working towards a vision of a cloud-based, highly-flexible, ingest, archive, management, and distribution system for its ever-growing and evolving data holdings. This free and open source system, Cumulus, is emerging from its prototyping stages and is poised to make a huge impact on how NASA manages and disseminates its Earth science data. This talk outlines the motivation for this work, present the achievements and hurdles of the past 18 months and charts a course for the future expansion of Cumulus. We explore not just the technical, but also the socio-technical challenges that we face in evolving a system of this magnitude into the cloud. The NASA EOSDIS archive is currently at nearly 30 PBs and will grow to over 300PBs in the coming years. We've presented progress on this effort at AWS re:Invent and the American Geophysical Union (AGU) Fall Meeting in 2017 and hope to have the opportunity to share with FOSS4G attendees information on the availability of the open sourced software and how NASA intends on making its Earth Observing Geospatial data available for free to the public in the cloud.