Cloud Computing at JPL Science Data Systems
Cloud computing is an approach and tool to support "Big Data".
Earth Science Data Systems↗
SEARCH · Search NASA
Results for “Earth system science”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Goddard Earth Observing System - Data Assimilation System (GEOS-4 DAS) Data Products at the NASA Goddard Earth Science DISC DAAC
This list contains the names of data products from the Goddard Earth Observing System - Data Assimilation System (GEOS-4 DAS) at the Goddard Earth Science (GES) Data and Information Services Center (DISC) Distributed Active Archive Center (DAAC). The list divides the data products into Assimilated Synoptic Files and Assimilated Time Averaged Files.
Source record↗
Drought Prediction for Socio-Cultural Stability Project
The primary objective of this project is to answer the question: "Can existing, linked infrastructures be used to predict the onset of drought months in advance?" Based on our work, the answer to this question is "yes" with the qualifiers that skill depends on both lead-time and location, and especially with the associated teleconnections (e.g., ENSO, Indian Ocean Dipole) active in a given region season. As part of this work, we successfully developed a prototype drought early warning system based on existing/mature NASA Earth science components including the Goddard Earth Observing System Data Assimilation System Version 5 (GEOS-5) forecasting model, the Land Information System (LIS) land data assimilation software framework, the Catchment Land Surface Model (CLSM), remotely sensed terrestrial water storage from the Gravity Recovery and Climate Experiment (GRACE) and remotely sensed soil moisture products from the Aqua/Advanced Microwave Scanning Radiometer - EOS (AMSR-E). We focused on a single drought year - 2011 - during which major agricultural droughts occurred with devastating impacts in the Texas-Mexico region of North America (TEXMEX) and the Horn of Africa (HOA). Our results demonstrate that GEOS-5 precipitation forecasts show skill globally at 1-month lead, and can show up to 3 months skill regionally in the TEXMEX and HOA areas. Our results also demonstrate that the CLSM soil moisture percentiles are a goof indicator of drought, as compared to the North American Drought Monitor of TEXMEX and a combination of Famine Early Warning Systems Network (FEWS NET) data and Moderate Resolution Imaging Spectrometer (MODIS)'s Normalizing Difference Vegetation Index (NDVI) anomalies over HOA. The data assimilation experiments produced mixed results. GRACE terrestrial water storage (TWS) assimilation was found to significantly improve soil moisture and evapotransportation, as well as drought monitoring via soil moisture percentiles, while AMSR-E soil moisture assimilation produced marginal benefits. We carried out 1-3 month lead-time forecast experiments using GEOS-5 forecasts as input to LIS/CLSM. Based on these forecast experiments, we find that the expected skill in GEOS-5 forecasts from 1-3 months is present in the soil moisture percentiles used to indicate drought. In the case of the HOA drought, the failure of the long rains in April appears in the February 1, March 1 and April 1 initialized forecasts, suggesting that for this case, drought forecasting would have provided some advance warning about the drought conditions observed in 2011. Three key recommendations for follow-up work include: (1) carry out a comprehensive analysis of droughts observed over the entire period of record for GEOS-5 forecasts; (2) continue to analyze the GEOS-5 forecasts in HOA stratifying by anomalies in long and short rains; and (3) continue to include GRACE TWS, Soil Moisture/Ocean Salinity (SMOS) and the upcoming NASA Soil Moisture Active/Passive (SMAP) soil moisture products in a routine activity building on this prototype to further quantify the benefits for drought assessment and prediction.
Peters-Lidard, Christa↗
Applying Satellite Data to Support Disaster Response and Emergency Management Decision Making
Using the vantage point of space, satellite observations provide information about the Earth that can serve a critical role in building situational awareness and filling in data gaps during disaster response. NASA’s Earth Science Division ( studies the Earth as a system and develops technologies to improve the quality of life here on our home planet. Within NASA ESD, the Disasters Program and its Disasters Response Coordination System (DRCS) aims to advance Earth science data and information to support management decisions that prevent or mitigate the impacts of disasters. Using a whole-of-NASA approach to coordinate and mobilize the Agency’s assets and expertise to provide geospatial information during disasters, this work brings the utility of Earth observation information to emergency management and disaster response and reduces the impacts of disasters on lives and livelihoods .This poster will introduce the utility of satellite and geospatial information to disaster response through examples of recent DRCS incident response activations and highlight the DRCS model that employs a user-centered activation framework beginning with direct requests from responders and ending with after-action assessments that feed lessons learned and process improvements.
Remote Sensing↗
An Analytic Collaborative Framework for the Earth System Observatory
NASA's Earth System Observatory groundbreaking observations will provide critical measurements to address societal relevant problems in climate change, natural hazard mitigation, fighting forest fires, and improving real-time agricultural processes. Central to the ESO vision is the notion of Open-Source Science (OSS), a collaborative culture enabled by technology that promotes the open sharing of data, information, and knowledge aiming to facilitate and accelerate scientific understanding, and the agile development of applications for the benefit of society. The larger vision of an Earth System Digital Twin (ESDT) calls for integrated Earth science frameworks that mirror the Earth by a proxy digital construct that includes km-scale resolution Earth system models and data assimilation systems along with an integrated set of analytic tools to enable the next generation of science discoveries and evidence-based decision making. The goal of this project is to develop an Analytic Collaborative Framework for ESO missions, based on realistic, science-based observing system simulations and the Program of Record (PoR). Tying it all together is a cloud-based cyberinfrastructure that will enable each uniquely designed satellite in the Earth System Observatory to work in tandem to create a 3D, holistic view of Earth. In this presentation, we lay the technological groundwork for enabling such a vision. Our approach consists of the 3 main interconnected building blocks: 1. Cloud-optimized representative datasets for ESO missions and the PoR to serve as basis for developing and prototyping an Analytic Collaborative Framework. 2. An Algorithm Workbench for enabling experimentation and exploration of synergistic algorithms not only for instruments within a mission, but also including the PoR and other ESO missions. 3. A series of concrete Open-Source Science demonstrations including use cases that span science discovery and end-user applications with direct societal impact. While our ultimate goal is to include all of the main missions comprising the Earth System Observatory, in our initial 2 years we will focus on AOS and SBG, two missions for which specific synergisms have been identified in a recent workshop. In this presentation we will describe our approach and discuss some illustrative examples of our framework.
Arlindo da SIlva↗
An Analytic Collaborative Framework for the Earth System Observatory
NASA's Earth System Observatory groundbreaking observations will provide critical measurements to address societal relevant problems in climate change, natural hazard mitigation, fighting forest fires, and improving real-time agricultural processes. Central to the ESO vision is the notion of Open-Source Science (OSS), a collaborative culture enabled by technology that promotes the open sharing of data, information, and knowledge aiming to facilitate and accelerate scientific understanding, and the agile development of applications for the benefit of society. The larger vision of an Earth System Digital Twin (ESDT) calls for integrated Earth science frameworks that mirror the Earth by a proxy digital construct that includes km-scale resolution Earth system models and data assimilation systems along with an integrated set of analytic tools to enable the next generation of science discoveries and evidence-based decision making. The goal of this project is to develop an Analytic Collaborative Framework for ESO missions, based on realistic, science-based observing system simulations and the Program of Record (PoR). Tying it all together is a cloud-based cyberinfrastructure that will enable each uniquely designed satellite in the Earth System Observatory to work in tandem to create a 3D, holistic view of Earth. In this presentation, we lay the technological groundwork for enabling such a vision. Our approach consists of the 3 main interconnected building blocks: 1. Cloud-optimized representative datasets for ESO missions and the PoR to serve as basis for developing and prototyping an Analytic Collaborative Framework. 2. An Algorithm Workbench for enabling experimentation and exploration of synergistic algorithms not only for instruments within a mission, but also including the PoR and other ESO missions. 3. A series of concrete Open-Source Science demonstrations including use cases that span science discovery and end-user applications with direct societal impact. While our ultimate goal is to include all of the main missions comprising the Earth System Observatory, in our initial 2 years we will focus on AOS and SBG, two missions for which specific synergisms have been identified in a recent workshop. In this presentation we will describe our approach and discuss some illustrative examples of our framework.
Arlindo da SIlva↗
Advanced Information Systems Technology for NASA Earth System Digital Twins (ESDT)
ESA and NASA have both started programs to design and develop Digital Twins of the Earth and/or Earth systems. Organized around interconnected, multi-domain, high-scale modeling capabilities, the three major components of an Earth System Digital Twin are a continuously updated Digital Replica of the Earth System of interest, dynamic Forecasting models, and Impact Assessment capabilities. Earth System Digital Twins integrate diverse Earth and human activity models, continuous observations, and information system capabilities to provide unified, comprehensive representations and predictions that can be utilized for monitoring the health of the Planet, as well as for developing actionable information to support decision making. More generally, Digital Twins will help researchers better understand the fundamental Earth systems that impact everything from wildfires to climate change. This Townhall will first provide a short description of ESA’s, NASA’s and CNES’s current efforts in Digital Twins: • Destination Earth (DestinE) is the first initiative of the European Union to create a Digital Twin of the Earth, particularly focused on weather and climate, and as a coordinated effort between the European Centre for Medium-Range Weather Forecasts (ECMWF), ESA and the European Organization for the Exploitation of Meteorological Satellites (EUMETSAT). • Additionally, ESA is developing several Digital Twin Earth Precursor Activities to study some of the key scientific and technical challenges associated with building a “Digital Twin Earth”. These include forests, hydrology, Antarctica, food systems, oceans, and climate hot spots Digital Twin prototypes. • NASA Earth Science Technology Office (ESTO)’s Advanced Information Systems Technology (AIST) Program has started an initiative in Earth System Digital Twins (ESDT), with 14 current projects in this area, developing various information systems technologies and prototypes that will help prepare the development of future NASA Digital Twins. • CNES is currently developing the concept of a Digital Twin Factory (DTF), which relies on a data lake, a high computing capability using clouds and/or HPC and has thematic algorithms and methodologies able to generate registered and coherent layers of information in order to enrich a datacube from which physical indicators can be computed spatially. NASA, ESA and CNES are also currently defining science use cases that will be presented during the townhall; those and a few short discussions of current projects will serve as a starting point to engage a dialogue about Digital Twins of the Earth with the IGARSS community.
earth science remote sensing; Information systems↗
Using Cloud-Based Storage Technologies for Earth Science Data
Cloud based infrastructure may offer several key benefits of scalability, built in redundancy and reduced total cost of ownership as compared with a traditional data center approach. However, most of the tools and software systems developed for NASA data repositories were not developed with a cloud based infrastructure in mind and do not fully take advantage of commonly available cloud-based technologies. Object storage services are provided through all the leading public (Amazon Web Service, Microsoft Azure, Google Cloud, etc.) and private (Open Stack) clouds, and may provide a more cost-effective means of storing large data collections online. We describe a system that utilizes object storage rather than traditional file system based storage to vend earth science data. The system described is not only cost effective, but shows superior performance for running many different analytics tasks in the cloud. To enable compatibility with existing tools and applications, we outline client libraries that are API compatible with existing libraries for HDF5 and NetCDF4. Performance of the system is demonstrated using clouds services running on Amazon Web Services.
Data↗
NASA’s Advance Information Systems Technology (AIST) Program
NASA’s Earth Science Technology Office (ESTO) develops early-stage technologies to enhance scientific understanding. ESTO’s technologies can be reliably and confidently applied to a broad range of science measurements and missions, as well as facilitate practical applications to benefit society at large. As the lead technology office within the Earth Science Division of the NASA Science Mission Directorate, ESTO is focused on the technological challenges inherent to space-based investigations of our planet's dynamic, interrelated systems. Through flexible, science-driven technology strategies and a competitive selection process, ESTO-funded technologies have supported numerous Earth science missions as well as commercial applications. From next generation sensors and instruments to communication and information systems, ESTO technologies enable many NASA missions and data services. The Advanced Information Systems Technology (AIST) Program is one focal area of ESTO. AIST innovates information system technologies that enable the development of new observing systems as well as agile science investigations through data analytics and artificial intelligence tools and algorithms. AIST utilizes an end-to-end development approach with the goal of infusing mature technologies into future missions, measurements, and analysis. One thrust of AIST is data exploitation and analysis using an analytic center framework to make observational data and model output more accessible and usable to scientists conducting specific investigations as well as to extract higher-level science content and information from the data. The framework accelerates scientific discovery by harmonizing the data, tools, and computational resources. NASA’s upcoming Surface, Biology and Geology (SBG) mission is one such mission whose data architecture will leverage many of the technologies developed through the AIST program. This talk will highlight current and future program development goals.
Laura Rogers↗
Incorporating NASA Earth Science Data into the DHIS2 Health Information System
Explore the source record for details and available documents.
ECOSTRESS DHIS2 malaria↗
NASA Strategic Roadmap Summary Report
In response to the Vision, NASA commissioned strategic and capability roadmap teams to develop the pathways for turning the Vision into a reality. The strategic roadmaps were derived from the Vision for Space Exploration and the Aldrich Commission Report dated June 2004. NASA identified 12 strategic areas for roadmapping. The Agency added a thirteenth area on nuclear systems because the topic affects the entire program portfolio. To ensure long-term public visibility and engagement, NASA established a committee for each of the 13 areas. These committees - made up of prominent members of the scientific and aerospace industry communities and senior government personnel - worked under the Federal Advisory Committee Act. A committee was formed for each of the following program areas: 1) Robotic and Human Lunar Exploration; 2) Robotic and Human Exploration of Mars; 3) Solar System Exploration; 4) Search for Earth-Like Planets; 5) Exploration Transportation System; 6) International Space Station; 7) Space Shuttle; 8) Universe Exploration; 9) Earth Science and Applications from Space; 10) Sun-Solar System Connection; 11) Aeronautical Technologies; 12) Education; 13) Nuclear Systems. This document contains roadmap summaries for 10 of these 13 program areas; The International Space Station, Space Shuttle, and Education are excluded. The completed roadmaps for the following committees: Robotic and Human Exploration of Mars; Solar System Exploration; Search for Earth-Like Planets; Universe Exploration; Earth Science and Applications from Space; Sun-Solar System Connection are collected in a separate Strategic Roadmaps volume. This document contains memebership rosters and charters for all 13 committees.
Wilson, Scott↗
Mission Status at Aura Science Team MOWG Meeting: EOS Aura
Presentation at the 24797-16 Earth Observing System (EOS) Aura Science Team Meeting (Mission Operations Work Group (MOWG)) at Rotterdam, Netherlands August 29, 2016. Presentation topics include mission summary, spacecraft subsystems summary, recent and planned activities, spacecraft anomalies, data capture, propellant usage and lifetime estimates, spacecraft maneuvers and ground track history, mission highlights and past spacecraft anomalies and reliability estimates.
MOWG↗
Making Earth Science Data Records for Use in Research Environments (MEaSUREs) Projects Data and Services at the GES DISC
NASA's Earth Science Program is dedicated to advancing Earth remote sensing and pioneering the scientific use of satellite measurements to improve human understanding of our home planet. Through the MEaSUREs Program, NASA is continuing its commitment to expand understanding of the Earth system using consistent data records. Emphasis is on linking together multiple data sources to form coherent time-series, and facilitating the use of extensive data in the development of comprehensive Earth system models. A primary focus of the MEaSUREs Program is the creation of Earth System Data Records (ESDRs). An ESDR is defined as a unified and coherent set of observations of a given parameter of the Earth system, which is optimized to meet specific requirements for addressing science questions. These records are critical for understanding Earth System processes; for the assessment of variability, long-term trends, and change in the Earth System; and for providing input and validation means to modeling efforts. Seven MEaSUREs projects will be archived and distributed through services at the Goddard Earth Sciences Data and Information Services Center (GES DISC).
Vollmer, Bruce E.↗
Report to Congress on the restructuring of the Earth Observing System
Contents: (1) The Science Objectives of EOS; (2) New Spacecraft Configurations; (3) The Impact of the Restructured EOS on Understanding the Climate; (4) The Impact of EOS on Adaptation and Mitigation Strategies; (5) EOS Data and Information System; (6) Interdisciplinary Investigations; (7) Missions in Advance of EOS; (8) The Role of the Departments of Energy and Defense; (9) Summary of the Mission to Planet Earth; and (10) Funding Requirement.
Source record↗
NASA Global Hawk Project Update and Future Plans: A New Tool for Earth Science Research
Science objectives include: First demonstration of the Global Hawk unmanned aircraft system (UAS) for NASA and NOAA Earth science research and applications; Validation of instruments on-board the Aura satellite; Exploration of trace gases, aerosols, and dynamics of remote upper Troposphere/lower Stratosphere regions; Sample polar vortex fragments and atmospheric rivers; Risk reduction for future missions that will study hurricanes and atmospheric rivers.
Naftel, Chris↗
Assessing the Needs of NASA's Near Real-Time Earth Observation Products
"The 2017-2027 Decadal Survey for Earth Science and Applications from Space stated that NASA's Earth Science with planned implementation of applications provides sustained earth observations for societal benefits [1]. The Decadal Survey indicated that data latency is invaluable for time-sensitive applications including disaster risk reduction, wildland fire carbon emissions quantification, real-time measurements of the state of the hydrologic systems and many more. Data latency refers to the time between earth observation and data products available to users. During the past 13 years, NASA's Land, Atmosphere Near Real-Time Capability for Earth Observing Systems (LANCE) continues to provide free access to earth observation products that are made available much quicker than routine processing allows. The latency of most LANCE data products is Near Real-time (NRT) which is defined as less than three hours from satellite observations [2]. LANCE is managed by the Earth Science Data and Information System (ESDIS) Project at NASA Goddard Space Flight Center [3], and a User Working Group (UWG) is responsible for providing guidance to LANCE. LANCE data are used by direct users and brokers who add value to the data [4]. NASA Earth Applied Sciences Program (ASP) is one of the primary users of LANCE, which collaborates with partner organizations and provides support to scientists to solve problems in applications of earth observations. ASP promotes the use of LANCE NRT data products to demonstrate applications in decision making, facilitates end-user feedback to the science team to improve data products, and provides information on future demands for research. LANCE supports applications that need a rapid response including detecting wildland fires and volcanic eruptions, tracking smoke, ash and dust plumes, monitoring air quality and tracking extreme weather events such as hurricanes, landslides, and floods. To gather feedback regarding the availability, accessibility and actionability of NASA's NRT data products for societal benefit, three surveys and a few discussions with experts involved in the topic within ASP were conducted from the perspective of users. Feedback has been collected from users who are interested in using low latency NASA data within application communities of agriculture, disasters, water resources, health and air quality, ecological conservation, wildland fires and capacity building. Analysis-ready NRT data products in a variety of formats have been mentioned many times in the collected feedback, especially for applied users with little to no experience using research-grade earth observation products. Users prefer to have products that can be easily integrated into their existing workflows and take their analysis to the data. HDF5 is a commonly used data format for research, but typically requires some conversion to a more friendly format for applications and regular use in decision-making. Users prefer the GeoTIFF data format that can be directly ingested into a GIS mapping software and platform for data analysis and visualization. For example, LANCE’s fire, flood, SO2 and Black Marble Nighttime Blue/Yellow Composite data products have been integrated into NASA Disasters Mapping Portal, which is an GIS-based open data portal, for users in the disaster management community. There are 291 LANCE NRT layers available through GIBS and Worldview, where users can download a snapshot in GeoTIFF format. Operational users expect data to be processed as close to the user as possible. The collected feedback indicates that LANCE fire products within 3 hours latency would meet the needs of the wildland fire community. The ideal latency for volcanic application is 10-15 minutes. Users in Volcanic Ash Advisory Centers (VAAC) reported that the first forecast volcanic product should be issued within 75 minutes from the volcano eruption [5]. Overall, for disaster applications, data latency within 3 hours is useful while latency greater than 12 hours is not timely enough for operational use. Capacity building and training are critical for users to be able to access, interpret and use data products and tools for their decision making, especially for applied users with limited experience using earth observation products. LANCE data products have been used in a number of capacity building projects domestically and internationally [6]. As LANCE continues to bring new products into the system, users request training to utilize LANCE new and upcoming data products and capabilities in their applications. Due to the limitation of bandwidth and downstream flow paths, users in some developing countries need tools to select and download data for a specific area of interest instead of bulk downloads. The collected feedback also shows the lack of available SAR satellite low latency data products. The advantages of SAR to monitor conditions and changes on the ground through darkness, clouds, volcanic ash, and other atmospheric conditions, are appealing to low latency users. For example, terabytes of low latency but cloudy optical images are not helpful in rapidly identifying the extent of flood or fire impacts. LANCE could be complemented with low latency measurements via the upcoming NASA-ISRO Synthetic Aperture Radar (NISAR) mission [7]. Requests for higher spatial resolution products are expressed. A user from the wildland fire management community reported that products with 30-m spatial resolution could be used to detect small fires. The 30-m Landsat OLI fire data is now part of NASA’s Fire Information for Resource Management System (FIRMS) US/Canada [8]. Within the open and free NASA resources, LANCE disseminates NRT data products in a manner that allows them to be accessible and understandable to both scientific and applied users. In many application areas, latency plays an important or even decisive role where low latency earth observations help people to observe areas of interest, detect and track changes in the environment and make timely decisions. NASA’s Earth Applied Sciences Program promotes the use of LANCE NRT products and builds a bridge between application users and research teams. The collected feedback indicates data latency within 3 hours is useful for most of the applications, and shows the needs of user-friendly, analysis-ready products, and requests training on LANCE’s new and upcoming data products. User feedback has been provided to LANCE UWG for guidance and recommendations, and for translating findings into something actionable.
Tian Yao↗
Entropy Masking
This paper details two projects that use the World Wide Web (WWW) for dissemination of curricula that focus on remote sensing. 1) Presenting grade-school students with the concepts used in remote sensing involves educating the teacher and then providing the teacher with lesson plans. In a NASA-sponsored project designed to introduce students in grades 4 through 12 to some of the ideas and terminology used in remote sensing, teachers from local grade schools and middle schools were recruited to write lessons about remote sensing concepts they could use in their classrooms. Twenty-two lessons were produced and placed in seven modules that include: the electromagnetic spectrum, two- and three-dimensional perception, maps and topography, scale, remote sensing, biotic and abiotic concepts, and landscape chi rise. Each lesson includes a section that evaluates what students have learned by doing the exercise. The lessons, instead of being published in a workbook and distributed to a limited number of teachers, have been placed on a WWW server, enabling much broader access to the package. This arrangement also allows for the lessons to be modified after feedback from teachers accessing the package. 2) Two-year colleges serve to teach trade skills, prepare students for enrollment in senior institutions of learning, and more and more, retrain students who have college degrees in new technologies and skills. A NASA-sponsored curriculum development project is producing a curriculum using remote sensing analysis an Earth science applications. The project has three major goals. First, it will implement the use of remote sensing data in a broad range of community college courses. Second, it will create curriculum modules and classes that are transportable to other community colleges. Third, the project will be an ongoing source of data and curricular materials to other community colleges. The curriculum will have these course pathways to a certificate; a) a Science emphasis, b) an Arts and Letters emphasis, and c) a Computer Science emphasis Each pathway includes course work in remote sensing, geographical information systems (GIS), computer science, Earth science, software and technology utilization, and communication. Distribution of products from this project to other two-year colleges will be accomplished using the WWW.
Watson, Andrew B.↗