SEARCH · Search NASA

Results for “NASA earth exchange”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

NASA NTRS2016

Using Docker Containers to Extend Reproducibility Architecture for the NASA Earth Exchange (NEX)

NASA Earth Exchange (NEX) is a data, supercomputing and knowledge collaboratory that houses NASA satellite, climate and ancillary data where a focused community can come together to address large-scale challenges in Earth sciences. As NEX has been growing into a petabyte-size platform for analysis, experiments and data production, it has been increasingly important to enable users to easily retrace their steps, identify what datasets were produced by which process chains, and give them ability to readily reproduce their results. This can be a tedious and difficult task even for a small project, but is almost impossible on large processing pipelines. We have developed an initial reproducibility and knowledge capture solution for the NEX, however, if users want to move the code to another system, whether it is their home institution cluster, laptop or the cloud, they have to find, build and install all the required dependencies that would run their code. This can be a very tedious and tricky process and is a big impediment to moving code to data and reproducibility outside the original system. The NEX team has tried to assist users who wanted to move their code into OpenNEX on Amazon cloud by creating custom virtual machines with all the software and dependencies installed, but this, while solving some of the issues, creates a new bottleneck that requires the NEX team to be involved with any new request, updates to virtual machines and general maintenance support. In this presentation, we will describe a solution that integrates NEX and Docker to bridge the gap in code-to-data migration. The core of the solution is saemi-automatic conversion of science codes, tools and services that are already tracked and described in the NEX provenance system, to Docker - an open-source Linux container software. Docker is available on most computer platforms, easy to install and capable of seamlessly creating and/or executing any application packaged in the appropriate format. We believe this is an important step towards seamless process deployment in heterogeneous environments that will enhance community access to NASA data and tools in a scalable way, promote software reuse, and improve reproducibility of scientific results.

earth exchange↗

NASA NTRS2018

NASA Earth eXchange (NEX) App Store

NASA Earth Exchange (NEX), and her public cloud version OpenNEX, have become platforms supporting scientific collaboration, knowledge sharing and research for the entire Earth science community. To date, a number of custom tools and capabilities have been integrated into the platforms. However, such integration has to undergo a case-by-case manual process thus lacks scalability. This timely project builds an App Store onto OpenNEX as a building block. Climate data analytics tools/programs can be easily uploaded, shared, organized, searched, and recommended like photos and videos on the YouTube. The foundation of our App Store is a provenance server, which not only records metadata but also execution history of climate data analytics apps including the input data and parameters, output data and products, who runs the app for which purpose, and how apps may be chained into workflows. Researchers can thus understand, reproduce, and repurpose existing apps and workflows. Machine learning approaches are applied to mine provenance to provide recommend-as-you-go services for Earth scientists, such as to recommend suitable apps and workflow snippets. A browser-based workflow tool is also provided for researchers to explore the provenance server and design value-added workflows. Scalability, sustainability, extensibility, usability, adaptability, security and privacy are considered in the App Store.

eXchange↗

NASA NTRSDate not supplied

Climate Information and Lessons Learned from the NASA Earth eXchange (NEX), Short-term Prediction Research and Transition Center (NASA SPoRT), and the NASA Regional Climate Model Evaluation System (RCMES)

Climate resilience can emerge from a combination of (1) climate projections that enable future-oriented planning and (2) contemporary observations that can be used for adaptation in the face of realized climate. NASA is uniquely positioned to provide global climate projections and satellite-based observations to users who must take a global perspective on climate risk (e.g., supply chain managers). Here, we will share the capabilities and experiences of three NASA projects. The first project, the NASA Earth eXchange (NEX) provides two downscaled climate projections, NEX-GDDP-CMIP6, a global 25 km resolution product, and NEX-DCP30-CMIP6, an 800 m resolution product covering the coterminous U.S. specifically designed for U.S. National Climate Assessment (NCA). NEX also offers land surface products that mirror the twice-daily products provided by the Moderate Resolution Imaging Spectroradiometer (MODIS) but are derived from operational geostationary weather satellite data collected at 5-10 minutes intervals. The second project, the Short-term Prediction Research and Transition Center (SPoRT), was established in 2002 to transition unique NASA satellite products and capabilities to stakeholders to improve decision-making that benefits society. SPoRT provides products and capabilities derived from NASA observations and models to end users in government, academia, and the private sector. SPoRT translates NASA Earth science into actionable solutions reaching over 400 stakeholders across 80 organizations. Finally, the Regional Climate Model Evaluation System (RCMES) is designed to facilitate regional-scale evaluations of climate models by providing standardized access to a vast and comprehensive set of observations, such as satellite, in-situ, and reanalyses, and modeling resources such as CMIP & CORDEX. These three projects form part of the core capabilities at the NASA Centers deliver climate information under the new NASA Earth Science to Action (ES2A) strategy.

NEX↗

NASA NTRSDate not supplied

NASA Earth Exchange – Current overview of climate and wildfire-oriented works

NASA Earth Exchange (NEX) combines state-of-the-art supercomputing, Earth system modeling, and NASA remote sensing data feeds to deliver a work environment for exploring and analyzing petabyte-scale datasets covering large regions, continents, or the globe. As an accessible platform, NEX can accelerate fundamental research, develop new applications, and reduce overall project costs by providing the research community with data, software, and high-end computing power. Two research thrusts for the NEX community are developing and distributing the NEX-GDDP-CMIP6 downscaled climate dataset and the community-driven wildfire research. NEX-GDDP-CMIP6 dataset is comprised of global downscaled climate scenarios derived from the General Circulation Model (GCM) runs conducted under the Coupled Model Intercomparison Project Phase 6 (CMIP6) and across two of the four “Tier 1” greenhouse gas emissions scenarios known as Shared Socioeconomic Pathways (SSPs). The wildfire research thrust leverages geostationary and low earth orbit remote sensing platforms and advanced modeling (WRF). We present a high-level overview of the NEX community, discuss relevant datasets and show several visualization techniques of data used in the wildfire research activity.

NEX↗

NASA NTRS2016

Uncertainty Assessment of the NASA Earth Exchange Global Daily Downscaled Climate Projections (NEX-GDDP) Dataset

The NASA Earth Exchange Global Daily Downscaled Projections (NEX-GDDP) dataset is comprised of downscaled climate projections that are derived from 21 General Circulation Model (GCM) runs conducted under the Coupled Model Intercomparison Project Phase 5 (CMIP5) and across two of the four greenhouse gas emissions scenarios (RCP4.5 and RCP8.5). Each of the climate projections includes daily maximum temperature, minimum temperature, and precipitation for the periods from 1950 through 2100 and the spatial resolution is 0.25 degrees (approximately 25 km x 25 km). The GDDP dataset has received warm welcome from the science community in conducting studies of climate change impacts at local to regional scales, but a comprehensive evaluation of its uncertainties is still missing. In this study, we apply the Perfect Model Experiment framework (Dixon et al. 2016) to quantify the key sources of uncertainties from the observational baseline dataset, the downscaling algorithm, and some intrinsic assumptions (e.g., the stationary assumption) inherent to the statistical downscaling techniques. We developed a set of metrics to evaluate downscaling errors resulted from bias-correction ("quantile-mapping"), spatial disaggregation, as well as the temporal-spatial non-stationarity of climate variability. Our results highlight the spatial disaggregation (or interpolation) errors, which dominate the overall uncertainties of the GDDP dataset, especially over heterogeneous and complex terrains (e.g., mountains and coastal area). In comparison, the temporal errors in the GDDP dataset tend to be more constrained. Our results also indicate that the downscaled daily precipitation also has relatively larger uncertainties than the temperature fields, reflecting the rather stochastic nature of precipitation in space. Therefore, our results provide insights in improving statistical downscaling algorithms and products in the future.

climate projection↗

NASA NTRS2016

Uncertainty Assessment of the NASA Earth Exchange Global Daily Downscaled Climate Projections (NEX-GDDP) Dataset

The NASA Earth Exchange Global Daily Downscaled Projections (NEX-GDDP) dataset is comprised of downscaled climate projections that are derived from 21 General Circulation Model (GCM) runs conducted under the Coupled Model Intercomparison Project Phase 5 (CMIP5) and across two of the four greenhouse gas emissions scenarios (RCP4.5 and RCP8.5). Each of the climate projections includes daily maximum temperature, minimum temperature, and precipitation for the periods from 1950 through 2100 and the spatial resolution is 0.25 degrees (approximately 25 km by 25 km). The GDDP dataset has received warm welcome from the science community in conducting studies of climate change impacts at local to regional scales, but a comprehensive evaluation of its uncertainties is still missing. In this study, we apply the Perfect Model Experiment framework (Dixon et al. 2016) to quantify the key sources of uncertainties from the observational baseline dataset, the downscaling algorithm, and some intrinsic assumptions (e.g., the stationary assumption) inherent to the statistical downscaling techniques. We developed a set of metrics to evaluate downscaling errors resulted from bias-correction ("quantile-mapping"), spatial disaggregation, as well as the temporal-spatial non-stationarity of climate variability. Our results highlight the spatial disaggregation (or interpolation) errors, which dominate the overall uncertainties of the GDDP dataset, especially over heterogeneous and complex terrains (e.g., mountains and coastal area). In comparison, the temporal errors in the GDDP dataset tend to be more constrained. Our results also indicate that the downscaled daily precipitation also has relatively larger uncertainties than the temperature fields, reflecting the rather stochastic nature of precipitation in space. Therefore, our results provide insights in improving statistical downscaling algorithms and products in the future.

general circulation model (GCM)↗

NASA NTRS2016

IN13B-1660: Analytics and Visualization Pipelines for Big Data on the NASA Earth Exchange (NEX) and OpenNEX

We are developing capabilities for an integrated petabyte-scale Earth science collaborative analysis and visualization environment. The ultimate goal is to deploy this environment within the NASA Earth Exchange (NEX) and OpenNEX in order to enhance existing science data production pipelines in both high-performance computing (HPC) and cloud environments. Bridging of HPC and cloud is a fairly new concept under active research and this system significantly enhances the ability of the scientific community to accelerate analysis and visualization of Earth science data from NASA missions, model outputs and other sources. We have developed a web-based system that seamlessly interfaces with both high-performance computing (HPC) and cloud environments, providing tools that enable science teams to develop and deploy large-scale analysis, visualization and QA pipelines of both the production process and the data products, and enable sharing results with the community. Our project is developed in several stages each addressing separate challenge - workflow integration, parallel execution in either cloud or HPC environments and big-data analytics or visualization. This work benefits a number of existing and upcoming projects supported by NEX, such as the Web Enabled Landsat Data (WELD), where we are developing a new QA pipeline for the 25PB system.

visualization↗

NASA NTRSDate not supplied

GeoNEX: A geostationary earth observatory at NASA Earth eXchange: Earth monitoring from operational geostationary satellite systems

The latest generation of geostationary satellites (Himawari 8/9, GOES-16/17, FY-4, GK-2A) carries sensors that closely mimic the spatial and spectral characteristics of widely used polar-orbiting, global monitoring sensors such as MODIS and VIIRS. When combined, data from various currently operating/planned geostationary platforms provide a geo-ring of hyper-temporal (5-10 minutes), multispectral observations at spatial resolutions as high as 500 m. These high frequency observations offer exciting new possibilities for monitoring our planet, including better retrievals of geophysical variables by overcoming cloud cover, enabling studies of diurnally varying phenomena in the atmosphere, land, and the oceans, and support operational decision-making in agriculture, hydrology and disaster management. The NASA Earth Exchange (NEX) team, in collaboration with scientists from JAXA, KARI, NOAA and other international institutions, created the GeoNEX (www.nasa.gov/geonex) pipeline to integrate data from all available geostationary platforms and produce and distribute spatially, temporally, and radiometrically consistent data for the earth science community. We envision various institutions adapting the Geo component (e.g., GeoNOAA, GeoKARI, GeoChiba, GeoJAXA, GeoCMA) and customizing the pipeline and downstream products to serve the local/regional research and applied science communities.

Ramakrishna R Nemani↗

NASA NTRSDate not supplied

NASA Earth eXchange (NEX)

Explore the source record for details and available documents.

Ian G Brosnan↗

NASA NTRS2022

Multisensor Machine Learning to Retrieve High Spatiotemporal Resolution Land Surface Temperature

Climate change is making heat waves more frequent, long-lasting, and severe. While multiple satellite types provide data to monitor surface temperature, geostationary (GEO) sensors provide near-continuous, continental-scale observations which can better capture the diurnal variability of land surface temperature (LST) than intermittent observations from low-earth orbit (LEO) sensors. However, standard products from GEO satellites are available at coarsened spatial and temporal resolutions compared to the native sensor resolution. Using datasets from the NASA Earth Exchange, we leveraged co-located, co-temporal observations from LEO and GEO satellites to learn a data-driven mapping using a convolutional neural network. The resulting NASA Earth eXchange Artificial Intelligence LST (NEXAI-LST) achieved a mean absolute error of 1.73 K relative to the target LEO product and improves on both spatial and temporal resolution [2 km, 10 minute] compared to the GEO full disk standard product [10 km, hourly]. In validation against measurements from a ground-based sensor network, NEXAI-LST achieves similar or better fit than both LEO and GEO standard products, while depending none of the prior knowledge of land surface and atmospheric states required by physical-statistical models. Further, application of the model to unseen LEO and GEO satellites demonstrates robust generalization of the model across spatial region, time of day, and sensor. In support of NASA’s open-source science initiative, we make our NEXAI-LST product, model, and codes available to facilitate data exploration and further studies.

Kate Marie Duffy↗

NASA NTRS2017

Harmonized Landsat/Sentinel-2 Reflectance Products for Land Monitoring (Invited)

Many land applications require more frequent observations than can be obtained from a single 'Landsat class' sensor. Agricultural monitoring, inland water quality assessment, stand-scale phenology, and numerous other applications all require near-daily imagery at better than 1ha resolution. Thus the land science community has begun expressing a desire for a '30-meter MODIS' global monitoring capability. One cost-effective way to achieve this goal is via merging data from multiple, international observatories into a single virtual constellation. The Harmonized Landsat/Sentinel-2 (HLS) project has been working to generate a seamless surface reflectance product by combining observations from USGS/NASA Landsat-8 and ESA Sentinel-2. Harmonization in this context requires a series of radiometric and geometric transforms to create a single surface reflectance time series agnostic to sensor origin. Radiometric corrections include a common atmospheric correction using the Landsat-8 LaSRC/6S approach, a simple BRDF adjustment to constant solar and nadir view angle, and spectral bandpass adjustments to fit the Landsat-8 OLI reference. Data are then resampled to a consistent 30m UTM grid, using the Sentinel-2 global tile system. Cloud and shadow masking are also implemented. Quality assurance (QA) involves comparison of the output 30m HLS products with near-simultaneous MODIS nadir-adjusted observations. Prototoype HLS products have been processed for approximately 7% of the global land area using the NASA Earth Exchange (NEX) compute environment at NASA Ames, and can be downloaded from the HLS web site (https://hls.gsfc.nasa.gov). A wall-to-wall North America data set is being prepared for 2018. This talk will review the objectives and status of the HLS project, and illustrate applications of high-density optical time series data for agriculture and ecology. We also discuss lessons learned from HLS in the general context of implementing virtual constellations.

Reflectance↗

NASA NTRS2015

Advanced Computing Support at NASA Advanced Supercomputing (NAS) Division

NAS (NASA Advanced Supercomputing) Division: Advanced Computing: High-End Computing Capability (HECC) Project; Quantum Artificial Intelligence Lab (QuAIL); NASA Earth Exchange (NEX); Data Analytics Infrastructure for NASA; Cloud Services for Science & Engineering Projects.

Advanced Computing↗

NASA NTRSDate not supplied

NASA’s Prototype Spectral Water Inversion Processor and Emulator (SWIPE): Towards Global Coastal and Inland Water Quality and Algal Biodiversity Monitoring

Degradation of Earth’s inland water resources due to anthropogenic perturbations and climate anomalies at both local and global scales continues to place human health at substantial risk. There is now a growing necessity to develop pragmatic approaches that allow timely and effective extrapolation of local processes, to spatially resolved global products, and to promote operational and sustainable resource policy management. This presentation will provide updates on NASA’s prototype open-source aquatic modeling platform, Spectral Water Inversion Processor and Emulator (SWIPE), which is a comprehensive, multi-faceted modeling platform for both forward and inverse modeling of diverse aquatic ecosystems from the benthos to top-of-atmosphere (TOA). SWIPE provides a cohesive application which leverages recent advancements in particle modeling, Big Data analytics, and machine learning to develop a high-fidelity synthetic training ground for sensitivity studies and algorithm development for multispectral or upcoming hyperspectral missions. Some of the prominent features of SWIPE to be discussed include: 1. Advanced hyperspectral modeling of globally diverse algal and non-algal particles using a novel two-layer coated sphere scattering model and radiative transfer modeling, 2. Massive, highly detailed synthetic spectral libraries of Analysis-Ready-Data (ARD) which include spectral libraries of particle microphysics, water biogeophysical and optical properties, as well as surface and TOA reflectances at 1 nm resolution, 3. An ensemble of pre-built analytic, machine learning, and deep learning inversion algorithms for various water quality and biodiversity related retrieval parameters and uncertainty quantification, 4. Sensor-agnostic water quality inversion at wide ranging spatial and spectral resolutions including a codebase for seamless application in the Google Earth Engine and NASA Earth Exchange (NEX) for planetary scale analysis. SWIPE will be a fully open-source platform based in python with comprehensive documentation, tutorials, and options for distributed computing on high performance computing clusters or on single, local machines. Further, we will discuss how we envision SWIPE contributing towards a global analysis of coastal and inland water quality dynamics.

top-of-atmosphere (TOA)↗

NASA NTRS2022

What Does Global Land Climate Look Like at 2°C Warming?

Constraining an increase in global mean temperature below 2°C compared to pre-industrial levels is critical to limiting dangerous and cascading impacts of anthropogenic climate change. Understanding future climatic changes and their spatial heterogeneity at 2°C warming is thus important for policy makers to prepare actionable adaptation and mitigation plans by identifying where and to what extent lives and livelihoods will be impacted. This study uses the recently released NASA Earth eXchange Global Daily Downscaled Projections (NEX-GDDP) CMIP6 data to provide a broad overview of projected changes in six key climate variables and two climate impact indicators at a time when warming exceeds 2°C. Analysis of global mean temperature changes indicates the 2040s as the decade when most CMIP6 models reach 2°C warming with respect to a pre-industrial period (1850–1900). During the 2040s, we find that global mean temperature, precipitation, relative humidity, downwelling shortwave and longwave radiation, and wind speed over land under the high emission scenario are projected to change by +2.8°C, +22.4 mm/year, −0.73%, −2.23 , +15.9 W/m 2 , and −0.04 m/s, respectively. Many of the future changes are expected to exacerbate climate impacts including heat stress and fire danger. Our analysis shows geographic patterns of policy-relevant climatic changes, as parts of the globe will experience significant climate impacts even if the goal to keep warming below 2°C goal is achieved. Our results highlight the urgent need for further studies focused on identifying key hotspots and advancing region-specific actionable adaptation and mitigation plans.

GDDP↗

NASA NTRSDate not supplied

GeoNEX: A Geostationary Earth Observatory

GeoNEX↗

NASA NTRSDate not supplied

AN INTRODUCTION TO THE GEONEX LEVEL-1G PRODUCTS: TOP-OF-ATMOSPHERE REFLECTANCE AND BRIGHTNESS TEMPERATURE

This paper introduces the GeoNEX (Geostationary-NASA Earth eXchange) Level-1G products of top-of-atmosphere (TOA) reflectance and brightness temperature. The products use data streams from the latest geostationary (GEO) sensors including the GOES-16/17 ABI and the Himawari-8/9 AHI. The GeoNEX processing pipeline starts by converting digital numbers to physical quantities with the latest radiometric calibration information. It integrates algorithms to automatically detect and remove residual geolocation errors, to estimate the pixel-wise data-acquisition time, and to accurately calculate the solar illumination angles for each pixel in the domain at every time step. The outputs are reprojected to a globally tiled common grid in geographic coordinates designed to facilitate inter-comparisons and/or synergies between the GeoNEX products and existing Earth observation datasets from polar-orbiting satellites. Therefore, the GeoNEX L1G products provide accurate and consistent TOA reflectance and brightness temperature datasets for scientific analyses and downstream product development.

Geostationary satellite, GOES-16, Himawari-8, NASA↗

NASA NTRSDate not supplied

Uncertainty Analysis of the GeoNEX Top-of-Atmospheric Reflectance Products Generated from the Third-Generation Geostationary Satellite Sensors

The GeoNEX (Geostationary-NASA Earth eXchange) Level-1G products consist of top-of-atmosphere (TOA) bi-directional reflectance factor (BRF) and brightness temperature generated with data streams from the latest geostationary (GEO) sensors including GOES-16/17 ABI, Himawari-8/9 AHI, and GK-2A AMI on a global tiled common grid (60oN-60o and 180oW-180oE) in geographic coordinates. With their 16 spectral bands, 0.01o/0.02o nadir spatial resolution, and 10-minute temporal resolutions, these products provide exciting opportunity to monitor Earth surface processes. However, the unique Sun-Target-Satellite geometry of geostationary sensors demands special attention in analyzing/interpreting these datasets. In this study we present a systematic analysis on the relationship between the radiometric uncertainties of the GeoNEX TOA reflectance and the corresponding solar/satellite zenith angles. We show that the signal-to-noise ratio (SNR) of the BRF are positively proportional to the square roots of the cosine of solar illuminating zenith angles. That is, the BRF data are noisier earlier in the morning or later in the afternoon than in the mid of the day. The cosine of satellite viewing zenith angles do not directly influence the SNR of the TOA BRF. However, they positively regulate the relative importance of the surface component in the TOA BRF. This means that variations in surface reflectance are more difficult to detect for pixels with larger view zenith angles, even when the SNR of the TOA BRF is the same. We are developing metrics to specify such illumination-view geometry related uncertainties in the GeoNEX L1G TOA BRF products so that this key information can be easily accessed by the user community.

Geostationary satellite↗

DOE OSTI2025

Data and code for Daily and Multi-Day Extreme Rainfall Analysis Under Future Climates Using Stochastic Storm Transposition and NEX-GDDP-CMIP6 Over CONUS

This data package provides inputs, codes, and outputs for a comprehensive analysis of projected changes in extreme precipitation across 10 regions of the continental United States, using 34 downscaled Earth System Models (ESMs) from the NASA Earth Exchange Global Daily Downscaled Projections, Coupled Model Intercomparison Project Phase 6 (NEX-GDDP-CMIP6) dataset. These models are part of the Coupled Model Intercomparison Project Phase 6 (CMIP6), a coordinated climate modeling framework widely used to assess climate change impacts. The analysis applies a stochastic storm transposition method to quantify changes in extreme rainfall under two Shared Socioeconomic Pathway (SSP) climate scenarios—SSP2-4.5 (moderate emissions) and SSP5-8.5 (high emissions)—compared to historical conditions (1995–2014 vs. 2081–2100). The dataset includes rainfall depth estimates for extreme events with return periods from 2 to 500 years across multiple storm durations (1, 3, and 5 days) for each of the 10 U.S. regions. Weighted ensemble statistics are derived from individual ESM performance against historical precipitation patterns, enabling robust uncertainty quantification through both sign-based and permutation-test-based model agreement assessments. Key analyses address: (1) relative changes in extreme precipitation for each climate scenario, (2) differences between SSP scenarios (SSP5-8.5 vs. SSP2-4.5), (3) contrasts between rare and frequent events, and (4) variations between multi-day and daily storm durations. The workflow produces ensemble statistics—median, 5th, 25th, 75th, and 95th percentiles—along with model agreement metrics that identify regions and event types with robust climate change signals. The dataset includes: processed rainfall depth outputs (netCDF format) from the RainyDay Python package, ESM weights from historical performance evaluation using DayMet observations, ensemble statistics across all storm dimensions, and figures summarizing key findings.

54 ENVIRONMENTAL SCIENCES↗