Search NASA⌕ Search

SEARCH · Search NASA

Results for “NEX”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Using Docker Containers to Extend Reproducibility Architecture for the NASA Earth Exchange (NEX)

NASA Earth Exchange (NEX) is a data, supercomputing and knowledge collaboratory that houses NASA satellite, climate and ancillary data where a focused community can come together to address large-scale challenges in Earth sciences. As NEX has been growing into a petabyte-size platform for analysis, experiments and data production, it has been increasingly important to enable users to easily retrace their steps, identify what datasets were produced by which process chains, and give them ability to readily reproduce their results. This can be a tedious and difficult task even for a small project, but is almost impossible on large processing pipelines. We have developed an initial reproducibility and knowledge capture solution for the NEX, however, if users want to move the code to another system, whether it is their home institution cluster, laptop or the cloud, they have to find, build and install all the required dependencies that would run their code. This can be a very tedious and tricky process and is a big impediment to moving code to data and reproducibility outside the original system. The NEX team has tried to assist users who wanted to move their code into OpenNEX on Amazon cloud by creating custom virtual machines with all the software and dependencies installed, but this, while solving some of the issues, creates a new bottleneck that requires the NEX team to be involved with any new request, updates to virtual machines and general maintenance support. In this presentation, we will describe a solution that integrates NEX and Docker to bridge the gap in code-to-data migration. The core of the solution is saemi-automatic conversion of science codes, tools and services that are already tracked and described in the NEX provenance system, to Docker - an open-source Linux container software. Docker is available on most computer platforms, easy to install and capable of seamlessly creating and/or executing any application packaged in the appropriate format. We believe this is an important step towards seamless process deployment in heterogeneous environments that will enhance community access to NASA data and tools in a scalable way, promote software reuse, and improve reproducibility of scientific results.

earth exchange↗

Climate Information and Lessons Learned from the NASA Earth eXchange (NEX), Short-term Prediction Research and Transition Center (NASA SPoRT), and the NASA Regional Climate Model Evaluation System (RCMES)

Climate resilience can emerge from a combination of (1) climate projections that enable future-oriented planning and (2) contemporary observations that can be used for adaptation in the face of realized climate. NASA is uniquely positioned to provide global climate projections and satellite-based observations to users who must take a global perspective on climate risk (e.g., supply chain managers). Here, we will share the capabilities and experiences of three NASA projects. The first project, the NASA Earth eXchange (NEX) provides two downscaled climate projections, NEX-GDDP-CMIP6, a global 25 km resolution product, and NEX-DCP30-CMIP6, an 800 m resolution product covering the coterminous U.S. specifically designed for U.S. National Climate Assessment (NCA). NEX also offers land surface products that mirror the twice-daily products provided by the Moderate Resolution Imaging Spectroradiometer (MODIS) but are derived from operational geostationary weather satellite data collected at 5-10 minutes intervals. The second project, the Short-term Prediction Research and Transition Center (SPoRT), was established in 2002 to transition unique NASA satellite products and capabilities to stakeholders to improve decision-making that benefits society. SPoRT provides products and capabilities derived from NASA observations and models to end users in government, academia, and the private sector. SPoRT translates NASA Earth science into actionable solutions reaching over 400 stakeholders across 80 organizations. Finally, the Regional Climate Model Evaluation System (RCMES) is designed to facilitate regional-scale evaluations of climate models by providing standardized access to a vast and comprehensive set of observations, such as satellite, in-situ, and reanalyses, and modeling resources such as CMIP & CORDEX. These three projects form part of the core capabilities at the NASA Centers deliver climate information under the new NASA Earth Science to Action (ES2A) strategy.

NEX↗

IN13B-1660: Analytics and Visualization Pipelines for Big Data on the NASA Earth Exchange (NEX) and OpenNEX

We are developing capabilities for an integrated petabyte-scale Earth science collaborative analysis and visualization environment. The ultimate goal is to deploy this environment within the NASA Earth Exchange (NEX) and OpenNEX in order to enhance existing science data production pipelines in both high-performance computing (HPC) and cloud environments. Bridging of HPC and cloud is a fairly new concept under active research and this system significantly enhances the ability of the scientific community to accelerate analysis and visualization of Earth science data from NASA missions, model outputs and other sources. We have developed a web-based system that seamlessly interfaces with both high-performance computing (HPC) and cloud environments, providing tools that enable science teams to develop and deploy large-scale analysis, visualization and QA pipelines of both the production process and the data products, and enable sharing results with the community. Our project is developed in several stages each addressing separate challenge - workflow integration, parallel execution in either cloud or HPC environments and big-data analytics or visualization. This work benefits a number of existing and upcoming projects supported by NEX, such as the Web Enabled Landsat Data (WELD), where we are developing a new QA pipeline for the 25PB system.

visualization↗

NASA Earth eXchange (NEX) App Store

NASA Earth Exchange (NEX), and her public cloud version OpenNEX, have become platforms supporting scientific collaboration, knowledge sharing and research for the entire Earth science community. To date, a number of custom tools and capabilities have been integrated into the platforms. However, such integration has to undergo a case-by-case manual process thus lacks scalability. This timely project builds an App Store onto OpenNEX as a building block. Climate data analytics tools/programs can be easily uploaded, shared, organized, searched, and recommended like photos and videos on the YouTube. The foundation of our App Store is a provenance server, which not only records metadata but also execution history of climate data analytics apps including the input data and parameters, output data and products, who runs the app for which purpose, and how apps may be chained into workflows. Researchers can thus understand, reproduce, and repurpose existing apps and workflows. Machine learning approaches are applied to mine provenance to provide recommend-as-you-go services for Earth scientists, such as to recommend suitable apps and workflow snippets. A browser-based workflow tool is also provided for researchers to explore the provenance server and design value-added workflows. Scalability, sustainability, extensibility, usability, adaptability, security and privacy are considered in the App Store.

eXchange↗

Uncertainty Assessment of the NASA Earth Exchange Global Daily Downscaled Climate Projections (NEX-GDDP) Dataset

The NASA Earth Exchange Global Daily Downscaled Projections (NEX-GDDP) dataset is comprised of downscaled climate projections that are derived from 21 General Circulation Model (GCM) runs conducted under the Coupled Model Intercomparison Project Phase 5 (CMIP5) and across two of the four greenhouse gas emissions scenarios (RCP4.5 and RCP8.5). Each of the climate projections includes daily maximum temperature, minimum temperature, and precipitation for the periods from 1950 through 2100 and the spatial resolution is 0.25 degrees (approximately 25 km x 25 km). The GDDP dataset has received warm welcome from the science community in conducting studies of climate change impacts at local to regional scales, but a comprehensive evaluation of its uncertainties is still missing. In this study, we apply the Perfect Model Experiment framework (Dixon et al. 2016) to quantify the key sources of uncertainties from the observational baseline dataset, the downscaling algorithm, and some intrinsic assumptions (e.g., the stationary assumption) inherent to the statistical downscaling techniques. We developed a set of metrics to evaluate downscaling errors resulted from bias-correction ("quantile-mapping"), spatial disaggregation, as well as the temporal-spatial non-stationarity of climate variability. Our results highlight the spatial disaggregation (or interpolation) errors, which dominate the overall uncertainties of the GDDP dataset, especially over heterogeneous and complex terrains (e.g., mountains and coastal area). In comparison, the temporal errors in the GDDP dataset tend to be more constrained. Our results also indicate that the downscaled daily precipitation also has relatively larger uncertainties than the temperature fields, reflecting the rather stochastic nature of precipitation in space. Therefore, our results provide insights in improving statistical downscaling algorithms and products in the future.

climate projection↗

Uncertainty Assessment of the NASA Earth Exchange Global Daily Downscaled Climate Projections (NEX-GDDP) Dataset

The NASA Earth Exchange Global Daily Downscaled Projections (NEX-GDDP) dataset is comprised of downscaled climate projections that are derived from 21 General Circulation Model (GCM) runs conducted under the Coupled Model Intercomparison Project Phase 5 (CMIP5) and across two of the four greenhouse gas emissions scenarios (RCP4.5 and RCP8.5). Each of the climate projections includes daily maximum temperature, minimum temperature, and precipitation for the periods from 1950 through 2100 and the spatial resolution is 0.25 degrees (approximately 25 km by 25 km). The GDDP dataset has received warm welcome from the science community in conducting studies of climate change impacts at local to regional scales, but a comprehensive evaluation of its uncertainties is still missing. In this study, we apply the Perfect Model Experiment framework (Dixon et al. 2016) to quantify the key sources of uncertainties from the observational baseline dataset, the downscaling algorithm, and some intrinsic assumptions (e.g., the stationary assumption) inherent to the statistical downscaling techniques. We developed a set of metrics to evaluate downscaling errors resulted from bias-correction ("quantile-mapping"), spatial disaggregation, as well as the temporal-spatial non-stationarity of climate variability. Our results highlight the spatial disaggregation (or interpolation) errors, which dominate the overall uncertainties of the GDDP dataset, especially over heterogeneous and complex terrains (e.g., mountains and coastal area). In comparison, the temporal errors in the GDDP dataset tend to be more constrained. Our results also indicate that the downscaled daily precipitation also has relatively larger uncertainties than the temperature fields, reflecting the rather stochastic nature of precipitation in space. Therefore, our results provide insights in improving statistical downscaling algorithms and products in the future.

general circulation model (GCM)↗

NASA Earth Exchange – Current overview of climate and wildfire-oriented works

NASA Earth Exchange (NEX) combines state-of-the-art supercomputing, Earth system modeling, and NASA remote sensing data feeds to deliver a work environment for exploring and analyzing petabyte-scale datasets covering large regions, continents, or the globe. As an accessible platform, NEX can accelerate fundamental research, develop new applications, and reduce overall project costs by providing the research community with data, software, and high-end computing power. Two research thrusts for the NEX community are developing and distributing the NEX-GDDP-CMIP6 downscaled climate dataset and the community-driven wildfire research. NEX-GDDP-CMIP6 dataset is comprised of global downscaled climate scenarios derived from the General Circulation Model (GCM) runs conducted under the Coupled Model Intercomparison Project Phase 6 (CMIP6) and across two of the four “Tier 1” greenhouse gas emissions scenarios known as Shared Socioeconomic Pathways (SSPs). The wildfire research thrust leverages geostationary and low earth orbit remote sensing platforms and advanced modeling (WRF). We present a high-level overview of the NEX community, discuss relevant datasets and show several visualization techniques of data used in the wildfire research activity.

NEX↗

GC31G-1182: Opennex, a Private-Public Partnership in Support of the National Climate Assessment

The NASA Earth Exchange (NEX) is a collaborative computing platform that has been developed with the objective of bringing scientists together with the software tools, massive global datasets, and supercomputing resources necessary to accelerate research in Earth systems science and global change. NEX is funded as an enabling tool for sustaining the national climate assessment. Over the past five years, researchers have used the NEX platform and produced a number of data sets highly relevant to the National Climate Assessment. These include high-resolution climate projections using different downscaling techniques and trends in historical climate from satellite data. To enable a broader community in exploiting the above datasets, the NEX team partnered with public cloud providers to create the OpenNEX platform. OpenNEX provides ready access to NEX data holdings on a number of public cloud platforms along with pertinent analysis tools and workflows in the form of Machine Images and Docker Containers, lectures and tutorials by experts. We will showcase some of the applications of OpenNEX data and tools by the community on Amazon Web Services, Google Cloud and the NEX Sandbox.

datasets↗

GeoNEX-SUBSETS: Cutouts of geostationary satellite data over long-term monitoring sites

Satellite remote sensing data are important tool for extrapolating the knowledge obtained at the Fluxnet towers. We introduce our GEO-NEX geostationary satellite subset products, which make it easy to compare between ground observation and Geo-NEX products. The MODIS subset has been frequently used for validating ecosystem models developed at flux towers and upscaling the observed flux data to regional scales. However, MODIS on the polar orbiting satellites can observe target regions only once a day, while the Fluxnet eddy-covariance data are compiled as sub-hourly datasets. As a results, summarizing the sub-hourly flux data into daily statistics is necessary for the comparison between MODIS and Flux data. Here, the new generation geostationary satellite sensors (GOES-16/17 ABI and Himawari-8/9 AHI) has the high-frequent observation feature (10 minutes) in addition to similar spectral band and spatial resolution with MODIS. The high frequent observation allows us to compare the flux diurnal cycle with geostationary satellite sensor data. Some studies have already shown the effective utilization of time series of geostationary satellite data for ecosystem modeling. We are producing NEX Level-1G products, which is the gridded Top-of-Atmosphere reflectance and brightness temperature data of geostationary satellite sensors. We cut out the NEX Level-1G data using the same file format with the MODIS subset except for the projection. The other data products (e.g., surface reflectance, land surface temperature, vegetation indices and climate data) will be also added upon their availability. We selected the ground observation sites from Fluxnet, Phenocam, and AERONET networks. The NEX subset data will be provided through NASA NEX data portal.

GeoNEX↗

Geostationary Satellite Observations Over Global Environmental Monitoring Sites

Globally, there are now hundreds of ground-based environmental monitoring stations routinely collecting data on a variety of earth-atmosphere interactions. Such observations are also being augmented with data from orbiting satellites. With the beginning of the EOS-era, the MODIS subset around flux towers has been frequently used for validating ecosystem models developed at flux towers and upscaling the observed flux data to regional scales. However, MODIS on the polar-orbiting satellites can observe target regions only once a day, while the Fluxnet eddy- covariance data are compiled as sub-hourly. Therefore, summarizing the sub-hourly flux data into daily statistics is necessary for the comparison between MODIS and Flux data. The new generation geostationary satellite sensors (GOES-16/17 ABI and Himawari-8/9 AHI) have capabilities similar to MODIS but collect data at 5-15 minute intervals. These high-frequency observations allow us to understand and scale diurnal fluxes. Some studies have already shown the effective utilization of time series of geostationary satellite data for ecosystem modeling. We are producing NEX Level-1G products, which are gridded Top-of-Atmosphere reflectance and brightness temperature data from geostationary satellite sensors. We cut out the NEX Level-1G data using the same file format with the MODIS subset except for the projection. The other data products (e.g., surface reflectance, land surface temperature, vegetation indices, and climate data) will be added upon their availability. Currently included networks are Fluxnet, PhenoCam, and AERONET. The NEX subset data will be provided through NASA NEX data portal.

Geostationary Satellites↗

Generation of Continental Scale Percent Tree Cover Product Using Deep-learning and Multi-scale Remote Sensing Data

Spatially explicit percent tree cover (TC) estimation is critical for mapping forest aboveground biomass and its dynamics. While various TC products have been developed, there has not been a generalized framework that can be applied to diverse terrestrial ecosystems due to underlain extreme complexities. Deep learning algorithms can learn a spatial pattern and radiometric characteristics of tree canopy as a robust approximation of physical or empirical models, and thus have emerged as promising and efficient tools for large-scale TC mapping. In this study, we synergistically use very high-resolution aerial imageries (National Agriculture Imagery Program, NAIP) and medium resolution Landsat data to map continental-scale TC (CONUS and Mexico) through a hierarchical deep learning approach (Convolutional Neural Network), i.e., NAIP TC generated from a NAIP model is utilized to train a Landsat model. The produced TC product (hereafter, NEX-TC) is able to capture the spatial pattern of TC distribution and its changes driven by natural disturbance and human land management. We further explore and analyze the reliability and potential uncertainty of the NEX-TC by comparing it to lidar- (lidar-TC), National Land Cover Database (NLCD-TC), and MODIS Vegetation Continuous Field (MODIS-TC). This evaluation practice reveals that TC products based on passive optical sensors tend to underestimate TC across all land cover types while Landsat-based TCs (i.e., NEX-TC & NLCD-TC) perform better than the coarser MODIS TC estimate. Our results show that the NEX-TC is generally comparable to NLCD-TC but it particularly outperforms NLCD-TC and MODIS-TC over the dense forests where lidar-TC indicates >80% TC. These results indicate that our hierarchical deep learning approach and TC product will be effective and useful for characterizing large-scale tree cover and possibly associated carbon dynamics.

Landsat↗

Effects of Resistive Vibration Exercise Combined with Whey Protein and KHCO3 on Bone Tturnover Markers in Head-down Tilt Bed Rest (MTBR-MNX Study)

High protein intake further increases bone resorption markers in head-down tilt bed rest (HDBR), most likely induced by low-grade metabolic acidosis. Adding an alkaline salt to a diet with high protein content prevents this additional rise of bone resorption markers in HDBR. In addition, high protein intake, specifically whey protein, increases muscle protein synthesis and improves glucose tolerance, which both are affected by HDBR. Resistive vibration exercise (RVE) training counteracts the inactivity-induced bone resorption during HDBR. To test the hypothesis that WP plus alkaline salt (KHCO3) together with RVE during HDBR will improve bone turnover markers, we conducted a randomized, three-campaign crossover design study with 12 healthy, moderately fit male subjects (age 34+/-8 y, body mass [BM] 70 +/- 8 kg). All study campaigns consisted of a 7-d ambulatory period, 21days of -6 deg. head-down tilt bed rest (HDBR), and a 6-d recovery period. Diet was standardized and identical across phases. In the control (CON) campaign, subjects received no supplement or RVE. In the intervention campaigns, subjects received either RVE alone or combined with WP and KHCO3 (NEX). WP was applied in 3 doses per day of 0.6 g WP/kg BM together with 6 doses of 15 mmol KHCO3 per day. Eleven subjects completed the RVE and CON campaign, 8 subjects completed all three campaigns. On day 21 of HDBR excretion of the bone resorption marker C-telopeptide (CTX) was 80+/-28% (p<0.001) higher than baseline, serum calcium concentrations increased by 12 +/- 29% (p<0.001) and serum osteocalcin concentrations decreased by 6+/-12% (p=0.001). Urinary CTX excretion was 11+/- 25% (p=0.02) lower on day 21 of HDBR in the RVE- and tended to decrease by 3+/- 22% (p=0.06) in the NEX campaign compared to CON. Urinary calcium excretion was higher on day 21 in HDBR in the RVE and NEX (24+/- 43% p=0.01; 25+/- 37% p=0.03) compared to the CON campaign. We conclude that combination of RVE with WP/KHCO3 was not superior to RVE alone in any of these results.

Graf, Sonja↗

Development of a Complete Landsat Evapotranspiration and Energy Balance Archive to Support Agricultural Consumptive Water Use Reporting and Prediction in the Central Valley, CA

Mapping evapotranspiration (ET) from agricultural areas in Californias Central Valley is critical for understanding historical consumptive use of surface and groundwater. In addition, long histories of ET maps provide valuable training information for predictive studies of surface and groundwater demands. During times of drought, groundwater is commonly pumped to supplement reduced surface water supplies in the Central Valley. Due to the lack of extensive groundwater pumping records, mapping consumptive use using satellite imagery is an efficient and robust way for estimating agricultural consumptive use and assessing drought impacts. To this end, we have developed and implemented an algorithm for automated calibration of the METRIC remotely sensed surface energy balance model on NASAs Earth Exchange (NEX) to estimate ET at the field scale. Using automated calibration techniques on the NEX has allowed for the creation of spatially explicit historical ET estimates for the Landsat archive dating from 1984 to the near present. Further, our use of spatial NLDAS and CIMIS weather data, and spatial soil water balance simulations within the NEX METRIC workflow, has helped overcome challenges of time integration between satellite image dates. This historical and near present time archive of agricultural water consumption for the Central Valley will be an extremely useful dataset for water use and drought impact reporting, and predictive analyses of groundwater demands.

valleys↗

Hourly GPP Estimation In Australia Using Himawari-8 AHI Products

We extended the MODIS 17 algorithm to hourly Gross Primary Product (GPP) estimation for Australia in 2018. AHI 1-km data are available at NASA Earth Exchange (NEX) facility. The high-frequent observation of Advanced Himawari Imager (AHI) enabled us to calculate hourly GPP, which is corresponding to ground observation of carbon flux measured by TERN OzFlux. We interpolated the weather observation data to 1-km grid over Australia ingesting AHI reflectance and radiometric temperature data (NEX-Gridded Hourly Meteorology (NEX-GHM)). Then, we applied MODIS 17 algorithm to each grid with optimized climate regulation functions. The estimation of climate and GPP were well correlated with OzFlux ground observation data.

Himawari-8↗

DeepSAT: A Deep Learning Approach to Tree-Cover Delineation in 1-m NAIP Imagery for the Continental United States

High resolution tree cover classification maps are needed to increase the accuracy of current land ecosystem and climate model outputs. Limited studies are in place that demonstrates the state-of-the-art in deriving very high resolution (VHR) tree cover products. In addition, most methods heavily rely on commercial softwares that are difficult to scale given the region of study (e.g. continents to globe). Complexities in present approaches relate to (a) scalability of the algorithm, (b) large image data processing (compute and memory intensive), (c) computational cost, (d) massively parallel architecture, and (e) machine learning automation. In addition, VHR satellite datasets are of the order of terabytes and features extracted from these datasets are of the order of petabytes. In our present study, we have acquired the National Agriculture Imagery Program (NAIP) dataset for the Continental United States at a spatial resolution of 1-m. This data comes as image tiles (a total of quarter million image scenes with ~60 million pixels) and has a total size of ~65 terabytes for a single acquisition. Features extracted from the entire dataset would amount to ~8-10 petabytes. In our proposed approach, we have implemented a novel semi-automated machine learning algorithm rooted on the principles of "deep learning" to delineate the percentage of tree cover. Using the NASA Earth Exchange (NEX) initiative, we have developed an end-to-end architecture by integrating a segmentation module based on Statistical Region Merging, a classification algorithm using Deep Belief Network and a structured prediction algorithm using Conditional Random Fields to integrate the results from the segmentation and classification modules to create per-pixel class labels. The training process is scaled up using the power of GPUs and the prediction is scaled to quarter million NAIP tiles spanning the whole of Continental United States using the NEX HPC supercomputing cluster. An initial pilot over the state of California spanning a total of 11,095 NAIP tiles covering a total geographical area of 163,696 sq. miles has produced true positive rates of around 88 percent for fragmented forests and 74 percent for urban tree cover areas, with false positive rates lower than 2 percent for both landscapes.

Imagery↗