Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Unsupervised Deep Persistent Monocular Visual Odometry and Depth Estimation in Extreme Environments

In recent years, unsupervised deep learning ap-proaches have received a significant attention to estimate depthand visual odometry (VO) from unlabelled monocular imagesequences. However, their performance is limited in challengingenvironments due to perceptual degradation, occlusions andrapid motions. Moreover, the existing unsupervised methodssuffer from the lack of scale-consistency constraints acrossframes, which causes that the VO estimators fail to providepersistent trajectories over long sequences. In this study, wepropose a unsupervised monocular deep VO framework thatpredicts 6 degrees-of-freedom pose camera motion and depthmap of the scene from unlabelled RGB image sequences.We provide detailed quantitative and qualitative evaluationsof the proposed framework on a) a challenging dataset col-lected during the DARPA Subterranean challenge1; and b)the benchmark KITTI and Cityscapes datasets. The proposedapproach outperforms both traditional and state-of-the-artunsupervised deep VO methods providing better results for bothpose estimation and depth recovery. The presented approach ispart of the solution used by the COSTAR team participatingat the DARPA Subterranean Challenge

Agha-mohammadi, Ali-akbar↗

CyberGAN: Generating High-fidelity Cybersecurity Data With Generative Adversarial Networks

Machine learning for cyber defense offers the promise of detecting adversarial activity against the ground data systems managing critical space assets. A fundamental challenge facing machine learning research in cybersecurity is the lack of high-fidelity, shareable datasets for robust evaluation and testing of machine learning-based solutions. High-fidelity, real-world datasets are necessary for reliable benchmarking of nominal system behavior and malicious activity. Unfortunately, such realistic datasets of both nominal and adversarial activity are rarely shared publicly by data owners due to security and privacy concerns. Besides, the available adversarial data is sparse, which makes training models on malicious activity much harder. This situation has impeded and continues to impede the research and successful adoption of machine learning methods for cyber defense. Researchers have dealt with this problem by generating data within a low-fidelity lab environment, using classified and thus unshareable datasets, or downloading low-fidelity public datasets made available by others. We propose an innovative solution to the problem by employing machine learning methods to generate high-fidelity data. Specifically, we propose the use of Generative Adversarial Networks (GANs) to generate high-fidelity data for cybersecurity purposes. GANs have found successful image processing and natural language applications, but have not yet been investigated for cyber data generation. Our proposed approach first involves training the `discriminator' network of the GAN with a sample of real-world data consisting of malicious and nominal samples. We then use the `generator' network to generate new high-fidelity data samples consisting of an appropriate mix of malicious and nominal activity. We demonstrate applications of our architecture by generating high-fidelity cybersecurity data containing both malicious and nominal samples. We thoroughly evaluate the fidelity of our generated data using heuristics and evaluate its usefulness for machine learning applications using three different datasets. Overall, our approach results in high-fidelity, shareable datasets.

Zhang, Yuening↗

Seasonal Forecasting Skill for the High Mountain Asia Region in the Goddard Earth Observing System

Seasonal variability of the global hydrologic cycle directly impacts human activities, including hazard assessment and mitigation, agricultural decisions, and water resources management. This is particularly true across the High Mountain Asia (HMA) region, where availability of water resources can change depending on local seasonality of the hydrologic cycle. Forecasting the atmospheric states and surface conditions, including hydrometeorological relevant variables, at subseasonal-to-seasonal (S2S) lead times of weeks-to-months is an area of active research and development. NASA’s 15 Goddard Earth Observing System (GEOS) S2S prediction system has been developed with this research goal in mind. Here, we benchmark the forecast skill of GEOS-S2S (version 2) hydrometeorological forecasts at 1-3 month lead times in the HMA region, including a portion of the Indian Subcontinent, during the retrospective forecast period, 1981-2016. To assess forecast skill, we evaluate 2-m air temperature, total precipitation, fractional snow cover, snow water equivalent, surface soil moisture, and terrestrial water storage forecasts against the Modern-Era Retrospective analysis for Research and 20 Applications, Version 2 (MERRA-2) and independent reanalysis data, satellite observations, and data fusion products. Anomaly correlation is highest when the forecasts are evaluated against MERRA-2 and particularly in variables with long memory in the climate system, likely due to similar initial conditions and model architecture used in GEOS-S2S and MERRA-2. When compared to MERRA-2, results for the 1-month forecast skill range from anomaly correlation of R anom =0.18 for precipitation to R anom =0.62 for soil moisture. Anomaly correlations are consistently lower when forecasts are 25 evaluated against independent observations; results for the 1-month forecast skill range from R anom =0.13 for snow water equivalent to R anom =0.24 for fractional snow cover. We find that, generally, hydrometeorological forecast skill is dependent on the forecast lead time, the memory of the variable within the physical system, and the validation dataset used. Overall, these results benchmark the GEOS-S2S system’s ability to forecast HMA hydrometeorology.

GEOS↗

A14H-04 Analysis of Simulated and Observed Trends in Global Surface PM2.5 and Aerosol Optical Properties from 1958 to 2018 Using the NASA GEOSCCM

Modeling of long-term trends of aerosols and their properties is important for constraining aerosol-climate forcing, and for characterizing changes in particulate matter pollution speciation and exposure. Here we study global and regional long-term trends in surface fine particulate matter (PM ) and aerosol optical properties for 60 years from 1958 to 2018, using simulations performed with the NASA Goddard Earth Observing System Chemistry Climate Model (GEOSCCM), and evaluate the model hindcast with observations for the last three decades. Comparing the modeled aerosols with a diverse set of observations helps interpret observed and simulated trends, and serves as a benchmark for future GEOSCCM developments and input datasets improvements. We first characterize modeled global and regional temporal changes in surface PM and its components, aerosol optical depth (AOD) and single scattering albedo (SSA) and we interpret their link with emissions drivers. We then compare modeled surface PM with ground-based observations from monitoring networks and with global reconstructed PM datasets from observations-model data fusion. Total AOD is compared with long-term satellite measurements from the Moderate Resolution Imaging Spectroradiometer (MODIS) and measurements from the ground-based Aerosol Robotic Network (AERONET). Additional aerosol optical properties, such as absorption and scattering coefficients, are evaluated with ground-based observations from the Global Atmosphere Watch (GAW) records.

aerosols↗

Navier-Stokes analysis of a liquid rocket engine disk cavity

This paper presents a Navier-Stokes analysis of hydrodynamic phenomena occurring in the aft disk cavity of a liquid rocket engine turbine. The cavity analyzed in the Space Shuttle Main Engine Alternate Turbopump currently being developed by NASA and Pratt and Whitney. Comparison of results obtained from the Navier-Stokes code for two rotating disk datasets available in the literature are presented as benchmark validations. The benchmark results obtained using the code show good agreement relative to experimental data, and the turbine disk cavity was analyzed with comparable grid resolution, dissipation levels, and turbulence models. Predicted temperatures in the cavity show that little mixing of hot and cold fluid occurs in the cavity and the flow is dominated by swirl and pumping up the rotating disk.

Benjamin, Theodore G.↗

AgMIP-Wheat Multi-Model Simulations on Climate Change Impact and Adaptation for Global Wheat

The climate change impact and adaptation simulations from the Agricultural Model Intercomparison and Improvement Project (AgMIP) for wheat provide a unique dataset of multi-model ensemble simulations for 60 representative global locations covering all global wheat mega environments. The multi-model ensemble reported here has been thoroughly benchmarked against a large number of experimental data, including different locations, growing season temperatures, atmospheric CO2 concentration, heat stress scenarios, and their interactions. In this paper, we describe the main characteristics of this global simulation dataset. Detailed cultivar, crop management, and soil datasets were compiled for all locations to drive 32 wheat growth models. The dataset consists of 30-year simulated data including 25 output variables for nine climate scenarios, including Baseline (1980-2010) with 360 or 550 ppm CO2, Baseline +2oC or +4oC with 360 or 550 ppm CO2, a mid-century climate change scenario (RCP8.5, 571 ppm CO2), and 1.5°C (423 ppm CO2) and 2.0oC (487 ppm CO2) warming above the pre-industrial period (HAPPI). This global simulation dataset can be used as a benchmark from a well-tested multi-model ensemble in future analyses of global wheat. Also, resource use efficiency (e.g., for radiation, water, and nitrogen use) and uncertainty analyses under different climate scenarios can be explored at different scales. The DOI for the dataset is 10.5281/zenodo.4027033 (AgMIP-Wheat, 2020), and all the data are available on the data repository of Zenodo (http://doi.org/10.5281/zenodo.4027033). Two scientific publications have been published based on some of these data here.

Agricultural Model Intercomparison and Improvement↗

Towards a Soil Moisture Drought Monitoring System for South Korea

The Korea Land Data Assimilation System (KLDAS) has been established for agricultural drought (i.e. soil moisture deficit) monitoring in South Korea, running the Noah-MP land surface model within the NASA Land Information System (LIS) framework with the added value of local precipitation forcing dataset and soil texture maps. KLDAS soil moisture is benchmarked against three global products: the Global Land Data Assimilation System (GLDAS), the Famine Early Warning Systems Network (FEWS NET) Land Data Assimilation System (FLDAS), and the European Space Agency Climate Change Initiative (ESA CCI) satellite product. The evaluation is performed using in situ measurements for 2013–2015 and one month standardized precipitation index (SPI-1) for 1982–2016, focusing on four major river basins in South Korea. The KLDAS outperforms all benchmark products in capturing soil moisture states and variability at a basin scale. Compared to GLDAS and FLDAS products, the EAS CCI product is not feasible for long term agricultural monitoring due to lower data quality for early periods (1979–1991) of soil moisture estimates. KLDAS shows that the most recent 2015 drought event leads to highest drought areas in the Han and Geum River basins in the past 35 years. This work supports KLDAS as an effective agricultural drought monitoring system to provide continuous regional high-resolution soil moisture estimates in South Korea.

Agricultural drought↗

AssistTaxi: A Comprehensive Dataset for Taxiway Analysis and Autonomous Operations

The availability of high-quality datasets play a crucial role in advancing research and development especially, for safety critical and autonomous systems. This poster presents AssistTaxi, which is a comprehensive novel dataset which is a collection of images for runway and taxiway analysis. The dataset comprises of more than 300,000 frames of diverse and carefully collected data, gathered from Melbourne (MLB) and Grant-Valkaria (X59) general aviation airports. The importance of AssistTaxi lies in its potential to advance autonomous operations, enabling researchers and developers to train and evaluate algorithms for efficient and safe taxiing. Researchers can utilize AssistTaxi to benchmark their algorithms, assess performance, and explore novel approaches for runway and taxiway analysis. Additionally, the dataset serves as a valuable resource for validating and enhancing existing algorithms as well as facilitating innovation in autonomous operations for aviation. We also propose an initial approach to label the dataset using a contour based detection and line extraction technique.

Data Collection↗

Can We Use the QA4ECV Black-sky Fraction of Absorbed Photosynthetically Active Radiation (FAPAR) using AVHRR Surface Reflectance to Assess Terrestrial Global Change?

NOAA platforms provide the longest period of terrestrial observation since the 1980s. The progress in calibration, atmospheric corrections and physically based land retrieval offers the opportunity to reprocess these data for extending terrestrial product time series. Within the Quality Assurance for Essential Climate Variables (QA4ECV) project, the black-sky Joint Research Centre (JRC)-fraction of absorbed photosynthetically active radiation (FAPAR) algorithm was developed for the AVHRR sensors on-board NOAA-07 to -16 using the Land Surface Reflectance Climate Data Record. The retrieval algorithm was based on the radiative transfer theory, and uncertainties were included in the products. We proposed a time and spatial composite for providing both 10-day and monthly products at 0.05º × 0.05º. Quality control and validation were achieved through benchmarking against third-party products, including Sea-Viewing Wide Field-of-View Sensor (SeaWiFS) datasets produced with the same retrieval algorithm. Past ground-based measurements, providing a proxy of FAPAR, showed good agreement of seasonality values over short homogeneous canopies and mixed vegetation. The average difference between SeaWiFS and QA4ECV monthly products over 2002–2005 is about 0.075 with a standard deviation of 0.091. We proposed a monthly linear bias correction that reduced these statistics to 0.02 and 0.001. The complete harmonized long-term time series was then used to address its fitness for the purpose of analysis of global terrestrial change.

AVHRR↗

A Chlorophyll-a Algorithm for Landsat-8 Based on Mixture Density Networks

Retrieval of aquatic biogeochemical variables, such as the near-surface concentration of chlorophyll-a (Chla) in inland and coastal waters via remote observations, has long been regarded as a challenging task. This manuscript applies Mixture Density Networks (MDN) that use the visible spectral bands available by the Operational Land Imager (OLI) aboard Landsat-8 to estimate Chla. We utilize a database of co-located in situ radiometric and Chla measurements (N = 4,354), referred to as Type A data, to train and test an MDN model (MDN(A)). This algorithm’s performance, having been proven for other satellite missions, is further evaluated against other widely used machine learning models (e.g., support vector machines), as well as other domain-specific solutions (OC3), and shown to offer significant advancements in the field. Our performance assessment using a held-out test data set suggests that a 49% (median) accuracy with near-zero bias can be achieved via the MDN(A) model, offering improvements of 20 to 100% in retrievals with respect to other models. The sensitivity of the MDN(A) model and benchmarking methods to uncertainties from atmospheric correction (AC) methods, is further quantified through a semi-global matchup dataset (N = 3,337), referred to as Type B data. To tackle the increased uncertainties, alternative MDN models (MDN(B)) are developed through various features of the Type B data (e.g., Rayleigh-corrected reflectance spectra ρ(s)). Using held-out data, along with spatial and temporal analyses, we demonstrate that these alternative models show promise in enhancing the retrieval accuracy adversely influenced by the AC process. Results lend support for the adoption of MDN(B) models for regional and potentially global processing of OLI imagery, until a more robust AC method is developed. Index Terms—Chlorophyll-a, coastal water, inland water, Landsat-8, machine learning, ocean color, aquatic remote sensing.

Brandon Smith↗

Construction of Polarimetric Radar-Based Reference Rain Maps for the Iowa Flood Studies Campaign

The Global Precipitation Measurement (GPM) Mission Iowa Flood Studies (IFloodS) campaign was conducted in central and northeastern Iowa during the months of April-June, 2013. Specific science objectives for IFloodS included quantification of uncertainties in satellite and ground-based estimates of precipitation, 4-D characterization of precipitation physical processes and associated parameters (e.g., size distributions, water contents, types, structure etc.), assessment of the impact of precipitation estimation uncertainty and physical processes on hydrologic predictive skill, and refinement of field observations and data analysis approaches as they pertain to future GPM integrated hydrologic validation and related field studies. In addition to field campaign archival of raw and processed satellite data (including precipitation products), key ground-based platforms such as the NASA NPOL S-band and D3R Ka/Ku-band dual-polarimetric radars, University of Iowa X-band dual-polarimetric radars, a large network of paired rain gauge platforms, and a large network of 2D Video and Parsivel disdrometers were deployed. In something of a canonical approach, the radar (NPOL in particular), gauge and disdrometer observational assets were deployed to create a consistent high-quality distributed (time and space sampling) radar-based ground "reference" rainfall dataset, with known uncertainties, that could be used for assessing the satellite-based precipitation products at a range of space/time scales. Subsequently, the impact of uncertainties in the satellite products could be evaluated relative to the ground-benchmark in coupled weather, land-surface and distributed hydrologic modeling frameworks as related to flood prediction. Relative to establishing the ground-based "benchmark", numerous avenues were pursued in the making and verification of IFloodS "reference" dual-polarimetric radar-based rain maps, and this study documents the process and results as they pertain specifically to efforts using the NPOL radar dataset. The initial portions of the "process" involved dual-polarimetric quality control procedures which employed standard phase and correlation-based approaches to removal of clutter and non-meteorological echo. Calculation of a scale-adaptive KDP was accomplished using the method of Wang and Chandrasekar (2009; J. Atmos. Oceanic Tech.). A dual-polarimetric blockage algorithm based on Lang et al. (2009; J. Atmos. Oceanic Tech.) was then implemented to correct radar reflectivity and differential reflectivity at low elevation angles. Next, hydrometeor identification algorithms were run to identify liquid and ice hydrometeors. After the quality control and data preparation steps were completed several different dual-polarimetric rain estimation algorithms were employed to estimate rainfall rates using rainfall scans collected approximately every two to three minutes throughout the campaign. These algorithms included a polarimetrically-tuned Z-R algorithm that adjusts for drop oscillations (via Bringi et al., 2004, J. Atmos. Oceanic Tech.), and several different hybrid polarimetric variable approaches, including one that made use of parameters tuned to IFloodS 2D Video Disdrometer measurements. Finally, a hybrid scan algorithm was designed to merge the rain rate estimates from multiple low level elevation angle scans (where blockages could not be appropriately corrected) in order to create individual low-level rain maps. Individual rain maps at each time step were subsequently accumulated over multiple time scales for comparison to gauge network data. The comparison results and overall error character depended strongly on rain event type, polarimetric estimator applied, and range from the radar. We will present the outcome of these comparisons and their impact on constructing composited "reference" rainfall maps at select time and space scales.

Radar↗

Short-Term Forecasts Using NU-WRF for the Winter Olympics 2018

The NASA Unified-Weather Research and Forecasting model (NU-WRF) will be included for testing and evaluation in the forecast demonstration project (FDP) of the International Collaborative Experiment −PyeongChang 2018 Olympic and Paralympic (ICE-POP) Winter Games. An international array of radar and supporting ground based observations together with various forecast and now-cast models will be operational during ICE-POP. In conjunction with personnel from NASA's Goddard Space Flight Center, the NASA Short-term Prediction Research and Transition (SPoRT) Center is developing benchmark simulations for a real-time NU-WRF configuration to run during the FDP. ICE-POP observational datasets will be used to validate model simulations and investigate improved model physics and performance for prediction of snow events during the research phase (RDP) of the project The NU-WRF model simulations will also support NASA Global Precipitation Measurement (GPM) Mission ground-validation physical and direct validation activities in relation to verifying, testing and improving satellite-based snowfall retrieval algorithms over complex terrain.

forecasting↗

Interactive Ozone and Methane Chemistry in GISS-E2 Historical and Future Climate Simulations

The new generation GISS climate model includes fully interactive chemistry related to ozone in historical and future simulations, and interactive methane in future simulations. Evaluation of ozone, its tropospheric precursors, and methane shows that the model captures much of the largescale spatial structure seen in recent observations. While the model is much improved compared with the previous chemistry-climate model, especially for ozone seasonality in the stratosphere, there is still slightly too rapid stratospheric circulation, too little stratosphere-to-troposphere ozone flux in the Southern Hemisphere and an Antarctic ozone hole that is too large and persists too long. Quantitative metrics of spatial and temporal correlations with satellite datasets as well as spatial autocorrelation to examine transport and mixing are presented to document improvements in model skill and provide a benchmark for future evaluations. The difference in radiative forcing (RF) calculated using modeled tropospheric ozone versus tropospheric ozone observed by TES is only 0.016W/sq. m. Historical 20th Century simulations show a steady increase in whole atmosphere ozone RF through 1970 after which there is a decrease through 2000 due to stratospheric ozone depletion. Ozone forcing increases throughout the 21st century under RCP8.5 owing to a projected recovery of stratospheric ozone depletion and increases in methane, but decreases under RCP4.5 and 2.6 due to reductions in emissions of other ozone precursors. RF from methane is 0.05 to 0.18W/ sq. m higher in our model calculations than in the RCP RF estimates. The surface temperature response to ozone through 1970 follows the increase in forcing due to tropospheric ozone. After that time, surface temperatures decrease as ozone RF declines due to stratospheric depletion. The stratospheric ozone depletion also induces substantial changes in surface winds and the Southern Ocean circulation, which may play a role in a slightly stronger response per unit forcing during later decades. Tropical precipitation shifts south during boreal summer from 1850 to 1970, but then shifts northward from 1970 to 2000, following upper tropospheric temperature gradients more strongly than those at the surface.

Ozone↗

Chapter 13: Errors and Uncertainties Associated with Quasi-Global Satellite Precipitation Products

Measuring precipitation on a global scale is only possible from satellite platforms. Satellite precipitation estimates are based on geosynchronous infrared sensors on geostationary satellites, characterized by high sampling frequency, and polar-orbiting microwave sensors on low-Earth-orbiting satellites with less-frequent sampling. Assessing satellite product performance is fundamental to infer the reliability of such estimates and effectively use them in water resources management, extreme event characterization, disease control, or weather forecasting. Nevertheless, errors and uncertainties associated with satellite precipitation products are often masked due to temporal and spatial sampling, as well as bias-corrections against a reference dataset. Moreover, the verification of satellite precipitation products is easier over land areas, where rain gauges and ground radars are available as benchmark, but extremely limited over the oceans. Substantial work still remains to better quantify relative and absolute errors and uncertainties within satellite-based precipitation products over land and oceans.

Viviana Maggioni↗

Ice Accretions and Full-Scale Iced Aerodynamic Performance Data for a Two-Dimensional NACA 23012 Airfoil

This report documents the data collected during the large wind tunnel campaigns conducted as part of the SUNSET project (StUdies oN Scaling EffecTs due to ice) also known as the Ice-Accretion Aerodynamics Simulation study: a joint effort by NASA, the Office National d'Etudes et Recherches Aérospatiales (ONERA), and the University of Illinois. These data form a benchmark database of full-scale ice accretions and corresponding ice-contaminated aerodynamic performance data for a two-dimensional (2D) NACA 23012 airfoil. The wider research effort also included an analysis of ice-contaminated aerodynamics that categorized ice accretions by aerodynamic effects and an investigation of subscale, low- Reynolds-number ice-contaminated aerodynamics for the NACA 23012 airfoil. The low-Reynolds-number investigation included an analysis of the geometric fidelity needed to reliably assess aerodynamic effects of airfoil icing using artificial ice shapes. Included herein are records of the ice accreted during campaigns in NASA Glenn Research Center's Icing Research Tunnel (IRT). Two different 2D NACA 23012 airfoil models were used during these campaigns; an 18-in. (45.7-cm) chord (subscale) model and a 72-in. (182.9-cm) chord (full-scale) model. The aircraft icing conditions used during these campaigns were selected from the Federal Aviation Administration's (FAA's) Code of Federal Regulations (CFR) Part 25 Appendix C icing envelopes. The records include the test conditions, photographs of the ice accreted, tracings of the ice, and ice depth measurements. Model coordinates and pressure tap locations are also presented. Also included herein are the data recorded during a wind tunnel campaign conducted in the F1 Subsonic Pressurized Wind Tunnel of ONERA. The F1 tunnel is a pressured, high- Reynolds-number facility that could accommodate the full-scale (72-in. (182.9-cm) chord) 2D NACA 23012 model. Molds were made of the ice accreted during selected test runs of the full-scale model in the IRT. From these molds, castings were made that closely replicated the features of the accreted ice. The castings were then mounted on the full-scale model in the F1 tunnel, and aerodynamic performance measurements were made using model surface pressure taps, the facility force balance system, and a large wake rake designed specifically for these tests. Tests were run over a range of Reynolds and Mach numbers. For each run, the model was rotated over a range of angles-of-attack that included airfoil stall. The benchmark data collected during these campaigns were, and continue to be, used for various purposes. The full-scale data form a unique, ice-accretion and associated aerodynamic performance dataset that can be used as a reference when addressing concerns regarding the use of subscale ice-accretion data to assess full-scale icing effects. Further, the data may be used in the development or enhancement of both ice-accretion prediction codes and computational fluid dynamic codes when applied to study the effects of icing. Finally, as was done in the wider study, the data may be used to help determine the level of geometric fidelity needed for artificial ice used to assess aerodynamic degradation due to aircraft icing. The structured, multifaceted approach used in this research effort provides a unique perspective on the aerodynamic effects of aircraft icing. The data presented in this report are available in electronic form upon formal approval by proper NASA and ONERA authorities.

Addy, Harold E., Jr.↗

NASA POWER: Providing Analysis-Ready, Cloud-Optimized Data for AI /ML Training and Applications in Earth Science

As global demand for sustainable development grows, the integration of Earth Observation (EO) data into decision making frameworks has become a primary objective for the scientific community. The NASA Prediction of Worldwide Energy Resources (POWER) project serves as a bridge between NASA EO data and the specialized needs of the renewable energy, sustainable infrastructure and agroclimatology communities. In this poster presentation we will present an overview of POWER data products and services along with its use in diverse research to decision-making workflows. By providing over 40 years of high-resolution historical, hourly and daily solar and meteorological data, POWER transforms satellite observations and global model reanalysis into actionable, Analysis-Ready Dataset (ARD). Currently, the project delivers over 250 industry-friendly parameters to the users from different NASA datasets like CERES SYN1Deg, MERRA-2, and IMERG alongside downscaled CMIP6 climate model data, fulfilling over 16 million requests from 50,000 unique users monthly. To ensure data quality and traceability, these parameters are rigorously validated against the ground-based observations from the Baseline Surface Radiation Network (BSRN) and the Global Surface Summary of the Day (GSOD) – these results will be discussed in the presentation. A newly introduced web-based PaRameter Uncertainty ViEwer (PRUVE) tool will be presented that provides an online validation platform to the users that benchmarks satellite-based and assimilation data products against these surface measurements. To reduce technical barriers to data adoption, POWER data is accessible through RESTful APIs, ESRI ArcGIS Image Services, a web-based Data Access Viewer tool, allowing users to visualize, validate and apply the dataset. For efficient data delivery POWER data is cloud-optimized into Zarr datastore accessible through NASA managed Amazon S3 ensures high-performance allowing users to integrate EO directly into operational pipelines. These customized services will be presented. Use cases from application will be presented from the energy sector - such as for design of generation systems, performance monitoring of solar power plants, in infrastructure sector- optimizing building energy efficiency and thermal comfort, in agriculture – such as driving crop simulation and yield forecasting models to enable climate resilient farming. Furthermore, the shift toward machine learning (ML) in EO research that has positioned POWER as a key provider for training datasets which will be discussed. Use-cases will be presented to showcase how NASA data is enabling the development of predictive tools for climate variability and resource management. The poster will present POWER’s future plans including technology development to enhance data traceability and reproducibility and improving I/O performance to support the rapid integration of new EO products, ensuring that POWER remains a robust scalable backend for the evolving landscape of AI-driven Earth Science. Additionally, POWER is developing an AI Agent and an MCP-Server to enable industry AI-Agentic workflows.

Neha Khadka↗

Benchmark Comparison of Cloud Analytics Methods Applied to Earth Observations

Cloud computing has the potential to bring high performance computing capabilities to the average science researcher. However, in order to take full advantage of cloud capabilities, the science data used in the analysis must often be reorganized. This typically involves sharding the data across multiple nodes to enable relatively fine-grained parallelism. This can be either via cloud-based file systems or cloud-enabled databases such as Cassandra, Rasdaman or SciDB. Since storing an extra copy of data leads to increased cost and data management complexity, NASA is interested in determining the benefits and costs of various cloud analytics methods for real Earth Observation cases. Accordingly, NASA's Earth Science Technology Office and Earth Science Data and Information Systems project have teamed with cloud analytics practitioners to run a benchmark comparison on cloud analytics methods using the same input data and analysis algorithms. We have particularly looked at analysis algorithms that work over long time series, because these are particularly intractable for many Earth Observation datasets which typically store data with one or just a few time steps per file. This post will present side-by-side cost and performance results for several common Earth observation analysis operations.

science data management↗

A Robust Hybrid Deep Learning Model for Spatiotemporal Image Fusion

Dense time-series remote sensing data with detailed spatial information are highly desired for the monitoring of dynamic earth systems. Due to the sensor tradeoff, most remote sensing systems cannot provide images with both high spatial and temporal resolutions. Spatiotemporal image fusion models provide a feasible solution to generate such a type of satellite imagery, yet existing fusion methods are limited in predicting rapid and/or transient phenological changes. Additionally, a systematic approach to assessing and understanding how varying levels of temporal phenological changes affect fusion results is lacking in spatiotemporal fusion research. The objective of this study is to develop an innovative hybrid deep learning model that can effectively and robustly fuse the satellite imagery of various spatial and temporal resolutions. The proposed model integrates two types of network models: super-resolution convolutional neural network (SRCNN) and long short-term memory (LSTM). SRCNN can enhance the coarse images by restoring degraded spatial details, while LSTM can learn and extract the temporal changing patterns from the time-series images. To systematically assess the effects of varying levels of phenological changes, we identify image phenological transition dates and design three temporal phenological change scenarios representing rapid, moderate, and minimal phenological changes. The hybrid deep learning model, alongside three benchmark fusion models, is assessed in different scenarios of phenological changes. Results indicate the hybrid deep learning model yields significantly better results when rapid or moderate phenological changes are present. It holds great potential in generating high-quality time-series datasets of both high spatial and temporal resolutions, which can further benefit terrestrial system dynamic studies. The innovative approach to understanding phenological changes’ effect will help us better comprehend the strengths and weaknesses of current and future fusion models.

spatiotemporal fusion↗