SEARCH · Search NASA

Results for “NASA Earth Exchange”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

NASA NTRS2017

H31G-1596: DeepSAT's CloudCNN: A Deep Neural Network for Rapid Cloud Detection from Geostationary Satellites

Cloud and cloud shadow detection has important applications in weather and climate studies. It is even more crucial when we introduce geostationary satellites into the field of terrestrial remote sensing. With the challenges associated with data acquired in very high frequency (10-15 mins per scan), the ability to derive an accurate cloud shadow mask from geostationary satellite data is critical. The key to the success for most of the existing algorithms depends on spatially and temporally varying thresholds,which better capture local atmospheric and surface effects.However, the selection of proper threshold is difficult and may lead to erroneous results. In this work, we propose a deep neural network based approach called CloudCNN to classify cloudshadow from Himawari-8 AHI and GOES-16 ABI multispectral data. DeepSAT's CloudCNN consists of an encoderdecoder based architecture for binary-class pixel wise segmentation. We train CloudCNN on multi-GPU Nvidia Devbox cluster, and deploy the prediction pipeline on NASA Earth Exchange (NEX) Pleiades supercomputer. We achieved an overall accuracy of 93.29% on test samples. Since, the predictions take only a few seconds to segment a full multispectral GOES-16 or Himawari-8 Full Disk image, the developed framework can be used for real-time cloud detection, cyclone detection, or extreme weather event predictions.

GOES-1↗

NASA NTRS2017

Linear Subpixel Learning Algorithm for Land Cover Classification from WELD using High Performance Computing

In this work, we use a Fully Constrained Least Squares Subpixel Learning Algorithm to unmix global WELD (Web Enabled Landsat Data) to obtain fractions or abundances of substrate (S), vegetation (V) and dark objects (D) classes. Because of the sheer nature of data and compute needs, we leveraged the NASA Earth Exchange (NEX) high performance computing architecture to optimize and scale our algorithm for large-scale processing. Subsequently, the S-V-D abundance maps were characterized into 4 classes namely, forest, farmland, water and urban areas (with NPP-VIIRS-national polar orbiting partnership visible infrared imaging radiometer suite nighttime lights data) over California, USA using Random Forest classifier. Validation of these land cover maps with NLCD (National Land Cover Database) 2011 products and NAFD (North American Forest Dynamics) static forest cover maps showed that an overall classification accuracy of over 91 percent was achieved, which is a 6 percent improvement in unmixing based classification relative to per-pixel-based classification. As such, abundance maps continue to offer an useful alternative to high-spatial resolution data derived classification maps for forest inventory analysis, multi-class mapping for eco-climatic models and applications, fast multi-temporal trend analysis and for societal and policy-relevant applications needed at the watershed scale.

Subpixel↗

NASA NTRS2015

Development of a Complete Landsat Evapotranspiration and Energy Balance Archive to Support Agricultural Consumptive Water Use Reporting and Prediction in the Central Valley, CA

Mapping evapotranspiration (ET) from agricultural areas in Californias Central Valley is critical for understanding historical consumptive use of surface and groundwater. In addition, long histories of ET maps provide valuable training information for predictive studies of surface and groundwater demands. During times of drought, groundwater is commonly pumped to supplement reduced surface water supplies in the Central Valley. Due to the lack of extensive groundwater pumping records, mapping consumptive use using satellite imagery is an efficient and robust way for estimating agricultural consumptive use and assessing drought impacts. To this end, we have developed and implemented an algorithm for automated calibration of the METRIC remotely sensed surface energy balance model on NASAs Earth Exchange (NEX) to estimate ET at the field scale. Using automated calibration techniques on the NEX has allowed for the creation of spatially explicit historical ET estimates for the Landsat archive dating from 1984 to the near present. Further, our use of spatial NLDAS and CIMIS weather data, and spatial soil water balance simulations within the NEX METRIC workflow, has helped overcome challenges of time integration between satellite image dates. This historical and near present time archive of agricultural water consumption for the Central Valley will be an extremely useful dataset for water use and drought impact reporting, and predictive analyses of groundwater demands.

valleys↗

NASA NTRS2017

Generating Land Surface Reflectance for the New Generation of Geostationary Satellite Sensors with the MAIAC Algorithm

The latest generation of geostationary satellite sensors, including the GOES-16/ABI and the Himawari 8/AHI, provide exciting capability to monitor land surface at very high temporal resolutions (5-15 minute intervals) and with spatial and spectral characteristics that mimic the Earth Observing System flagship MODIS. However, geostationary data feature changing sun angles at constant view geometry, which is almost reciprocal to sun-synchronous observations. Such a challenge needs to be carefully addressed before one can exploit the full potential of the new sources of data. Here we take on this challenge with Multi-Angle Implementation of Atmospheric Correction (MAIAC) algorithm, recently developed for accurate and globally robust applications like the MODIS Collection 6 re-processing. MAIAC first grids the top-of- atmosphere measurements to a fixed grid so that the spectral and physical signatures of each grid cell are stacked (“remembered”) over time and used to dramatically improve cloud/shadow/snow detection, which is by far the dominant error source in the remote sensing. It also exploits the changing sun-view geometry of the geostationary sensor to characterize surface BRDF with augmented angular resolution for accurate aerosol retrievals and atmospheric correction. The high temporal resolutions of the geostationary data indeed make the BRDF retrieval much simpler and more robust as compared with sun-synchronous sensors such as MODIS. As a prototype test for the geostationary-data processing pipeline on NASA Earth Exchange (GEONEX), we apply MAIAC to process 18 months of data from Himawari 8/AHI over Australia. We generate a suite of test results, including the input TOA reflectance and the output cloud mask, aerosol optical depth (AOD), and the atmospherically-corrected surface reflectance for a variety of geographic locations, terrain, and land cover types. Comparison with MODIS data indicates a general agreement between the retrieved surface reflectance products. Furthermore, the geostationary results satisfactorily capture the movement of clouds and variations in atmospheric dust/aerosol concentrations, suggesting that high quality land surface and vegetation datasets from the advanced geostationary sensors can help complement and improve the corresponding EOS products.

geostationary satellite sensors↗

NASA NTRS2020

Data Science for Weather Impacts on Crop Yield

Private businesses in sectors, such as food, energy, and retail, as well as public sector and federal agencies are interested in the predictive understanding of weather impacts on crop yield, which is an important aspect of food security. Scientific literature has mainly examined how crop yield is impacted by growing season-averaged weather indices. Although a few studies did consider weather extremes in their analysis, their scope was either restricted to measuring their conditional relationship with yield or the extreme event types considered were limited. Selection of regression models, whether the more commonly used linear approaches or nonlinear methods, have not been appropriately justified in this context. Here, we develop data-driven methods to examine two inter-related hypotheses for improved scientific understanding and enhanced predictive modeling. The first hypothesis, that extreme weather indices have a statistically significant information content in them is found to be valid based on linear and nonlinear methods for pairwise dependence. The second hypothesis, examines the value addition of nonlinear regression methods, and suggests that linear approaches may not alone be adequate. The results of this study can inform scientific understanding, generation and relevance of indices and end-to-end risk assessment systems in the context of climate impacts on crop yield. An immediate application may be in the context of NASA Earth Exchange (NEX) which facilitates the generation and dissemination of impacts relevant weather data and indices using a multitude of satellite-derived data sets and model outputs.

Data mining, food security, weather impacts↗

NASA NTRSDate not supplied

Hourly GPP Estimation In Australia Using Himawari-8 AHI Products

We extended the MODIS 17 algorithm to hourly Gross Primary Product (GPP) estimation for Australia in 2018. AHI 1-km data are available at NASA Earth Exchange (NEX) facility. The high-frequent observation of Advanced Himawari Imager (AHI) enabled us to calculate hourly GPP, which is corresponding to ground observation of carbon flux measured by TERN OzFlux. We interpolated the weather observation data to 1-km grid over Australia ingesting AHI reflectance and radiometric temperature data (NEX-Gridded Hourly Meteorology (NEX-GHM)). Then, we applied MODIS 17 algorithm to each grid with optimized climate regulation functions. The estimation of climate and GPP were well correlated with OzFlux ground observation data.

Himawari-8↗

NASA NTRSDate not supplied

Detecting Short Term Drought Impact in the Southwest US Using GOES-16 ABI Data

Satellite optical remote sensing has been often used for monitoring broad-region vegetation change, for example, phenology observations and the year-to-year leaf area index (LAI) responses to climate oscillations. However, rapid responses of vegetation to day-to-day weather perturbations are difficult to detect using available optical remote sensing satellites because of the low frequency of the observations. Sun-synchronous optical sensors, such as Moderate Resolution Imaging Spectroradiometer (MODIS) and Advanced Very High Resolution Radiometer (AVHRR), can observe a target area once a day. Daily observations cannot distinguish whether short-term changes in Normalized Differential Vegetation Index (NDVI) are actual LAI change or cloud contamination. NOAA’s GOES satellites make observations every 10 to 15 minutes using the Advanced Baseline Imager (ABI). In this study, we used the Geostationary-NASA Earth Exchange (GeoNEX) L1G Top-of-Atmosphere (TOA) ABI data to detect drought impact on NDVI time series in the Southwest US. We used an empirical method to cancel the BRDF effect of varying solar zenith angle. The ABI was able to detect short term drought impacts as well as an NDVI decrease in the dry season. Increased NDVI right after a rainfall followed by an immediate decrease was observed. These ABI NDVI changes were correlated with the RGB time series from PhenoCam Network data. Results indicated that the ABI can be used for short-term analysis of LAI and can detect small LAI changes caused by drought in an arid area, suggesting the potential for its use in near-real time drought monitoring applications.

ABI↗

NASA NTRSDate not supplied

Development of the GeoNEX Level 2G Products: Exploiting the Diurnal Variability of TOA Reflectance in Atmospheric Correction

This study develops a new atmospheric correction algorithm to generate the Level 2G products, in particular the gap-filled Surface Reflectance at 10-minute time steps, for the Geostationary-NASA Earth Exchange (GeoNEX) project. The algorithm is based on the MODIS MAIAC (Multi-Angle Implementation of Atmospheric Correction) framework but with significant modifications to exploit angular/temporal information from the diurnal variability of the GeoNEX L1G TOA (Top-of-Atmosphere) reflectance. The algorithm starts by evaluating the roughness/smoothness of the diurnal time series of the TOA reflectance. Because rapid changes in TOA reflectance are generally caused by passing clouds or shadows, rough segments of the time series are automatically filtered out while the smooth segments are further tested for brightness and temperature to identify clear-sky and snow-free observations. Next the algorithm runs the MAIAC RTM (Radiative Transfer Model) to retrieve the Ross-Thick-Li-Sparse (RTLS) BRDF model parameters and the daily-mean atmospheric optical depth (AOD) that allow the RTM to optimally simulate the observed diurnal variability of clear-sky TOA reflectance. Once the initial RTLS parameters are retrieved after the algorithm’s burn-in period, they are used as the prior information to predict the AOD level for the next days, while the subsequent clear-sky observations are used to make necessary adjustments to the RTLS parameters in an continuous fashion. This “prediction-analysis” cycle is then iterated to process the full time series of the L1G data, skipping only total-cloudy days or when surface snow is detected. We tested the algorithm over a list of selected AERONET sites. The retrieved results (the daily mean AOD and the RTLS parameters) reasonably agree with the ground-based measurements. Importantly, the results indicate that the diurnal cycles of surface reflectance are continuous functions of the illumination-view geometry. Thus we can use the retrieved RTLS model to accurately fill in data gaps on partial cloudy days. Also, our algorithm is totally independent from the traditional approaches based on the use of spectral band ratios between the shortwave infrared (e.g., 2.2µm) and the visible (e.g., 0.47µm and 0.64µm) bands. Our results thus demonstrate that the high-frequent diurnal geostationary observations contain unique information that helps us improve atmospheric correction of remote sensing data.

GeoNEX↗

NASA NTRSDate not supplied

Communicating Metrics of Land Surface Temperature Variability Using Multi-sensor Machine Learning

Land surface temperature (LST) is a key climate observable used to detect changes in the Earth’s surface energy budget that influence carbon and water cycles. Land surface temperature exhibits strong diurnal variability, which geostationary satellites can observe at scale thanks to their temporal resolution. Due to anthropogenic climate and land use changes, the surface energy balance has been considerably modified and may be described by changes in diurnal temperature range and extremes. Using high performance computing and datasets from the NASA Earth Exchange, we exploit co-located, co-temporal observations from low-earth orbit (LEO) and geostationary (GEO) sensors to develop a deep learning-based method for LEO-to-GEO algorithm emulation. Our model is trained to predict MODIS Terra LST from GOES-16 thermal bands and achieves validation error <2K. Application of the model to unseen times of day (observed by MODIS Aqua) and a new GEO sensor (Himawari-8) observing an unseen spatial domain, demonstrate the generalization of the deep learning model across space, time and spectra. Further, time series clustering approaches are examined with the objective of identifying key indicators of change in diurnal cycling and extremes on a continental scale. Communicating LST variability observed by geostationary satellites can have impacts in multiple disciplines, from understanding of snow, vegetation and soil dynamics, to recognizing trends in heat events relevant to human health.

Kate Duffy↗

NASA NTRSDate not supplied

GeoNEX-SUBSETS: Geostationary Satellite Observations Over International Observing Network Sites

Satellite remote sensing is crucial for monitoring the Earth’s surface and for simulating global carbon and water cycles. Subsets of satellite data from sensors such as MODIS over established observing networks have been valuable for researchers for comparing the ground observed phenomena with satellite observations. Here, we introduce new subsets of the GeoNEX geostationary satellite datasets over locations of several ground observation networks. The NASA Earth Exchange group has been generating geostationary satellite products with our international partners and universities to cover the entire globe. In comparison to polar-orbiting satellite sensors such as MODIS, the new generation geostationary satellites observe target areas at a higher frequency (5-10 minutes), which also significantly increased the data volume. To reduce the burden of downloading and extracting geostationary time series data and provide easy access to the community, we provide subsets of GeoNEX products through our data portal [www.data.nas.nasa.gov]. The ready-to-use subset follows the same format as the MODIS fixed sites subset tools for users who are familiar with MODIS subset data and software. The selected networks include Fluxnet, AERONET, and Phenocam over the conterminous US. We demonstrate the usage of the GeoNEX fixed-site subset data and showcase thir advantages with three example studies. The first example is simulating the diurnal cycle of plant ecophysiology at Fluxnet sites. The high frequency of the GeoNEX time series allows us to run ecological models at sub-hour time steps and directly compare the simulated carbon and water fluxes with half-hourly Fluxnet data. The second example uses the geostationary data to track phenological changes. It highlights the high-frequent observations of geostationary satellites in helping mask cloud covers and capture the quick responses of vegetation to environmental changes. As such, these examples demonstrate the value of ready-to-use GeoNEX subsets data in terrestrial ecophysiology research.

GeoNEX↗

NASA NTRSDate not supplied

A generalizable machine learning approach to predict land surface temperature

Monitoring of land surface and atmospheric states is highly reliant on satellite data. Traditionally, data products are generated using carefully tuned and validated algorithms for low-earth orbit (LEO) sensors. However, the emerging constellation of geostationary (GEO) sensors contributes global, high temporal resolution observations which can better capture the diurnal variability of key observables like land surface temperature (LST). Using high performance computing and datasets from the NASA Earth Exchange, we exploit co-located, co-temporal observations from LEO and GEO satellites to develop a deep learning-based method for sensor-to-sensor algorithm emulation. Our model is trained on GOES-16 thermal bands to predict MODIS Terra LST and achieves a validation error <2K. Further, application of the model to unseen times of day and a second GEO sensor observing an unseen spatial domain demonstrate the generalization of the deep learning model across space, time and spectra. We anticipate that the synergies between a variety of active orbit configurations can be used to accelerate application of existing algorithms to new datasets.

Kate Marie Duffy↗

NASA NTRSDate not supplied

GeoNEX-ML: A Machine Learning System for Earth Observations

Improved capabilities of earth monitoring satellites are enabling a wide range of studies on the environmental effects of climate change, often leveraging the recent advancements in machine learning. At the same time, the new capabilities, including higher spatial resolution and temporal frequency, are expanding the amount of data generated at exponential rates. At the NASA Earth eXchange (NEX), we build deep learning methods to learn from cross sensor satellite-based Earth observations for generating new datasets with efficient processing techniques. Using current generation geostationary satellites on NEX, we present an interchangeable set of machine models to perform spectral adjustment, physical model emulation, LEO-GEO emulation, and optical flow. These tools are used to generate consistent virtual observations across sensors, perform atmospheric correction and cloud detection, and estimate land surface temperature and atmospheric winds. This approach aims to improve the robustness of remotely sensed data processing by learning from diverse sets of observations while enabling near real-time and on-demand capabilities.

Geostationary↗

NASA NTRSDate not supplied

LEO Sensor to GEO Sensor Algorithm Transfer Models for Land Surface Temperature

Land surface temperature (LST) is a key climate observable used to detect changes in the Earth’s surface energy budget that influence carbon and water cycles. Land surface temperature exhibits strong diurnal variability, which geostationary satellites can observe at scale thanks to their temporal resolution. Due to anthropogenic climate and land use changes, the surface energy balance has been considerably modified and may be described by changes in diurnal temperature range and extremes. Using high performance computing and datasets from the NASA Earth Exchange, we exploit co-located, co-temporal observations from low-earth orbit (LEO) and geostationary (GEO) sensors to develop a deep learning-based method for LEO-to-GEO algorithm emulation. Our model is trained to predict MODIS Terra LST from GOES-16 thermal bands and achieves validation error <2K. Application of the model to unseen times of day (observed by MODIS Aqua) and a new GEO sensor (Himawari-8) observing an unseen spatial domain, demonstrate the generalization of the deep learning model across space, time and spectra. Communicating diurnal LST variability observed by geostationary satellites can have impacts in multiple disciplines, from understanding of snow, vegetation and soil dynamics, to recognizing trends in heat events relevant to human health.

Kate Marie Duffy↗

NASA NTRSDate not supplied

Deep Learning System for Efficient Processing of Geostationary Satellite Imagery

Improved capabilities of Earth monitoring satellites are enabling a wide range of studies on the environmental effects of climate change, often leveraging the recent advancements in machine learning. At the same time, the new capabilities, including higher spatial resolution and temporal frequency, are expanding the amount of data generated at exponential rates. Further, a large majority of archived datasets generated by scientific processing is never used. This motivates the development of an efficient machine learning system for end-to-end processing of multi-level satellite datasets, from level 1 top of atmosphere observations to user friendly environmental variables of interest. Using current generation geostationary satellites GOES-16/17 (NOAA/NASA), and Himawari-8/9 (JAXA), we present an interchangeable set of machine models to perform spectral adjustment among sensors, physical model emulation, LEO-GEO emulation, and optical flow in a high performance computing environment. We use these tools on the NASA Earth eXchange (NEX) to generate consistent virtual observations across sensors, perform atmospheric correction and cloud detection, and estimate surface reflectance, surface temperature and atmospheric winds. This approach aims to improve the robustness of remotely sensed data processing by learning from diverse sets of observations while enabling near real-time and on-demand capabilities.

Thomas Vandal↗

NASA NTRSDate not supplied

Atmospheric winds with deep optical flow

Atmospheric winds↗

NASA NTRSDate not supplied

Development of Carbon Flux Model Using ABI Data Over the Conterminous US

The satellite-driven carbon flux estimation has been playing important role to estimate continental-scale carbon budget. One of the biggest recent advances in the satellite-driven carbon flux modeling is utilization of high-frequent geostationary satellites to estimate diurnal cycle in carbon fluxes. The satellite based carbon flux estimation used the polar orbiting satellite sensors (e.g., Moderate Resolution Imaging Spectroradiometer (MODIS)), which allow us to observe target regions only once during the day. The new generation of geostationary satellite sensors provide frequent observations, often less than every 10 minutes. Here, we use GOES Advanced Baseline Imager (ABI) data to estimate hourly NEE over the conterminous US. We used the Terrestrial Observation Prediction System (TOPS) model for estimating hourly NEE. TOPS is a diagnostic ecosystem process model that simulates the fluxes of carbon and water through vegetation in response to climate variability. For the climate input, we developed hourly climate data using the same algorithm with NASA Earth Exchange Gridded Daily Meteorology (NEX-GDM) datasets based on machine learning techniques. The hourly climate data includes precipitation, maximum temperature, minimum temperature, dew point temperature, and solar radiation were derived from the Geostationary observations. The spatial patterns of ecosystem parameters used in TOPS are optimized using satellite Solar Induced Fluorescence (SIF) data. The high frequency GPP estimations from geostationary satellite sensors make it comparable to the instantaneous SIF data than daily GPP. We also used Ameriflux data for optimization of model parameters and the validation of the output. The derived data addresses the diurnal dynamics of carbon cycling at large scales and should help in reducing the uncertainties in carbon budget studies.

geostationary satellite↗

NASA NTRS2023

Technical Note: NASAaccess – A Tool for Access, Reformatting, and Visualization of Remotely Sensed Earth Observation and Climate Data

The National Aeronautics and Space Administration (NASA) has launched a new initiative, the Open-Source Science Initiative (OSSI), to enable and support science towards openness. The OSSI supports open-source software development and dissemination. In this work, we present NASAaccess, which is an open-source software package and web-based environmental modeling application for earth observation data accessing, reformatting, and presenting quantitative data products. The main objective of developing the NASAaccess platform is to facilitate exploration, modeling, and understanding of earth data for scientists, stakeholders, and concerned citizens whose objectives align with the new OSSI goals. The NASAaccess platform is available as software packages (i.e., the R and conda packages) as well as an interactive-format web-based environmental modeling application for earth observation data developed with Tethys Platform. NASAaccess has been envisioned as lowering the technical barriers and simplifying the process of accessing scalable distributed computing resources and leveraging additional software for data and computationally intensive modeling frameworks. Specifically, NASAaccess has been developed to meet the need for seamless earth observation remote-sensing and climate data ingestion into various hydrological modeling frameworks. Moreover, NASAaccess is also contributing to keeping interested parties and stakeholders engaged with environmental modeling, accessing the information available in various remote-sensing products. NASAaccess' current capabilities cover various NASA datasets and products that include the Global Precipitation Measurement (GPM) data products, the Global Land Data Assimilation System (GLDAS) land surface states and fluxes, and the NASA Earth Exchange Global Daily Downscaled Projections (NEX-GDDP) Coupled Model Intercomparison Project Phase 5 (CMIP5) and Coupled Model Intercomparison Project Phase 6 (CMIP6) climate change dataset products.

Ibrahim Nourein Mohammed↗

NASA NTRSDate not supplied

Mapping Surface Vapor Pressure Deficits From Geostationary Satellites for Fire Weather Monitoring

The increase in the wildfires were observed globally in accordance with global warming, and to real- time monitoring of wildfire risk in broad scale is demanded for wildfire management to prevent the spread of wildfires. Scientists invented a lot of indices to assess the wildfire risk. Vapor Pressure Deficit (VPD) is one of the most important meteorological components for those indices. Compared to other components of fire weather indices, VPD can change quickly from lower risk to higher risk even in sub-hourly. Therefore, real-time fire risk monitoring requires high-resolution and high- temporal VPD spatial map. Here, we developed VPD estimation method using the GOES Advanced Baseline Imager (ABI) data. Unlike the polar-orbital satellite data, the ABI can observe target region every 10 minutes, so that we can estimate VPD for fire weather in real-time. The method used to estimate VPD is same with the algorithm of NASA Earth Exchange Gridded Daily Meteorology (NEX- GDM), which estimate meteorological variables from ground weather observation and spatial variables based on random forest (RF). We calculated RF importance to select bands of ABI as input of the model. To validate our results, we compared the spatial pattern of our VPD data with the Real- Time Mesoscale Analysis (RTMA) data over the conterminous USA. We sought possibility of applying our method to the region where no real-time high-resolution weather data is available, such as South America. The developed method can produce real-time high-resolution high-frequent VPD data in the continental scale. The derived data from GOES ABI could contribute to improve the fire weather monitoring and lead to prevent wildfires.

Hirofumi Hashimoto↗