Engineering topics

Andrew Michaelis

Publications and source records attributed to Andrew Michaelis.

At least 19 records

NASA NTRS2022

NASA Global Daily Downscale Projections, CMIP6

We describe the latest version of the NASA Earth Exchange Global Daily Downscaled Projections (NEX-GDDP-CMIP6). The archive contains downscaled historical and future projections for 1950–2100 based on output from Phase 6 of the Climate Model Intercomparison Project (CMIP6). The downscaled products were produced using a daily variant of the monthly bias correction/spatial disaggregation (BCSD) method and are at 1/4-degree horizontal resolution. Currently, eight variables from five CMIP6 experiments (historical, SSP126, SSP245, SSP370, and SSP585) are provided as procurable from thirty-five global climate models.

Climate↗

NASA NTRS2022

A Novel Atmospheric Correction Algorithm to Exploit the Diurnal Variability in Hypertemporal Geostationary Observations

This study developed a new atmospheric correction algorithm, GeoNEX-AC, that is independent from the traditional use of spectral band ratios but dedicated to exploiting information from the diurnal variability in the hypertemporal geostationary observations. The algorithm starts by evaluating smooth segments of the diurnal time series of the top-of-atmosphere (TOA) reflectance to identify clear-sky and snow-free observations. It then attempts to retrieve the Ross-Thick–Li-Sparse (RTLS) surface bi-directional reflectance distribution function (BRDF) parameters and the daily mean atmospheric optical depth (AOD) with an atmospheric radiative transfer model (RTM) to optimally simulate the observed diurnal variability in the clear-sky TOA reflectance. Once the initial RTLS parameters are retrieved after the algorithm’s burn-in period, they serve as the prior information to estimate the AOD levels for the following days and update the surface BRDF information with the new clear-sky observations. This process is iterated through the full time span of the observations, skipping only totally cloudy days or when surface snow is detected. We tested the algorithm over various Aerosol Robotic Network (AERONET) sites and the retrieved results well agree with the ground-based measurements. This study demonstrates that the high-frequency diurnal geostationary observations contain unique information that can help to address the atmospheric correction problem from new directions.

atmospheric correction↗

NASA NTRS2021

Spectral Synthesis for Geostationary Satellite-to-Satellite Translation

Earth-observing satellites carrying multispectral sensors are widely used to monitor the physical and biological states of the atmosphere, land, and oceans. These satellites have different vantage points above the Earth and different spectral imaging bands resulting in inconsistent imagery from one to another. This presents challenges in building downstream applications. What if we could generate synthetic bands for existing satellites from the union of all domains? We tackle the problem of generating synthetic spectral imagery for multispectral sensors as an unsupervised image-to-image translation problem modeled with a variational autoencoder (VAE) and generative adversarial network (GAN) architecture. Our approach introduces a novel shared spectral reconstruction loss to constrain the high-dimensional feature space of multispectral images. Simulated experiments performed by dropping one or more spectral bands show that cross-domain reconstruction outperforms measurements obtained from a second vantage point. Our proposed approach enables the synchronization of multispectral data and provides a basis for more homogeneous remote sensing datasets.

Geostationary satellites↗

NASA NTRS2021

Semantic Segmentation of High-Resolution Satellite Imagery using Generative Adversarial Networks with Progressive Growing

With increase in urbanization and Earth Sciences research into urban areas, the need to quickly and accurately segment urban rooftop maps has never been greater. Cur-rent machine learning techniques struggle to produce high accuracy maps in dense urban zones where there is high image noise and foot print overlap. In this paper, we evaluate a training methodology for pixel-wise segmentation for high resolution satellite imagery using progressive growing of generative adversarial networks as a solution. We apply our model to segmenting building rooftops and compare these results to conventional methods for rooftop segmentation. We evaluate our approach using the SpaceNet version 2 and xView datasets. Our experiments show that for SpaceNet, progressive Generative Adversarial Network (GAN) training achieved a test accuracy of 93% compared to 89% for traditional GAN training and 87% for U-Net architecture, while for xView, we achieved 71% accuracy using progressive GAN training compared to 69% through traditional GAN training and 65% using U-Net.

Semantic↗

NASA NTRSDate not supplied

AN INTRODUCTION TO THE GEONEX LEVEL-1G PRODUCTS: TOP-OF-ATMOSPHERE REFLECTANCE AND BRIGHTNESS TEMPERATURE

This paper introduces the GeoNEX (Geostationary-NASA Earth eXchange) Level-1G products of top-of-atmosphere (TOA) reflectance and brightness temperature. The products use data streams from the latest geostationary (GEO) sensors including the GOES-16/17 ABI and the Himawari-8/9 AHI. The GeoNEX processing pipeline starts by converting digital numbers to physical quantities with the latest radiometric calibration information. It integrates algorithms to automatically detect and remove residual geolocation errors, to estimate the pixel-wise data-acquisition time, and to accurately calculate the solar illumination angles for each pixel in the domain at every time step. The outputs are reprojected to a globally tiled common grid in geographic coordinates designed to facilitate inter-comparisons and/or synergies between the GeoNEX products and existing Earth observation datasets from polar-orbiting satellites. Therefore, the GeoNEX L1G products provide accurate and consistent TOA reflectance and brightness temperature datasets for scientific analyses and downstream product development.

Geostationary satellite, GOES-16, Himawari-8, NASA↗

NASA NTRSDate not supplied

Hourly GPP Estimation In Australia Using Himawari-8 AHI Products

We extended the MODIS 17 algorithm to hourly Gross Primary Product (GPP) estimation for Australia in 2018. AHI 1-km data are available at NASA Earth Exchange (NEX) facility. The high-frequent observation of Advanced Himawari Imager (AHI) enabled us to calculate hourly GPP, which is corresponding to ground observation of carbon flux measured by TERN OzFlux. We interpolated the weather observation data to 1-km grid over Australia ingesting AHI reflectance and radiometric temperature data (NEX-Gridded Hourly Meteorology (NEX-GHM)). Then, we applied MODIS 17 algorithm to each grid with optimized climate regulation functions. The estimation of climate and GPP were well correlated with OzFlux ground observation data.

Himawari-8↗

NASA NTRSDate not supplied

Virtual Sensing with Unsupervised Image-to-Image Translation

Earth observing satellites carrying multi-spectral sensors are widely used to monitor the physical and biological states of the atmosphere, land, and oceans. These satellites have different vantage points above the earth and different spectral imaging bands resulting in inconsistent imagery from one to another. This presents challenges in building downstream applications. What if we could generate synthetic bands for existing satellites from the union of all domains? We tackle the problem of generating synthetic spectral imagery for multispectral sensors as an unsupervised image-to-image translation problem with partial labels and introduce a novel shared spectral reconstruction loss. Simulated experiments performed by dropping one or more spectral bands show that cross-domain reconstruction outperforms measurements obtained from a second vantage point. On a downstream cloud detection task, we show that generating synthetic bands with our model improves segmentation performance beyond our baseline. Our proposed approach enables synchronization of multispectral data and provides a basis for more homogeneous remote sensing datasets.

Geostationary satellites↗

NASA NTRSDate not supplied

Geostationary Satellite Observations Over Global Environmental Monitoring Sites

Globally, there are now hundreds of ground-based environmental monitoring stations routinely collecting data on a variety of earth-atmosphere interactions. Such observations are also being augmented with data from orbiting satellites. With the beginning of the EOS-era, the MODIS subset around flux towers has been frequently used for validating ecosystem models developed at flux towers and upscaling the observed flux data to regional scales. However, MODIS on the polar-orbiting satellites can observe target regions only once a day, while the Fluxnet eddy- covariance data are compiled as sub-hourly. Therefore, summarizing the sub-hourly flux data into daily statistics is necessary for the comparison between MODIS and Flux data. The new generation geostationary satellite sensors (GOES-16/17 ABI and Himawari-8/9 AHI) have capabilities similar to MODIS but collect data at 5-15 minute intervals. These high-frequency observations allow us to understand and scale diurnal fluxes. Some studies have already shown the effective utilization of time series of geostationary satellite data for ecosystem modeling. We are producing NEX Level-1G products, which are gridded Top-of-Atmosphere reflectance and brightness temperature data from geostationary satellite sensors. We cut out the NEX Level-1G data using the same file format with the MODIS subset except for the projection. The other data products (e.g., surface reflectance, land surface temperature, vegetation indices, and climate data) will be added upon their availability. Currently included networks are Fluxnet, PhenoCam, and AERONET. The NEX subset data will be provided through NASA NEX data portal.

Geostationary Satellites↗

NASA NTRSDate not supplied

Using the Diurnal Variability in GeoNEX TOA Reflectances for Earth Monitoring

Observations from the third-generation geostationary satellite instruments (GOES 16/17 ABI, Himawari 8/9 AHI, and etc.) have spatial resolution and spectral band configurations comparable to flagship LEO sensors (e.g., MODIS/VIIRS). More importantly, these data are acquired at very high temporal resolution, faithfully recording the variations of the full disk of Earth at every 5-10 minutes. They thus provide unique information about Earth’s atmosphere and surface. In order to explore the unique information content of geostationary data, this study systematically analyzes the diurnal variability in the GeoNEX L1G TOA reflectance products and compares them to simulated results by state-of-the-art radiative transfer codes. Our results show that • The smoothness of the TOA reflectance diurnal cycle provides a convenient and reliable way to identify stable atmospheric conditions and filter out passing clouds/shadows. • The diurnal variability of the blue band (0.47µm) reflectance is regulated mainly by atmospheric optical conditions over a majority of land cover types. As such, the diurnal variability of the blue band data allows us to retrieve AOD without invoking the use of spectral band ratios (SRC) as in previous algorithms. • In comparison, the diurnal variability of the short-wave infrared band (2.2µm) BRFs is mainly regulated by surface reflectance and the sun-target-satellite geometry. This information allows us to test and, if suitable, retrieve surface BRDF parameters. • Spectral band ratios, especially those between the 2.2µm and 0.47µm bands, are not constant but vary by locations and sun-target-satellite geometries. Our analysis clearly demonstrates that the information provided in high-frequent geostationary observations is unique and complementary to LEO sensors. Therefore, a synergy of GEO and LEO (and other) sensors has the great potential to improve existing remote sensing models and algorithms for better Earth monitoring.

Diurnal Variability↗

NASA NTRSDate not supplied

Development of the GeoNEX Level 2G Products: Exploiting the Diurnal Variability of TOA Reflectance in Atmospheric Correction

This study develops a new atmospheric correction algorithm to generate the Level 2G products, in particular the gap-filled Surface Reflectance at 10-minute time steps, for the Geostationary-NASA Earth Exchange (GeoNEX) project. The algorithm is based on the MODIS MAIAC (Multi-Angle Implementation of Atmospheric Correction) framework but with significant modifications to exploit angular/temporal information from the diurnal variability of the GeoNEX L1G TOA (Top-of-Atmosphere) reflectance. The algorithm starts by evaluating the roughness/smoothness of the diurnal time series of the TOA reflectance. Because rapid changes in TOA reflectance are generally caused by passing clouds or shadows, rough segments of the time series are automatically filtered out while the smooth segments are further tested for brightness and temperature to identify clear-sky and snow-free observations. Next the algorithm runs the MAIAC RTM (Radiative Transfer Model) to retrieve the Ross-Thick-Li-Sparse (RTLS) BRDF model parameters and the daily-mean atmospheric optical depth (AOD) that allow the RTM to optimally simulate the observed diurnal variability of clear-sky TOA reflectance. Once the initial RTLS parameters are retrieved after the algorithm’s burn-in period, they are used as the prior information to predict the AOD level for the next days, while the subsequent clear-sky observations are used to make necessary adjustments to the RTLS parameters in an continuous fashion. This “prediction-analysis” cycle is then iterated to process the full time series of the L1G data, skipping only total-cloudy days or when surface snow is detected. We tested the algorithm over a list of selected AERONET sites. The retrieved results (the daily mean AOD and the RTLS parameters) reasonably agree with the ground-based measurements. Importantly, the results indicate that the diurnal cycles of surface reflectance are continuous functions of the illumination-view geometry. Thus we can use the retrieved RTLS model to accurately fill in data gaps on partial cloudy days. Also, our algorithm is totally independent from the traditional approaches based on the use of spectral band ratios between the shortwave infrared (e.g., 2.2µm) and the visible (e.g., 0.47µm and 0.64µm) bands. Our results thus demonstrate that the high-frequent diurnal geostationary observations contain unique information that helps us improve atmospheric correction of remote sensing data.

GeoNEX↗

NASA NTRSDate not supplied

Improving Geolocation Accuracy of the Advanced Meteorological Imager on the GEO-KOMPSAT-2A

GeoNEX is a collaborative project led by scientists from NASA and many other international institutes to generate Earth monitoring products using data streams from the latest geostationary (GEO) sensors. Its consistent processing and common gridding systems can produce research-quality data products from GEO sensors and leverage GEO-GEO or GEO-LEO (low earth orbit) synergistic uses. Currently, GeoNEX has produced and disseminated L1G (geometrically corrected Level 1 products) from GOES 16/17 ABIs and Himawari-8 AHI, but a new Korean geostationary sensor (Advanced Meteorological Imager, AMI) onboard Geo-KOMPSAT-2A covering a large proportion of Asia and all of Oceania is in development. Our recent efforts on assessing geolocation accuracy in ABI and AHI suggest a nontrivial residual exists in both level 1B data with varying spatiotemporal patterns. The findings urge us to prioritize identifying and correcting geolocation residuals of AMI to generate accurate and consistent GeoNEX top-of-atmosphere (TOA) reflectance products and following processing chains. Here we implement a phase correlation correction approach to a visible band (0.64 μm, 500 m) using landmarks prepared from finer scale digital terrain models. We characterize spatiotemporal patterns (e.g., diurnal & daily) of geolocation residuals of AMI before and after correction. We then assess stability of datasets and quantify impact of unexpected geolocation errors on terrestrial monitoring. The geolocation corrected AMI data are further compared with GeoNEX AHI L1G products which are able to create unique stereo-type observations with AMI through leveraging the similarities of spectral bands and the sun-target-sensor geometry. Further, we discuss challenges in utilizing the GEO-GEO (e.g., AMI & AHI) satellite data for potential applications.

Geostationary Satellites↗

NASA NTRSDate not supplied

GeoNEX-SUBSETS: Geostationary Satellite Observations Over International Observing Network Sites

Satellite remote sensing is crucial for monitoring the Earth’s surface and for simulating global carbon and water cycles. Subsets of satellite data from sensors such as MODIS over established observing networks have been valuable for researchers for comparing the ground observed phenomena with satellite observations. Here, we introduce new subsets of the GeoNEX geostationary satellite datasets over locations of several ground observation networks. The NASA Earth Exchange group has been generating geostationary satellite products with our international partners and universities to cover the entire globe. In comparison to polar-orbiting satellite sensors such as MODIS, the new generation geostationary satellites observe target areas at a higher frequency (5-10 minutes), which also significantly increased the data volume. To reduce the burden of downloading and extracting geostationary time series data and provide easy access to the community, we provide subsets of GeoNEX products through our data portal [www.data.nas.nasa.gov]. The ready-to-use subset follows the same format as the MODIS fixed sites subset tools for users who are familiar with MODIS subset data and software. The selected networks include Fluxnet, AERONET, and Phenocam over the conterminous US. We demonstrate the usage of the GeoNEX fixed-site subset data and showcase thir advantages with three example studies. The first example is simulating the diurnal cycle of plant ecophysiology at Fluxnet sites. The high frequency of the GeoNEX time series allows us to run ecological models at sub-hour time steps and directly compare the simulated carbon and water fluxes with half-hourly Fluxnet data. The second example uses the geostationary data to track phenological changes. It highlights the high-frequent observations of geostationary satellites in helping mask cloud covers and capture the quick responses of vegetation to environmental changes. As such, these examples demonstrate the value of ready-to-use GeoNEX subsets data in terrestrial ecophysiology research.

GeoNEX↗

NASA NTRSDate not supplied

GeoNEX-ML: A Machine Learning System for Geostationary Satellite Imagery

Improved capabilities of earth monitoring satellites are enabling a wide range of studies on the environmental effects of climate change, often leveraging the recent advancements in machine learning. At the same time, the new capabilities, including higher spatial resolution and temporal frequency, are expanding the amount of data generated at exponential rates. Further, a large majority of archived datasets generated by scientific processing is never used. This motivates the development of an efficient machine learning system for end-to-end processing of multi-level satellite datasets, from level 1 top of atmosphere observations to user friendly environmental variables of interest. Using current generation geostationary satellites GOES-16/17 (NOAA/NASA), Himawari-8/9 (JAXA), and GK-2A (Korea), we present an interchangeable set of machine models to perform spectral adjustment, physical model emulation, LEO-GEO emulation, and optical flow in a high performance computing environment. We use these tools to generate consistent virtual observations across sensors, perform atmospheric correction and cloud detection, and estimate land surface temperature and atmospheric winds. This approach aims to improve the robustness of remotely sensed data processing by learning from diverse sets of observations while enabling near real-time and on-demand capabilities.

Geostationary satellites↗

NASA NTRSDate not supplied

GeoNEX-SUBSETS: Cutouts of geostationary satellite data over long-term monitoring sites

Satellite remote sensing data are important tool for extrapolating the knowledge obtained at the Fluxnet towers. We introduce our GEO-NEX geostationary satellite subset products, which make it easy to compare between ground observation and Geo-NEX products. The MODIS subset has been frequently used for validating ecosystem models developed at flux towers and upscaling the observed flux data to regional scales. However, MODIS on the polar orbiting satellites can observe target regions only once a day, while the Fluxnet eddy-covariance data are compiled as sub-hourly datasets. As a results, summarizing the sub-hourly flux data into daily statistics is necessary for the comparison between MODIS and Flux data. Here, the new generation geostationary satellite sensors (GOES-16/17 ABI and Himawari-8/9 AHI) has the high-frequent observation feature (10 minutes) in addition to similar spectral band and spatial resolution with MODIS. The high frequent observation allows us to compare the flux diurnal cycle with geostationary satellite sensor data. Some studies have already shown the effective utilization of time series of geostationary satellite data for ecosystem modeling. We are producing NEX Level-1G products, which is the gridded Top-of-Atmosphere reflectance and brightness temperature data of geostationary satellite sensors. We cut out the NEX Level-1G data using the same file format with the MODIS subset except for the projection. The other data products (e.g., surface reflectance, land surface temperature, vegetation indices and climate data) will be also added upon their availability. We selected the ground observation sites from Fluxnet, Phenocam, and AERONET networks. The NEX subset data will be provided through NASA NEX data portal.

GeoNEX↗

NASA NTRSDate not supplied

Deep Learning System for Efficient Processing of Geostationary Satellite Imagery

Improved capabilities of Earth monitoring satellites are enabling a wide range of studies on the environmental effects of climate change, often leveraging the recent advancements in machine learning. At the same time, the new capabilities, including higher spatial resolution and temporal frequency, are expanding the amount of data generated at exponential rates. Further, a large majority of archived datasets generated by scientific processing is never used. This motivates the development of an efficient machine learning system for end-to-end processing of multi-level satellite datasets, from level 1 top of atmosphere observations to user friendly environmental variables of interest. Using current generation geostationary satellites GOES-16/17 (NOAA/NASA), and Himawari-8/9 (JAXA), we present an interchangeable set of machine models to perform spectral adjustment among sensors, physical model emulation, LEO-GEO emulation, and optical flow in a high performance computing environment. We use these tools on the NASA Earth eXchange (NEX) to generate consistent virtual observations across sensors, perform atmospheric correction and cloud detection, and estimate surface reflectance, surface temperature and atmospheric winds. This approach aims to improve the robustness of remotely sensed data processing by learning from diverse sets of observations while enabling near real-time and on-demand capabilities.

Thomas Vandal↗

NASA NTRSDate not supplied

Development of a Global Reference Surface Reflectance and BRDF Datasets from Geostationary Satellite Observations and AERONET Measurements

Surface reflectances and their dependency on illumination-view geometries (i.e., BRDF) are the foundation of many high-level satellite products for land and water monitoring. Yet it is difficult to evaluate the quality of satellite-based surface reflectances with ground-based measurements due to the spatial scale differences. In order to fill the gap, here we develop a reference dataset of surface reflectance and BRDF at the global AERONET sites with data streams from operational geostationary sensors including Himawari 8/9 AHI, GK-2A AMI, and GOES 16/17 ABI. Taking the top-of-atmosphere (TOA) reflectance and the site measured atmospheric aerosol optical depth (AOD) as the main inputs, we apply the GeoNEX-AC algorithm to performance accurate atmospheric correction and derive 10-minute surface reflectance and daily Ross-Thick-Li-Sparse (RTLS) BRDF parameters at AERONET sites where coincident AOD measurements and TOA observations are available from 2016 (for Himawari) or 2018 (for GOES) onwards. The algorithm ensures that the retrieved surface BRDF parameters, along with the site-measured AOD, allow the atmospheric radiative transfer model, SHARM, accurately simulate the observed TOA reflectance at diurnal and longer time scales. They are our best estimates of the surface optical properties and thus can serve as the “reference” to evaluate the performance of operational atmospheric correction algorithms (where AOD is assumed unknown and needs to be retrieved). The reference BRDF also allow us to evaluate the spectral band ratios between the SWIR (e.g., 2200 nm) and the visible (e.g., 650 nm) regions, which are commonly used in operational atmospheric correction algorithms. Finally, we demonstrate that the reference dataset can be used to develop potential data synergies between different GEO satellites as well as GEO-LEO sensors.

Weile Wang↗

NASA NTRSDate not supplied

Hourly Carbon Fluxes Estimation Using the GOES Advanced Baseline Imager (ABI) Data Over the Conterminous USA

Tremendous efforts by Fluxnet scientists over the past few decades have made thousands of site-years of carbon flux observations available for advancing our understanding of carbon cycling in terrestrial ecosystems. One of key Fluxnet measurements is net ecosystem exchange (NEE) as it is directly related to carbon budget of terrestrial ecosystems. However, carbon flux estimation studies using satellite remote sensing have focused mainly on daily Gross Primary Production (GPP). The satellite based carbon flux estimation used the polar orbiting satellite sensors (e.g., Moderate Resolution Imaging Spectroradiometer (MODIS)), which allow us to observe target regions only once during the day. Because daily NEE is close to zero value, the carbon flux models using the polar orbiting satellite data have not been well used for NEE estimation. The new generation of geostationary satellite sensors (e.g., GOES Advanced Baesline Imager (ABI) and Himawari Advanced Himawari Imager (AHI)) provide frequent observations, often less than every 10 minutes. Here, we use GOES ABI data to estimate hourly NEE over the conterminous USA. We used the Terrestrial Observation Prediction System (TOPS) model for estimating hourly NEE. TOPS is a diagnostic ecosystem process model that simulates the fluxes of carbon and water through vegetation in response to climate variability. For the climate input, we developed hourly climate data using the same algorithm with NASA Earth Exchange Gridded Daily Meteorology (NEX-GDM) datasets based on machine learning techniques. The hourly climate data includes precipitation, maximum temperature, minimum temperature, dew point temperature, and, in particular, solar radiation that is directly derived from the Geostationary observations. The spatial patterns of ecosystem parameters used in TOPS are optimized using satellite Solar Induced Fluorescence (SIF) data. The high frequency GPP estimations from geostationary satellite sensors make it comparable to the instantaneous SIF data than daily GPP. We also used Fluxnet data for optimization of model parameters and the validation of the output. The derived data addresses the diurnal dynamics of carbon cycling at large scales and should help in reducing the uncertainties in carbon budget studies.

Geostationary satellite↗

NASA NTRSDate not supplied

NASA Earth Exchange – Current overview of climate and wildfire-oriented works

NASA Earth Exchange (NEX) combines state-of-the-art supercomputing, Earth system modeling, and NASA remote sensing data feeds to deliver a work environment for exploring and analyzing petabyte-scale datasets covering large regions, continents, or the globe. As an accessible platform, NEX can accelerate fundamental research, develop new applications, and reduce overall project costs by providing the research community with data, software, and high-end computing power. Two research thrusts for the NEX community are developing and distributing the NEX-GDDP-CMIP6 downscaled climate dataset and the community-driven wildfire research. NEX-GDDP-CMIP6 dataset is comprised of global downscaled climate scenarios derived from the General Circulation Model (GCM) runs conducted under the Coupled Model Intercomparison Project Phase 6 (CMIP6) and across two of the four “Tier 1” greenhouse gas emissions scenarios known as Shared Socioeconomic Pathways (SSPs). The wildfire research thrust leverages geostationary and low earth orbit remote sensing platforms and advanced modeling (WRF). We present a high-level overview of the NEX community, discuss relevant datasets and show several visualization techniques of data used in the wildfire research activity.

NEX↗