GeoNEX-ML: A Machine Learning System for Earth Observations

Thomas Vandal

NASA NTRS · 20210024983

GeoNEX-ML: A Machine Learning System for Earth Observations

Abstract

Improved capabilities of earth monitoring satellites are enabling a wide range of studies on the environmental effects of climate change, often leveraging the recent advancements in machine learning. At the same time, the new capabilities, including higher spatial resolution and temporal frequency, are expanding the amount of data generated at exponential rates. At the NASA Earth eXchange (NEX), we build deep learning methods to learn from cross sensor satellite-based Earth observations for generating new datasets with efficient processing techniques. Using current generation geostationary satellites on NEX, we present an interchangeable set of machine models to perform spectral adjustment, physical model emulation, LEO-GEO emulation, and optical flow. These tools are used to generate consistent virtual observations across sensors, perform atmospheric correction and cloud detection, and estimate land surface temperature and atmospheric winds. This approach aims to improve the robustness of remotely sensed data processing by learning from diverse sets of observations while enabling near real-time and on-demand capabilities.

Explore related subjects

Geostationary machine learning LEO-GEO emulation

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Thomas Vandal. GeoNEX-ML: A Machine Learning System for Earth Observations. https://ntrs.nasa.gov/citations/20210024983

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

NASA NTRS2018

Geonex: A NASA-NOAA Collaboration for Producing Land Surface Products from Geostationary Sensors Using Cloud Computing

The latest generation of geostationary satellites carry sensors such as the Advanced Baseline Imager (GOES-16/17) and the Advanced Himawari Imager (Himawari-8/9) that closely mimic the spatial and spectral characteristics of MODIS and VIIRS, useful for monitoring land surface conditions. The NASA Earth Exchange (NEX) team at Ames Research Center has embarked on a collaborative effort among scientists from NASA and NOAA exploring the feasibility of producing operational land surface products similar to those from MODIS/VIIRS. The team built a processing pipeline called GEONEX that is capable of converting raw geostationary data into routine products of Fires, surface reflectances, vegetation indices, LAI/FPAR, ET and GPP/NPP using algorithms adapted from both NASA/EOS and NOAA/GOES-R programs. The GEONEX pipeline has been deployed on Amazon Web Services cloud platform and it currently leverages near-realtime geostationary data hosted in AWS public datasets under a NOAA-AWS agreement.Initial analyses of various products from ABI/AHI sensors suggest that they are comparable to those from MODIS in representing the spatio-temporal dynamics of land conditions. Cloud computing offers a variety of options for deploying the GEONEX pipeline including choice CPUs, storage media, and automation. We estimate the cost of deploying GEONEX to be $400 - 750 a month for processing data (every 30 minutes) and producing products over the conterminous US. For products such as Fire, latency can be as little as 10 minutes from the time of data acquisition.

Geostationary↗

NASA NTRS2018

The Dawn of Geostationary Air Quality Monitoring: Case Studies from Seoul and Los Angeles

With the near-future launch of geostationary pollution monitoring satellite instruments over North America, East Asia, and Europe, the air quality community is preparing for an integrated global atmospheric composition observing system at unprecedented spatial and temporal resolutions. One of the ways that NASA has supported this community preparation is through demonstration of future space-borne capabilities using the Geostationary Trace gas and Aerosol Sensor Optimization (GeoTASO) airborne instrument. This paper integrates repeated high-resolution maps from GeoTASO, ground-based Pandora spectrometers, and low Earth orbit measurements from the Ozone Mapping and Profiler Suite (OMPS), for case studies over two metropolitan areas: Seoul, South Korea on June 9, 2016 and Los Angeles, California on June 27, 2017. This dataset provides a unique opportunity to illustrate how geostationary air quality monitoring platforms and ground-based remote sensing networks will close the current spatiotemporal observation gap. GeoTASO observes large differences in diurnal behavior between these urban areas, with NO2 accumulating within the Seoul Metropolitan Area through the day but NO2 peaking in the morning and decreasing throughout the afternoon in the Los Angeles Basin. In both areas, the earliest morning maps exhibit spatial patterns similar to emission source areas (e.g., urbanized valleys, roadways, major airports). These spatial patterns change later in the day due to boundary layer dynamics, horizontal transport, and chemistry. The nominal resolution of GeoTASO is finer than will be obtained from geostationary platforms, but when NO2 data over Los Angeles are up-scaled to the expected resolution of TEMPO, spatial features discussed are conserved. Pandora instruments installed in both metropolitan areas capture the diurnal patterns observed by GeoTASO, continuously and over longer time periods, and will play a critical role in validation of the next generation of satellite measurement. These case studies demonstrate that different regions can have diverse diurnal patterns and that day-to-day variability due to meteorology or anthropogenic patterns such as weekday/weekend variations in emissions is large. Low Earth orbit measurements, despite their inability to capture the diurnal patterns at fine spatial resolution, will be essential for intercalibrating the geostationary radiances and cross-validating the geostationary retrievals in an integrated global observing system.

Geostationary↗

NASA NTRSDate not supplied

Towards Physics Guided Optical Flow for Tracking Atmospheric Motion

Observations of atmospheric 3D winds are critical for improving short-range and long-range forecasting. Such advancement in forecasting directly applies to research in a number of areas including convective processes, wildfire plumes and tornado prediction. Atmospheric Motion Vectors (AMVs) provide a passively sensed approach to quantifying horizontal motion and cloud heights, which are typically sourced from geostationary sensors due to the availability of high frequency observations. Recent work has shown that estimating AMVs by tracking individual pixels with dense optical flow is a promising new direction. In this work, we compare state-of-the-art convolutional neural networks for optical flow in a physics-guided deep learning framework for predicting AMVs. The approach is semi-supervised and uses physically informed wind vectors from high-resolution numerical simulations for supervised learning followed by fine-tuning though warping and reconstruction of full-disk geostationary images (GOES-16). In the vertical direction, we use labels from the CALIPSO low-earth orbit satellite to predict cloud height from 16-band geostationary images with a neural network. We present results for both tasks on held-out time periods and secondary datasets.

Geostationary↗