Search NASA⌕ Search

Engineering topics

Andrew M Sayer

Publications and source records attributed to Andrew M Sayer.

3D Cloud Masking Across A Broad Swath Using Multi-Angle Polarimetry and Deep Learning

Understanding the 3-dimensional structure of clouds is of crucial importance to modeling our changing climate. Active sensors, such as radar and lidar, provide accurate vertical cloud profiles, but are mostly restricted to along-track sampling. Passive sensors can capture a wide swath, but struggle to see beneath cloud tops. In essence, both types of products are restricted to two dimensions: as a cross-section in the active case, and an image in the passive case. However, multi-angle sensor configurations contain implicit information about 3D structure, due to parallax and atmospheric path differences. Extracting that implicit information can be challenging, requiring computationally expensive radiative transfer techniques. Machine learning, as an alternative, may be able to capture some of the complexity of a full 3D radiative transfer solution with significantly less computational expense. In this work, we make three contributions towards understanding 3D cloud structure from multi-angle polarimetry. First, we introduce a large-scale, publicly available dataset that fuses existing cloud products into a format more amenable to machine learning. This dataset treats multi-angle polarimetry as an input, and radar-based vertical cloud profiles as an output. Second, we describe and evaluate strong baseline machine learning models based that predict these profiles from the passive imagery. Notably, these models are trained only on center-swath labels, but can predict cloud profiles over the entire passive imagery swath. Third, we leverage the information-theoretic nature of machine learning to draw conclusions about the relative utility of various sensor configurations, including spectral channels, viewing angles, and polarimetry. These findings have implications for Earth-observing missions such as NASA’s Plankton, Aerosol, Cloud-ocean Ecosystem (PACE) and Atmosphere Observing System (AOS) missions, as well as in informing future applications of computer vision to atmospheric remote sensing.

clouds↗

VIIRS Version 2 Deep Blue Aerosol Products

NASA's Deep Blue aerosol project has developed global aerosol data records using consistent retrieval algorithms applied to various satellite sensors. The primary components of these data records are derived from the series of Visible Infrared Imaging Radiometer Suite (VIIRS) aboard the Suomi National Polar-orbiting Partnership (SNPP) and the National Oceanic and Atmospheric Administration or NOAA-20+ satellites as well as the Moderate Resolution Imaging Spectroradiometer (MODIS), among others. These instruments provide over 23 years of measurements with similar radiometric characteristics for aerosol retrievals. The algorithms used for the initial Version 1 SNPP VIIRS data set were based on the MODIS Collection 6.1 Deep Blue algorithm over land and Satellite Ocean Aerosol Retrieval (SOAR) algorithm over water. For VIIRS Version 2 data reprocessing, major updates have been made to the algorithm suite, including better accounting for effects of surface pressure, improved determination of surface reflectance, and the inclusion of fine-mode aerosol optical models to better represent anthropogenic aerosols over land. Cross-calibration gain factors are derived for the NOAA-20 VIIRS measurements to be consistent with the SNPP VIIRS, which allows the use of a unified algorithm package for both instruments. Comparisons against AERONET observations indicate that the Version 2 AOD data from SNPP VIIRS are significantly better than the Version 1 counterpart over land and slightly degraded over water in exchange for better spatial coverage. The AOD data from SNPP and NOAA-20 VIIRS are comparable, indicating that cross-calibration enables the creation of consistent aerosol data records using the series of VIIRS sensors.

Deep Blue↗

PACE Technical Report Series, Volume 11: The PACE Postlaunch Airborne eXperiment (PACE-PAX)

The Plankton, Aerosol, Cloud, ocean Ecosystem (PACE; https://pace.gsfc.nasa.gov) mission is NASA's latest and greatest effort to study the ocean-atmosphere system and build upon the legacy of previous satellite missions that have revolutionized our understanding of our home planet. By using advanced radiometric and polarimetric instruments to measure ocean color and key atmospheric variables, PACE aims to provide new insights into the complex interactions between the ocean, atmosphere, and biosphere. This information will be critical for improving our ability to model and predict changes in the Earth's climate, as well as to manage and conserve our planet's valuable natural resources. Performance assessments and science data product validation is a critical process for any Earth Science space-borne mission, as it involves assessing and verifying the quality of the data products generated by the mission while it is in orbit, as well as assigning uncertainties to these retrievals. More specifically, validation efforts are essential for assessing the accuracy of instrument data and the derived science products across varied spatial and temporal scales and ensuring their reliability and consistency with the mission's scientific goals and objectives. The overall plan for validation of PACE data is described in “PACE Science Data Product Validation Plan” (see, e.g., https://pace.gsfc.nasa.gov), and among range of post-launch activities, it describes the need and requirements for a post-launch airborne field campaign in support of PACE validation. This volume outlines the plans and requirements of the PACE Postlaunch Airborne eXperiment (PACE-PAX). The main goal of PACE-PAX is to gather validation and assessment data for the PACE mission, using a variety of airborne and ground-based assets. These assets will be coordinated to obtain complementary measurements of key ocean and atmospheric variables, such as ocean color, aerosols, and clouds. By collecting data from multiple sources, PACE-PAX will help to validate and refine the data products generated by the PACE mission, as well as to identify any potential errors or biases in the measurements. This will be essential for ensuring the accuracy and reliability of the PACE data products, and for maximizing the scientific value of the mission.

Kirk D Knobelspiesse↗

Adaptive Data Screening for Multi-Angle Polarimetric Aerosol and Ocean Color Remote Sensing Accelerated by Automatic Differentiation

Remote sensing measurements from multi-angle polarimeters (MAPs) contain rich aerosol microphysical property information, and these sensors have been used to perform retrievals in optically complex atmosphere and ocean systems. Previous studies have concluded that, generally, five moderately separated viewing angles in each spectral band provide sufficient accuracy for aerosol property retrievals, with performance gradually saturating as angles are added above that threshold. The Hyper-Angular Rainbow Polarimeter (HARP) instruments provide high angular sampling with a total of 90-120 unique angles across four bands, a capability developed mainly for liquid cloud retrievals. In practice, not all view angles are optimal for aerosol retrievals due to impacts of clouds, sun glint, and other impediments. The many viewing angles of HARP can provide resilience to these effects, if the impacted views are screened from the dataset, as the remaining views may be sufficient for successful analysis. In this study, we discuss how the number of available viewing angles impacts aerosol and ocean color retrieval uncertainties, as applied to two versions of the HARP instrument. AirHARP is an airborne prototype that was deployed in the ACEPOL field campaign, while HARP2 is an instrument in development for the upcoming NASA Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission. Based on synthetic data, we find that a total of 20-30 angles across all bands (i.e. five to eight viewing angles per band) are sufficient to achieve good retrieval performance. Following from this result, we develop an adaptive multi-angle polarimetric data screening (MAPDS) approach to evaluate data quality by comparing measurements with their best-fitted forward model. The FastMAPOL retrieval algorithm is used to retrieve scene geophysical values, by matching an efficient, deep learning-based, radiative transfer emulator to observations. The data screening method effectively identifies and removes viewing angles affected by thin cirrus clouds and other anomalies, improving retrieval performance. This was tested with AirHARP data, and we found agreement with the High Spectral Resolution Lidar-2 (HSRL-2) aerosol data. The data screening approach can be applied to modern satellite remote sensing missions, such as PACE, where a large amount of multi-angle, hyperspectral, polarimetric measurements will be collected.

multi-angle polarimeter↗

Global Estimates and Long-Term Trends of Fine Particulate Matter Concentrations (1998-2018)

Exposure to outdoor fine particulate matter (PM2.5) is a leading risk factor for mortality. We develop global estimates of annual PM2.5 concentrations and trends for 1998–2018 using advances in satellite observations, chemical transport modeling, and ground-based monitoring. Aerosol optical depths (AODs) from advanced satellite products including finer resolution, increased global coverage, and improved long-term stability are combined and related to surface PM2.5 concentrations using geophysical relationships between surface PM2.5 and AOD simulated by the GEOS-Chem chemical transport model with updated algorithms. The resultant annual mean geophysical PM2.5 estimates are highly consistent with globally distributed ground monitors (R2 = 0.81; slope = 0.90). Geographically weighted regression is applied to the geophysical PM2.5 estimates to predict and account for the residual bias with PM2.5 monitors, yielding even higher cross validated agreement (R2 = 0.90–0.92; slope = 0.90–0.97) with ground monitors and improved agreement compared to all earlier global estimates. The consistent long-term satellite AOD and simulation enable trend assessment over a 21 year period, identifying significant trends for eastern North America (−0.28 ± 0.03 μg/m3/yr), Europe (−0.15 ± 0.03 μg/m3/yr), India (1.13 ± 0.15 μg/m3/yr), and globally (0.04 ± 0.02 μg/m3/yr). The positive trend (2.44 ± 0.44 μg/m3/yr) for India over 2005–2013 and the negative trend (−3.37 ± 0.38 μg/m3/yr) for China over 2011–2018 are remarkable, with implications for the health of billions of people.

Melanie S. Hammer↗

Aerosol Layer Height with Enhanced Spectral Coverage Achieved by Synergy between VIIRS and OMPS-NM Measurements

This letter presents a near production-ready algorithm to retrieve the height of biomass burning smoke and mineral dust aerosols as part of National Aeronautics and Space Administration (NASA)’s Deep Blue aerosol data product suite. It utilizes the enhanced spectral coverage achieved by using colocated data from the Visible Infrared Imaging Radiometer Suite (VIIRS) and the Ozone Mapping and Profiler Suite Nadir Mapper (OMPS-NM), both aboard the Suomi National Polar-orbiting Partnership (S-NPP) satellite. In particular, the 412-nm top-of-atmosphere (TOA) reflectance from VIIRS and the ultraviolet aerosol index from OMPS-NM are used to determine the height and single-scattering albedo of the absorbing aerosols simultaneously. Constraints on aerosol optical depth at 550 nm and surface reflectance for the 412-nm band are provided by the operational VIIRS Deep Blue aerosol product. Wildfire smoke layer heights obtained from the algorithm over North America, where smoke plumes often stretched thousands of kilometers, are shown to agree with those from Cloud–Aerosol Lidar with Orthogonal Polarization (CALIOP) measurements, with an uncertainty generally within 1–1.5 km. This new height data set will be included in the upcoming Version 2 VIIRS Deep Blue aerosol product.

aerosol↗

Aerosol Layer Height With Enhanced Spectral Coverage Achieved by Synergy Between VIIRS and OMPS-NM Measurements

This study presents a near production-ready algorithm to retrieve the height of biomass burning smoke and mineral dust aerosols as part of NASA’s Deep Blue aerosol data product suite. It utilizes the enhanced spectral coverage achieved by using co-located data from the Visible Infrared Imaging Radiometer Suite (VIIRS) and the Ozone Mapping and Profiler Suite Nadir Mapper (OMPS-NM), both aboard the Suomi National Polar-orbiting Partnership (S-NPP) satellite. Specifically, the 412 nm top-of-atmosphere reflectance from VIIRS and the ultraviolet aerosol index from OMPS-NM are used to determine the height and single-scattering albedo of the absorbing aerosols simultaneously. Constraints on aerosol optical depth at 550 nm and surface reflectance for the 412 nm band are provided by the operational VIIRS Deep Blue aerosol product. Wildfire smoke layer heights obtained from the algorithm over North America, where smoke plumes often stretched thousands of kilometers, are shown to agree with those from Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) measurements, with an uncertainty generally within 1-1.5 km. This new height data set will be included in the upcoming Version 2 VIIRS Deep Blue aerosol product.

Aerosol↗

Validation of Modis Cloud Liquid Water Path to Prepare for Pace Evaluation Efforts

The Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission will launch in January 2024, extending and improving NASA’s global satellite observations in its eponymous domains. PACE’s hyperspectral Ocean Color Instrument (OCI) will offer daily near-global spatial coverage with a 1.2 km horizontal pixel size at the subsatellite point. PACE will also have two multi-angle polarimeters (HARP2 and SPEXone) capable of advanced atmospheric characterization. Validation of cloud retrievals is challenging. Here we evaluate liquid water path (LWP) from MODIS from the standard (MOD06) product. The same cloud optical properties retrieval algorithm will be applied to OCI data. This will allow us to understand the expected performance of this algorithm and to develop the processing and analysis code needed to evaluate PACE data. Please tell us what you think and if we should be doing something differently!

MODIS↗

ARM Data as A Resource for Validation of NASA PACE Cloud Retrievals

NASA’s Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission will launch in January 2024 and continue and improve upon satellite data records in its eponymous domains. PACE will carry a broad-swath hyperspectral imager, OCI, which will provide MODIS/VIIRS-type cloud data products (i.e. a cloud mask, top height, visible optical thickness, droplet effective radius, phase, and derived water path). It will also carry two multi-angle polarimeters (HARP2 and SPEXone) which will not only provide the above but also enable retrievals of additional cloud properties (e.g. droplet effective variance, ice crystal asymmetry parameter). Validating satellite-based cloud retrievals is challenging. We plan to use several ARM data streams to evaluate PACE cloud data products and are prototyping our analyses using retrievals from MODIS on the Aqua satellite and OLCI on the Sentinel-3A satellite. This poster shows how we plan to use ARM data to evaluate liquid water path (via MWRRET) and cloud top height retrievals (via KARZASRCL), with example results from these proxy sensors and ARM data from the SGP, ENA, and NSA sites. We seek comments from and collaborations with the ARM community to get the most out of our respective data streams.

ARM↗