Search NASA⌕ Search

Engineering topics

Zachary Fasnacht

Publications and source records attributed to Zachary Fasnacht.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2024

Noise Reduction for Solar-Induced Fluorescence Retrievals Using Machine Learning and Principal Component Analysis: Simulations and Applications to GOME-2 Satellite Retrievals

We use a spectral-based approach that employs principal component analysis along with a relatively shallow artificial neural network (NN) to substantially reduce noise and other artifacts in terrestrial chlorophyll solar-induced fluorescence (SIF) retrievals. SIF is a very small emission at red and far-red wavelengths that is difficult to measure and is highly sensitive to random errors and systematic artifacts. Our approach relies upon an assumption that a trained NN can effectively reconstruct the total SIF signal from a relatively small number of leading principal components of the satellite-observed far-red radiance spectra without using information from the trailing modes that contain most of the random errors. We test the approach with simulated reflectance spectra produced with a full atmospheric and surface radiative transfer model using different observing and geophysical parameters and various noise levels. Resulting noisy and noise-reduced retrieved SIF values are compared with true values to assess performance. We then apply our noise reduction approach to SIF derived from two different satellite spectrometers. For evaluation, since the truth in this case is unknown, we compare SIF retrievals from two independent sensors with each other. We also compare the noise-reduced SIF temporal variations with those from an independent gross primary product (GPP) product that should display similar variations. Results show that our noise reduction approach improves capture of SIF seasonal and inter-annual variability. Our approach should be applicable to many noisy data products derived from spectral measurements. Our methodology does not replace the original retrieval algorithms; rather the original noisy retrievals are needed as the target for the NN training process.

noise reduction, solar-induced fluorescence, SIF, ↗
NASA NTRS2024

Revised estimates of NO 2 reductions during the COVID-19 lockdowns using updated TROPOMI NO 2 retrievals and model simulations

The TROPOspheric Monitoring Instrument (TROPOMI) observed unprecedented declines in NO 2 vertical column densities (VCD) over the world's most densely populated cities during the 2020 COVID-19 lockdowns. These favorable changes in NO 2 air quality were correlated with sharp reductions in traffic volume and economic activity during the lockdowns. In this comprehensive global study, we provide revised estimates of the declines in anthropogenic emissions for 36 megacities using a novel methodology for disentangling the anthropogenic emissions from the meteorological transport and natural variability. We further quantify the uncertainty associated with changes in the a priori profile shape information during the lockdowns due to reduced emissions. Satellite NO 2 retrieval techniques calculate an air mass factor that requires a priori NO 2 profile shape information representative of the local atmosphere. This information, which is typically obtained from a chemical transport model (CTM), was not available for the early studies. This study also accounts for the satellite sampling errors resulting from the selective sampling of non-cloudy scenes during the study period. For our analysis, we used CTM simulations that were generated with and without COVID-impacted emissions. We perform retrievals of tropospheric NO 2 columns with the NASA NO 2 algorithm, and then use observed and simulated data to disentangle the meteorological transport from the contribution due anthropogenic emissions. We found that the meteorological transport was most significant source of variability ranging between −35% and 22% of the change total tropospheric VCD. We also find that not accounting for changes in the a priori NO 2 profile shape information during the lockdowns resulted in systematic retrieval errors that were up to 12% of the estimated decline, and the elimination of cloud contaminated scenes resulted in sampling errors that in general ranged between varied ±15%.

NO2↗
NASA NTRS2023

Use of Machine Learning and Principal Component Analysis to Retrieve Nitrogen Dioxide (NO 2 ) With Hyperspectral Imagers and Reduce Noise in Spectral Fitting

Nitrogen dioxide (NO 2 ) is an important trace-gas pollutant and climate agent whose presence also leads to spectral interference in ocean color retrievals. NO 2 column densities have been retrieved with satellite UV–Vis spectrometers such as the Ozone Monitoring Instrument (OMI) and the Tropospheric Monitoring Instrument (TROPOMI) that typically have spectral resolutions of the order of 0.5 nm or better and spatial footprints as small as 3.6 km × 5.6 km. These NO 2 observations are used to estimate emissions, monitor pollution trends, and study effects on human health. Here, we investigate whether it is possible to retrieve NO 2 amounts with lower-spectral-resolution hyperspectral imagers such as the Ocean Color Instrument (OCI) that will fly on the Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) satellite set for launch in early 2024. OCI will have a spectral resolution of 5 nm and a spatial resolution of ∼ 1 km with global coverage in 1–2 d. At this spectral resolution, small-scale spectral structure from NO 2 absorption is still present. We use real spectra from the OMI to simulate OCI spectra that are in turn used to estimate NO 2 slant column densities (SCDs) with an artificial neural network (NN) trained on target OMI retrievals. While we obtain good results with no noise added to the OCI simulated spectra, we find that the expected instrumental noise substantially degrades the OCI NO 2 retrievals. Nevertheless, the NO 2 information from OCI may be of value for ocean color retrievals. OCI retrievals can also be temporally averaged over timescales of the order of months to reduce noise and provide higher-spatial-resolution maps that may be useful for downscaling lower-spatial-resolution data provided by instruments such as OMI and TROPOMI; this downscaling could potentially enable higher-resolution emissions estimates and be useful for other applications. In addition, we show that NNs that use coefficients of leading modes of a principal component analysis of radiance spectra as inputs appear to enable noise reduction in NO 2 retrievals. Once trained, NNs can also substantially speed up NO 2 spectral fitting algorithms as applied to OMI, TROPOMI, and similar instruments that are flying or will soon fly in geostationary orbit.

NO2↗
NASA NTRS2022

Using Machine Learning for Timely Estimates of Ocean Color Information From Hyperspectral Satellite Measurements in the Presence of Clouds, Aerosols, and Sunglint

Retrievals of ocean color from space are important for better understanding of the ocean ecosystem but can be limited under conditions such as clouds, aerosols, and sunglint. Many ocean color algorithms use a few selected spectral bands to perform an atmospheric correction and then derive the upwelling radiance from the ocean. The limitations in the atmospheric correction under certain conditions lead to many gaps in daily spatial coverage of ocean color retrievals. To address these limitations, we introduce a new approach that uses machine learning to estimate ocean color from top of atmosphere radiances or reflectance measurements. In this approach, a principal component analysis is used to decompose the hyperspectral measurements into spectral features that describe the scattering and absorption of the atmosphere and the underlying surface. The coefficients of the principal components are then used to train a neural network to predict ocean color properties derived from the MODIS atmospheric correction algorithm. This machine learning approach is independent of a priori information and does not rely on any radiative transfer modeling. We apply the approach to two hyperspectral UV/VIS instruments, the ozone monitoring instrument (OMI) and the TROPOspheric Monitoring Instrument (TROPOMI), using measurements from 320–500 nm to show that it can be used to reproduce ocean color properties in less-than-ideal conditions. This machine learning approach complements the current atmospheric correction ocean color retrievals by filling in the gaps resulting from cloud, aerosol, and sunglint contamination. This method can be applied to the future hyperspectral Ocean Color Instrument (OCI), which will be onboard NASA’s Plankton, Aerosol Cloud, ocean Ecosystem (PACE) ocean color satellite set to launch in 2024.

Ocean color↗
NASA NTRS2021

Detection of Anomalies in the UV/Vis Reflectances from the Ozone Monitoring Instrument

Various instrumental or geophysical artifacts, such as saturation, stray light, or obstruction of light (either coming from the instrument or related to solar eclipses), negatively impact satellite measured ultraviolet and visible Earthshine radiance spectra and downstream retrievals of atmospheric and surface properties derived from these spectra. In addition, excessive noise such as from cosmic ray impacts, prevalent within the South Atlantic Anomaly, can also degrade satellite radiance measurements. Saturation specifically pertains to observations of very bright surfaces such as sun glint over open water or thick clouds. When saturation occurs, additional photoelectric charge generated at the saturated pixel may overflow to pixels adjacent to a saturated area and be reflected as a distorted image in the final sensor output.When these effects cannot be corrected to an acceptable level for science quality retrievals, flagging of the affected pixels is indicated. Here, we introduce a straightforward detection method that is based on the correlation, r, between the observed Earthshine radiance and solar irradiance spectraover a 10 nm-spectral range; our Decorrelation Index (DI for brevity) is simply defined as DI=1-r. DI increases with anomalous additive effects or excessive noise in either radiances, the most likely cause indata from theOzone Monitoring Instrument (OMI),or irradiances. DI is relatively straight-forward to use and interpret and can be 20computed for different wavelength intervals. We developed a set of DIs for two spectral channelsof the OMI, a hyperspectral pushbroom imaging spectrometer. For each OMI spatial measurement, we define 14 wavelength-dependent DIs within the OMI visible channel (350-498 nm) and 6 DIs in its ultraviolet 2 (UV2) channel (310-370 nm). As defined, DIs reflect a continuous range of deviations of observed spectra from the reference irradiance spectrum that are complementary to the binary Saturation Possibility Warning (SPW) flags currently provided for each individual spectral/spatial pixel in the OMI radiance data set. Smaller values of DI are also caused by a number of geophysical factors; this allows one to obtain interesting physical results on the global distribution of spectral variations.

Space sensor↗
NASA NTRSDate not supplied

GMAO Simulated Data

Updates on GMAO simulated observations for PACE OCI.

Patricia Castellanos↗
NASA NTRSDate not supplied

TROPOMI Geometry-dependent Lambertian-Equivalent surface Reflectivity (GLER) Product for Improved Trace-Gas Retrieval

Accurate information about the reflectivity of the Earth's surface is required for most satellite retrievals of atmospheric composition, and this information is generally taken from monthly surface reflectivity climatology that neglects angular dependence. Previously we introduced Geometry-dependent Lambertian-equivalent surface reflectivity (GLER) which captures solar and satellite viewing angle dependence as well as daily and seasonal changes. GLER is calculated from simulations of Rayleigh-only top-of-atmosphere (TOA) radiances over non-Lambertian surfaces. We use NASA's Moderate Resolution Imaging Spectroradiometer (MODIS) bidirectional reflectance distribution function (BRDF) product over land and the wind-dependent Cox–Munk wave-facet slope distribution including water-leaving radiance over water to accounts for surface BRDF. We have developed global GLER product, previously for the Ozone Monitoring Instrument (OMI) and recently for Sentinel-5 Precursor (S5P) TROPOspheric Monitoring Instrument (TROPOMI) with several new improvements and updates. We have implemented the near real time daily V006 MODIS MCD43C1 BRDF data and gap-filled with a daily BRDF coefficient climatology created from 2002-2017 V006 MCD43GF data. The NASA’s Global Modelling Initiative hourly 0.25 x 0.25 deg Replay simulations are used for more accurate determination of pixel specific terrain pressure. To improve detection of seasonal snow/ice scenes, we use the 4-km snow cover product from the Interactive Multi-sensor Snow and Ice Mapping System (IMS). Finally, we use an improved version of the vector linearized discrete ordinate radiative transfer (VLIDORT) for update of the top-of-atmosphere (TOA) radiance look-up-tables (LUTs). We demonstrate how the use of GLER is beneficial to TROPOMI’s high spatial resolution (up to 3.5 km x 3.5 km) measurements to monitor atmospheric trace gas pollutants down to the sub-city scale.

TROPOMI↗
NASA NTRSDate not supplied

Has NO(2) in Metropolitan Areas Returned to Pre-COVID-19 Levels as Measured by OMI Satellite Data?

Nitrogen oxides (NOx = NO + NO2) are primarily emitted through the combustion of fossil fuels, such as automobiles and power plants. NOx can contribute to chemical reactions that produce ozone and fine particulate matter (PM2.5) pollution. Using tropospheric vertical column density (TVCD) NO2 data from satellite hyperspectral instruments, such as the Ozone Monitoring Instrument (OMI) on board NASA’s EOS Aura satellite, one can monitor changes in NO2 pollution during “black-swan” events, such as mobility restrictions during COVID-19 lockdowns. Our OMI team has created the Global Nitrogen Dioxide Monitoring Home Page (https://so2.gsfc.nasa.gov/no2/no2_index.html ) where we display NO2 TVCD time series, animated maps, and COVID-specific NO2 anomalies comparing to a pre-COVID five-year average for 317 cities and regions around the world. During the pandemic as a result of the widespread lockdowns, many areas saw low NO2 anomalies superimposed on the natural weather related NO2 changes, such as seasonal NO2 cycle. Has NO2 levels returned to pre-Covid-19 levels in large metropolitan areas? We analyze NO2 time series from March through September for the years 2020-2023 using as a reference the average NO2 from 2015-2019 for those months. We will present data from selected cities that represent all countries.

Keith D Evans↗
NASA NTRSDate not supplied

How Can We Harness the Power of Machine Learning With TEMPO Data?

There are many potential applications of machine learning for TEMPO data that include - Improve retrievals by reducing the effect of random instrument noise - Expand coverage by producing data in moderately cloudy conditions (see also Fasnacht et al. poster) - Help diagnose impacts of instrumental artifacts - Produce value-added products quickly by training on existing products from other sensors (land and ocean) - Speed up processing by training on products produced with full-physics algorithms (e.g., NO 2 slant column fitting may take ~1 hour/orbit but with a neural net it may take only minutes)

NO2↗
NASA NTRSDate not supplied

Assessment of Long-term Trends in the Collection 4 Total Ozone Record from the Ozone Monitoring Instrument

Long-term changes in total ozone affect the amount of harmful UV radiation reaching Earth’s surface and reflect progress made towards recovery of stratospheric ozone. Satellite total ozone data are also used to estimate long-term trends in tropospheric ozone, a reactive and potent greenhouse gas, by subtracting the stratospheric column timeseries from that of total ozone. For these scientific applications, the long-term stability should be better than 1%. Left unchecked, instrument calibration drift can produce a trend of this magnitude or greater. NASA has produced nearly twenty years of total ozone data from the Ozone Monitoring Instrument (OMI) using the Total Ozone Mapping Spectrometer (TOMS) algorithm. The drift in the OMI instrument as monitored by ice radiance calibration has been relatively slow, but it has reached a level of ~3% over the mission lifetime. This drift was corrected in the recently released Collection 4 OMI calibrated radiances, updating the Collection 3 calibration released in 2006. We have reprocessed the OMI total ozone record using the Collection 4 calibration and updates to the TOMS algorithm. We summarize these changes and evaluate their impact by comparing to the previous Collection 3 OMI dataset, the Suomi NPP Ozone Mapping and Profiler Suite Nadir Mapper (OMPS-NM) and Solar Backscatter UV (SBUV) Merged Ozone Dataset (MOD) total ozone records and other independent satellite total ozone datasets. Climatological radiance residuals from OMI and OMPS-NM are calculated and compared to investigate differences in spectral calibration that can cause drifts in long-term total ozone trends. We also analyze the tropospheric ozone record produced using the Collection 4 OMI total ozone and stratospheric column ozone from MLS. Collection 3 OMI data processed with the TOMS algorithm show a positive drift relative to other satellite and ground-based data of 1-2 DU per decade. Initial results show that this drift is reduced in Collection 4 OMI, due to the updated OMI calibration. In this work we will quantify the improvements in Collection 4 OMI relative to independent data sources at both the ozone and radiance level

Collection 4 OMI Total Ozone↗
NASA NTRSDate not supplied

Use of TEMPO as a Proxy for Hyperspectral Geostationary Ocean Color Measurements from the GeoXO OCX Instrument: Harnessing Machine Learning and Principal Component Techniques for Atmospheric and Glint Correction

Retrievals of ocean color from space are important for better understanding the ocean ecosystem. The launch of atmospheric geostationary hyperspectral sensors such as TEMPO, provides a unique opportunity to examine the diurnal variability in ocean ecology. While TEMPO does not have as high spatial resolution or full spectral coverage as planned coastal ocean sensors such as the Geosynchronous Littoral Imaging and Monitoring Radiometer (GLIMR) or GeoXO Ocean Color instrument (OCX), its hourly measurements provide coverage of regions such as Lake Erie and the Gulf of Mexico at spatial scales of approximately 5 km. These data can be useful for testing new algorithms. We will apply our newly developed machine learning based atmospheric correction approach for ocean color retrievals to TEMPO data. Our approach begins by decomposing measured radiances from hyperspectral sensors into spectral features that describe the scattering and absorption of the atmosphere as well as the underlying surface reflectance. The coefficients of the principal components are then used to train a neural network to predict ocean color properties derived from collocated MODIS/VIIRS physically-based retrievals. This machine learning approach does not rely on radiative transfer modeling, and the use of MODIS/VIIRS data for training accounts for possible calibration b in hyperspectral data. Previously, we applied our approach using blue and UV wavelengths with the Ozone Monitoring Instrument (OMI) and TROPOspheric Monitoring Instrument (TROPOMI) to show that it can estimate ocean color properties in less-than-ideal conditions such as lightly to moderately clouded conditions as well as sun glint and thus improve the spatial coverage of ocean color measurements. TEMPO provides an opportunity to improve on this approach since it will provide collocated measurements at green and red wavelengths that were not available from OMI and TROPOMI and are important particularly for coastal waters. Additionally, our technique can be applied early in the mission and has potential to demonstrate the value of near real time ocean color products that are important for monitoring of harmful algae blooms and other oceanic phenomena.

Zachary Fasnacht↗
NASA NTRSDate not supplied

Principal Component and Machine Learning Approach to Gap Fill Hyperspectral Ocean Color Satellite Retrievals

Retrievals of ocean color properties from space are important for monitoring the health of the ocean ecosystem but such retrievals can be limited spatially due to conditions such as clouds, aerosols, and sun glint. Gap filling of ocean color retrievals is typically performed by combining retrievals from multiple satellites or temporally averaging multiple days of retrievals. Despite these techniques large gaps still exist posing challenges for near real time monitoring of events like harmful algae blooms. To address these limitations, we developed a spatial gap filling approach applying machine learning approach to hyperspectral instruments to learn how to perform an atmospheric correction under challenging retrieval conditions. In this approach a principal component analysis is used to decompose the hyperspectral measurements into spectral components that describe the scattering and absorption of the atmosphere mixed with the surface spectral signatures. The coefficients of the principal components are used to train a neural network to predict ocean color properties derived from a standard MODIS ocean color algorithm. We apply the approach to two hyperspectral UV/VIS sensors, the Ozone Monitoring Instrument (OMI) and TROPOspheric Monitoring Instrument (TROPOMI) to show that it can be used to estimate ocean color properties such as chlorophyll, remote sensing reflectance, and fluorescence line height. This method could be used as a gap-filling technique for the future Ocean Color Instrument (OCI) onboard upcoming NASA's Plankton, Aerosol Cloud, ocean Ecosystem (PACE) satellite to provide additional information for monitoring the health of our global oceans. Additionally, it could be applied to the first NASA and Smithsonian geostationary Tropospheric Emissions: Monitoring of Pollution (TEMPO) spectrometer to better understand diurnal variability in inland and coastal ocean ecology.

Zachary Fasnacht↗
NASA NTRSDate not supplied

A Principal Component and Machine Learning Approach to Spatially Gap Fill Hyperspectral Ocean Color Satellite Retrievals

Retrievals of ocean color properties from space are important for monitoring the health of the ocean ecosystem but such retrievals tend to be limited in spatial coverage due to conditions such as clouds, aerosols, and sun glint. Gap filling of ocean color retrievals is typically performed by combining retrievals from multiple satellites or temporally averaging multiple days of retrievals but despite these techniques large gaps still exist posing challenges for near real time monitoring of events like harmful algae blooms. To address these limitations, we propose a spatial gap filling approach using machine learning to learn how to perform an atmospheric correction under challenging retrieval conditions. In this approach a principal component analysis is used to decompose the hyperspectral measurements into spectral features that describe the scattering and absorption of the atmosphere as well as the underlying surface. The coefficients of the principal components are then used to train a neural network to predict ocean color properties derived from a standard ocean color algorithm such as the MODIS atmospheric correction algorithm. This machine learning approach is independent of a priori information and does not rely on any radiative transfer modeling. We apply the approach to two hyperspectral UV/VIS instruments, the Ozone Monitoring Instrument (OMI) and TROPOspheric Monitoring Instrument (TROPOMI) to show that it can be used to estimate ocean color properties such as chlorophyll, remote sensing reflectance, and fluorescence line height. This method could be used as a gap-filling technique for the future Ocean Color Instrument (OCI) which will be onboard NASA's Plankton, Aerosol Cloud, ocean Ecosystem (PACE) ocean color satellite to provide additional information for monitoring the health of our global oceans. Additionally, it could be applied to the geostationary satellite Tropospheric Emissions: Monitoring of Pollution (TEMPO) to better understand diurnal variability in ocean ecology.

MODIS atmospheric correction algorithm↗