Search NASA⌕ Search

Engineering topics

David Haffner

Publications and source records attributed to David Haffner.

13 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2022

Ozone Monitoring Instrument (OMI) collection 4: establishing a 17-year-long series of detrended level-1b data

The Ozone Monitoring Instrument (OMI) was launched on 15 July 2004, with an expected mission lifetime of 5 years. After more than 17 years in orbit the instrument is still functioning satisfactorily and in principle can continue doing so until the expected decommissioning of its platform Aura in 2025. In order to continue the datasets acquired by OMI and the Microwave Limb Sounder, the mission was extended up to at least 2023. Actions have been taken to ensure the proper functioning of the OMI operations, the data processing, and the calibration monitoring system until the eventual end of the mission. For the data processing a new level-0 (L0) to level-1b (L1b) data processor was built based on the recent developments for the TROPOspheric Monitoring Instrument (TROPOMI). With corrections for the degradation of the instrument now included, it is feasible to generate a new data collection to supersede the current collection-3 data products and reprocess the data of the entire mission up to now. This paper describes the differences between the collection-3 and collection-4 data. It will be shown that the collection-4 L1b data comprise a clear improvement with respect to the previous collections. By correcting for the gentle optical and electronic aging that has occurred over the past 17 years, OMI’s ability to make trend-quality ozone measurements has further improved.

UV↗
NASA NTRS2022

Using Machine Learning for Timely Estimates of Ocean Color Information From Hyperspectral Satellite Measurements in the Presence of Clouds, Aerosols, and Sunglint

Retrievals of ocean color from space are important for better understanding of the ocean ecosystem but can be limited under conditions such as clouds, aerosols, and sunglint. Many ocean color algorithms use a few selected spectral bands to perform an atmospheric correction and then derive the upwelling radiance from the ocean. The limitations in the atmospheric correction under certain conditions lead to many gaps in daily spatial coverage of ocean color retrievals. To address these limitations, we introduce a new approach that uses machine learning to estimate ocean color from top of atmosphere radiances or reflectance measurements. In this approach, a principal component analysis is used to decompose the hyperspectral measurements into spectral features that describe the scattering and absorption of the atmosphere and the underlying surface. The coefficients of the principal components are then used to train a neural network to predict ocean color properties derived from the MODIS atmospheric correction algorithm. This machine learning approach is independent of a priori information and does not rely on any radiative transfer modeling. We apply the approach to two hyperspectral UV/VIS instruments, the ozone monitoring instrument (OMI) and the TROPOspheric Monitoring Instrument (TROPOMI), using measurements from 320–500 nm to show that it can be used to reproduce ocean color properties in less-than-ideal conditions. This machine learning approach complements the current atmospheric correction ocean color retrievals by filling in the gaps resulting from cloud, aerosol, and sunglint contamination. This method can be applied to the future hyperspectral Ocean Color Instrument (OCI), which will be onboard NASA’s Plankton, Aerosol Cloud, ocean Ecosystem (PACE) ocean color satellite set to launch in 2024.

Ocean color↗
NASA NTRS2021

Detection of Anomalies in the UV/Vis Reflectances from the Ozone Monitoring Instrument

Various instrumental or geophysical artifacts, such as saturation, stray light, or obstruction of light (either coming from the instrument or related to solar eclipses), negatively impact satellite measured ultraviolet and visible Earthshine radiance spectra and downstream retrievals of atmospheric and surface properties derived from these spectra. In addition, excessive noise such as from cosmic ray impacts, prevalent within the South Atlantic Anomaly, can also degrade satellite radiance measurements. Saturation specifically pertains to observations of very bright surfaces such as sun glint over open water or thick clouds. When saturation occurs, additional photoelectric charge generated at the saturated pixel may overflow to pixels adjacent to a saturated area and be reflected as a distorted image in the final sensor output.When these effects cannot be corrected to an acceptable level for science quality retrievals, flagging of the affected pixels is indicated. Here, we introduce a straightforward detection method that is based on the correlation, r, between the observed Earthshine radiance and solar irradiance spectraover a 10 nm-spectral range; our Decorrelation Index (DI for brevity) is simply defined as DI=1-r. DI increases with anomalous additive effects or excessive noise in either radiances, the most likely cause indata from theOzone Monitoring Instrument (OMI),or irradiances. DI is relatively straight-forward to use and interpret and can be 20computed for different wavelength intervals. We developed a set of DIs for two spectral channelsof the OMI, a hyperspectral pushbroom imaging spectrometer. For each OMI spatial measurement, we define 14 wavelength-dependent DIs within the OMI visible channel (350-498 nm) and 6 DIs in its ultraviolet 2 (UV2) channel (310-370 nm). As defined, DIs reflect a continuous range of deviations of observed spectra from the reference irradiance spectrum that are complementary to the binary Saturation Possibility Warning (SPW) flags currently provided for each individual spectral/spatial pixel in the OMI radiance data set. Smaller values of DI are also caused by a number of geophysical factors; this allows one to obtain interesting physical results on the global distribution of spectral variations.

Space sensor↗
NASA NTRSDate not supplied

TROPOMI Geometry-dependent Lambertian-Equivalent surface Reflectivity (GLER) Product for Improved Trace-Gas Retrieval

Accurate information about the reflectivity of the Earth's surface is required for most satellite retrievals of atmospheric composition, and this information is generally taken from monthly surface reflectivity climatology that neglects angular dependence. Previously we introduced Geometry-dependent Lambertian-equivalent surface reflectivity (GLER) which captures solar and satellite viewing angle dependence as well as daily and seasonal changes. GLER is calculated from simulations of Rayleigh-only top-of-atmosphere (TOA) radiances over non-Lambertian surfaces. We use NASA's Moderate Resolution Imaging Spectroradiometer (MODIS) bidirectional reflectance distribution function (BRDF) product over land and the wind-dependent Cox–Munk wave-facet slope distribution including water-leaving radiance over water to accounts for surface BRDF. We have developed global GLER product, previously for the Ozone Monitoring Instrument (OMI) and recently for Sentinel-5 Precursor (S5P) TROPOspheric Monitoring Instrument (TROPOMI) with several new improvements and updates. We have implemented the near real time daily V006 MODIS MCD43C1 BRDF data and gap-filled with a daily BRDF coefficient climatology created from 2002-2017 V006 MCD43GF data. The NASA’s Global Modelling Initiative hourly 0.25 x 0.25 deg Replay simulations are used for more accurate determination of pixel specific terrain pressure. To improve detection of seasonal snow/ice scenes, we use the 4-km snow cover product from the Interactive Multi-sensor Snow and Ice Mapping System (IMS). Finally, we use an improved version of the vector linearized discrete ordinate radiative transfer (VLIDORT) for update of the top-of-atmosphere (TOA) radiance look-up-tables (LUTs). We demonstrate how the use of GLER is beneficial to TROPOMI’s high spatial resolution (up to 3.5 km x 3.5 km) measurements to monitor atmospheric trace gas pollutants down to the sub-city scale.

TROPOMI↗
NASA NTRSDate not supplied

Verification of TROPOMI NO2 Product Using OMI NO2 algorithm

We evaluated S5P TROPOspheric Monitoring Instrument (TROPOMI) operational nitrogen dioxide (NO2) product by comparing with the NO2 retrievals from Ozone Monitoring Instrument (OMI) onboard NASA’s Aura satellite. We compared spatially matched NO2 vertical column density (VCD) data from OMI and TROPOMI to identify any discrepancies between the two operational products. We also applied OMI Air-Mass Factor (AMF) algorithm to TROPOMI Slant Column Density (SCD) data (v02.03.01) aiming to create long-term merged NO2 Earth Science Data Record (https://disc.gsfc.nasa.gov/datasets/TROPOMI_MINDS_NO2_1.1/summary ). The algorithm (version 4.0) uses new Geometry-dependent Lambertian Equivalent surface Reflectivity (GLER) product available for each TROPOMI pixel. GLER is pre-calculated using the vector linearized discrete ordinate radiative transfer (VLIDORT) model, which uses as input high-resolution bidirectional reflectance distribution function (BRDF) information from NASA's Aqua Moderate Resolution Imaging Spectroradiometer (MODIS) over land and the wind-dependent Cox–Munk wave-facet slope distribution over water, the latter with a contribution from the water-leaving radiance based on MODIS gap-filled in-water chlorophyll-a data. The GLER data, combined with consistently retrieved cloud parameters, provide improved information for the calculation of the scattering weight profiles. Additional AMF improvements result from using high resolution (0.25o latitude x 0.25o longitude) a priori NO2 profile shapes and other auxiliary information from the Global Modeling Initiative (GMI) Replay simulation sampled using S5P orbital simulator. Our TROPOMI_MINDS_NO2 algorithm employs the stratosphere-troposphere separation scheme, de-striping, and surface snow/ice treatment consistently with the latest OMI NO2 re-processing (version 4). We evaluate the TROPOMI_MINDS_NO2 product by comparing with the S5P operational NO2 product as well as with independent NO2 observations from ground-based Pandora and aircraft observations. Our results indicate that the new TROPOMI_MINDS_NO2 retrievals are generally higher than the S5P operational NO2 product over polluted regions and show improved agreement with independent validation data.

TROPOMI↗
NASA NTRSDate not supplied

Use of TEMPO as a Proxy for Hyperspectral Geostationary Ocean Color Measurements from the GeoXO OCX Instrument: Harnessing Machine Learning and Principal Component Techniques for Atmospheric and Glint Correction

Retrievals of ocean color from space are important for better understanding the ocean ecosystem. The launch of atmospheric geostationary hyperspectral sensors such as TEMPO, provides a unique opportunity to examine the diurnal variability in ocean ecology. While TEMPO does not have as high spatial resolution or full spectral coverage as planned coastal ocean sensors such as the Geosynchronous Littoral Imaging and Monitoring Radiometer (GLIMR) or GeoXO Ocean Color instrument (OCX), its hourly measurements provide coverage of regions such as Lake Erie and the Gulf of Mexico at spatial scales of approximately 5 km. These data can be useful for testing new algorithms. We will apply our newly developed machine learning based atmospheric correction approach for ocean color retrievals to TEMPO data. Our approach begins by decomposing measured radiances from hyperspectral sensors into spectral features that describe the scattering and absorption of the atmosphere as well as the underlying surface reflectance. The coefficients of the principal components are then used to train a neural network to predict ocean color properties derived from collocated MODIS/VIIRS physically-based retrievals. This machine learning approach does not rely on radiative transfer modeling, and the use of MODIS/VIIRS data for training accounts for possible calibration b in hyperspectral data. Previously, we applied our approach using blue and UV wavelengths with the Ozone Monitoring Instrument (OMI) and TROPOspheric Monitoring Instrument (TROPOMI) to show that it can estimate ocean color properties in less-than-ideal conditions such as lightly to moderately clouded conditions as well as sun glint and thus improve the spatial coverage of ocean color measurements. TEMPO provides an opportunity to improve on this approach since it will provide collocated measurements at green and red wavelengths that were not available from OMI and TROPOMI and are important particularly for coastal waters. Additionally, our technique can be applied early in the mission and has potential to demonstrate the value of near real time ocean color products that are important for monitoring of harmful algae blooms and other oceanic phenomena.

Zachary Fasnacht↗
NASA NTRSDate not supplied

Principal Component and Machine Learning Approach to Gap Fill Hyperspectral Ocean Color Satellite Retrievals

Retrievals of ocean color properties from space are important for monitoring the health of the ocean ecosystem but such retrievals can be limited spatially due to conditions such as clouds, aerosols, and sun glint. Gap filling of ocean color retrievals is typically performed by combining retrievals from multiple satellites or temporally averaging multiple days of retrievals. Despite these techniques large gaps still exist posing challenges for near real time monitoring of events like harmful algae blooms. To address these limitations, we developed a spatial gap filling approach applying machine learning approach to hyperspectral instruments to learn how to perform an atmospheric correction under challenging retrieval conditions. In this approach a principal component analysis is used to decompose the hyperspectral measurements into spectral components that describe the scattering and absorption of the atmosphere mixed with the surface spectral signatures. The coefficients of the principal components are used to train a neural network to predict ocean color properties derived from a standard MODIS ocean color algorithm. We apply the approach to two hyperspectral UV/VIS sensors, the Ozone Monitoring Instrument (OMI) and TROPOspheric Monitoring Instrument (TROPOMI) to show that it can be used to estimate ocean color properties such as chlorophyll, remote sensing reflectance, and fluorescence line height. This method could be used as a gap-filling technique for the future Ocean Color Instrument (OCI) onboard upcoming NASA's Plankton, Aerosol Cloud, ocean Ecosystem (PACE) satellite to provide additional information for monitoring the health of our global oceans. Additionally, it could be applied to the first NASA and Smithsonian geostationary Tropospheric Emissions: Monitoring of Pollution (TEMPO) spectrometer to better understand diurnal variability in inland and coastal ocean ecology.

Zachary Fasnacht↗
NASA NTRSDate not supplied

A Principal Component and Machine Learning Approach to Spatially Gap Fill Hyperspectral Ocean Color Satellite Retrievals

Retrievals of ocean color properties from space are important for monitoring the health of the ocean ecosystem but such retrievals tend to be limited in spatial coverage due to conditions such as clouds, aerosols, and sun glint. Gap filling of ocean color retrievals is typically performed by combining retrievals from multiple satellites or temporally averaging multiple days of retrievals but despite these techniques large gaps still exist posing challenges for near real time monitoring of events like harmful algae blooms. To address these limitations, we propose a spatial gap filling approach using machine learning to learn how to perform an atmospheric correction under challenging retrieval conditions. In this approach a principal component analysis is used to decompose the hyperspectral measurements into spectral features that describe the scattering and absorption of the atmosphere as well as the underlying surface. The coefficients of the principal components are then used to train a neural network to predict ocean color properties derived from a standard ocean color algorithm such as the MODIS atmospheric correction algorithm. This machine learning approach is independent of a priori information and does not rely on any radiative transfer modeling. We apply the approach to two hyperspectral UV/VIS instruments, the Ozone Monitoring Instrument (OMI) and TROPOspheric Monitoring Instrument (TROPOMI) to show that it can be used to estimate ocean color properties such as chlorophyll, remote sensing reflectance, and fluorescence line height. This method could be used as a gap-filling technique for the future Ocean Color Instrument (OCI) which will be onboard NASA's Plankton, Aerosol Cloud, ocean Ecosystem (PACE) ocean color satellite to provide additional information for monitoring the health of our global oceans. Additionally, it could be applied to the geostationary satellite Tropospheric Emissions: Monitoring of Pollution (TEMPO) to better understand diurnal variability in ocean ecology.

MODIS atmospheric correction algorithm↗