Search NASA⌕ Search

Engineering topics

Sergey Marchenko

Publications and source records attributed to Sergey Marchenko.

7 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2023

Use of Machine Learning and Principal Component Analysis to Retrieve Nitrogen Dioxide (NO 2 ) With Hyperspectral Imagers and Reduce Noise in Spectral Fitting

Nitrogen dioxide (NO 2 ) is an important trace-gas pollutant and climate agent whose presence also leads to spectral interference in ocean color retrievals. NO 2 column densities have been retrieved with satellite UV–Vis spectrometers such as the Ozone Monitoring Instrument (OMI) and the Tropospheric Monitoring Instrument (TROPOMI) that typically have spectral resolutions of the order of 0.5 nm or better and spatial footprints as small as 3.6 km × 5.6 km. These NO 2 observations are used to estimate emissions, monitor pollution trends, and study effects on human health. Here, we investigate whether it is possible to retrieve NO 2 amounts with lower-spectral-resolution hyperspectral imagers such as the Ocean Color Instrument (OCI) that will fly on the Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) satellite set for launch in early 2024. OCI will have a spectral resolution of 5 nm and a spatial resolution of ∼ 1 km with global coverage in 1–2 d. At this spectral resolution, small-scale spectral structure from NO 2 absorption is still present. We use real spectra from the OMI to simulate OCI spectra that are in turn used to estimate NO 2 slant column densities (SCDs) with an artificial neural network (NN) trained on target OMI retrievals. While we obtain good results with no noise added to the OCI simulated spectra, we find that the expected instrumental noise substantially degrades the OCI NO 2 retrievals. Nevertheless, the NO 2 information from OCI may be of value for ocean color retrievals. OCI retrievals can also be temporally averaged over timescales of the order of months to reduce noise and provide higher-spatial-resolution maps that may be useful for downscaling lower-spatial-resolution data provided by instruments such as OMI and TROPOMI; this downscaling could potentially enable higher-resolution emissions estimates and be useful for other applications. In addition, we show that NNs that use coefficients of leading modes of a principal component analysis of radiance spectra as inputs appear to enable noise reduction in NO 2 retrievals. Once trained, NNs can also substantially speed up NO 2 spectral fitting algorithms as applied to OMI, TROPOMI, and similar instruments that are flying or will soon fly in geostationary orbit.

NO2↗
NASA NTRS2021

Detection of Anomalies in the UV/Vis Reflectances from the Ozone Monitoring Instrument

Various instrumental or geophysical artifacts, such as saturation, stray light, or obstruction of light (either coming from the instrument or related to solar eclipses), negatively impact satellite measured ultraviolet and visible Earthshine radiance spectra and downstream retrievals of atmospheric and surface properties derived from these spectra. In addition, excessive noise such as from cosmic ray impacts, prevalent within the South Atlantic Anomaly, can also degrade satellite radiance measurements. Saturation specifically pertains to observations of very bright surfaces such as sun glint over open water or thick clouds. When saturation occurs, additional photoelectric charge generated at the saturated pixel may overflow to pixels adjacent to a saturated area and be reflected as a distorted image in the final sensor output.When these effects cannot be corrected to an acceptable level for science quality retrievals, flagging of the affected pixels is indicated. Here, we introduce a straightforward detection method that is based on the correlation, r, between the observed Earthshine radiance and solar irradiance spectraover a 10 nm-spectral range; our Decorrelation Index (DI for brevity) is simply defined as DI=1-r. DI increases with anomalous additive effects or excessive noise in either radiances, the most likely cause indata from theOzone Monitoring Instrument (OMI),or irradiances. DI is relatively straight-forward to use and interpret and can be 20computed for different wavelength intervals. We developed a set of DIs for two spectral channelsof the OMI, a hyperspectral pushbroom imaging spectrometer. For each OMI spatial measurement, we define 14 wavelength-dependent DIs within the OMI visible channel (350-498 nm) and 6 DIs in its ultraviolet 2 (UV2) channel (310-370 nm). As defined, DIs reflect a continuous range of deviations of observed spectra from the reference irradiance spectrum that are complementary to the binary Saturation Possibility Warning (SPW) flags currently provided for each individual spectral/spatial pixel in the OMI radiance data set. Smaller values of DI are also caused by a number of geophysical factors; this allows one to obtain interesting physical results on the global distribution of spectral variations.

Space sensor↗
NASA NTRSDate not supplied

Verification of TROPOMI NO2 Product Using OMI NO2 algorithm

We evaluated S5P TROPOspheric Monitoring Instrument (TROPOMI) operational nitrogen dioxide (NO2) product by comparing with the NO2 retrievals from Ozone Monitoring Instrument (OMI) onboard NASA’s Aura satellite. We compared spatially matched NO2 vertical column density (VCD) data from OMI and TROPOMI to identify any discrepancies between the two operational products. We also applied OMI Air-Mass Factor (AMF) algorithm to TROPOMI Slant Column Density (SCD) data (v02.03.01) aiming to create long-term merged NO2 Earth Science Data Record (https://disc.gsfc.nasa.gov/datasets/TROPOMI_MINDS_NO2_1.1/summary ). The algorithm (version 4.0) uses new Geometry-dependent Lambertian Equivalent surface Reflectivity (GLER) product available for each TROPOMI pixel. GLER is pre-calculated using the vector linearized discrete ordinate radiative transfer (VLIDORT) model, which uses as input high-resolution bidirectional reflectance distribution function (BRDF) information from NASA's Aqua Moderate Resolution Imaging Spectroradiometer (MODIS) over land and the wind-dependent Cox–Munk wave-facet slope distribution over water, the latter with a contribution from the water-leaving radiance based on MODIS gap-filled in-water chlorophyll-a data. The GLER data, combined with consistently retrieved cloud parameters, provide improved information for the calculation of the scattering weight profiles. Additional AMF improvements result from using high resolution (0.25o latitude x 0.25o longitude) a priori NO2 profile shapes and other auxiliary information from the Global Modeling Initiative (GMI) Replay simulation sampled using S5P orbital simulator. Our TROPOMI_MINDS_NO2 algorithm employs the stratosphere-troposphere separation scheme, de-striping, and surface snow/ice treatment consistently with the latest OMI NO2 re-processing (version 4). We evaluate the TROPOMI_MINDS_NO2 product by comparing with the S5P operational NO2 product as well as with independent NO2 observations from ground-based Pandora and aircraft observations. Our results indicate that the new TROPOMI_MINDS_NO2 retrievals are generally higher than the S5P operational NO2 product over polluted regions and show improved agreement with independent validation data.

TROPOMI↗
NASA NTRSDate not supplied

How Can We Harness the Power of Machine Learning With TEMPO Data?

There are many potential applications of machine learning for TEMPO data that include - Improve retrievals by reducing the effect of random instrument noise - Expand coverage by producing data in moderately cloudy conditions (see also Fasnacht et al. poster) - Help diagnose impacts of instrumental artifacts - Produce value-added products quickly by training on existing products from other sensors (land and ocean) - Speed up processing by training on products produced with full-physics algorithms (e.g., NO 2 slant column fitting may take ~1 hour/orbit but with a neural net it may take only minutes)

NO2↗