Search NASA⌕ Search

Engineering topics

Lok Lamsal

Publications and source records attributed to Lok Lamsal.

13 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2024

Noise Reduction for Solar-Induced Fluorescence Retrievals Using Machine Learning and Principal Component Analysis: Simulations and Applications to GOME-2 Satellite Retrievals

We use a spectral-based approach that employs principal component analysis along with a relatively shallow artificial neural network (NN) to substantially reduce noise and other artifacts in terrestrial chlorophyll solar-induced fluorescence (SIF) retrievals. SIF is a very small emission at red and far-red wavelengths that is difficult to measure and is highly sensitive to random errors and systematic artifacts. Our approach relies upon an assumption that a trained NN can effectively reconstruct the total SIF signal from a relatively small number of leading principal components of the satellite-observed far-red radiance spectra without using information from the trailing modes that contain most of the random errors. We test the approach with simulated reflectance spectra produced with a full atmospheric and surface radiative transfer model using different observing and geophysical parameters and various noise levels. Resulting noisy and noise-reduced retrieved SIF values are compared with true values to assess performance. We then apply our noise reduction approach to SIF derived from two different satellite spectrometers. For evaluation, since the truth in this case is unknown, we compare SIF retrievals from two independent sensors with each other. We also compare the noise-reduced SIF temporal variations with those from an independent gross primary product (GPP) product that should display similar variations. Results show that our noise reduction approach improves capture of SIF seasonal and inter-annual variability. Our approach should be applicable to many noisy data products derived from spectral measurements. Our methodology does not replace the original retrieval algorithms; rather the original noisy retrievals are needed as the target for the NN training process.

noise reduction, solar-induced fluorescence, SIF, ↗
NASA NTRS2023

Characterization of Errors in Satellite-Based HCHO/NO 2 Tropospheric Column Ratios With Respect to Chemistry, Column-to-PBL Translation, Spatial Representation, and Retrieval Uncertainties

The availability of formaldehyde (HCHO) (a proxy for volatile organic compound reactivity) and nitrogen dioxide (NO 2 ) (a proxy for nitrogen oxides) tropospheric columns from ultraviolet–visible (UV–Vis) satellites has motivated many to use their ratios to gain some insights into the near-surface ozone sensitivity. Strong emphasis has been placed on the challenges that come with transforming what is being observed in the tropospheric column to what is actually in the planetary boundary layer (PBL) and near the surface; however, little attention has been paid to other sources of error such as chemistry, spatial representation, and retrieval uncertainties. Here we leverage a wide spectrum of tools and data to quantify those errors carefully. Concerning the chemistry error, a well-characterized box model constrained by more than 500 h of aircraft data from NASA's air quality campaigns is used to simulate the ratio of the chemical loss of HO 2 + RO 2 (LRO x ) to the chemical loss of NO x (LNO x ). Subsequently, we challenge the predictive power of HCHO/NO 2 ratios (FNRs), which are commonly applied in current research, in detecting the underlying ozone regimes by comparing them to LRO x /LNO x . FNRs show a strongly linear (R 2 =0.94) relationship with LRO x /LNO x , but only on the logarithmic scale. Following the baseline (i.e., ln(LRO x /LNO x ) = −1.0 ± 0.2) with the model and mechanism (CB06, r2) used for segregating NO x -sensitive from VOC-sensitive regimes, we observe a broad range of FNR thresholds ranging from 1 to 4. The transitioning ratios strictly follow a Gaussian distribution with a mean and standard deviation of 1.8 and 0.4, respectively. This implies that the FNR has an inherent 20 % standard error (1σ) resulting from not accurately describing the RO x –HO x cycle. We calculate high ozone production rates (PO 3 ) dominated by large HCHO × NO 2 concentration levels, a new proxy for the abundance of ozone precursors. The relationship between PO 3 and HCHO × NO 2 becomes more pronounced when moving towards NO x -sensitive regions due to nonlinear chemistry; our results indicate that there is fruitful information in the HCHO × NO 2 metric that has not been utilized in ozone studies. The vast amount of vertical information on HCHO and NO 2 concentrations from the air quality campaigns enables us to parameterize the vertical shapes of FNRs using a second-order rational function permitting an analytical solution for an altitude adjustment factor to partition the tropospheric columns into the PBL region. We propose a mathematical solution to the spatial representation error based on modeling isotropic semivariograms. Based on summertime-averaged data, the Ozone Monitoring Instrument (OMI) loses 12 % of its spatial information at its native resolution with respect to a high-resolution sensor like the TROPOspheric Monitoring Instrument (TROPOMI) (> 5.5 × 3.5 km 2 ). A pixel with a grid size of 216 km 2 fails at capturing ∼ 65 % of the spatial information in FNRs at a 50 km length scale comparable to the size of a large urban center (e.g., Los Angeles). We ultimately leverage a large suite of in situ and ground-based remote sensing measurements to draw the error distributions of daily TROPOMI and OMI tropospheric NO 2 and HCHO columns. At a 68 % confidence interval (1σ), errors pertaining to daily TROPOMI observations, either HCHO or tropospheric NO 2 columns, should be above 1.2–1.5 × 10 16 molec. cm −2 to attain a 20 %–30 % standard error in the ratio. This level of error is almost non-achievable with the OMI given its large error in HCHO. The satellite column retrieval error is the largest contributor to the total error (40 %–90 %) in the FNRs. Due to a stronger signal in cities, the total relative error (< 50 %) tends to be mild, whereas areas with low vegetation and anthropogenic sources (e.g., the Rocky Mountains) are markedly uncertain (> 100 %). Our study suggests that continuing development in the retrieval algorithm and sensor design and calibration is essential to be able to advance the application of FNRs beyond a qualitative metric.

Amir H. Souri↗
NASA NTRS2023

Use of Machine Learning and Principal Component Analysis to Retrieve Nitrogen Dioxide (NO 2 ) With Hyperspectral Imagers and Reduce Noise in Spectral Fitting

Nitrogen dioxide (NO 2 ) is an important trace-gas pollutant and climate agent whose presence also leads to spectral interference in ocean color retrievals. NO 2 column densities have been retrieved with satellite UV–Vis spectrometers such as the Ozone Monitoring Instrument (OMI) and the Tropospheric Monitoring Instrument (TROPOMI) that typically have spectral resolutions of the order of 0.5 nm or better and spatial footprints as small as 3.6 km × 5.6 km. These NO 2 observations are used to estimate emissions, monitor pollution trends, and study effects on human health. Here, we investigate whether it is possible to retrieve NO 2 amounts with lower-spectral-resolution hyperspectral imagers such as the Ocean Color Instrument (OCI) that will fly on the Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) satellite set for launch in early 2024. OCI will have a spectral resolution of 5 nm and a spatial resolution of ∼ 1 km with global coverage in 1–2 d. At this spectral resolution, small-scale spectral structure from NO 2 absorption is still present. We use real spectra from the OMI to simulate OCI spectra that are in turn used to estimate NO 2 slant column densities (SCDs) with an artificial neural network (NN) trained on target OMI retrievals. While we obtain good results with no noise added to the OCI simulated spectra, we find that the expected instrumental noise substantially degrades the OCI NO 2 retrievals. Nevertheless, the NO 2 information from OCI may be of value for ocean color retrievals. OCI retrievals can also be temporally averaged over timescales of the order of months to reduce noise and provide higher-spatial-resolution maps that may be useful for downscaling lower-spatial-resolution data provided by instruments such as OMI and TROPOMI; this downscaling could potentially enable higher-resolution emissions estimates and be useful for other applications. In addition, we show that NNs that use coefficients of leading modes of a principal component analysis of radiance spectra as inputs appear to enable noise reduction in NO 2 retrievals. Once trained, NNs can also substantially speed up NO 2 spectral fitting algorithms as applied to OMI, TROPOMI, and similar instruments that are flying or will soon fly in geostationary orbit.

NO2↗
NASA NTRS2022

Polarization performance simulation for the GeoXO atmospheric composition instrument: NO2 retrieval impacts

NOAA’s Geostationary Extended Observations (GeoXO) constellation will continue and expand on the capabilities of the current generation of geostationary satellite systems to support US weather, ocean, atmosphere, and climate operations. It is planned to consist of a dedicated atmospheric composition instrument (ACX) to support air quality forecasting and monitoring by providing similar capabilities to missions such as TEMPO (Tropospheric Emission: Monitoring Pollution), currently planned to launch in 2023, and Ozone Monitoring Instrument (OMI), TROPOMI (TROPOspheric Monitoring Instrument), and GEMS (Geostationary Environment Monitoring Spectrometer) currently in operation. As the early phases of ACX development are progressing, design trade-offs are being considered to understand the relationship between instrument design choices and trace gas retrieval impacts. Some of these choices will affect the instrument polarization sensitivity (PS), which can have radiometric impacts on environmental satellite observations. We conducted a study to investigate how such radiometric impacts can affect NO2 retrievals by exploring their sensitivities to time of day, location, and scene type with an ACX instrument model that incorporates PS. The study addresses the basic steps of operational NO2 retrievals: the spectral fitting step and the conversion of slant column to vertical column via the air mass factor (AMF). The spectral fitting step was performed by generating at-sensor radiance from a clear sky scene with a known NO2 amount, the application of an instrument model including both instrument PS and noise, and a physical retrieval. The spectral fitting step was found to mitigate the impacts of instrument PS. The AMF-related step was considered for clear sky and partially cloudy scenes, where instrument PS can lead to errors in interpreting the cloud content, propagating to AMF errors and finally to NO2 retrieval errors. For this step, the NO2 retrieval impacts were small but non-negligible for high NO2 amounts; we estimated that a typical high NO2 amount can cause maximum of 0.25 x 10^15 molecules/cm^2 for a PS of 5%. These simulation capabilities were designed to aid in the development of a GeoXO atmospheric composition instrument that will improve our ability to monitor and understand the Earth’s atmosphere.

trace gases↗
NASA NTRS2022

Polarization Performance Simulation for the GeoXO Atmospheric Composition Instrument: NO2 Retrieval Impacts

NOAA's Geostationary Extended Observations (GeoXO) constellation will continue and expand on the capabilities of the current generation of geostationary satellite systems to support US weather, ocean, atmosphere, and climate operations. It is planned to consist of a dedicated atmospheric composition instrument (ACX) to support air quality forecasting and monitoring by providing capabilities similar to missions such as TEMPO (Tropospheric Emission: Monitoring Pollution), currently planned to launch in 2023, as well as OMI (Ozone Monitoring Instrument), TROPOMI (TROPOspheric Monitoring Instrument), and GEMS (Geostationary Environment Monitoring Spectrometer) currently in operation. As the early phases of ACX development are progressing, design trade-offs are being considered to understand the relationship between instrument design choices and trace gas retrieval impacts. Some of these choices will affect the instrument polarization sensitivity (PS), which can have radiometric impacts on environmental satellite observations. We conducted a study to investigate how such radiometric impacts can affect NO2 retrievals by exploring their sensitivities to time of day, location, and scene type with an ACX instrument model that incorporates PS. The study addresses the basic steps of operational NO2 retrievals: the spectral fitting step and the conversion of slant column to vertical column via the air mass factor (AMF). The spectral fitting step was performed by generating at-sensor radiance from a clear-sky scene with a known NO2 amount, the application of an instrument model including both instrument PS and noise, and a physical retrieval. The spectral fitting step was found to mitigate the impacts of instrument PS. The AMF-related step was considered for clear-sky and partially cloudy scenes, for which instrument PS can lead to errors in interpreting the cloud content, propagating to AMF errors and finally to NO2 retrieval errors. For this step, the NO2 retrieval impacts were small but non-negligible for high NO2 amounts; we estimated that a typical high NO2 amount can cause a maximum retrieval error of 0.25×1015 molec. cm−2 for a PS of 5 %. These simulation capabilities were designed to aid in the development of a GeoXO atmospheric composition instrument that will improve our ability to monitor and understand the Earth's atmosphere.

Aaron Pearlman↗
NASA NTRS2019

Five Decades Observing Earth's Atmospheric Trace Gases Using Ultraviolet and Visible Backscatter Solar Radiation from Space

Over the last five decades, Earth’s atmosphere has been extensively monitored from space using different spectral ranges. Early efforts were directed at improving weather forecasts with the first meteorological satellites launched in the 1960s. Soon thereafter, the intersection between weather, climate and atmospheric chemistry led to the observation of atmospheric composition from space. During the 1970s the Nimbus satellite program started regular monitoring of ozone integrated columns and water vapor profiles using the Backscatter Ultraviolet Spectrometer, the Infrared Interferometer Spectrometer and the Satellite Infrared Spectrometer instruments. Five decades after these pioneer efforts, continuous progress in instrument design, and retrieval techniques allow researchers to monitor tropospheric concentrations of a wide range of species with implications for air quality, climate and weather. The time line of historic, present and future space-borne instruments measuring ultraviolet and visible backscattered solar radiation designed to quantify atmospheric trace gases is presented. We describe the instruments technological evolution and the basic concepts of retrieval theory. We include a review of algorithms developed for ozone, nitrogen dioxide, sulfur dioxide, formaldehyde, bromine monoxide, water vapor and glyoxal, a selection of studies using these algorithms, the challenges they face and how these challenges can be addressed. The paper ends by providing insights on the opportunities that new instruments will bring to the atmospheric chemistry, weather and air quality communities and how to address the pressing need for long-term, inter-calibrated data records necessary to monitor the response of the atmosphere to rapidly changing ecosystems.

Infrared Interferometer Spectrometer↗
NASA NTRSDate not supplied

TROPOMI Geometry-dependent Lambertian-Equivalent surface Reflectivity (GLER) Product for Improved Trace-Gas Retrieval

Accurate information about the reflectivity of the Earth's surface is required for most satellite retrievals of atmospheric composition, and this information is generally taken from monthly surface reflectivity climatology that neglects angular dependence. Previously we introduced Geometry-dependent Lambertian-equivalent surface reflectivity (GLER) which captures solar and satellite viewing angle dependence as well as daily and seasonal changes. GLER is calculated from simulations of Rayleigh-only top-of-atmosphere (TOA) radiances over non-Lambertian surfaces. We use NASA's Moderate Resolution Imaging Spectroradiometer (MODIS) bidirectional reflectance distribution function (BRDF) product over land and the wind-dependent Cox–Munk wave-facet slope distribution including water-leaving radiance over water to accounts for surface BRDF. We have developed global GLER product, previously for the Ozone Monitoring Instrument (OMI) and recently for Sentinel-5 Precursor (S5P) TROPOspheric Monitoring Instrument (TROPOMI) with several new improvements and updates. We have implemented the near real time daily V006 MODIS MCD43C1 BRDF data and gap-filled with a daily BRDF coefficient climatology created from 2002-2017 V006 MCD43GF data. The NASA’s Global Modelling Initiative hourly 0.25 x 0.25 deg Replay simulations are used for more accurate determination of pixel specific terrain pressure. To improve detection of seasonal snow/ice scenes, we use the 4-km snow cover product from the Interactive Multi-sensor Snow and Ice Mapping System (IMS). Finally, we use an improved version of the vector linearized discrete ordinate radiative transfer (VLIDORT) for update of the top-of-atmosphere (TOA) radiance look-up-tables (LUTs). We demonstrate how the use of GLER is beneficial to TROPOMI’s high spatial resolution (up to 3.5 km x 3.5 km) measurements to monitor atmospheric trace gas pollutants down to the sub-city scale.

TROPOMI↗
NASA NTRSDate not supplied

Decoupling the Effects of Anthropogenic Emission Reductions from the Meteorology and Natural Emissions in TROPOMI NO 2 Retrievals During the 2020 COVID-19 Lockdowns

Satellite measurements during the COVID-19 lockdowns that began in 2020 revealed unprecedented reductions in NO 2 tropospheric vertical column densities (VCD). These reductions have largely been attributed to reduced anthropogenic emissions associated with abrupt decreases in road traffic and other power consuming business activities. Although decreased emissions tended to be the main contributor to the observed NO 2 VCD reduction, meteorological variability also played a role. Whereas the observed VCD changes were predominantly negative in places where public health policies were strictly enforced, meteorology had both positive and negative effects over short time intervals. Here, we present results from a global study of the NO 2 reductions aimed at disentangling the meteorological and natural emission variability from the anthropogenic emissions over the world’s most populated megacities. For this study, NASA’s TROPOMI NO 2 algorithm was used in conjunction with the Global Modeling Initiative (GMI) chemical transport model to separate the contributions due emissions and meteorology. A priori NO 2 profiles were generated from two GMI simulations performed for 2020 at a resolution of 0.25° longitude x 0.25° latitude. The first simulation used updated, COVID-impacted NOX emissions based on Forster et al. (2020), while the second simulation used the 2019 emissions with the 2020 meteorology, referred to here as 2020BAU. The 2020BAU data set allowed for the decoupling of the emission component from the meteorology. When compared to the same period in 2019, NO 2 column amounts during the lockdowns were reduced in 35 out of 36 cities. While reduced emissions contributed most to the observed total change in NO 2 during the lockdowns, the effects of meteorology were significant, ranging between 40% (Chennai) and 15% (Beijing). In China, an increase in NO 2 levels due to meteorology were observed in five out of the seven cities considered in the study. Use of different a-priori NO 2 profiles from the two simulations in our TROPOMI retrievals allowed for a determination of retrieval errors that ranged from -1.7% to -11.0%. We used the quality assurance flag > 0.75 to select the highest quality scenes in the study period. Using the GMI, we estimated the sampling biases to be in the range -11% to 10% of the total change for the cities in our study.

Brad Fisher↗
NASA NTRSDate not supplied

How Can We Harness the Power of Machine Learning With TEMPO Data?

There are many potential applications of machine learning for TEMPO data that include - Improve retrievals by reducing the effect of random instrument noise - Expand coverage by producing data in moderately cloudy conditions (see also Fasnacht et al. poster) - Help diagnose impacts of instrumental artifacts - Produce value-added products quickly by training on existing products from other sensors (land and ocean) - Speed up processing by training on products produced with full-physics algorithms (e.g., NO 2 slant column fitting may take ~1 hour/orbit but with a neural net it may take only minutes)

NO2↗