SEARCH · Search NASA

Results for “retrieval algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,747 records · Page 97

All sources NASA NTRS DOE OSTI

NASA NTRS1999

Seasonal Characteristics of Non-Meteorological Radar Reflectivity Returns in Central Florida and Their Impact on TRMM Ground Validation

Radar data quality control is a major component to the Tropical Rainfall Measuring Mission (TRMM) Ground Validation (GV) effort. The quality control algorithm utilizes several adjustable height and reflectivity threshold parameters to remove non-precipitation echoes from ground-based radar data. Spurious radar reflectivity returns not removed during the quality control process may create biases in ground validation rainfall products used to evaluate rainfall measurements retrieved from aboard the TRMM satellite. To better evaluate the performance of the quality control algorithm, WSR-88D radar data from one primary GV site, Melbourne, Florida, are used to determine the seasonal characteristics of non-meteorological radar echoes in cast central Florida during the first year of the TRMM mission. It is demonstrated that unique spurious echo regimes develop throughout the year, leading to different levels of successful non-meteorological echo removal by the quality control algorithm. In addition to the type of non- precipitation echoes present, the success of the algorithm is also greatly dependent upon the amount of precipitation present. Less aggressive attempts to remove non-meteorological echoes must be employed when rain is observed so as not to remove these echoes as well. Therefore, precipitation statistics from ground validation monthly rainfall products will be utilized to further document the quality control algorithm performance. Moreover, these precipitation statistics will be used to demonstrate the relationship between dominant spurious echo regimes and rainfall amount. Finally, monthly statistics of contaminated ground validation radar data will be calculated and the effect on rainfall accumulation products will be discussed.

Robinson, Michael↗

NASA NTRS2002

The MODIS Aerosol Algorithm: From First Light to Maturity

The MODerate resolution Imaging Spectroradiometer (MODIS) currently aboard both the Terra and Aqua satellites produces a suite of products designed to characterize global aerosol distribution, optical thickness and particle size. Terra with MODIS aboard was launched at the end of 1999 and began transmitting data at the end of February 2000. Algorithms were in place, designed to use the observed radiances to derive many important aerosol products. Early comparisons of the retrieved aerosol parameters with ground-based validation data, showed remarkable agreement between the two types of data, but also showed us situations in which the algorithms could be improved. Almost immediately, the algorithms were modified to reflect a better understanding of the instrument's capabilities and the nature of aerosols and clouds. We describe the MODIS aerosol algorithms, highlighting the changes that were implemented post-launch. We describe the wealth of aerosol products derived from MODIS data and available to any user. Lastly, we compare over a year of MODIS data to co-located ground-based data as validation, and analyze the validation as to geographic location and temporal changes. This presentation is meant as an overview of the mature MODIS aerosol algorithm.

Remer, L. A.↗

NASA NTRS2016

Retrieving the Height of Smoke and Dust Aerosols by Synergistic Use of Multiple Satellite Sensors

The Aerosol Single scattering albedo and Height Estimation (ASHE) algorithm was first introduced in Jeong and Hsu (2008) to provide aerosol layer height and single scattering albedo (SSA) for biomass burning smoke aerosols. By using multiple satellite sensors synergistically, ASHE can provide the height information over much broader areas than lidar observations alone. The complete ASHE algorithm uses aerosol data from MODIS or VIIRS, OMI or OMPS, and CALIOP. A simplified algorithm also exists that does not require CALIOP data as long as the SSA of the aerosol layer is provided by another source. Several updates have recently been made: inclusion of dust layers in the retrieval process, better determination of the input aerosol layer height from CALIOP, improvement in aerosol optical depth (AOD) for nonspherical dust, development of quality assurance (QA) procedure, etc.

satellite remote sensing↗

NASA NTRS2011

Evaluation and Windspeed Dependence of MODIS Aerosol Retrievals Over Open Ocean

The Maritime Aerosol Network (MAN) data set provides high quality ground-truth to validate the MODIS aerosol product over open ocean. Prior validation of the ocean aerosol product has been limited to coastal and island sites. Comparing MODIS Collection 5 ocean aerosol retrieval products with collocated MAN measurements from ships shows that MODIS is meeting the pre-launch uncertainty estimates for aerosol optical depth (AOD) with 64% and 67% of retrievals at 550 nm, and 74% and 78% of retrievals at 870 nm, falling within expected uncertainty for Terra and Aqua, respectively. Angstrom Exponent comparisons show a high correlation between MODIS retrievals and shipboard measurements (R= 0.85 Terra, 0.83 Aqua), although the MODIS aerosol algorithm tends to underestimate particle size for large particles and overestimate size for small particles, as seen in earlier Collections. Prior analysis noted an offset between Terra and Aqua ocean AOD, without concluding which sensor was more accurate. The simple linear regression reported here, is consistent with other anecdotal evidence that Aqua agreement with AERONET is marginally better. However we cannot claim based on the current study that the better Aqua comparison is statistically significant. Systematic increase of error as a function of wind speed is noted in both Terra and Aqua retrievals. This wind speed dependency enters the retrieval when winds deviate from the 6 m/s value assumed in the rough ocean surface and white cap parameterizations. Wind speed dependency in the results can be mitigated by using auxiliary NCEP wind speed information in the retrieval process.

Kleidman, Richard G.↗

DOE OSTI2020

Thunderstorm Cloud-Type Classification from Space-Based Lightning Imagers

The organization and structure of thunderstorms determines the extent and severity of their hazards to the general public and their consequences for the Earth system. Distinguishing vigorous convective regions that produce heavy rain and hail from adjacent regions of stratiform clouds or overhanging anvil clouds that produce light to no rainfall is valuable in operations and physical research. Cloud-type algorithms that partition convection from stratiform regions have been developed for space-based radar, passive microwave, and now Geostationary Operational Environmental Satellites (GOES) Advanced Baseline Imager (ABI) multispectral products. However, there are limitations for each of these products including temporal availability, spatial coverage, and the degree to which they based on cloud microphysics. We report we have developed a cloud-type algorithm for GOES Geostationary Lightning Mapper (GLM) observations that identifies convective/nonconvective regions in thunderstorms based on signatures of interactions with nonconvective charge structures in the lightning flash data. The GLM sensor permits a rapid (20 s) update cycle over the combined GOES-16–GOES-17 domain across all hours of the day. Storm regions that do not produce lightning will not be classified by our algorithm, however. The GLM cloud-type product is intended to provide situational awareness of electrified nonconvective clouds and to complement other cloud-type retrievals by providing a contemporary assessment tied to lightning physics. We propose that a future combined ABI–GLM cloud-type algorithm would be a valuable product that could draw from the strengths of each instrument and approach.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Phase retrieval for refraction-enhanced x-ray radiography using a deep neural network

X-ray refraction-enhanced radiography (RER) or phase contrast imaging is widely used to study internal discontinuities within materials. The resulting radiograph captures both the decrease in intensity caused by material absorption along the x-ray path, as well as the phase shift, which is highly sensitive to gradients in density. A significant challenge lies in effectively analyzing the radiographs to decouple the intensity and phase information and accurately ascertain the density profile. Conventional algorithms often yield ambiguous and unrealistic results due to difficulties in including physical constraints and other relevant information. We have developed an algorithm that uses a deep neural network to address these issues and applied it to extract the detailed density profile from an experimental RER. To generalize the applicability of our algorithm, we have developed a technique that quantitatively evaluates the complexity of the phase retrieval process based on the characteristics of the sample and the configuration of the experiment. Accordingly, this evaluation aids in the selection of the neural network architecture for each specific case. Beyond RER, the model has potential applications for other diagnostics where phase retrieval analysis is required.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NASA NTRS2010

Demonstration of on Sky Contrast Improvement Using the Modified Gerchberg-Saxton Algorithm at the Palomar Observatory

We have successfully demonstrated significant improvements in the high contrast detection limit of the Well-Corrected Subaperture (WCS) using the Autonomous Phase Retrieval Calibration (APRC) software package developed at the Jet Propulsion Laboratory (JPL) for the Palomar adaptive optics instrument (PALAO). APRC utilizes the Modified Gerchberg-Saxton (MGS) wavefront sensing algorithm, also developed at JPL. The WCS delivers such excellent correction of the atmosphere that non-common path (NCP) wavefront errors not sensed by PALAO but present at the coronagraphic image plane begin to factor heavily as a limit to contrast. We have implemented the APRC program to reduce these NCP wavefront errors from 110 nm to 35 nm (rms) in the lab, and we have extended these exceptional results to targets on the sky for the first time, leading to a significant suppression of speckle noise. Consequently we now report a contrast level of very nearly 1x10(exp -4) at separations of 2 lambda/D before the data is post processed. We describe here the major components of our instrument, the work done to improve the NCP wavefront errors, and the ensuing excellent on sky results, including the detection of the three exoplanets orbiting the star HR8799.

mgs↗

NASA NTRS2022

Evaluation of Retrieving Chlorophyll a Concentration and Colored Dissolved Organic Matter Absorption from Satellite Ocean Color Remote Sensing in the Coastal Waters of Hokkaido, Japan

Coastal ecosystems are important in biogeochemical cycles, because they provide many pathways for chemical elements and compounds to flow between the physical environment and living organisms. The spatial and temporal scales of the biotic and abiotic interactions establish the inherent dynamics of the coastal zone and the requirement for high-resolution investigations. Using match-up data collected in Hokkaido coastal waters, the study herein evaluated the performance of deriving chlorophyll (Chl) a concentration and colored dissolved organic matter (CDOM) absorption (a(sub CDOM)) as a function of wavelength (λ) from satellite observations. The Japanese Aerospace Exploration Agency (JAXA) Second generation GLobal Imager (SGLI), which has 250 m spatial resolution, was compared with other satellite ocean color (OC) sensors. Our results show that the standard SGLI OC4 algorithm with the 530 nm band provided the best performance for Chl a retrievals, and the end-member analysis (EMA) technique improved the estimation of a(sub CDOM)(λ) . Overall differences between in situ radiometric data and satellite retrievals suggest that additional challenges remain, especially in the ultraviolet and blue spectral domains which are useful for studying CDOM and harmful algae blooms in coastal waters. To fulfill applications wherein high-quality remote sensing data are required, the improvement of the atmospheric correction is a likely research area where additional accomplishment will be beneficial for satellite observations of optically complex coastal waters.

SGLI/GCOM-C↗

NASA NTRSDate not supplied

The PACE-MAPP Algorithm: Simultaneous Aerosol and Ocean Products From Combined Polarimeter and Shortwave Infrared Measurements

PACE-MAPP collaborative algorithm project - Produce accurate aerosol optical and microphysical properties and ocean properties - Use a coupled atmosphere-ocean vector radiative transfer (VRT) model - Use accurate but fast Mie/SS/T-matrix LUTs - Use scientific machine learning to speed-up retrievals by 1000x (PACE-MAPP Neural Network) - PACE-MAPP is a multi-instrument polarimeter algorithm for SPEXone, HARP2, OCI shortwave infrared channels

Snorre Alfred Moen Stamnes↗

NASA NTRSDate not supplied

Forward and Inverse Models for Satellite Remote Sensors using Principal Component Analysis

Satellite remote sensors such as AIRS on Aqua, CrIS on S-NPP, NOAA20 and JPSS-2, IASI on Metop A, B, and C make millions of observations each day with thousands of spectral channels for each observation; this poses challenges for efficiently inversion of the inherently large dataset as needed to retrieve atmospheric and surface properties. This presentation will illustrate the use of Principal Component Analysis (PCA) to speed up radiative transfer forward model calculations and to stabilize the inversion algorithms. A Principal Component-based radiative transfer model (PCRTM) developed at NASA Langley Research Center can simulate top of atmosphere (TOA) radiance or reflectance spectra from 50 cm-1 to 50000 cm-1 (200 m to 0.20 m quickly and accurately. PCRTM demonstrated very high accuracy relative to reference line-by-line radiative transfer models and it saves orders of magnitude computational time. Examples of the PCRTM model developed for hyperspectral sensors such as AIRS, CrIS, IASI, NAST-I, SHIS, CPF, TEMPO, SBG, OMI, and SCIAMACHY will be presented. In addition to using the PCRTM as forward model, the NASA Langley developed inversion algorithm also uses PCA to compress the state vector into a compressed dimension to speed up and stabilize the inversion process. Examples of retrieved atmospheric temperature, water vapor, CO2, CO, CH4, N2O, and O3 profiles, cloud properties (optical depth, size, phase, and height), and surface properties (surface emissivity spectra and skin temperatures) will be presented. This algorithm is being transitioned to the NASA Sounder SIPS and NASA's Goddard Earth Sciences Data and Information Services Center (GES DISC).

forward model↗

NASA NTRS1988

Climatological aspects of Nimbus-7 SMMR data

An algorithm was developed for calculating simultaneously SSTs, SWs, and TAUs on a global basis using only the 6.6 and 18 GHz channels of the SMMR. Samples of the retrievals were calculated in each of eight of the SMMR years and found to produce independent results, consistent with weather charts and climatic records, even in the presence of high winds. Another new algorithm for calculating high-latitude scalar winds from Nimbus-7 Scanning Multichannel Microwave Radiometer (SMMR) data was devised and tuned with surface observations from a number of documented Arctic Polar Low events. The algorithm utilizes the horizontally and vertically polarized radiances from the 0.8 and 1.7 cm wavelength channels of the ten-channel SMMR to retrieve near surface oceanic scalar winds and cloud water in the column, and takes advantage of the relatively small fluctuations in atmospheric water vapor at high latitudes. An advantage of this algorithm for high latitude winds from SMMR over the global algorithm is an inherently better spatial resolution as a result of the shorter wavelengths used.

Gloersen, P.↗

DOE OSTI2023

TRACER CLAMPS2 MWR TROPoe Retrievals

These files contain 24 hour periods of retrieved thermodynamic profiles derived from observations collected by the CLAMPS2 Atmospheric Emitted Radiance Interferometer (AERI) and microwave radiometer (MWR). The TROPoe algorithm is a python equivalent to the AERIoe algorithm (see Turner and Loehnert, 2014; Turner and Blumberg 2019). These data were collected during the TRACER-CUBIC project. MWR only and combined AERI and MWR retrievals are available. During this deployment the AERI had high noise so AERI only retrievals are unavailable and the combined AERI and MWR retrievals should be used with extreme caution.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

TRACER CLAMPS2 AERI_MWR TROPoe Retrievals

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2023

Evaluation of Snowfall Retrieval Performance of Gpm Constellation Radiometers Relative to Spaceborne Radars

This study assesses the level-2 snowfall retrieval results from 11 passive microwave radiometers generated by the version 5 Goddard profiling algorithm (GPROF) relative to two spaceborne radars: CloudSat Cloud Profiling Radar (CPR) and Global Precipitation Measurement (GPM) Ku-band Precipitation Radar (KuPR). These 11 radiometers include six conical scanning radiometers [Advanced Microwave Scanning Radiometer for the Earth Observing System (AMSR-E), its successor sensor AMSR2, GPM Microwave Imager (GMI), and three Special Sensor Microwave Imager/Sounders (SSMIS)] and five cross-track scanning radiometers [Advanced Technology Microwave Sounder (ATMS) and four Microwave Humidity Sounders (MHS)]. Results show that over ocean conical scanning radiometers have better detection and intensity estimation skills than cross-track sensors, likely due to the availability and usage of the low-frequency channels (e.g., 19 and 37 GHz). Over land, AMSR-E and AMSR2 have noticeably worse performance than other sensors, primarily due to the lack of higher than 89-GHz channels (e.g., 150, 166, and 183 GHz). Over both land and ocean, all 11 sensors severely underestimate the snowfall intensity, which propagates to the widely used level 3 precipitation product [i.e., Integrated Multi-satelliteE Retrievals for GPM (IMERG)]. These conclusions hold regardless of using either KuPR or CPR as the reference, though the statistical metrics vary quantitatively. The conclusions drawn from these comparisons apply solely to the GPROF version 5 algorithm.

Yalei You↗

DOE OSTI2019

Radiative Flux Analysis (RADFLUXANAL) Value-Added Product: Retrieval of Clear-Sky Broadband Radiative Fluxes and Other Derived Values

This technical report describes the algorithms used in the Radiative Flux Analysis (RADFLUXANAL) Value-Added Product (VAP). This VAP estimates clear sky broadband irradiance values and derives several additional cloud properties from broadband measurements including fractional sky cover and cloud optical depth. The VAP is based on a collection of algorithms and codes developed by Charles N. Long. It is an updated version of the Shortwave Flux Analysis VAP that has been used in ARM for a number of years. The RADFLUXANAL VAP includes two major updates over the previous Shortwave Flux Analysis VAP: 1) longwave (LW) clear sky irradiance estimates and derived parameters, and 2) takes in better quality-controlled input data from the QCRAD VAP.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2011

Improvement of OMI Ozone Profile Retrievals in the Troposphere and Lower Troposphere by the Use of the Tropopause-Based Ozone Profile Climatology

An advance algorithm based on the optimal estimation technique has beeen developed to derive ozone profile from GOME UV radiances and have adapted it to OMI UV radiances. OMI vertical resolution : 7-11 km in the troposphere and 10-14 km in the stratosphere. Satellite ultraviolet measurements (GOME, OMI) contain little vertical information for the small scale of ozone, especially in the upper troposphere (UT) and lower stratosphere (LS) where the sharp O3 gradient across the tropopause and large ozone variability are observed. Therefore, retrievals depend greatly on the a-priori knowledge in the UTLS

Bak, Juseon↗

DOE OSTI2025

Propagating information content: an example with advection

The mathematical algorithm to derive geophysical information from remote sensing observations is called a retrieval. The mathematics of many retrieval problems are ill-posed, and thus a priori information is used to help constrain the derived geophysical variable to realistic values. One quantity of interest, therefore, is the information content of the observation. Perfect information content in the observation would be achieved if the retrieval were able to capture any perturbation in the desired geophysical variable with the proper magnitude. Many new data products can be derived by combining geophysical variables retrieved from multiple different remote sensors. This paper explores, for the first time, how to derive the information content of these derived products. The approach uses traditional error propagation techniques to derive the uncertainty of the derived field twice, both when the observations are used in the retrieval and also when only the a priori information from each remote sensor is propagated. These two uncertainties are then used to provide an estimate of the information content of the derived geophysical variable. This study demonstrates how to propagate the uncertainties from six different instruments to provide the information content for water vapor and temperature advection. A multi-month analysis demonstrates that, in a mean sense, the information content for temperature advection is nearly unity for all heights below 700 m while, the information content for water vapor advection is somewhat more variable but still larger than 0.6 in the convective boundary layer.

Turner, David D. [National Oceanic and Atmospheric↗

DOE OSTI2024

Parallax-corrected VISST-derived pixel-level products from satellite GOES-16

The NASA Langley group led by William Smith produced GOES-16 satellite cloud retrievals over an approximate 10 by 10 degree region over the CACTI field campaign location. These retrievals are described here: https://www.arm.gov/capabilities/vaps/visst and are available for download here . They use algorithms historically called VISST that are now referred to as SatCORPS. More information can be found in Trepte et al. (2019), Minnis et al. (2021), and Yost et al. (2021). If using this dataset, please cite these references, the CACTI VISST dataset DOI found at the download link above, and this dataset’s DOI. The CACTI VISST pixel-level retrievals are on a 2 km spatial grid and available every 15 minutes (every 10 minutes late in the campaign), producing 21,765 files for the entire field campaign between October 2018 and April 2019. They are not corrected for parallax error, which is an offset in the actual geographical location of a cloud above the surface due to the satellite viewing the cloud partly from the side off nadir. This dataset applies a correction for parallax using the location relative to the satellite and the retrieved cloud top height above the surface, which allows the dataset to be geo-located with surface-based observations. The parallax correction for each location depends on the longitude, latitude and cloud top height above ground level (AGL) for that longitude and latitude in the original VISST files. The cloud top height AGL requires first computing the surface elevation at each VISST grid point. Data from the Advanced Spaceborne Thermal Emission and Reflection (ASTER) Global Digital Elevation Map Version 3 at 30-m resolution is projected onto the VISST grid using conservative coarsening (conserving surface elevation) in the xESMF Python package. The surface elevation is then subtracted from the VISST-retrieved cloud top height above mean sea level. These cloud top heights AGL are then combined with longitude and latitude to estimate the latitude and longitude corrections. Due to variability in cloud top height, the parallax shifts produce an irregular grid of values since higher cloud tops are shifted further than lower cloud tops. A ball tree-based neighbor search with Haversine distance is performed using the Python-based scikit-learn library to find the nearest VISST grid point to each parallax correction-shifted point. The data value of the shifted point is then assigned to that VISST grid point. In this manner, the irregular geographical shifts to correct for parallax are projected back to the rectilinear VISST grid. Because relatively higher clouds should obscure lower clouds, the variable values for the highest cloud top are preferentially chosen if two or more values are assigned to a grid point. The parallax correction should be viewed as an improved but still imperfect estimation of the cloud top locations, largely because the cloud top height is an imperfect retrieval. Please see the attached README document for further information. Users are encouraged to contact the authors with any additional questions.

54 ENVIRONMENTAL SCIENCES↗