Search NASA⌕ Search

SEARCH · Search NASA

Results for “Retrieval algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
NASA NTRS2004

Review of TRMM/GPM Rainfall Algorithm Validation

A review is presented concerning current progress on evaluation and validation of standard Tropical Rainfall Measuring Mission (TRMM) precipitation retrieval algorithms and the prospects for implementing an improved validation research program for the next generation Global Precipitation Measurement (GPM) Mission. All standard TRMM algorithms are physical in design, and are thus based on fundamental principles of microwave radiative transfer and its interaction with semi-detailed cloud microphysical constituents. They are evaluated for consistency and degree of equivalence with one another, as well as intercompared to radar-retrieved rainfall at TRMM's four main ground validation sites. Similarities and differences are interpreted in the context of the radiative and microphysical assumptions underpinning the algorithms. Results indicate that the current accuracies of the TRMM Version 6 algorithms are approximately 15% at zonal-averaged / monthly scales with precisions of approximately 25% for full resolution / instantaneous rain rate estimates (i.e., level 2 retrievals). Strengths and weaknesses of the TRMM validation approach are summarized. Because the dew of convergence of level 2 TRMM algorithms is being used as a guide for setting validation requirements for the GPM mission, it is important that the GPM algorithm validation program be improved to ensure concomitant improvement in the standard GPM retrieval algorithms. An overview of the GPM Mission's validation plan is provided including a description of a new type of physical validation model using an analytic 3-dimensional radiative transfer model.

Smith, Eric A.↗
NASA NTRS1999

Temperature Crosstalk Sensitivity of the Kummerow Rainfall Algorithm

Even though the signal source for passive microwave retrievals is thermal emission, retrievals of non-temperature geophysical parameters typically do not explicitly take into account the effects of temperature change on the retrievals. For global change research, changes in geophysical parameters (e.g. water vapor, rainfall, etc.) are referenced to the accompanying changes in temperature. If the retrieval of a certain parameter has a cross-talk response from temperature change alone, the retrievals might not be very useful for climate research. We investigated the sensitivity of the Kummerow rainfall retrieval algorithm to changes in air temperature. It was found that there was little net change in total rainfall with air temperature change. However, there were non-negligible changes within individual rain rate categories.

Spencer, Roy W.↗
NASA NTRS2016

Phase-Retrieval Uncertainty Estimation and Algorithm Comparison for the JWST-ISIM Test Campaign

Phase retrieval, the process of determining the exitpupil wavefront of an optical instrument from image-plane intensity measurements, is the baseline methodology for characterizing the wavefront for the suite of science instruments (SIs) in the Integrated Science Instrument Module (ISIM) for the James Webb Space Telescope (JWST). JWST is a large, infrared space telescope with a 6.5-meter diameter primary mirror. JWST is currently NASA's flagship mission and will be the premier space observatory of the next decade. ISIM contains four optical benches with nine unique instruments, including redundancies. ISIM was characterized at the Goddard Space Flight Center (GSFC) in Greenbelt, MD in a series of cryogenic vacuum tests using a telescope simulator. During these tests, phase-retrieval algorithms were used to characterize the instruments. The objective of this paper is to describe the Monte-Carlo simulations that were used to establish uncertainties (i.e., error bars) for the wavefronts of the various instruments in ISIM. Multiple retrieval algorithms were used in the analysis of ISIM phase-retrieval focus-sweep data, including an iterativetransform algorithm and a nonlinear optimization algorithm. These algorithms emphasize the recovery of numerous optical parameters, including low-order wavefront composition described by Zernike polynomial terms and high-order wavefront described by a point-by-point map, location of instrument best focus, focal ratio, exit-pupil amplitude, the morphology of any extended object, and optical jitter. The secondary objective of this paper is to report on the relative accuracies of these algorithms for the ISIM instrument tests, and a comparison of their computational complexity and their performance on central and graphical processing unit clusters. From a phase-retrieval perspective, the ISIM test campaign includes a variety of source illumination bandwidths, various image-plane sampling criteria above and below the Nyquist- Shannon critical sampling value, various extended object sizes, and several other impactful effects.

Design Analysis↗
NASA NTRS1999

Global Aerosol Climatology Project: An Update

This paper outlines the methodology of interpreting channe1 1 and 2 AVHRR (Advanced Very High Resolution Radiometer) radiance data over the oceans and describes a detailed analysis of the sensitivity of monthly averages of retrieved aerosol parameters to the assumptions made in different retrieval algorithms. The analysis is based on using real AVHRR data and exploiting accurate numerical techniques for computing single and multiple scattering and spectral absorption of light in the vertically inhomogeneous atmospheric-ocean system. We show that two-channel algorithms can be expected tp provide significantly more biased retrievals of the aerosol optical thickness than one-channel algorithms and that imperfect cloud screening and calibration uncertainties are by far the largest sources of errors in the retrieved aerosol parameters. Both underestimating and overestimating aerosol absorption as well as the potentially strong variability of the real part of the aerosol refractive index may lead to regional and/or seasonal biases in optical thickness retrievals. The Angstrom exponent appears to be the most invariant aerosol size characteristic and should be retrieved along with optical thickness as the second aerosol parameter.

Mishchenko, Michael I.↗
NASA NTRS2011

A Ground Validation Network for the Global Precipitation Measurement Mission

A prototype Validation Network (VN) is currently operating as part of the Ground Validation System for NASA's Global Precipitation Measurement (GPM) mission. The VN supports precipitation retrieval algorithm development in the GPM prelaunch era. Postlaunch, the VN will be used to validate GPM spacecraft instrument measurements and retrieved precipitation data products. The period of record for the VN prototype starts on 8 August 2006 and runs to the present day. The VN database includes spacecraft data from the Tropical Rainfall Measuring Mission (TRMM) precipitation radar (PR) and coincident ground radar (GR) data from operational meteorological networks in the United States, Australia, Korea, and the Kwajalein Atoll in the Marshall Islands. Satellite and ground radar data products are collected whenever the PR satellite track crosses within 200 km of a VN ground radar, and these data are stored permanently in the VN database. VN products are generated from coincident PR and GR observations when a significant rain event occurs. The VN algorithm matches PR and GR radar data (including retrieved precipitation data in the case of the PR) by calculating averages of PR reflectivity (both raw and attenuation corrected) and rain rate, and GR reflectivity at the geometric intersection of the PR rays with the individual GR elevation sweeps. The algorithm thus averages the minimum PR and GR sample volumes needed to "matchup" the spatially coincident PR and GR data types. The result of this technique is a set of vertical profiles for a given rainfall event, with coincident PR and GR samples matched at specified heights throughout the profile. VN data can be used to validate satellite measurements and to track ground radar calibration over time. A comparison of matched TRMM PR and GR radar reflectivity factor data found a remarkably small difference between the PR and GR radar reflectivity factor averaged over this period of record in stratiform and convective rain cases when samples were taken from high in the atmosphere. A significant difference in PR and GR reflectivity was found in convective cases, particularly in convective samples from the lower part of the atmosphere. In this case, the mean difference between PR and corrected GR reflectivity was −1.88 dBZ. The PR-GR bias was found to increase with the amount of PR attenuation correction applied, with the PR-GR bias reaching −3.07 dBZ in cases where the attenuation correction applied is greater than 6 dBZ. Additional analysis indicated that the version 6 TRMM PR retrieval algorithm underestimates rainfall in case of convective rain in the lower part of the atmosphere by 30%-40%.

Schwaller, Mathew R.↗
NASA NTRS2011

A Ground Validation Network for the Global Precipitation Measurement Mission

A prototype Validation Network (VN) is currently operating as part of the Ground Validation System for NASA's Global Precipitation Measurement (GPM) mission. The VN supports precipitation retrieval algorithm development in the GPM prelaunch era. Postlaunch, the VN will be used to validate GPM spacecraft instrument measurements and retrieved precipitation data products. The period of record for the VN prototype starts on 8 August 2006 and runs to the present day. The VN database includes spacecraft data from the Tropical Rainfall Measuring Mission (TRMM) precipitation radar (PR) and coincident ground radar (GR) data from operational meteorological networks in the United States, Australia, Korea, and the Kwajalein Atoll in the Marshall Islands. Satellite and ground radar data products are collected whenever the PR satellite track crosses within 200 km of a VN ground radar, and these data are stored permanently in the VN database. VN products are generated from coincident PR and GR observations when a significant rain event occurs. The VN algorithm matches PR and GR radar data (including retrieved precipitation data in the case of the PR) by calculating averages of PR reflectivity (both raw and attenuation corrected) and rain rate, and GR reflectivity at the geometric intersection of the PR rays with the individual GR elevation sweeps. The algorithm thus averages the minimum PR and GR sample volumes needed to "matchup" the spatially coincident PR and GR data types. The result of this technique is a set of vertical profiles for a given rainfall event, with coincident PR and GR samples matched at specified heights throughout the profile. VN data can be used to validate satellite measurements and to track ground radar calibration over time. A comparison of matched TRMM PR and GR radar reflectivity factor data found a remarkably small difference between the PR and GR radar reflectivity factor averaged over this period of record in stratiform and convective rain cases when samples were taken from high in the atmosphere. A significant difference in PR and GR reflectivity was found in convective cases, particularly in convective samples from the lower part of the atmosphere. In this case, the mean difference between PR and corrected GR reflectivity was -1.88 dBZ. The PR-GR bias was found to increase with the amount of PR attenuation correction applied, with the PR-GR bias reaching -3.07 dBZ in cases where the attenuation correction applied is greater than 6 dBZ. Additional analysis indicated that the version 6 TRMM PR retrieval algorithm underestimates rainfall in case of convective rain in the lower part of the atmosphere by 30%-40%.

Schwaller, Mathew R.↗
NASA NTRS2022

A Comprehensive Machine Learning Study to Classify Precipitation Type over Land from Global Precipitation Measurement Microwave Imager (GPM-GMI) Measurements

Precipitation type is a key parameter used for better retrieval of precipitation characteristics as well as to understand the cloud–convection–precipitation coupling processes. Ice crystals and water droplets inherently exhibit different characteristics in different precipitation regimes (e.g., convection, stratiform), which reflect on satellite remote sensing measurements that help us distinguish them. The Global Precipitation Measurement (GPM) Core Observatory’s microwave imager (GMI) and dual-frequency precipitation radar (DPR) together provide ample information on global precipitation characteristics. As an active sensor, the DPR provides an accurate precipitation type assignment, while passive sensors such as the GMI are traditionally only used for empirical understanding of precipitation regimes. Using collocated precipitation type flags from the DPR as the “truth”, this paper employs machine learning (ML) models to train and test the predictability and accuracy of using passive GMI-only observations together with ancillary information from a reanalysis and GMI surface emissivity retrieval products. Out of six ML models, four simple ones (support vector machine, neural network, random forest, and gradient boosting) and the 1-D convolutional neural network (CNN) model are identified to produce 90–94% prediction accuracy globally for five types of precipitation (convective, stratiform, mixture, no precipitation, and other precipitation), which is much more robust than previous similar effort. One novelty of this work is to introduce data augmentation (subsampling and bootstrapping) to handle extremely unbalanced samples in each category. A careful evaluation of the impact matrices demonstrates that the polarization difference (PD), brightness temperature (Tc) and surface emissivity at high-frequency channels dominate the decision process, which is consistent with the physical understanding of polarized microwave radiative transfer over different surface types, as well as in snow and liquid clouds with different microphysical properties. Furthermore, the view-angle dependency artifact that the DPR’s precipitation flag bears with does not propagate into the conical-viewing GMI retrievals. This work provides a new and promising way for future physics-based ML retrieval algorithm development.

machine learning/artificial intelligence↗
NASA NTRS2005

Radiative Studies of Planetary Atmospheres

Retrieval algorithms and associated software for application to CIRS infrared spectral data have been developed and coded. A general forward radiative transfer code has been written that runs efficiently on a Macintosh, even at high spectral resolution (0.5 per centimeter). It makes use of the correlated-k approach for representation of the gaseous absorption and can include those gases listed in the HITRAN and GEISA atlases, along with collision-induced absorption. Cloud effects are included as spectrally dependent absorbers. Provision has been made for future extension to include particle scattering in an n-stream approximation. The primary purpose of the code is to produce synthetic data and to serve as the forward calculating element in gas and cloud retrieval programs developed for the Mac as well as other platforms. Initial development of algorithms and production software suitable for application to CIRS data to be obtained from Jupiter, Saturn and Titan has been completed, and production versions of the software for application to the spectral data are in place. This includes temperature, gaseous constituent, and cloud opacity retrieval, algorithms that can be applied to both nadir and limb data. This work has been done as a cooperative effort between Conrath and Matcheva (Cornell), Achterberg (GSFWSSAI), and Flasar (GSFC).

Conrath, Barney J.↗
NASA NTRS1993

An analysis of errors in special sensor microwave imager evaporation estimates over the global oceans

The method proposed by Liu (1984) is used to estimate monthly averaged evaporation over the global oceans from 1 yr of special sensor microwave imager (SDSM/I) data. Intercomparisons involving SSM/I and in situ data are made over a wide range of oceanic conditions during August 1987 and February 1988 to determine the source of errors in the evaporation estimates. The most significant spatially coherent evaporation errors are found to come from estimates of near-surface specific humidity, q. Systematic discrepancies of over 2 g/kg are found in the tropics, as well as in the middle and high latitudes. The q errors are partitioned into contributions from the parameterization of q in terms of the columnar water vapor, i.e., the Liu q/W relationship, and from the retrieval algorithm for W. The effects of W retrieval errors are found to be smaller over most of the global oceans and due primarily to the implicitly assumed vertical structures of temperature and specific humidity on which the physically based SSM/I retrievals of W are based.

Esbensen, S. K.↗
NASA NTRS2014

The Impact of the Assimilation of Aquarius Sea Surface Salinity Data in the GEOS Ocean Data Assimilation System

Ocean salinity and temperature differences drive thermohaline circulations. These properties also play a key role in the ocean-atmosphere coupling. With the availability of L-band space-borne observations, it becomes possible to provide global scale sea surface salinity (SSS) distribution. This study analyzes globally the along-track (Level 2) Aquarius SSS retrievals obtained using both passive and active L-band observations. Aquarius alongtrack retrieved SSS are assimilated into the ocean data assimilation component of Version 5 of the Goddard Earth Observing System (GEOS-5) assimilation and forecast model. We present a methodology to correct the large biases and errors apparent in Version 2.0 of the Aquarius SSS retrieval algorithm and map the observed Aquarius SSS retrieval into the ocean models bulk salinity in the topmost layer. The impact of the assimilation of the corrected SSS on the salinity analysis is evaluated by comparisons with insitu salinity observations from Argo. The results show a significant reduction of the global biases and RMS of observations-minus-forecast differences at in-situ locations. The most striking results are found in the tropics and southern latitudes. Our results highlight the complementary role and problems that arise during the assimilation of salinity information from in-situ (Argo) and space-borne surface (SSS) observations

Salinty↗
NASA NTRS2013

Application of OMI, SCIAMACHY and GOME-2 Satellite SO2 Retrievals for Detection of Large Emission Sources

Retrievals of sulfur dioxide (SO2) from space-based spectrometers are in a relatively early stage of development. Factors such as interference between ozone and SO2 in the retrieval algorithms often lead to errors in the retrieved values. Measurements from the Ozone Monitoring Instrument (OMI), Scanning Imaging Absorption Spectrometer for Atmospheric Chartography (SCIAMACHY), and Global Ozone Monitoring Experiment-2 (GOME-2) satellite sensors, averaged over a period of several years, were used to identify locations with elevated SO2 values and estimate their emission levels. About 30 such locations, detectable by all three sensors and linked to volcanic and anthropogenic sources, were found after applying low and high spatial frequency filtration designed to reduce noise and bias and to enhance weak signals to SO2 data from each instrument. Quantitatively, the mean amount of SO2 in the vicinity of the sources, estimated from the three instruments, is in general agreement. However, its better spatial resolution makes it possible for OMI to detect smaller sources and with additional detail as compared to the other two instruments. Over some regions of China, SCIAMACHY and GOME-2 data show mean SO2 values that are almost 1.5 times higher than those from OMI, but the suggested spatial filtration technique largely reconciles these differences.

SO2 retrievals↗
NASA NTRS2016

Soil Moisture Active Passive (SMAP) Project Algorithm Theoretical Basis Document SMAP L1B Radiometer Data Product: L1B_TB

The purpose of the Soil Moisture Active Passive (SMAP) radiometer calibration algorithm is to convert Level 0 (L0) radiometer digital counts data into calibrated estimates of brightness temperatures referenced to the Earth's surface within the main beam. The algorithm theory in most respects is similar to what has been developed and implemented for decades for other satellite radiometers; however, SMAP includes two key features heretofore absent from most satellite borne radiometers: radio frequency interference (RFI) detection and mitigation, and measurement of the third and fourth Stokes parameters using digital correlation. The purpose of this document is to describe the SMAP radiometer and forward model, explain the SMAP calibration algorithm, including approximations, errors, and biases, provide all necessary equations for implementing the calibration algorithm and detail the RFI detection and mitigation process. Section 2 provides a summary of algorithm objectives and driving requirements. Section 3 is a description of the instrument and Section 4 covers the forward models, upon which the algorithm is based. Section 5 gives the retrieval algorithm and theory. Section 6 describes the orbit simulator, which implements the forward model and is the key for deriving antenna pattern correction coefficients and testing the overall algorithm.

microwave radiometers↗
NASA NTRS2016

L-band Radiometer Calibration Consistency Assessment for the SMOS, SMAP, and Aquarius Instruments

Three L-band radiometers have been observing the Earth in order to retrieve soil moisture and ocean salinity. They use different instrument configurations and calibration and retrieval algorithms. In any case, the brightness temperature retrieved at the Earth surface should be consistent between all instruments. One reason for inconsistency would be the use of different approaches for the instrument calibration or the use of different models to retrieve surface brightness temperature. We report on the different approaches used for the SMOS, SMAP and Aquarius instruments and their impact on the observations consistency.

Aquarius↗
NASA NTRS2017

Assessment of Version 4 of the SMAP Passive Soil Moisture Standard Product

NASAs Soil Moisture Active Passive (SMAP) mission launched on January 31, 2015 into a sun-synchronous 6 am6 pm orbit with an objective to produce global mapping of high-resolution soil moisture and freeze-thaw state every 2-3 days. The SMAP radiometer began acquiring routine science data on March 31, 2015 and continues to operate nominally. SMAPs radiometer-derived standard soil moisture product (L2SMP) provides soil moisture estimates posted on a 36-km fixed Earth grid using brightness temperature observations and ancillary data. A beta quality version of L2SMP was released to the public in October, 2015, Version 3 validated L2SMP soil moisture data were released in May, 2016, and Version 4 L2SMP data were released in December, 2016. Version 4 data are processed using the same soil moisture retrieval algorithms as previous versions, but now include retrieved soil moisture from both the 6 am descending orbits and the 6 pm ascending orbits. Validation of 19 months of the standard L2SMP product was done for both AM and PM retrievals using in situ measurements from global core calval sites. Accuracy of the soil moisture retrievals averaged over the core sites showed that SMAP accuracy requirements are being met.

SMAP↗
NASA NTRSDate not supplied

Hyperspectral Radiatve Transfer Modeling and its Applications

We will describe a fast radiative transfer model that is specifically designed for hyperspectral remote sensing applications. The fast radiative transfer model is capable of performing efficient and accurate calculations under cloudy condition and in the presence of solar radiations. The model uses a Principal Component Analysis to speed up computational speed. The PCRTM model is capable of simulating top of atmospheric radiance or reflectance spectral from 50 wavenumber to 30000 wavenumber. The PCRTM has a very good accuracy relative to reference line-by-line radiative transfer models and it saves orders of magnitude computational time. We will show comparisons of the PCRTM model to AIRS, CrIS, IASI, NAST-I, and SCIAMACHY data. We will further show results of applying the PCRTM retrieval algorithm to these remote sensing data to retrieve atmospheric temperature and moisture profiles, CO2, CO, CH4, N2O, and O3 profiles, cloud optical depth, size, phase, and height. Surface properties such as surface emissivity spectra and surface skin temperatures are also retrieved simultaneously.

X Liu↗
NASA NTRS2019

Exploring Aerosols Near Clouds With High‐Spatial‐Resolution Aircraft Remote Sensing During SEAC(4)RS

Since aerosols are important to our climate system, we seek to observe the variability of aerosol properties within cloud systems. When applied to the satellite‐borne Moderate‐resolution Imaging Spectroradiometer (MODIS), the Dark Target retrieval algorithm provides global aerosol optical depth (AOD; at 0.55 μm) in cloud‐free scenes. Since MODIS' resolution (500‐m pixels, 3‐ or 10‐km product) is too coarse for studying near‐cloud aerosol, we ported the Dark Target algorithm to the high‐resolution (~50‐m pixels) enhanced‐MODIS Airborne Simulator (eMAS), which flew on the high‐altitude ER‐2 during the Studies of Emissions, Atmospheric Composition, Clouds, and Climate Coupling by Regional Surveys Airborne Science Campaign over the United States in 2013. We find that even with aggressive cloud screening, the ~0.5‐km eMAS retrievals show enhanced AOD, especially within 6 km of a detected cloud. To determine the cause of the enhanced AOD, we analyze additional eMAS products (cloud retrievals and degraded‐resolution AOD), coregistered Cloud Physics Lidar profiles, MODIS aerosol retrievals, and ground‐based Aerosol Robotic Network observations. We also define spatial metrics to indicate local cloud distributions near each retrieval and then separate into near‐cloud and far‐from‐cloud environments. The comparisons show that low cloud masking is robust, and unscreened thin cirrus would have only a small impact on retrieved AOD. Some of the enhancement is consistent with clear‐cloud transition zone microphysics such as aerosol swelling. However, 3‐D radiation interaction between clouds and the surrounding clear air appears to be the primary cause of the high AOD near clouds.

aerosol retrieval algorithm↗
NASA NTRS2011

Statistically Optimized Inversion Algorithm for Enhanced Retrieval of Aerosol Properties from Spectral Multi-Angle Polarimetric Satellite Observations

The proposed development is an attempt to enhance aerosol retrieval by emphasizing statistical optimization in inversion of advanced satellite observations. This optimization concept improves retrieval accuracy relying on the knowledge of measurement error distribution. Efficient application of such optimization requires pronounced data redundancy (excess of the measurements number over number of unknowns) that is not common in satellite observations. The POLDER imager on board the PARASOL microsatellite registers spectral polarimetric characteristics of the reflected atmospheric radiation at up to 16 viewing directions over each observed pixel. The completeness of such observations is notably higher than for most currently operating passive satellite aerosol sensors. This provides an opportunity for profound utilization of statistical optimization principles in satellite data inversion. The proposed retrieval scheme is designed as statistically optimized multi-variable fitting of all available angular observations obtained by the POLDER sensor in the window spectral channels where absorption by gas is minimal. The total number of such observations by PARASOL always exceeds a hundred over each pixel and the statistical optimization concept promises to be efficient even if the algorithm retrieves several tens of aerosol parameters. Based on this idea, the proposed algorithm uses a large number of unknowns and is aimed at retrieval of extended set of parameters affecting measured radiation.

Dubovik, O↗
NASA NTRS1988

Nimbus-7 global cloud climatology. I - Algorithms and validation

An improved version of the Nimbus-7 cloud retrieval algorithm was validated using data from Nimbus-7 Temperature Humidity Infrared Radiometer and Total Ozone Mapping Spectrometer to determine cloudiness parameters for the globe. Quantitative validation of total cloud amount was performed by comparing the algorithm results with estimates derived from GOES images and auxiliary meteorological data. The systematic errors of the Nimbus-7 total cloud-amount algorithm, relative to the GOES-derived estimates, were found to be less than 10 percent. The random errors of daily estimates ranged between 7 and 16 percent, day or night.

Stowe, L. L.↗