Search NASA⌕ Search

SEARCH · Search NASA

Results for “retrieval algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86

MODIS Collection 6 Clear Sky Restoral (CSR): Filtering Cloud Mast 'Not Clear' Pixels

Correctly identifying cloudy pixels appropriate for the MOD06 cloud optical and microphysical property retrievals is accomplished in large part using results from the MOD35 1km cloud mask tests (note there are also two 250m subpixel cloud mask tests that can convert the 1km cloudy designations to clear sky). However, because MOD35 is by design clear sky conservative (i.e., it identifies "not clear" pixels), certain situations exist in which pixels identified by MOD35 as "cloudy" are nevertheless likely to be poor retrieval candidates. For instance, near the edge of clouds or within broken cloud fields, a given 1km MODIS field of view (FOV) may in fact only be partially cloudy. This can be problematic for the MOD06 retrievals because in these cases the assumptions of a completely overcast homogenous cloudy FOV and 1-dimensional plane-parallel radiative transfer no longer hold, and subsequent retrievals will be of low confidence. Furthermore, some pixels may be identified by MOD35 as "cloudy" for reasons other than the presence of clouds, such as scenes with thick smoke or lofted dust, and should therefore not be retrieved as clouds. With such situations in mind, a Clear Sky Restoral (CSR) algorithm was introduced in C5 that attempts to identify pixels expected to be poor retrieval candidates. Table 1 provides SDS locations for CSR and partly cloudy (PCL) pixels.

cloud mask↗

A diagnostic analysis of the VVP single-doppler retrieval technique

A diagnostic analysis of the VVP (volume velocity processing) retrieval method is presented, with emphasis on understanding the technique as a linear, multivariate regression. Similarities and differences to the velocity-azimuth display and extended velocity-azimuth display retrieval techniques are discussed, using this framework. Conventional regression diagnostics are then employed to quantitatively determine situations in which the VVP technique is likely to fail. An algorithm for preparation and analysis of a robust VVP retrieval is developed and applied to synthetic and actual datasets with high temporal and spatial resolution. A fundamental (but quantifiable) limitation to some forms of VVP analysis is inadequate sampling dispersion in the n space of the multivariate regression, manifest as a collinearity between the basis functions of some fitted parameters. Such collinearity may be present either in the definition of these basis functions or in their realization in a given sampling configuration. This nonorthogonality may cause numerical instability, variance inflation (decrease in robustness), and increased sensitivity to bias from neglected wind components. It is shown that these effects prevent the application of VVP to small azimuthal sectors of data. The behavior of the VVP regression is further diagnosed over a wide range of sampling constraints, and reasonable sector limits are established.

Boccippio, Dennis J.↗

Retrieval of nonprecipitating liquid water cloud parameters from microwave data - A simulation study

A new microwave algorithm, analogous to the IR 'radiance-ratioing' method of Eyre and Menzel (1989) is developed to retrieve the height and 'effective' fraction (defined as the product of the emissivity times the actual physical fractional coverage) of nonprecipitating water clouds using various pairs of the 20 microwave channels planned for the Advanced Microwave Sounding Unit (AMSU), an instrument slated to fly on polar-orbiting satellites beginning in 1994. The results of a simulation study are presented to provide some insights into the potentials of this technique using different AMSU channel combinations. This study suggests that the use of the oxygen channels 3 and 5 and water vapor channels 19 and 20 will produce the most accurate retrievals of liquid water cloud parameters and the highest percentage of good-quality retrievals over a range of meteorological and cloud conditions.

Huang, Hung-Lung↗

CSAPR2 CMAC 2.0 level c1 data.

Raw data from ARM precipitation radars must be corrected for atmospheric phenomena and instrument characteristics (e.g., attenuation, clutter) to retrieve precipitation properties. The Corrected Moments in Antenna Coordinates Version 2 (CMAC2) value-added product (VAP) is a set of algorithms and code that does such corrections, and it also retrieves precipitation quantities from the radar measurements. Similar to the X-SAPR radars at the ARM main site, C-SAPR2 radar data also needs corrections and improvements. CMAC 2.0 has been updated to work with the ARM C-SAPR 2 radar. Data and fields that have been processed to: correct for velocity aliasing, unfold and generate a cross-polarimetric phase difference that is monotonically increasing, removing impulses caused by non-uniform beam filling and phase shift on backscatter, recalculate specific differential phase using a 20-point Sobel filter on the aforementioned phase, correct for liquid path attenuation using the polarimetric signals, estimate rainfall rates at the gate using the specific attenuation. In addition, CMAC writes the data out into a community-standard format netCDF File using the CF/Radial conventions. The data are therefore compatible with new and existing National Center for Atmospheric Research (NCAR) tools such as RadXConvert for converting to a variety of popular file formats.

54 ENVIRONMENTAL SCIENCES↗

An Alternative Inter-Satellite Calibration of the UMD HIRS OLR Retrievals

The observational record for determining Outgoing Longwave Radiation (OLR) from satellites remains largely fragmented with gaps over the past three decades among the Earth Radiation Budget Experiment (ERBE), Earth Radiation Budget Satellite (ERBS) and Clouds and the Earth s Radiant Energy System (CERES) measurements. Multi-band OLR retrievals are thus an important supplement to the broadband measurements. The most semi-continuous set of OLR retrievals comes from the University of Maryland (UMD) algorithm that uses four HIRS (High Resolution Infrared Sounder) channels on the NOAA polar orbiting satellites to estimate OLR. but residual biases due principally to diurnal drift of the polar orbiter platforms remain an issue. Here we show how an alternative recalibration of the UMD retrievals taking advantage of the relative diurnal drift rates between "morning" and "evening" satellite platforms removes much of the remaining uncertainty due to changes in equator crossing times.

Robertson, Franklin R.↗

Global Assessment of OMI Aerosol Single-scattering Albedo Using Ground-based AERONET and SKYNET Inversions

We compare the aerosol single-scattering albedo (SSA) retrieved by the near-UV two-channel algorithm (OMAERUV) applied to the Aura-Ozone Monitoring Instrument (OMI) measurements with an equivalent inversion made by the ground-based Aerosol Robotic Network (AERONET). This work is the first comprehensive effort to globally compare the OMI-retrieved SSA with that of AERONET using all available sites spanning the regions of biomass burning, dust, and urban pollution. An analysis of the co-located retrievals over 269 sites reveals that about 46 percent (69 percent) of OMI-AERONET matchups agree within the absolute difference of plus or minus 0.03 (plus or minus 0.05) for all aerosol types. The comparison improves to 52 percent (77 percent) when only 'smoke' and 'dust' aerosol types were identified by the OMAERUV algorithm. Regionally, the agreement between the two inversions was robust over the biomass burning sites of South America, Sahel, Indian subcontinent, and oceanic-coastal sites followed by a reasonable agreement over north-east Asia. Over the desert regions, OMI tends to retrieve higher SSA, particularly over the Arabian Peninsula. Globally, the OMI-AERONET matchups agree mostly within plus or minus 0.03 for the aerosol optical depth (440 nanometers) and UV-aerosol index larger than 0.4 and 1.0, respectively. We also compare the OMAERUV SSA against the inversion made by an independent network of ground-based radiometer called SKYNET with its operating sites in Japan, China, South-East Asia, India, and Europe. The advantage of the SKYNET database over AERONET is that it performs retrieval at near-UV wavelengths which facilitate the direct comparison of OMI retrievals with the equivalent ground-based inversion. Comparison of OMI and SKYNET over currently available sites reveals a good agreement between the two where more than 70 percent of matchups agree within the absolute difference of 0.05.

Aerosol Single-scattering Albedo↗

Retrieval of water vapor profiles from microwave radiometric measurements near 90 and 183 GHz

Upwelling radiometric measurements at 90 GHz and three side bands near 183 GHz are used to retrieve water vapor profiles over the ocean surface. An algorithm incorporating a new technique of handling moderate cloud cover is illustrated for the profiling of both relative humidity and water vapor burden. It is shown that the retrieved relative humidity profiles reflect gross features of the corresponding profiles recorded by the radiosondes. However, the retrieval generally cannot produce fine details of the observed profiles at altitudes where a rapid change in relative humidity occurs. For this reason, comparison of retrieved and observed values at a given altitude often yields an appreciable rms error. Profiling of water vapor burden, a parameter equivalent to total integrated water vapor above a certain altitude, results in much better agreement, as expected. The rms error obtained from the results of the retrieval at the surface is comparable to that derived from the combination of measurements at 18 GHz and 21 GHz channels of the Scanning Multichannel Microwave Radiometer aboard the Nimbus 7 satellite.

Wang, J. R.↗

Machine Learning Application for Improving Cloud Detection and Phase Determination Over Sunglint Regions for Geostationary Satellites

Cloud detection and phase determination over sunglint regions has been a challenge, especially for geostationary (GEO) satellites. Sunglint is observed when the sunlight specular reflection is at the same viewing angle of the satellite sensor. This intense reflection in the visible channels (VIS) is often comparable to that from optically thick clouds. It also contaminates the shortwave infrared channels (SWIR). Consequently, VIS and SWIR channels become less useful - or not useful- when they are saturated, hampering the detection of cloudy and clear-sky pixels. Sunglint contamination happens frequently and exists nearly in every daytime GEO full disk satellite images. However, sunglint intensity and region are difficult to model due to variable viewing geometry and ocean surface conditions. Moreover, existing physical models do not meet the accuracy required for operational GEO satellite cloud detection. We developed a machine learning algorithm to improve cloud detection in sunglint conditions for the NASA Langley’s Satellite ClOud and radiation Property retrieval System (SatCORPS). This poster presents our recent progress in the algorithm development, validation and applications. The algorithm is validated using collocated SatCORPS GOES-East and GOES-West cloud products. We demonstrate that the machine learning cloud detection in sunglint regions is superior to the traditional approach by improving temporal consistency between sunglint and non-sunglint conditions.

Machine Learning, Cloud detection, Sunglint, SatCO↗

Evaluation of GPROF V05 Precipitation Retrievals under Different Cloud Regimes

Precipitation retrievals from passive microwave satellite observations form the basis of many widely used precipitation products, but the performance of the retrievals depends on numerous factors such as surface type and precipitation variability. Previous evaluation efforts have identified bias dependence on precipitation regime, which may reflect the influence on retrievals of recurring factors. In this study, the concept of a regime-based evaluation of precipitation from the Goddard profiling (GPROF) algorithm is extended to cloud regimes. Specifically, GPROF V05 precipitation retrievals under four different cloud regimes are evaluated against ground radars over the United States. GPROF is generally able to accurately retrieve the precipitation associated with both organized convection and less organized storms, which collectively produce a substantial fraction of global precipitation. However, precipitation from stratocumulus systems is underestimated over land and overestimated over water. Similarly, precipitation associated with trade cumulus environments is underestimated over land, while biases over water depend on the sensor’s channel configuration. By extending the evaluation to more sensors and suppressed environments, these results complement insights previously obtained from precipitation regimes, thus demonstrating the potential of cloud regimes in categorizing the global atmosphere into discrete systems.

precipitation↗

Multilayer Cloud Detection with the MODIS Near-Infrared Water Vapor Absorption Band

Data Collection 5 processing for the Moderate Resolution Imaging Spectroradiometer (MODIS) onboard the NASA Earth Observing System EOS Terra and Aqua spacecraft includes an algorithm for detecting multilayered clouds in daytime. The main objective of this algorithm is to detect multilayered cloud scenes, specifically optically thin ice cloud overlying a lower-level water cloud, that presents difficulties for retrieving cloud effective radius using single layer plane-parallel cloud models. The algorithm uses the MODIS 0.94 micron water vapor band along with CO2 bands to obtain two above-cloud precipitable water retrievals, the difference of which, in conjunction with additional tests, provides a map of where multilayered clouds might potentially exist. The presence of a multilayered cloud results in a large difference in retrievals of above-cloud properties between the CO2 and the 0.94 micron methods. In this paper the MODIS multilayered cloud algorithm is described, results of using the algorithm over example scenes are shown, and global statistics for multilayered clouds as observed by MODIS are discussed. A theoretical study of the algorithm behavior for simulated multilayered clouds is also given. Results are compared to two other comparable passive imager methods. A set of standard cloudy atmospheric profiles developed during the course of this investigation is also presented. The results lead to the conclusion that the MODIS multilayer cloud detection algorithm has some skill in identifying multilayered clouds with different thermodynamic phases

Wind, Galina↗

Three-Dimensional Convective–Stratiform Echo-Type Classification and Convectivity Retrieval from Radar Reflectivity

The Echo Classification from COnvectivity (ECCO) algorithm identifies convective and stratiform types of radar echo in three dimensions. It is based on the calculation of reflectivity texture—a combination of the intensity and the heterogeneity of the radar echoes on each horizontal plane in a 3D Cartesian volume. Reflectivity texture is translated into convectivity, which is designed to be a quantitative measure of the convective nature of each 3D radar grid point. It ranges from 0 (100% stratiform) to 1 (100% convective). By thresholding convectivity, a more traditional qualitative categorization is obtained, which classifies radar echoes as convective, mixed, or stratiform. In contrast to previous algorithms, these echo-type classifications are provided on the full 3D grid of the reflectivity field. The vertically resolved classifications, in combination with temperature data, allow for subclassifications into shallow, mid-, deep, and elevated convective features, and low, mid-, and high stratiform regions—again in three dimensions. The algorithm was validated using datasets collected over the U.S. Great Plains during the PECAN field campaign. An analysis of lightning counts shows ~90% of lightning occurring in regions classified as convective by ECCO. A statistical comparison of ECCO echo types with the well-established GPM radar precipitation-type categories show 84% (88%) of GPM stratiform (convective) echo being classified as stratiform (convective) or mixed by ECCO. ECCO was applied to radar grids for the continental United States, the United Arab Emirates, Australia, and Europe, illustrating its robustness and adaptability to different radar grid characteristics and climatic regions.

Radars/Radar observations↗

Overview of the Tropical Rainfall Measuring Mission (TRMM)

A space system for measuring tropical rainfall and its variations is described, and its tasks are outlined. TRMM instrumentation is covered, including a cross-track scanning multichannel passive microwave radiometer, precipitation radar, and high-resolution radiometer. A circular orbit giving intensive coverage in the tropics is analyzed. TRMM rain retrievals and validation are discussed, along with algorithms calculating rain amounts and vertical profiles.

Simpson, Joanne↗

Comparison of NOAA-9 ERBE measurements with Cirrus IFO satellite and aircraft measurements

Earth Radiation Budget Experiment (ERBE) measurements onboard the NOAA-9 are compared for consistency with satellite and aircraft measurements made during the Cirrus Intensive Field Observation (IFO) of October 1986. ERBE scene identification is compared with NOAA-9 TIROS Operational Vertical Sounder (TOVS) cloud retrievals; results from the ERBE spectral inversion algorithms are compared with High resolution Interferometer Sounder (HIS) measurements; and ERBE radiant existance measurements are compared with aircraft radiative flux measurements.

Ackerman, Steven A.↗

Increasing levels of assistance in refinement of knowledge-based retrieval systems

The task of incrementally acquiring and refining the knowledge and algorithms of a knowledge-based system in order to improve its performance over time is discussed. In particular, the design of DE-KART, a tool whose goal is to provide increasing levels of assistance in acquiring and refining indexing and retrieval knowledge for a knowledge-based retrieval system, is presented. DE-KART starts with knowledge that was entered manually, and increases its level of assistance in acquiring and refining that knowledge, both in terms of the increased level of automation in interacting with users, and in terms of the increased generality of the knowledge. DE-KART is at the intersection of machine learning and knowledge acquisition: it is a first step towards a system which moves along a continuum from interactive knowledge acquisition to increasingly automated machine learning as it acquires more knowledge and experience.

Baudin, Catherine↗

Remote Sensing of Aerosol and their Radiative Properties from the MODIS Instrument on EOS-Terra Satellite: First Results and Evaluation

The MODIS instrument was launched on the NASA Terra satellite in Dec. 1999. Since last Oct., the sensor and the aerosol algorithm reached maturity and provide global daily retrievals of aerosol optical thickness and properties. MODIS has 36 spectral channels in the visible to IR with resolution down to 250 m. This allows accurate cloud screening and multi-spectral aerosol retrievals. We derive the aerosol optical thickness over the ocean and most of the land areas, distinguishing between fine (mainly man-made aerosol) and coarse aerosol particles. The information is more precise over the ocean where we derive also the effective radius and scattering asymmetry parameter of the aerosol. New methods to derive the aerosol single scattering albedo are also being developed. These measurements are use to track different aerosol sources, transport and the radiative forcing at the top and bottom of the atmosphere. The AErosol RObotic NETwork of ground based radiometers is used for global validation of the satellite derived optical thickness, size parameters and single scattering albedo and measure additional aerosol parameters that cannot be derived from space.

Kaufman, Yoram↗

The New MODIS-Terra, and the Proposed COBRA Mission: First Global Aerosol Distribution and Properties Over Land and Ocean, and Plans to Measure Global Black Carbon Absorption Over the Ocean Glint

The MODIS instrument was launched on the NASA Terra satellite in Dec. 1999. Since last Oct, the sensor and the aerosol algorithm reached maturity and provide global daily retrievals of aerosol optical thickness and properties. MODIS has 36 spectral channels in the visible to IR with resolution down to 250 m. This allows accurate cloud screening and multi-spectral aerosol retrievals. We derive the aerosol optical thickness over the ocean and most of the land areas, distinguishing between fine (mainly man-made aerosol) and coarse (mainly natural) aerosol particles. New methods to derive the aerosol absorption of sunlight are also being developed. These measurements are use to track different aerosol sources, transport and the radiative forcing at the top and bottom of the atmosphere. However MODIS or any present satellite sensor cannot measure absorption by Black Carbon over the oceans, a critical component in studying climate change and human health. For this purpose we propose the COBRA mission that observes the ocean at glint and off glint simultaneously measuring the spectral polarized light and deriving precisely the aerosol absorption.

Kaufman, Yoram J.↗

Observing System Simulation Experiment (OSSE) for the HyspIRI Spectrometer Mission

The OSSE software provides an integrated end-to-end environment to simulate an Earth observing system by iteratively running a distributed modeling workflow based on the HyspIRI Mission, including atmospheric radiative transfer, surface albedo effects, detection, and retrieval for agile exploration of the mission design space. The software enables an Observing System Simulation Experiment (OSSE) and can be used for design trade space exploration of science return for proposed instruments by modeling the whole ground truth, sensing, and retrieval chain and to assess retrieval accuracy for a particular instrument and algorithm design. The OSSE in fra struc ture is extensible to future National Research Council (NRC) Decadal Survey concept missions where integrated modeling can improve the fidelity of coupled science and engineering analyses for systematic analysis and science return studies. This software has a distributed architecture that gives it a distinct advantage over other similar efforts. The workflow modeling components are typically legacy computer programs implemented in a variety of programming languages, including MATLAB, Excel, and FORTRAN. Integration of these diverse components is difficult and time-consuming. In order to hide this complexity, each modeling component is wrapped as a Web Service, and each component is able to pass analysis parameterizations, such as reflectance or radiance spectra, on to the next component downstream in the service workflow chain. In this way, the interface to each modeling component becomes uniform and the entire end-to-end workflow can be run using any existing or custom workflow processing engine. The architecture lets users extend workflows as new modeling components become available, chain together the components using any existing or custom workflow processing engine, and distribute them across any Internet-accessible Web Service endpoints. The workflow components can be hosted on any Internet-accessible machine. This has the advantages that the computations can be distributed to make best use of the available computing resources, and each workflow component can be hosted and maintained by their respective domain experts.

Turmon, Michael J.↗