Search NASA⌕ Search

SEARCH · Search NASA

Results for “retrieval algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,585 records · Page 88

The NDSC ozone and temperature lidar alogorithm intercomparison ubutuatuve (A2I): project overview

In September 2003, the Lidar Working Group (LWG) of the Network for Detection of Stratospheric Change (NDSC) initiated an extensive project to compare the ozone and temperature algorithms used within NDSC. This initiative, referred to later as Algorithm Intercomparison Initiative (A2I), uses simulated lidar signals to test and compare various parts of the ozone and temperature lidar algorithms. In addition to the fact that it meets the requirement of the NDSC protocols, this exercise allows the detailed assessment, by all the participants, of some of the sources and magnitudes of various uncertainties associated with the algorithms, and/or with the theoretical assumptions made in these algorithms. The outcome of the A21 is to try to find common grounds in the way ozone and temperature can be retrieved in order to reduce and possibly eradicate discrepancies due to algorithm issues alone. Specific issues such as homogenizing the choice of Rayleigh extinction cross-sections, ozone absorption cross-sections, a priori information, and the definition of the vertical resolutions are among the primary targets of the A21 outcome.

lidar↗

Quantifying and Reducing Uncertainty in Microwave Vegetation Optical Depth and Soil Moisture Retrievals

Soil moisture and vegetation optical depth (VOD; related to vegetation water content) retrieved from SMAP and SMOS satellites are widely used for a range of hydrosphere and biosphere applications. However, while soil moisture has been globally well-validated, VOD validation has been sparse. Furthermore, simultaneously retrieval of these parameters results in uncertainties both individually in soil moisture and VOD retrievals as well as in compensation between the parameters. Here, we show global locations where soil moisture and VOD retrievals will have lower uncertainty, based on complementary brightness temperature information content and signal-to-noise ratio metrics. In these same locations, we show that error still propagates more into VOD. However, using VOD regularization algorithms, this error is greatly reduced, especially at sub-weekly timescales where algorithmic error can be most apparent. Despite these regularization approaches that reduce errors, there are yet vast differences in available global regularized retrievals originating from different algorithmic choices.

Passive microwave radiometry↗

Thermal Infrared Dust Optical Depth and Coarse-Mode Effective Diameter Over Oceans Retrieved From Collocated MODIS and CALIOP Observations

In this study, we developed a novel algorithm based on the collocated Moderate Resolution Imaging Spectroradiometer (MODIS) thermal infrared (TIR) observations and dust vertical profiles from the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) to simultaneously retrieve dust aerosol optical depth at 10 µm (DAOD10μm) and the coarse-mode dust effective diameter (Deff) over global oceans. The accuracy of the Deff retrieval is assessed by comparing the dust lognormal volume particle size distribution (PSD) corresponding to retrieved Deff with the in-situ measured dust PSDs from the AER-D, SAMUM-2 and SALTRACE field campaigns through case studies. The new DAOD10μm retrievals were evaluated first through comparisons with the collocated DAOD10.6μm retrieved from the combined Imaging Infrared Radiometer (IIR) and CALIOP observations from our previous study (Zheng et al. 2022). The pixel-to-pixel comparison of the two DAOD retrievals indicates a good agreement (R~0.7) and a significant reduction of (~50%) retrieval uncertainties largely thanks to the better constraint on dust size. In a climatological comparison, the seasonal and regional (5°×2°) mean DAOD10um retrievals based on our combined MODIS and CALIOP method are in good agreement with the two independent Infrared Atmospheric Sounding Interferometer (IASI) products over three dust transport regions (i.e., North Atlantic (NA; R = 0.9), Indian Ocean (IO; R = 0.8) and North Pacific (NP; R = 0.7)). Using the new retrievals from 2013 to 2017, we performed a climatological analysis of coarse mode dust Deff over global oceans. We found that dust Deff over IO and NP are up to 20% smaller than that over NA. Over NA in summer, we found a ~50% reduction of the number of retrievals with Deff > 5 μm from 15°W to 35°W and a stable trend of Deff average at 4.4 μm from 35°W throughout the Caribbean Sea (90°W). Over NP in spring, only ~5% of retrieved pixels with Deff > 5 μm are found from 150°E to 180°, while the mean Deff remains stable at 4.0 μm throughout eastern NP. To our best knowledge, this study is the first to retrieve both DAOD and coarse-mode dust particle size over global oceans for multiple years. This retrieval dataset provides insightful information for evaluating dust long-wave radiative effects and coarse mode dust particle size in models.

dust optical depth↗

WATCHMAN: A Data Warehouse Intelligent Cache Manager

Data warehouses store large volumes of data which are used frequently by decision support applications. Such applications involve complex queries. Query performance in such an environment is critical because decision support applications often require interactive query response time. Because data warehouses are updated infrequently, it becomes possible to improve query performance by caching sets retrieved by queries in addition to query execution plans. In this paper we report on the design of an intelligent cache manager for sets retrieved by queries called WATCHMAN, which is particularly well suited for data warehousing environment. Our cache manager employs two novel, complementary algorithms for cache replacement and for cache admission. WATCHMAN aims at minimizing query response time and its cache replacement policy swaps out entire retrieved sets of queries instead of individual pages. The cache replacement and admission algorithms make use of a profit metric, which considers for each retrieved set its average rate of reference, its size, and execution cost of the associated query. We report on a performance evaluation based on the TPC-D and Set Query benchmarks. These experiments show that WATCHMAN achieves a substantial performance improvement in a decision support environment when compared to a traditional LRU replacement algorithm.

Scheuermann, Peter↗

An Alternative Inter-Satellite Calibration of the UMD HIRS OLR Retrievals

Outgoing Longwave Radiation (OLR) at the top-of-atmosphere (TOA) is a fundamental component of Earth's energy balance and represents the heat energy in the thermal bands rejected to space by the planet. Determination of OLR from satellites has a long and storied history, but the observational record remains largely fragmented with gaps in satellite measurements over the past three decades. Perhaps the most semi-continuous set of retrievals comes from the University of Maryland (UMD) algorithm that uses four HIRS (High Resolution Infrared Sounder) channels on the NOAA polar orbiting satellites to estimate OLR. This data set shows great promise in helping to bridge the discontinuous ERBS (Earth Radiation Budget Satellite) and CERES (Clouds and the Earth s Radiant Energy System) measurements. However, significant satellite inter-calibration biases persist with the present UMD data, principally outside the tropics. Difficulties relate to the combination of drift of the satellite equator crossing time through the diurnal cycle and changes in HIRS channel response function design. Here we show how an ad hoc recalibration of the UMD retrievals among the different satellites removes much of the remaining uncertainty due to diurnal drift of the satellite orbit. The adjusted HIRS data (using no other external information) show much better agreement with OLR from the European Center Interim Reanalysis (EC-Int), longer-term signals in the Global Energy and Water Cycle Experiment / Surface Radiation Budget (GEWEX/SRB) retrievals, and also agree well with ERBS and CERES OLR measurements. These results augur well for narrowing the uncertainties in multi-decadal estimates of this important climate variable.

Robertson, Franklin R.↗

Optimization of Ocean Color Algorithms: Application to Satellite Data Merging

The objective of our program is to develop and validate a procedure for ocean color data merging which is one of the major goals of the SIMBIOS project. The need for a merging capability is dictated by the fact that since the launch of MODIS on the Terra platform and over the next decade, several global ocean color missions from various space agencies are or will be operational simultaneously. The apparent redundancy in simultaneous ocean color missions can actually be exploited to various benefits. The most obvious benefit is improved coverage. The patchy and uneven daily coverage from any single sensor can be improved by using a combination of sensors. Beside improved coverage of the global Ocean the merging of Ocean color data should also result in new, improved, more diverse and better data products with lower uncertainties. Ultimately, ocean color data merging should result in the development of a unified, scientific quality, ocean color time series, from SeaWiFS to NPOESS and beyond. Various approaches can be used for ocean color data merging and several have been tested within the frame of the SIMBIOS program. As part of the SIMBIOS Program, we have developed a merging method for ocean color data. Conversely to other methods our approach does not combine end-products like the subsurface chlorophyll concentration (chl) from different sensors to generate a unified product. Instead, our procedure uses the normalized water-leaving radiances (L(sub WN)(lambda)) from single or multiple sensors and uses them in the inversion of a semi-analytical ocean color model that allows the retrieval of several ocean color variables simultaneously. Beside ensuring simultaneity and consistency of the retrievals (all products are derived from a single algorithm), this model-based approach has various benefits over techniques that blend end-products (e.g. chlorophyll): 1) it works with single or multiple data sources regardless of their specific bands, 2) it exploits band redundancies and band differences, 3) it accounts for uncertainties in the (L(sub WN)(lambda)) data and, 4) it provides uncertainty estimates for the retrieved variables.

Maritorena, Stephane↗

Optimization Of Ocean Color Algorithms: Application To Satellite And In Situ Data Merging

The objective of our program is to develop and validate a procedure for ocean color data merging which is one of the major goals of the SIMBIOS project (McClain et al., 1995). The need for a merging capability is dictated by the fact that since the launch of MODIS on the Terra platform and over the next decade, several global ocean color missions from various space agencies are or will be operational simultaneously. The apparent redundancy in simultaneous ocean color missions can actually be exploited to various benefits. The most obvious benefit is improved coverage (Gregg et al., 1998; Gregg & Woodward, 1998). The patchy and uneven daily coverage from any single sensor can be improved by using a combination of sensors. Beside improved coverage of the global ocean the merging of ocean color data should also result in new, improved, more diverse and better data products with lower uncertainties. Ultimately, ocean color data merging should result in the development of a unified, scientific quality, ocean color time series, from SeaWiFS to NPOESS and beyond. Various approaches can be used for ocean color data merging and several have been tested within the frame of the SIMBIOS program (see e.g. Kwiatkowska & Fargion, 2003, Franz et al., 2003). As part of the SIMBIOS Program, we have developed a merging method for ocean color data. Conversely to other methods our approach does not combine end-products like the subsurface chlorophyll concentration (chl) from different sensors to generate a unified product. Instead, our procedure uses the normalized waterleaving radiances (LwN( )) from single or multiple sensors and uses them in the inversion of a semianalytical ocean color model that allows the retrieval of several ocean color variables simultaneously. Beside ensuring simultaneity and consistency of the retrievals (all products are derived from a single algorithm), this model-based approach has various benefits over techniques that blend end-products (e.g. chlorophyll): 1) it works with single or multiple data sources regardless of their specific bands, 2) it exploits band redundancies and band differences, 3) it accounts for uncertainties in the LwN( ) data and, 4) it provides uncertainty estimates for the retrieved variables.

Maritorena, Stephane↗

Producing Science-Ready Radar Datasets for the Retrieval of Forest Structure Parameters from Backscatter: Correcting for Terrain Topography and Changes in Vegetation Reflectivity

Radar backscatter data contain both geometric and radiometric distortions due to underlying topography and the radar viewing geometry. Our objective is to develop a radiometric correction algorithm specific to the UAVSAR system configuration that would improve retrieval of forest structure parameters. UAVSAR is an airborne Lband radar capable of repeat?pass interferometry producing images with a spatial resolution of 5m. It is characterized by an electronically steerable antenna to compensate for aircraft attitude. Thus, the computation of viewing angles (i.e. look, incidence and projection) must include aircraft attitude angles (i.e. yaw, pitch and roll) in addition to the antenna steering angle. In this presentation, we address two components of radiometric correction: area projection and vegetation reflectivity. The first correction is applied by normalization of the radar backscatter by the local ground area illuminated by the radar beam. The second is a correction due to changes in vegetation reflectivity with viewing geometry.

polarimetry↗

Graupel and Hail Identification Algorithm for the Dual-frequency Precipitation Radar (DPR) on the GPM Core Satellite

Precipitation consists of many types of hydrometeors, such as raindrops, ice crystals, graupel, and hail. Due to their impacts, graupel and hail (GH) have received particular attention in the literature. Global Precipitation Measurement (GPM) dual-frequency radar (DPR) has proved to be a very reliable system for global precipitation retrievals. This paper aims to develop a GH identification algorithm for GPM DPR. This algorithm is constructed using a precipitation type index (PTI) defined for DPR. The PTI is effective in separating hydrometeor types and is calculated using measurements of reflectivity, dual-frequency ratio, and storm top height data. The output of the algorithm is a Boolean product representing the existence of graupel or hail along with the vertical profile for each Ku- and Ka-band matched footprint. Cross validation is performed with the Weather Service Radar (WSR-88D) network over continental United States as well as during the Remote sensing of Electrification, Lightning, and Mesoscale/Microscale Processes with Adaptive Ground Observations (RELAMPAGO) experiment. Evaluation of the GH identification algorithm is performed on a global basis, which illustrates promising comparisons with the global lightning and hail precipitation maps generated using radar and radiometer.

54 ENVIRONMENTAL SCIENCES↗

Global Validation of Columnar Water Vapor Derived from EOS MODIS-MAIAC Algorithm Against the Ground-Based AERONET Observations

The water vapor is a relevant greenhouse gas in the Earth's climate system, and satellite products become one of the most effective way to characterize and monitor the columnar water vapor (CWV) content at global scale. Recently, a new product (MCD19) was released as part of MODIS (Moderate Resolution Imaging Spectroradiometer) Collection 6 (C6). This operational product from the Multi-Angle Implementation for Atmospheric Correction (MAIAC) algorithm includes a high 1-kilometer resolution CWV retrievals. This study presents the first global validation of MAIAC C6 CWV obtained from MODIS MCD19A2 product. This evaluation was performed using Aerosol Robotic Network (AERONET) observations at 265 sites (2000-2017). Overall, the results show a good agreement between MAIAC/AERONET CWV retrievals, with correlation coefficient higher than 0.95 and RMS (Root Mean Square) error lower than 0.250 centimeters. The binned error analysis revealed an underestimation (approximately 10 percent) of Aqua CWV retrievals with negative bias for CWV higher than 3.0 centimeters. In contrast, Terra CWV retrievals show a slope of regression close to unity and a low mean bias of 0.075 centimeters. While the accuracy is relatively similar between 1.0 and 5.0 centimeters for both sensor products, Terra dataset is more reliable for applications in humid tropical areas (less than 5.0 centimeters). The expected error was defined as plus or minus 15 percent, with less than 68 percent of retrievals falling within this envelope. However, the accuracy is regionally dependent, and lower error should be expected in some regions, such as South America and Oceania. Since MODIS instruments have exceeded their design lifetime, time series analysis was also presented for both sensor products. The temporal analysis revealed a systematic offset of global average between Terra and Aqua CWV records. We also found an upward trend (approximately 0.2 centimeters per decade) in Terra CWV retrievals, while Aqua CWV retrievals remain stable over time. The sensor degradation influences the ability to detect climate signals, and this study indicates the need for revisiting calibration of the MODIS bands 17-19, mainly for Terra instrument, to assure the quality of the MODIS water vapor product. Finally, this study presents a comprehensive validation analysis of MAIAC CWV over land, raising the understanding of its overall quality.

MAIAC↗

Non-Spherical Aerosol Phase Functions Derived from MODIS and AERONET Observations

We compare MODIS (Moderate Resolution Imaging Spectroradiometer) satellite aerosol retrievals of spectral optical thickness and size parameters over ocean with the same quantities derived from AERONET (Aerosol Robotic Network) observations made at island and coastal sites. Over much of the globe, the satellite-derived quantities agree well with the AERONET quantities. However, in regimes dominated by desert dust aerosol, the agreement is less robust. In the dust regimes, the MODIS retrievals show greater spectral dependence and report smaller particle sizes than do the AERONET derivations. We suggest that the reason for this discrepancy is the nonspherical nature of desert dust particles, which the initial MODIS algorithm is not able to handle. Using the discrepancy between MODIS and AERONET derived spectral optical thickness as an asset, instead of a detriment, we reconstruct the aerosol phase functions that the MODIS algorithm would have needed in order to match the AERONET retrievals. No assumptions of particle shape are used in the derivation of these functions and the results are empirical total column, ambient phase functions. We compare the empirically derived phase functions with phase functions calculated from spheres and spheroids, both situations in which assumptions about particle shape must be made. The resulting empirical nonspherical phase functions will be included in future updates of the MODIS algorithm.

Remer, L. A.↗

Improving Total Column Ozone Retrievals by Using Cloud Pressures Derived from Raman Scattering in the UV

The higher spectral resolution, coverage, and sampling of the Aura satellite ozone monitoring instrument (OMI), as compared with the total ozone mapping spectrometer (TOMS) should allow for improved ozone retrievals, including estimates of tropospheric ozone. By default, the TOMS-like OMI total column ozone algorithm uses climatological cloud-top pressures based on infrared (IR) measurements to estimate the column ozone below the clouds. Alternatively, cloud pressure can be retrieved using atmospheric rotational Raman scattering with OMI. The retrieved cloud pressures should be more consistent with assumptions made in the total ozone algorithm. Here, we use data from the global ozone monitoring experiment (GOME) to estimate total ozone using both the IR-climatological and retrieved cloud pressures. The exceed approximately 15 DU. Use of the UV cloud pressure retrievals leads to a smoother distribution of ozone along a satellite track by reducing small spatial irregularities presumably caused by errors in the climatological cloud pressures.

Vasilkov, A.↗

Highlights from a Decade of OMI-TOMS Total Ozone Observations on EOS Aura

Total ozone measurements from OMI have been instrumental in meeting Aura science objectives. In the last decade, OMI has extended the length of the TOMS total ozone record to over 35 years to monitor stratospheric ozone recovery. OMI-TOMS total ozone measurements have also been combined synergistically with measurements from other Aura instruments and MLS in particular, which provides vertically resolved information that complements the total O3 mapping capability of OMI. With this combined approach, the EOS Aura platform has produced more accurate and detailed measurements of tropospheric ozone. This has led in turn to greater understanding of the sources and transport of tropospheric ozone as well as its radiative forcing effect. The combined use of OMI and MLS data was also vital to the analysis of the severe Arctic ozone depletion event of 2011. The quality of OMI-TOMS total O3 data used in these studies is the result of several factors: a mature and well-validated algorithm, the striking stability of the OMI instrument, and OMI's hyperspectral capabilities used to derive cloud pressures. The latter has changed how we think about the effects of clouds on total ozone retrievals. We will discuss the evolution of the operational V8.5 algorithm and provide an overview and motivation for V9. After reviewing results and developments of the past decade, we finally highlight how ozone observations from EOS Aura are playing an important role in new ozone mapping missions.

Ozone↗

Characterization of Asian Dust Properties Near Source Region During ACE-Asia

Asian dust typically originates in desert areas far from polluted urban regions. During transport, dust layers can interact with anthropogenic sulfate and soot aerosols from heavily polluted urban areas. Added to the complex effects of clouds and natural marine aerosols, dust particles reaching the marine environment can have drastically different properties than those from the source. Thus, understanding the unique temporal and spatial variations of Asian aerosols is of special importance in regional-to-global climate issues such as radiative forcing, the hydrological cycle, and primary biological productivity in the mid-Pacific Ocean. During ACE-Asia campaign, we have acquired ground- based (temporal) and satellite (spatial) measurements to infer aerosol physical/optical/radiative properties, column precipitable water amount, and surface reflectivity over this region. The inclusion of flux measurements permits the determination of aerosol radiative flux in addition to measurements of loading and optical depth. At the time of the Terra/MODIS, SeaWiFS, TOMS and other satellite overpasses, these ground-based observations can provide valuable data to compare with satellite retrievals over land. In this paper, we will demonstrate new capability of the Deep Blue algorithm to track the evolution of the Asian dust storm from sources to sinks. Although there are large areas often covered by clouds in the dust season in East Asia, this algorithm is able to distinguish heavy dust from clouds over the entire regions. Examination of the retrieved daily maps of dust plumes over East Asia clearly identifies the sources contributing to the dust loading in the atmosphe~~. We have compared the satellite retrieved aerosol optical thickness to the ground-based measurements and obtained a reasonable agreement between these two. Our results also indicate that there is a large difference in the retrieved value of spectral single scattering albedo of windblown dust between different sources in East Asia.

Tsay, Si-Chee↗

Cloud and moisture fields derived from the GLA retrievals of HIRS2/MSU data

The GLA retrieval scheme for the analysis of HIRS and MSU radiances is applied to derive cloud and humidity fields from the HIRS2/MSU data for June 1979. For the retrieval of cloud fraction and cloud top pressure, the original algorithm of Susskind et al. (1983) and Susskind et al. (1984) was improved. The derived profiles of the monthly mean fields of cloud fraction and cloud top pressure clearly show the intertropical convergence zone, with the most intense convection in the monsoonal region of the southern Asia and over Central America, which show up as containing the highest cloud top levels and largest cloud amount. For the retrieval of humidity profiles, which are not one of the products of the original processing system, a new algorithm was derived.

Reuter, D.↗

Infrared algorithm development for ocean observations with EOS/MODIS

Efforts continue under this contract to develop algorithms for the computation of sea surface temperature (SST) from MODIS infrared retrievals. This effort includes radiative transfer modeling, comparison of in situ and satellite observations, development and evaluation of processing and networking methodologies for algorithm computation and data accession, evaluation of surface validation approaches for IR radiances, and participation in MODIS (project) related activities. Efforts in this contract period have focused on radiative transfer modeling and evaluation of atmospheric path radiance efforts on SST estimation, exploration of involvement in ongoing field studies, evaluation of new computer networking strategies, and objective analysis approaches.

Brown, Otis B.↗

Infrared algorithm development for ocean observations

Efforts continue under this contract to develop algorithms for the computation of sea surface temperature (SST) from MODIS infrared retrievals. This effort includes radiative transfer modeling, comparison of in situ and satellite observations, development and evaluation of processing and networking methodologies for algorithm computation and data accession, evaluation of surface validation approaches for IR radiances, and participation in MODIS (project) related activities. Efforts in this contract period have focused on radiative transfer modeling, evaluation of atmospheric correction methodologies, involvement in field studies, production and evaluation of new computer networking strategies, and objective analysis approaches.

Brown, Otis B.↗