Search NASA⌕ Search

SEARCH · Search NASA

Results for “retrieval”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Efficient Methods to Assimilate Satellite Retrievals Based on Information Content: Suboptimal Retrieval Assimilation - Part 2

One of the outstanding problems in data assimilation has been and continues to be how best to utilize satellite data while balancing the tradeoff between accuracy and computational cost. A number of weather prediction centers have recently achieved remarkable success in improving their forecast skill by changing the method by which satellite data are assimilated into the forecast model from the traditional approach of assimilating retrievals to the direct assimilation of radiances in a variational framework. The operational implementation of such a substantial change in methodology involves a great number of technical details, e.g., pertaining to quality control procedures, systematic error correction techniques, and tuning of the statistical parameters in the analysis algorithm. Although there are clear theoretical advantages to the direct radiance assimilation approach, it is not obvious at all to what extent the improvements that have been obtained so far can be attributed to the change in methodology, or to various technical aspects of the implementation. The issue is of interest because retrieval assimilation retains many practical and logistical advantages which may become even more significant in the near future when increasingly high-volume data sources become available. The central question we address here is: how much improvement can we expect from assimilating radiances rather than retrievals, all other things being equal? We compare the two approaches in a simplified one-dimensional theoretical framework, in which problems related to quality control and systematic error correction are conveniently absent. By assuming a perfect radiative transfer model and perfect knowledge of radiance and background error covariances, we are able to formulate a nonlinear local error analysis for each assimilation method. Direct radiance assimilation is optimal in this idealized context, while the traditional method of assimilating retrievals is suboptimal because it ignores the cross-covariances between background errors and retrieval errors. We show that interactive retrieval assimilation (where the same background used for assimilation is also used in the retrieval step) is equivalent to direct assimilation of radiances with suboptimal analysis weights. We illustrate and extend these theoretical arguments with several one-dimensional assimilation experiments, where we estimate vertical atmospheric profiles using simulated data from both the High-resolution InfraRed Sounder 2 (HIRS2) and the future Atmospheric InfraRed Sounder (AIRS).

Joiner, J.↗

Retrieval of Ice Cloud Properties Using an Optimal Estimation Algorithm and MODIS Infrared Observations: 2. Retrieval Evaluation

An infrared-based optimal estimation (OE-IR) algorithm for retrieving ice cloud properties is evaluated. Specifically, the implementation of the algorithm with MODerate resolution Imaging Spectroradiometer (MODIS) observations is assessed in comparison with the operational retrieval products from MODIS on the Aqua satellite (MYD06), Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP), and the Imaging Infrared Radiometer (IIR); the latter two instruments fly on the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO) satellite in the Afternoon Constellation (A-Train) with Aqua. The results show that OE-IR cloud optical thickness (tau) and effective radius (r(sub eff)) retrievals perform best for ice clouds having 0.5 < tau< 7 and r(sub eff) < 50microns. For global ice clouds, the averaged retrieval uncertainties of tau and r(sub eff) are 19% and 33%, respectively. For optically thick ice clouds with tau larger than 10, however, the tau and r(sub eff) retrieval uncertainties can exceed 30% and 50%, respectively. For ice cloud top height (h), the averaged global uncertainty is 0.48km. Relatively large h uncertainty (e.g., > 1km) occurs for tau < 0.5. Analysis of 1month of the OE-IR retrievals shows large tau and r(sub eff) uncertainties in storm track regions and the southern oceans where convective clouds are frequently observed, as well as in high-latitude regions where temperature differences between the surface and cloud top are more ambiguous. Generally, comparisons between the OE-IR and the operational products show consistent tau and h retrievals. However, obvious differences between the OE-IR and the MODIS Collection 6 r(sub eff) are found.

cloud optics↗

The CU 2-D-MAX-DOAS instrument – Part 2: Raman scattering probability measurements and retrieval of aerosol optical properties

Abstract. The multiannual global mean of aerosol optical depth at 550 nm (AOD550) over land is ∼ 0.19, and that over oceans is ∼ 0.13. About 45 % of the Earth surface shows AOD550 smaller than 0.1. There is a need for measurement techniques that are optimized to measure aerosol optical properties under low AOD conditions. We present an inherently calibrated retrieval (i.e., no need for radiance calibration) to simultaneously measure AOD and the aerosol phase function parameter, g, based on measurements of azimuth distributions of the Raman scattering probability (RSP), the near-absolute rotational Raman scattering (RRS) intensity. We employ radiative transfer model simulations to show that for solar azimuth RSP measurements at solar elevation and solar zenith angle (SZA) smaller than 80°, RSP is insensitive to the vertical distribution of aerosols and maximally sensitive to changes in AOD and g under near-molecular scattering conditions. The University of Colorado two-dimensional Multi-AXis Differential Optical Absorption Spectroscopy (CU 2-D-MAX-DOAS) instrument was deployed as part of the Two Column Aerosol Project (TCAP) at Cape Cod, MA, during the summer of 2012 to measure direct sun spectra and RSP from scattered light spectra at solar relative azimuth angles (SRAAs) between 5 and 170°. During two case study days with (1) high aerosol load (17 July, 0.3 < AOD430 < 0.6) and (2) near-molecular scattering conditions (22 July, AOD430 < 0.13) we compare RSP-based retrievals of AOD430 and g with data from a co-located CIMEL sun photometer, Multi-Filter Rotating Shadowband Radiometer (MFRSR), and an airborne High Spectral Resolution Lidar (HSRL-2). The average difference (relative to DOAS) for AOD430 is +0.012 ± 0.023 (CIMEL), −0.012 ± 0.024 (MFRSR), −0.011 ± 0.014 (HSRL-2), and +0.023 ± 0.013 (CIMELAOD − MFRSRAOD) and yields the following expressions for correlations between different instruments: DOASAOD = −(0.019 ± 0.006) + (1.03 ± 0.02) × CIMELAOD (R2 = 0.98), DOASAOD = −(0.006 ± 0.005) + (1.08 ± 0.02) × MFRSRAOD (R2 = 0.98), and CIMELAOD = (0.013 ± 0.004) + (1.05 ± 0.01) × MFRSRAOD (R2 = 0.99). The average g measured by DOAS on both days was 0.66 ± 0.03, with a difference of 0.014 ± 0.05 compared to CIMEL. Active steps to minimize the error in the RSP help to reduce the uncertainty in retrievals of AOD and g. As AOD decreases and SZA increases, the RSP signal-to-noise ratio increases. At AOD430 ∼ 0.4 and 0.10 the absolute AOD errors are ∼ 0.014 and 0.003 at 70° SZA and 0.02 and 0.004 at 35° SZA. Inherently calibrated, precise AOD and g measurements are useful to better characterize the aerosol direct effect in urban polluted and remote pristine environments.

54 ENVIRONMENTAL SCIENCES↗

Utilizing the MODIS 1.38 micrometer Channel for Cirrus Cloud Optical Thickness Retrievals: Algorithm and Retrieval Uncertainties

The cloud products from the Moderate Resolution Imaging Spectroradiometers (MODIS) on Terra and Aqua have been widely used within the atmospheric research community. The retrieval algorithms, however, oftentimes have difficulty detecting and retrieving thin cirrus, due to sensitivities to surface reflectance. Conversely, the 1.38 micron channel, located within a strong water vapor absorption band, is quite useful for detecting thin cirrus clouds since the signal from the surface can be blocked or substantially attenuated by the absorption of atmospheric water vapor below cirrus. This channel, however, suffers from nonnegligible attenuation due to the water vapor located above and within the cloud layer. Here we provide details of a new technique pairing the 1.38 micron and 1.24 micron channels to estimate the above/in-cloud water vapor attenuation and to subsequently retrieve thin cirrus optical thickness (tau) from attenuation-corrected 1.38 p.m reflectance measurements. In selected oceanic cases, this approach is found to increase cirrus retrievals by up to 38% over MOD06. For these cases, baseline 1.38 micron retrieval uncertainties are estimated to be between 15 and 20% for moderately thick cirrus (tau > 1), with the largest error source being the unknown cloud effective particle radius, which is not retrieved with the described technique. Uncertainties increase to around 90% for the thinnest clouds (tau < 0.5) where instrument and surface uncertainties dominate.

Meyer, Kerry↗

Aerosol Retrievals from Different Polarimeters During the ACEPOL Campaign Using a Common Retrieval Algorithm

In this paper, we present aerosol retrieval results from the ACEPOL (Aerosol Characterization from Polarimeter and Lidar) campaign, which was a joint initiative between NASA and SRON – the Netherlands Institute for Space Research. The campaign took place in October–November 2017 over the western part of the United States. During ACEPOL six different instruments were deployed on the NASA ER-2 high-altitude aircraft, including four multi-angle polarimeters (MAPs): SPEX airborne, the Airborne Hyper Angular Rainbow Polarimeter (AirHARP), the Airborne Multi-angle SpectroPolarimetric Imager (AirMSPI), and the Research Scanning Polarimeter (RSP). Also, two lidars participated: the High Spectral Resolution Lidar-2 (HSRL-2) and the Cloud Physics Lidar (CPL). Flights were conducted mainly for scenes with low aerosol load over land, but some cases with higher AOD were also observed. We perform aerosol retrievals from SPEX airborne, RSP (410–865 nm range only), and AirMSPI using the SRON aerosol retrieval algorithm and compare the results against AERONET (AErosol RObotic NETwork) and HSRL-2 measurements (for SPEX airborne and RSP). All three MAPs compare well against AERONET for the aerosol optical depth (AOD), with a mean absolute error (MAE) between 0.014 and 0.024 at 440 nm. For the fine-mode effective radius the MAE ranges between 0.021 and 0.028 µm. For the comparison with HSRL-2 we focus on a day with low AOD (0.02–0.14 at 532 nm) over the California Central Valley, Arizona, and Nevada (26 October) as well as a flight with high AOD (including measurements with AOD>1.0 at 532 nm) over a prescribed forest fire in Arizona (9 November). For the day with low AOD the MAEs in AOD (at 532 nm) with HSRL-2 are 0.014 and 0.022 for SPEX and RSP, respectively, showing the capability of MAPs to provide accurate AOD retrievals for the challenging case of low AOD over land. For the retrievals over the smoke plume a reasonable agreement in AOD between the MAPs and HSRL-2 was also found (MAE 0.088 and 0.079 for SPEX and RSP, respectively), despite the fact that the comparison is hampered by large spatial variability in AOD throughout the smoke plume. A good comparison is also found between the MAPs and HSRL-2 for the aerosol depolarization ratio (a measure of particle sphericity), with an MAE of 0.023 and 0.016 for SPEX and RSP, respectively. Finally, SPEX and RSP agree very well for the retrieved microphysical and optical properties of the smoke plume.

Fu, Guangliang↗

HELIOS–RETRIEVAL: An Open-source, Nested Sampling Atmospheric Retrieval Code; Application to the HR 8799 Exoplanets and Inferred Constraints for Planet Formation

We present an open-source retrieval code named HELIOS–RETRIEVAL, designed to obtain chemical abundances and temperature–pressure profiles by inverting the measured spectra of exoplanetary atmospheres. In our forward model, we use an exact solution of the radiative transfer equation, in the pure absorption limit, which allows us to analytically integrate over all of the outgoing rays. Two chemistry models are considered: unconstrained chemistry and equilibrium chemistry (enforced via analytical formulae). The nested sampling algorithm allows us to formally implement Occam’s Razor based on a comparison of the Bayesian evidence between models. We perform a retrieval analysis on the measured spectra of the four HR 8799 directly imaged exoplanets. Chemical equilibrium is disfavored for HR 8799b and c. We find supersolar C/H and O/H values for the outer HR 8799b and c exoplanets, while the inner HR 8799d and e exoplanets have a range of C/H and O/H values. The C/O values range from being superstellar for HR 8799b to being consistent with stellar for HR 8799c and being substellar for HR 8799d and e. If these retrieved properties are representative of the bulk compositions of the exoplanets, then they are inconsistent with formation via gravitational instability (without late-time accretion) and consistent with a core accretion scenario in which late-time accretion of ices occurred differently for the inner and outer exoplanets. For HR 8799e, we find that spectroscopy in the K band is crucial for constraining C/O and C/H. HELIOS–RETRIEVAL is publicly available as part of the Exoclimes Simulation Platform (http://www.exoclime.org).

79 ASTRONOMY AND ASTROPHYSICS↗

Noise Reduction for Solar-Induced Fluorescence Retrievals Using Machine Learning and Principal Component Analysis: Simulations and Applications to GOME-2 Satellite Retrievals

We use a spectral-based approach that employs principal component analysis along with a relatively shallow artificial neural network (NN) to substantially reduce noise and other artifacts in terrestrial chlorophyll solar-induced fluorescence (SIF) retrievals. SIF is a very small emission at red and far-red wavelengths that is difficult to measure and is highly sensitive to random errors and systematic artifacts. Our approach relies upon an assumption that a trained NN can effectively reconstruct the total SIF signal from a relatively small number of leading principal components of the satellite-observed far-red radiance spectra without using information from the trailing modes that contain most of the random errors. We test the approach with simulated reflectance spectra produced with a full atmospheric and surface radiative transfer model using different observing and geophysical parameters and various noise levels. Resulting noisy and noise-reduced retrieved SIF values are compared with true values to assess performance. We then apply our noise reduction approach to SIF derived from two different satellite spectrometers. For evaluation, since the truth in this case is unknown, we compare SIF retrievals from two independent sensors with each other. We also compare the noise-reduced SIF temporal variations with those from an independent gross primary product (GPP) product that should display similar variations. Results show that our noise reduction approach improves capture of SIF seasonal and inter-annual variability. Our approach should be applicable to many noisy data products derived from spectral measurements. Our methodology does not replace the original retrieval algorithms; rather the original noisy retrievals are needed as the target for the NN training process.

noise reduction, solar-induced fluorescence, SIF, ↗

Social media based NPL system to find and retrieve ARM data: Concept paper

Information connectivity and retrieval has a role in our daily lives. The most pervasive source of online information is databases. The amount of data is growing at rapid rate and database technology is improving and having a profound effect. Almost all online applications are storing and retrieving information from databases. One challenge in supplying the public with wider access to informational databases is the need for knowledge of database languages like Structured Query Language (SQL). Although the SQL language has been published in many forms, not everybody is able to write SQL queries. Another challenge is that it may not be practical to make the public aware of the structure of the database. There is a need for novice users to query relational databases using their natural language. To solve this problem, many natural language interfaces to structured databases have been developed. The goal is to provide more intuitive method for generating database queries and delivering responses. Social media makes it possible to interact with a wide section of the population. Through this medium, and with the help of Natural Language Processing (NLP) we can make the data of the Atmospheric Radiation Measurement Data Center (ADC) more accessible to the public. We propose an architecture for using Apache Lucene/Solr [1], OpenML [2,3], and Kafka [4] to generate an automated query/response system with inputs from Twitter5, our Cassandra DB, and our log database. Using the Twitter API and NLP we can give the public the ability to ask questions of our database and get automated responses.

Devarakonda, Ranjeet↗

Use of information-retrieval languages in automated retrieval of experimental data from long-term storage

Problems and methods are discussed of automating information retrieval operations in a data bank used for long term storage and retrieval of data from scientific experiments. Existing information retrieval languages are analyzed along with those being developed. The results of studies discussing the application of the descriptive 'Kristall' language used in the 'ASIOR' automated information retrieval system are presented. The development and use of a specialized language of the classification-descriptive type, using universal decimal classification indices as the main descriptors, is described.

Khovanskiy, Y. D.↗

Land Surface Temperature Retrievals from GOES-8 Using Emissivities Retrieved from MODIS

Recent studies at the Global Hydrology and Climate Center (GHCC) have shown that the assimilation of land skin temperature (LST) tendencies into a mesoscale model can significantly improve short-term forecasts of near surface air temperature and moisture. Derived land surface products from the GOES satellites were used in these studies to provide high spatial and temporal resolution information about the spatial and temporal variability of the land surface forcing simulated in the model. In the model assimilation studies, LST was derived using a split window technique using the 11 and 12 pm channels found on the GOES-8 Sounder. These studies used a constant surface emissivity of 0.98 for both channels. However, this emissivity assumption over the land does not take into account emissivity variations due to varying terrain characteristics and differences between channels. These emissivity variations are seen to be significant as indicated by emissivity products from the polar orbiting MODIS instrument channels similar to the GOES-8 Sounder channels mentioned above. MODIS is a key instrument aboard the Terra (EOS AM) and Aqua (EOS PM) satellites. In an attempt to improve the emissivity assumptions used in the GOES Sounder LST retrieval procedure, the incorporation of MODIS high spatial resolution (1 km) emissivity measurements into the LST procedure is being explored. This paper intercompares the LST retrievals from the GOES-8 Sounder using a constant emissivity assumption with those using MODIS retrieved emissivities. The effects of MODIS emissivities on the LST retrievals are discussed. Potential improvements in model forecasts using assimilated LST products incorporating MODIS emissivities are also examined.

Arnold, James E.↗

Fast Simulators for Satellite Cloud Optical Centroid Pressure Retrievals, 1. Evaluation of OMI Cloud Retrievals

The cloud Optical Centroid Pressure (OCP), also known as the effective cloud pressure, is a satellite-derived parameter that is commonly used in trace-gas retrievals to account for the effects of clouds on near-infrared through ultraviolet radiance measurements. Fast simulators are desirable to further expand the use of cloud OCP retrievals into the operational and climate communities for applications such as data assimilation and evaluation of cloud vertical structure in general circulation models. In this paper, we develop and validate fast simulators that provide estimates of the cloud OCP given a vertical profile of optical extinction. We use a pressure-weighting scheme where the weights depend upon optical parameters of clouds and/or aerosol. A cloud weighting function is easily extracted using this formulation. We then use fast simulators to compare two different satellite cloud OCP retrievals from the Ozone Monitoring Instrument (OMI) with estimates based on collocated cloud extinction profiles from a combination of CloudS at radar and MODIS visible radiance data. These comparisons are made over a wide range of conditions to provide a comprehensive validation of the OMI cloud OCP retrievals. We find generally good agreement between OMI cloud OCPs and those predicted by CloudSat. However, the OMI cloud OCPs from the two independent algorithms agree better with each other than either does with the estimates from CloudSat/MODIS. Differences between OMI cloud OCPs and those based on CloudSat/MODIS may result from undetected snow/ice at the surface, cloud 3-D effects, low altitude clouds missed by CloudSat, and the fact that CloudSat only observes a relatively small fraction of an OMI field-of-view.

Joiner, J.↗

Precipitation Retrievals from Passive Microwave Cross-Track Sensors: The Precipitation Retrieval and Profiling Scheme

The retrieval of precipitation (snowfall and rainfall) from satellite sensors on a global basis is essential in aiding our knowledge and understanding of the Earth System and to many societal applications. Measurements from surface-based instruments are essentially limited to populated regions, necessitating the use of satellite-based observations to provide estimates of precipitation across the whole of the Earth’s surface. The temporal and spatial variability of precipitation requires adequate sampling, especially at finer resolutions. It is therefore necessary to exploit all available data from precipitation-capable satellites to ensure the proper representation of precipitation. To date, the estimation of precipitation using passive microwave observations has been largely concentrated upon the conically-scanning imaging instruments, with relatively few techniques exploiting the observations made from the cross-track sounders. This paper describes the development of the Precipitation Retrieval and Profiling Scheme (PRPS) to retrieve precipitation from cross-track sensors, together with its performance against surface radar data and other satellite precipitation retrievals.

Chris Kidd↗

Special cases of AIRS v4.0.x retrievals: missing forecast surface pressure and regression-only retrieval

This memo examines the differences that can be expected when performing two special cases of retrievals with the v.4.0.x PGE: (1) retrivals without the surface pressure from the NOAA Global Forecast System (GFS) and (2) regression only retrievals. An understanding of these differences is important for users who may want to give up some accuracy in the retrieval in exchange for a rapid solution.

AIRS↗

Comparative Results of AIRS/AMSU and CrIS/ATMS Retrievals Using a Scientifically Equivalent Retrieval Algorithm

The AIRS Science Team Version-6 retrieval algorithm is currently producing high quality level-3 Climate Data Records (CDRs) from AIRS/AMSU which are critical for understanding climate processes. The AIRS Science Team is finalizing an improved Version-7 retrieval algorithm to reprocess all old and future AIRS data. AIRS CDRs should eventually cover the period September 2002 through at least 2020. CrIS/ATMS is the only scheduled follow on to AIRS/AMSU. The objective of this research is to prepare for generation of long term CrIS/ATMS CDRs using a retrieval algorithm that is scientifically equivalent to AIRS/AMSU Version-7.

AIRS AMSU↗

A SYSTEMATIC RETRIEVAL ANALYSIS OF SECONDARY ECLIPSE SPECTRA. I. A COMPARISON OF ATMOSPHERIC RETRIEVAL TECHNIQUES

Exoplanet atmosphere spectroscopy enables us to improve our understanding of exoplanets just as remote sensing in our own solar system has increased our understanding of the solar system bodies. The challenge is to quantitatively determine the range of temperatures and molecular abundances allowed by the data, which is often difficult given the low information content of most exoplanet spectra that commonly leads to degeneracies in the interpretation. A variety of spectral retrieval approaches have been applied to exoplanet spectra, but no previous investigations have sought to compare these approaches. We compare three different retrieval methods: optimal estimation, differential evolution Markov chain Monte Carlo, and bootstrap Monte Carlo on a synthetic water-dominated hot Jupiter. We discuss expectations of uncertainties in abundances and temperatures given current and potential future observations. In general, we find that the three approaches agree for high spectral resolution, high signal-to-noise data expected to come from potential future spaceborne missions, but disagree for low-resolution, low signal-to-noise spectra representative of current observations. We also compare the results from a parameterized temperature profile versus a full classical Level-by-Level approach and discriminate in which situations each of these approaches is applicable. Furthermore, we discuss the implications of our models for the inferred C-to-O ratios of exoplanetary atmospheres. Specifically, we show that in the observational limit of a few photometric points, the retrieved C/O is biased toward values near solar and near one simply due to the assumption of uninformative priors.

79 ASTRONOMY AND ASTROPHYSICS↗

Inclusion of the second Umkehr in the conventional Umkehr retrieval analysis as a means of improving ozone retrievals in the upper stratosphere

The Umkehr method for retrieving the gross features of the vertical ozone distribution requires measurements of the ratio of zenith-sky radiances at two wavelengths in the near-UV region while the solar zenith angle (SZA) changes from 60 to 90 degrees. A Brewer spectrophotometer was used for taking such measurements extending the SZA range down to 96 degrees. Analyzed data from the Spring of 1991 imply that observations at twilight are of great significance in improving ozone retrievals in the upper stratosphere. Judged by the variance reduction for Umkehr layers 9 to 12 (25-30 percent for layer 11) and the increase in separation and amplitude of the averaging kernels for the relevant layers, the ozone retrievals in the upper stratosphere are shown to be in better agreement with climatological means.

Gioulgkidis, Konstantinos↗

Fast Simulators for Satellite Cloud Optical Centroid Pressure Retrievals, 1. Evaluation of OMI Cloud Retrievals

We have developed a relatively simple scheme for simulating retrieved cloud optical centroid pressures (OCP) from satellite solar backscatter observations. We have compared simulator results with those from more detailed retrieval simulators that more fully account for the complex radiative transfer in a cloudy atmosphere. We used this fast simulator to conduct a comprehensive evaluation of cloud OCPs from the two OMI algorithms using collocated data from CloudSat and Aqua MODIS, a unique situation afforded by the A-train formation of satellites. We find that both OMI algorithms perform reasonably well and that the two algorithms agree better with each other than either does with the collocated CloudSat data. This indicates that patchy snow/ice, cloud 3D, and aerosol effects not simulated with the CloudSat data are affecting both algorithms similarly. We note that the collocation with CloudSat occurs mainly on the East side of OMI's swath. Therefore, we are not able to address cross-track biases in OMI cloud OCP retrievals. Our fast simulator may also be used to simulate cloud OCP from output generated by general circulation models (GCM) with appropriate account of cloud overlap. We have implemented such a scheme and plan to compare OMI data with GCM output in the near future.

Joiner, J.↗