Search NASA⌕ Search

SEARCH · Search NASA

Results for “Retrieval methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2013

Results from CrIS-ATMS Obtained Using the AIRS Science Team Retrieval Methodology

AIRS was launched on EOS Aqua in May 2002, together with AMSU-A and HSB (which subsequently failed early in the mission), to form a next generation polar orbiting infrared and microwave atmospheric sounding system. AIRS/AMSU had two primary objectives. The first objective was to provide real-time data products available for use by the operational Numerical Weather Prediction Centers in a data assimilation mode to improve the skill of their subsequent forecasts. The second objective was to provide accurate unbiased sounding products with good spatial coverage that are used to generate stable multi-year climate data sets to study the earth's interannual variability, climate processes, and possibly long-term trends. AIRS/AMSU data for all time periods are now being processed using the state of the art AIRS Science Team Version-6 retrieval methodology. The Suomi-NPP mission was launched in October 2011 as part of a sequence of Low Earth Orbiting satellite missions under the "Joint Polar Satellite System" (JPSS). NPP carries CrIS and ATMS, which are advanced infra-red and microwave atmospheric sounders that were designed as follow-ons to the AIRS and AMSU instruments. The main objective of this work is to assess whether CrIS/ATMS will be an adequate replacement for AIRS/AMSU from the perspective of the generation of accurate and consistent long term climate data records, or if improved instruments should be developed for future flight. It is critical for CrIS/ATMS to be processed using an algorithm similar to, or at least comparable to, AIRS Version-6 before such an assessment can be made. We have been conducting research to optimize products derived from CrIS/ATMS observations using a scientific approach analogous to the AIRS Version-6 retrieval algorithm. Our latest research uses Version-5.70 of the CrIS/ATMS retrieval algorithm, which is otherwise analogous to AIRS Version-6, but does not yet contain the benefit of use of a Neural-Net first guess start-up system which significantly improved results of AIRS Version-6. Version-5.70 CrIS/ATMS temperature profile and surface skin temperature retrievals are of very good quality, and are better than AIRS Version-5 retrievals, but are still significantly poorer than those of AIRS Version-6. CrIS/ATMS retrievals should improve when a Neural-Net start-up system is ready for use. We also examined CrIS/ATMS retrievals generated by NOAA using their NUCAPS retrieval algorithm, which is based on earlier versions of the AIRS Science Team retrieval algorithms. We show that the NUCAPS algorithm as currently configured is not well suited for climate monitoring purposes.

CrIS↗
NASA NTRS2015

CrIS/ATMS Retrievals Using the Latest AIRS/AMSU Retrieval Methodology

This research is being done under the NPP Science Team Proposal: Analysis of CrISATMS Using an AIRS Version 6-like Retrieval Algorithm Objective: Generate a long term CrISATMS level-3 data set that is consistent with that of AIRSAMSU Approach: Adapt the currently operational AIRS Science Team Version-6 Retrieval Algorithm, or an improved version of it, for use with CrISATMS data. Metric: Generate monthly mean level-3 CrISATMS climate data sets and evaluate the results by comparison of monthly mean AIRSAMSU and CrISATMS products, and more significantly, their inter-annual differences and, eventually, anomaly time series. The goal is consistency between the AIRSAMSU and CrISATMS climate data sets.

Retrieval Methodology↗
NASA NTRS2015

Major Upgrades to the AIRS Version-6 Water Vapor Profile Methodology

This research is a continuation of part of what was shown at the last AIRS Science Team Meeting and the AIRS 2015 NetMeeting. AIRS Version 6 was finalized in late 2012 and is now operational. Version 6 contained many significant improvements in retrieval methodology compared to Version 5. Version 6 retrieval methodology used for the water vapor profile q(p) and ozone profile O3(p) retrievals is basically unchanged from Version 5, or even from Version 4. Subsequent research has made significant improvements in both water vapor and O3 profiles compared to Version 6.

Version-6↗
NASA NTRS2015

Major Upgrades to the AIRS Version-6 Ozone Profile Methodology

This research is a continuation of part of what was shown at the last AIRS Science Team Meeting in the talk Improved Water Vapor and Ozone Profiles in SRT AIRS Version-6.X and the AIRS February 11, 2015 NetMeeting Further improvements in water vapor and ozone profiles compared to Version-6.AIRS Version-6 was finalized in late 2012 and is now operational. Version-6 contained many significant improvements in retrieval methodology compared to Version-5. However, Version-6 retrieval methodology used for the water vapor profile q(p) and ozone profile O3(p) retrievals is basically unchanged from Version-5, or even from Version-4. Subsequent research has made significant improvements in both water vapor and O3 profiles compared to Version-6. This talk will concentrate on O3 profile retrievals. Improvements in water vapor profile retrievals are given in a separate presentation.

Ozone↗
NASA NTRS2019

Comparing Level-2 and Level-3 Satellite Ocean Color Retrieval Validation Methodologies

Many ocean color data applications leverage global spatially composited Level-3(L3) satellite data, because of their regular Earth-grid frame of reference. However, ocean color satellite retrieval performance is routinely evaluated on Level-2 (L2) data at the native satellite swath resolution and geometries. This study assesses how accurately binned and gridded L3 data represent L2 satellite data products via satellite-to-in situ match-up activities.L2 and L3 satellite data retrievals of the photosynthetic pigment chlorophyll-a are compared with a common in situ data set, revealing similar L2 and L3 satellite-to-in situ performance for both MODIS-Aqua and VIIRS-SNPP. This agreement implies that L2 validation results are generally applicable to L3 data. However, uncertainties are introduced during the generation of L3 data from L2 data. L3 data comparisons introduce a wider temporal window between the time of in situ measurement and the time of the satellite observation, which can unintentionally reflect on the quality of the satellite retrieval or algorithm performance. The choice of L3 map projection may introduce additional uncertainty by spatially distorting the true location of the satellite retrievals. Each manipulation of satellite data beyond theinstrument's native spatio temporal reference (L2) reduces the applicability of L2 validation results to higher data processing levels.

Ocean Color↗
NASA NTRS2005

Validation of AIRS/AMSU Cloud Retrievals Using MODIS Cloud Analyses

The AIRS/AMSU (flying on the EOS-AQUA satellite) sounding retrieval methodology allows for the retrieval of key atmospheric/surface parameters under partially cloudy conditions (Susskind et al.). In addition, cloud parameters are also derived from the AIRS/AMSU observations. Within each AIRS footprint, cloud parameters at up to 2 cloud layers are determined with differing cloud top pressures and effective (product of infrared emissivity at 11 microns and physical cloud fraction) cloud fractions. However, so far the AIRS cloud product has not been rigorously evaluated/validated. Fortunately, collocated/coincident radiances measured by MODIS/AQUA (at a much lower spectral resolution but roughly an order of-magnitude higher spatial resolution than that of AIRS) are used to determine analogous cloud products from MODIS. This allows us for a rather rare and interesting possibility: the intercomparisons and mutual validation of imager vs. sounder-based cloud products obtained from the same satellite positions. First, we present results of small-scale (granules) instantaneous intercomparisons. Next, we will evaluate differences of temporally averaged (monthly) means as well as the representation of inter-annual variability of cloud parameters as presented by the two cloud data sets. In particular, we present statistical differences in the retrieved parameters of cloud fraction and cloud top pressure. We will investigate what type of cloud systems are retrieved most consistently (if any) with both retrieval schemes, and attempt to assess reasons behind statistically significant differences.

Molnar, Gyula I.↗
NASA NTRS2014

Improved Methodology for Surface and Atmospheric Soundings, Error Estimates, and Quality Control Procedures: the AIRS Science Team Version-6 Retrieval Algorithm

The AIRS Science Team Version-6 AIRS/AMSU retrieval algorithm is now operational at the Goddard DISC. AIRS Version-6 level-2 products are generated near real-time at the Goddard DISC and all level-2 and level-3 products are available starting from September 2002. This paper describes some of the significant improvements in retrieval methodology contained in the Version-6 retrieval algorithm compared to that previously used in Version-5. In particular, the AIRS Science Team made major improvements with regard to the algorithms used to 1) derive surface skin temperature and surface spectral emissivity; 2) generate the initial state used to start the cloud clearing and retrieval procedures; and 3) derive error estimates and use them for Quality Control. Significant improvements have also been made in the generation of cloud parameters. In addition to the basic AIRS/AMSU mode, Version-6 also operates in an AIRS Only (AO) mode which produces results almost as good as those of the full AIRS/AMSU mode. This paper also demonstrates the improvements of some AIRS Version-6 and Version-6 AO products compared to those obtained using Version-5.

Quality Control↗
NASA NTRS2016

Analysis of CrIS ATMS and AIRS AMSU Data Using Scientifically Equivalent Retrieval Algorithms

Monthly mean August 2014 Version-6.28 AIRS and CrIS products agree well with OMPS and CERES, and reasonably well with each other. Version-6.28 CrIS total precipitable water is biased dry compared to AIRS. AIRS and CrIS Version-6.36 water vapor products are both improved compared to Version-6.28. Version-6.36 AIRS and CrIS total precipitable water also shows improved agreement with each other. AIRS Version-6.36 total ozone agrees even better with OMPS than does AIRS Version-6.28, and gives reasonable results during polar winter where OMPS does not generate products. CrIS and ATMS are high spectral resolution IR and Microwave atmospheric sounders currently flying on the SNPP satellite, and are also scheduled for flight on future NPOESS satellites. CrIS/ATMS have similar sounding capabilities to those of the AIRS/AMSU sounder suite flying on EOS Aqua. The objective of this research is to develop and implement scientifically equivalent AIRS/AMSU and CrIS/ATMS retrieval algorithms with the goal of generating a continuous data record of AIRS/AMSU and CrIS/ATMS level-3 data products with a seamless transition between them in time. To achieve this, monthly mean AIRS/AMSU and CrIS/ATMS retrieved products, and more importantly their interannual differences, should show excellent agreement with each other. The currently operational AIRS Science Team Version-6 retrieval algorithm has generated 14 years of level-3 data products. A scientifically improved AIRS Version-7 retrieval algorithm is expected to become operational in 2017. We see significant improvements in water vapor and ozone in Version-7 retrieval methodology compared to Version-6.We are working toward finalization and implementation of scientifically equivalent AIRS/AMSU and CrIS/ATMS Version-7 retrieval algorithms to be used for the eventual processing of all AIRS/AMSU and CrIS/ATMS data. The latest version of our retrieval algorithm is Verison-6.36, which includes almost all the improvements we want in Version-7. Version-6.28 has been used to process both AIRS and CrIS data for August 2014. This poster compares August 2014 monthly mean Version-6.28 AIRS/AMSU and CrIS/ATMS products with each other, and also with monthly mean products obtained using AIRS Version-6. AIRS and CrIS results using Version-6.36 are presented for April 15, 2016. These demonstrate further improvements since Version-6.28. The new results also show improved agreement of Version-6.36 AIRS and CrIS products with each other. Version-6.36 is not yet optimized for CrIS ozone products.

AIRS↗
NASA NTRS2021

The CHIMAERA System for Retrievals of Cloud Top, Optical and Microphysical Properties from Imaging Sensors

Continuity and consistency of geophysical retrieval products obtained from different Earth-observing spaceborne or airborne atmospheric multispectral imagers can be challenging due to inherent differences in the instruments and/or the use of different retrieval algorithms. The Cross-platform HIgh resolution Multi-instrument AtmosphEric Retrieval Algorithms (CHIMAERA) system addresses the latter aspect of the inter-sensor continuity problem for cloud property retrievals by removing retrieval methodology and implementation as a source of inconsistency when applied to instruments that share common measurement capabilities. Transferring an existing retrieval algorithm to a new sensor oftentimes is a nontrivial task, as it is common for an algorithm code to be tightly coupled to the sensor for which it was developed. By creating a clear division between the science algorithm and the instrument I/O codes, CHIMAERA allows easy migration of science algorithms to different sensors. CHIMAERA is built from C and FORTRAN source code, and can operate in a variety of environments ranging from a personal laptop to a high-performance computing environment for near real-time satellite data production. It is highly adaptable, low-maintenance and allows for easy expansion such that adding new instruments into the system requires only instrument-specific I/O and provision of any external lookup tables specific to the instrument's spectral characteristics. CHIMAERA currently supports 14 spaceborne and airborne atmospheric imagers from a single code base, and has been in use since 2007. In this paper we describe the engineering aspects of CHIMAERA and briefly discuss a few examples from its many current applications.

Galina (Gala) Wind↗
NASA NTRS2016

Developing Atmospheric Retrieval Methods for Direct Imaging Spectroscopy of Gas Giants in Reflected Light I: Methane Abundances and Basic Cloud Properties

Reflected light spectroscopy and photometry of cool, directly imaged extrasolar giant planets are expected to be performed in the next decade by space-based telescopes equipped with optical wavelength coronagraphs and integral field spectrographs, such as the Wide-Field Infrared Survey Telescope (WFIRST). We are developing a new atmospheric retrieval methodology to help assess the science return and inform the instrument design for such future missions, and ultimately interpret the resulting observations. Our retrieval technique employs an albedo model coupled with both a Markov chain Monte Carlo Ensemble Sampler (emcee) and a multimodal nested sampling algorithm (MultiNest) to map the posterior distribution. This combination makes the global evidence calculation more robust for any given model, and highlights possible discrepancies in the likelihood maps. Here we apply this methodology to simulated spectra of cool giant planets. As a proof-of-concept, our current atmospheric model contains 1 or 2 cloud layers, methane as a major absorber, and a H2-He background gas. This 6-to-9 parameter model is appropriate for Jupiter-like planets and can be easily expanded in the future. In addition to deriving the marginal likelihood distribution and confidence intervals for the model parameters, we perform model selection to determine the significance of methane and cloud detection as a function of expected signal-to-noise, in the presence of spectral noise correlations. After internal validation, the method is applied to realistic reflected-light spectra of Jupiter, Saturn, and HD 99492 c, a likely observing target. We find that the presence or absence of clouds and methane can be determined with high accuracy, while parameters uncertainties are model-dependent.

spectroscopy↗
NASA NTRS2012

The Physics of Imaging with Remote Sensors : Photon State Space & Radiative Transfer

Standard (mono-pixel/steady-source) retrieval methodology is reaching its fundamental limit with access to multi-angle/multi-spectral photo- polarimetry. Next... Two emerging new classes of retrieval algorithm worth nurturing: multi-pixel time-domain Wave-radiometry transition regimes, and more... Cross-fertilization with bio-medical imaging. Physics-based remote sensing: - What is "photon state space?" - What is "radiative transfer?" - Is "the end" in sight? Two wide-open frontiers! center dot Examples (with variations.

clouds↗
NASA NTRS1992

The use of VAS retrievals for thunderstorm forecasting at the Kennedy Space Center

A modified version of the current operational VAS retrieval methodology was used to examine preconvective environments over central Florida in the vicinity of NASA's Kennedy Space Center. The modifications to the retrieval algorithm are discussed, and results of a case study of 10-11 July 1989 are presented. The VAS retrievals detected mesoscale humidity and stability features that were not resolved by the operational radiosonde network. These features were closely associated with the locations of thunderstorm development.

Hoepner, Wayne A.↗
NASA NTRS2018

Remote Sensing, Uncertainty Quantification, and a Theory of Data Systems; Workshop Report

The purpose of the workshop was to invite statisticians, applied mathematicians, computer scientists, data system architects, experts in remote sensing technology, and Climate and Earth System scientists to review, discuss, and plan research on issues related to large-scale, efficient analysis of distributed data using spatial statistical methods. Our motivation in organizing this event was to catalyze interchange among experts on the fast-emerging problem of analysis of distributed data. As part of SAMSI's 2017-2018 Program on Mathematical and Statistical Methods for Climate and the Earth System, a Working Group on Remote Sensing was established to address statistical and mathematical research problems in the analysis of remote sensing data. The Working Group has five subgroups: 1) Spatial Retrieval Methodology (the so-called \Spatial-X" subgroup); 2) Spatial Analysis for Hyperspectral Data (the so-called \Spatial-Y" subgroup); 3) Emulators for Complex Forward Models; 4) Optimization for Remote Sensing Retrievals; and 5) Theory of Data Systems (ToDS). The ToDS subgroup spent the first half of this academic year formulating a framework in which to consider the joint problem of a) optimizing statistical methods for environments where data are distributed and too large to move to a central location, and b) the design of data system infrastructures within which to implement those statistical methods. To x ideas, the Workshop focused on spatial statistical methods. To date there are many new spatial statistical methods designed with massive data sets in mind, in the literature. However, very few have been implemented for remote sensing data, and none have been implemented in operational settings like those used by NASA and NOAA. A major impediment to their use in these cases is that the data are not only massive, but are stored in different physical locations. These data must be brought together in some way in order to estimate spatial covariance functions, but moving data to a central location for analysis is tedious at best and impossible at worst. Some remote data reduction is almost certainly necessary, but how much? What are the consequences for inference? The fundamental issue underlying these questions is how to navigate the trade-space between costs and uncertainty in the estimates or inferences that are ultimately produced.

Braverman, Amy↗
NASA NTRS2018

Global Precipitation Measurement (GPM): Unified Precipitation Estimation From Space

Global Precipitation Measurement (GPM) is an international satellite mission that uses measurements from an advanced radar/radiometer system on a Core Observatory as reference standards to unify and advance precipitation estimates through a constellation of research and operational microwave sensors. GPM is a science mission focusing on a key component of the Earth's water and energy cycle, delivering near real-time observations of precipitation for monitoring severe weather events, freshwater resources, and other societal applications. This work presents the GPM mission design, together with descriptions of sensor characteristics, inter-satellite calibration, retrieval methodologies, ground validation activities, and societal applications.

satellite↗
NASA NTRS2006

AIRS Retrieval Validation During the EAQUATE

Atmospheric and surface thermodynamic parameters retrieved with advanced hyperspectral remote sensors of Earth observing satellites are critical for weather prediction and scientific research. The retrieval algorithms and retrieved parameters from satellite sounders must be validated to demonstrate the capability and accuracy of both observation and data processing systems. The European AQUA Thermodynamic Experiment (EAQUATE) was conducted mainly for validation of the Atmospheric InfraRed Sounder (AIRS) on the AQUA satellite, but also for assessment of validation systems of both ground-based and aircraft-based instruments which will be used for other satellite systems such as the Infrared Atmospheric Sounding Interferometer (IASI) on the European MetOp satellite, the Cross-track Infrared Sounder (CrIS) from the NPOESS Preparatory Project and the following NPOESS series of satellites. Detailed inter-comparisons were conducted and presented using different retrieval methodologies: measurements from airborne ultraspectral Fourier transform spectrometers, aircraft in-situ instruments, dedicated dropsondes and radiosondes, and ground based Raman Lidar, as well as from the European Center for Medium range Weather Forecasting (ECMWF) modeled thermal structures. The results of this study not only illustrate the quality of the measurements and retrieval products but also demonstrate the capability of these validation systems which are put in place to validate current and future hyperspectral sounding instruments and their scientific products.

Zhou, Daniel K.↗
DOE OSTI2024

An ML-based terrestrial data fusion and augmentation framework to enable advanced understanding of the terrestrial carbon and water interactions

Soil moisture is essential to the terrestrial carbon and water cycles and land–atmosphere interactions. There are various types of soil moisture data, and each type has the distinct spatiotemporal strengths and limitations, depending on the diverse applications and retrieval methodologies of different data types (Li et al., in review; The PNNL-82151 FY23 Report). However, the limitations of different soil moisture data in terms of accuracy and spatiotemporal coverage hinder our ability to further understand the soil moisture dynamics across scales. To have a gap free soil moisture data product with a fine spatiotemporal coverage and vertical profiles, we train extreme gradient boosting (XGBoost) models by using (1) in-situ soil moisture measurements from the International Soil Moisture Network (ISMN), (2) soil moisture from the ECMWF reanalysis (ERA) at the 9 km and sub-daily spatiotemporal resolution, (3) the Daymet meteorological fields, and (4) data products that characterize surface conditions, including soil texture, organic content, topography, vegetation type, and rooting depth. We use the trained XGBoost models that have consistent performance across seven soil layers, i.e., 0–5 cm, 5–10 cm, 10–20 cm, 20–40 cm, 40–60 cm, 60–100 cm, and 100–200 cm, and the gridded model predictors to generate a soil moisture data at the 1 km and daily spatiotemporal resolution for the Continental United States (CONUS) from 2001–2020. This dataset can be broadly used for Earth system model benchmark, monitoring extreme weathers, making informed decisions regarding agriculture, water resource management, climate change mitigation, and ecosystem preservation.

58 GEOSCIENCES↗
NASA NTRS1990

The 27-28 October 1986 FIRE IFO cirrus case study - Cloud parameter fields derived from satellite data

A cirrus parameter retrieval methodology and the results of its application over the cirrus Intensive Field Observation (IFO) area using data from the Geostationary Operational Environmental Satellite (GOES) taken during the FIRE cirrus case study days, October 27-28, 1986. An impirical cloud bidirectional reflectance model derived from another IFO analysis was combined with a theoretical ice crystal cloud albedo model to estimate visible cloud optical thickness, which was used to derive the cloud infrared emittance. Cloud altitude was adjusted based on the derived emittance and observed temperatures. The approach developed here produced a very reasonable picture of cirrus cloud fields. It was estimated that the cloud-top and cloud-center heights are derived with a precision of about 0.6 km, except in very broken cloud conditions. Cirrus cloud thicknesses were also estimated and it is found that the derived results are comparable to other case study observations.

Minnis, Patrick↗