Search NASA⌕ Search

SEARCH · Search NASA

Results for “Retrieval methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS2015

A Module for Assimilating Hyperspectral Infrared Retrieved Profiles into the Gridpoint Statistical Interpolation System for Unique Forecasting Applications

Hyperspectral infrared sounder radiance data are assimilated into operational modeling systems however the process is computationally expensive and only approximately 1% of available data are assimilated due to data thinning as well as the fact that radiances are restricted to cloud-free fields of view. In contrast, the number of hyperspectral infrared profiles assimilated is much higher since the retrieved profiles can be assimilated in some partly cloudy scenes due to profile coupling other data, such as microwave or neural networks, as first guesses to the retrieval process. As the operational data assimilation community attempts to assimilate cloud-affected radiances, it is possible that the use of retrieved profiles might offer an alternative methodology that is less complex and more computationally efficient to solve this problem. The NASA Short-term Prediction Research and Transition (SPoRT) Center has assimilated hyperspectral infrared retrieved profiles into Weather Research and Forecasting Model (WRF) simulations using the Gridpoint Statistical Interpolation (GSI) System. Early research at SPoRT demonstrated improved initial conditions when assimilating Atmospheric Infrared Sounder (AIRS) thermodynamic profiles into WRF (using WRF-Var and assigning more appropriate error weighting to the profiles) to improve regional analysis and heavy precipitation forecasts. Successful early work has led to more recent research utilizing WRF and GSI for applications including the assimilation of AIRS profiles to improve WRF forecasts of atmospheric rivers and assimilation of AIRS, Cross-track Infrared and Microwave Sounding Suite (CrIMSS), and Infrared Atmospheric Sounding Interferometer (IASI) profiles to improve model representation of tropopause folds and associated non-convective wind events. Although more hyperspectral infrared retrieved profiles can be assimilated into model forecasts, one disadvantage is the retrieved profiles have traditionally been assigned the same error values as the rawinsonde observations when assimilated with GSI. Typically, satellitederived profile errors are larger and more difficult to quantify than traditional rawinsonde observations (especially in the boundary layer), so it is important to appropriately assign observation errors within GSI to eliminate potential spurious innovations and analysis increments that can sometimes arise when using retrieved profiles. The goal of this study is to describe modifications to the GSI source code to more appropriately assimilate hyperspectral infrared retrieved profiles and outline preliminary results that show the differences between a model simulation that assimilated the profiles as rawinsonde observations and one that assimilated the profiles in a module with the appropriate error values.

Berndt, Emily↗
NASA NTRS2007

Recent Theoretical Advances in Analysis of AIRS/AMSU Sounding Data

AIRS was launched on EOS Aqua on May 4,2002, together with AMSU-A and HSB, to form a next generation polar orbiting infrared and microwave atmospheric sounding system. This paper describes the AIRS Science Team Version 5.0 retrieval algorithm. Starting in early 2007, the Goddard DAAC will use this algorithm to analyze near real time AIRS/AMSU observations. These products are then made available to the scientific community for research purposes. The products include twice daily measurements of the Earth's three dimensional global temperature, water vapor, and ozone distribution as well as cloud cover. In addition, accurate twice daily measurements of the earth's land and ocean temperatures are derived and reported. Scientists use this important set of observations for two major applications. They provide important information for climate studies of global and regional variability and trends of different aspects of the earth's atmosphere. They also provide information for researchers to improve the skill of weather forecasting. A very important new product of the AIRS Version 5 algorithm is accurate case-by-case error estimates of the retrieved products. This heightens their utility for use in both weather and climate applications. These error estimates are also used directly for quality control of the retrieved products. Version 5 also allows for accurate quality controlled AIRS only retrievals, called "Version 5 AO retrievals" which can be used as a backup methodology if AMSU fails. Examples of the accuracy of error estimates and quality controlled retrieval products of the AIRS/AMSU Version 5 and Version 5 AO algorithms are given, and shown to be significantly better than the previously used Version 4 algorithm. Assimilation of Version 5 retrievals are also shown to significantly improve forecast skill, especially when the case-by-case error estimates are utilized in the data assimilation process.

Susskind, Joel↗
NASA NTRS2024

Noise Reduction for Solar-Induced Fluorescence Retrievals Using Machine Learning and Principal Component Analysis: Simulations and Applications to GOME-2 Satellite Retrievals

We use a spectral-based approach that employs principal component analysis along with a relatively shallow artificial neural network (NN) to substantially reduce noise and other artifacts in terrestrial chlorophyll solar-induced fluorescence (SIF) retrievals. SIF is a very small emission at red and far-red wavelengths that is difficult to measure and is highly sensitive to random errors and systematic artifacts. Our approach relies upon an assumption that a trained NN can effectively reconstruct the total SIF signal from a relatively small number of leading principal components of the satellite-observed far-red radiance spectra without using information from the trailing modes that contain most of the random errors. We test the approach with simulated reflectance spectra produced with a full atmospheric and surface radiative transfer model using different observing and geophysical parameters and various noise levels. Resulting noisy and noise-reduced retrieved SIF values are compared with true values to assess performance. We then apply our noise reduction approach to SIF derived from two different satellite spectrometers. For evaluation, since the truth in this case is unknown, we compare SIF retrievals from two independent sensors with each other. We also compare the noise-reduced SIF temporal variations with those from an independent gross primary product (GPP) product that should display similar variations. Results show that our noise reduction approach improves capture of SIF seasonal and inter-annual variability. Our approach should be applicable to many noisy data products derived from spectral measurements. Our methodology does not replace the original retrieval algorithms; rather the original noisy retrievals are needed as the target for the NN training process.

noise reduction, solar-induced fluorescence, SIF, ↗
NASA NTRS2015

Assimilation of GPM GMI Rainfall Product with WRF GSI

The Global Precipitation Measurement (GPM) is an international mission to provide next-generation observations of rain and snow worldwide. The GPM built on Tropical Rainfall Measuring Mission (TRMM) legacy, while the core observatory will extend the observations to higher latitudes. The GPM observations can help advance our understanding of precipitation microphysics and storm structures. Launched on February 27th, 2014, the GPM core observatory is carrying advanced instruments that can be used to quantify when, where, and how much it rains or snows around the world. Therefore, the use of GPM data in numerical modeling work is a new area and will have a broad impact in both research and operational communities. The goal of this research is to examine the methodology of assimilation of the GPM retrieved products. The data assimilation system used in this study is the community Gridpoint Statistical Interpolation (GSI) system for the Weather Research and Forecasting (WRF) model developed by the Development Testbed Center (DTC). The community GSI system runs in independently environment, yet works functionally equivalent to operational centers. With collaboration with the NASA Short-term Prediction Research and Transition (SPoRT) Center, this research explores regional assimilation of the GPM products with case studies. Our presentation will highlight our recent effort on the assimilation of the GPM product 2AGPROFGMI, the retrieved Microwave Imager (GMI) rainfall rate data for initializing a real convective storm. WRF model simulations and storm scale data assimilation experiments will be examined, emphasizing both model initialization and short-term forecast of precipitation fields and processes. In addition, discussion will be provided on the development of enhanced assimilation procedures in the GSI system with respect to other GPM products. Further details of the methodology of data assimilation, preliminary result and test on the impact of GPM data and the influence on precipitation forecast will be presented at the conference.

Li, Xuanli↗
NASA NTRS2014

Direct Aerosol Radiative Forcing Based on Combined A-Train Observations: Towards All-sky Estimates and Attribution to Aerosol Type

We describe a technique for combining CALIOP aerosol backscatter, MODIS spectral AOD (aerosol optical depth), and OMI AAOD (absorption aerosol optical depth) measurements for the purpose of estimating full spectral sets of aerosol radiative properties, and ultimately for calculating the 3-D distribution of direct aerosol radiative forcing. We present results using one year of data collected in 2007 and show comparisons of the aerosol radiative property estimates to collocated AERONET retrievals. Initial calculations of seasonal clear-sky aerosol radiative forcing based on our multi-sensor aerosol retrievals compare well with over-ocean and top of the atmosphere IPCC-2007 model-based results, and with more recent assessments in the "Climate Change Science Program Report: Atmospheric Aerosol Properties and Climate Impacts" (2009). We discuss some of the challenges that exist in extending our clear-sky results to all-sky conditions. On the basis of comparisons to suborbital measurements, we present some of the limitations of the MODIS and CALIOP retrievals in the presence of adjacent or underlying clouds. Strategies for meeting these challenges are discussed. We also discuss a methodology for using the multi-sensor aerosol retrievals for aerosol type classification based on advanced clustering techniques. The combination of research results permits conclusions regarding the attribution of aerosol radiative forcing to aerosol type.

AOD↗
NASA NTRS2003

MISR Multi-Angle Imaging SpectroRadiometer

This viewgraph presentation reviews the concept of the Multi-Angle Imaging SpectroRadiometer (MISR), a methodology to use the MISR to retrieve aerosols over water and land. The presentation shows some of the results of the use of the MISR in graphs and charts. Multi-angle remote sensing provides unique ways of retrieving aerosol properties over many surface types, including bright deserts which are major source regions.

global maps↗
NASA NTRS2017

Validation of SMAP Surface Soil Moisture Products with Core Validation Sites

The NASA Soil Moisture Active Passive (SMAP) mission has utilized a set of core validation sites as the primary methodology in assessing the soil moisture retrieval algorithm performance. Those sites provide well calibrated in situ soil moisture measurements within SMAP product grid pixels for diverse conditions and locations.The estimation of the average soil moisture within the SMAP product grid pixels based on in situ measurements is more reliable when location specific calibration of the sensors has been performed and there is adequate replication over the spatial domain, with an up-scaling function based on analysis using independent estimates of the soil moisture distribution. SMAP fulfilled these requirements through a collaborative CalVal Partner program.This paper presents the results from 34 candidate core validation sites for the first eleven months of the SMAP mission. As a result of the screening of the sites prior to the availability of SMAP data, out of the 34 candidate sites 18 sites fulfilled all the requirements at one of the resolution scales (at least). The rest of the sites are used as secondary information in algorithm evaluation. The results indicate that the SMAP radiometer-based soil moisture data product meets its expected performance of 0.04 cu m/cu m volumetric soil moisture (unbiased root mean square error); the combined radar-radiometer product is close to its expected performance of 0.04 cu m/cu m, and the radar-based product meets its target accuracy of 0.06 cu m/cu m (the lengths of the combined and radar-based products are truncated to about 10 weeks because of the SMAP radar failure). Upon completing the intensive CalVal phase of the mission the SMAP project will continue to enhance the products in the primary and extended geographic domains, in co-operation with the CalVal Partners, by continuing the comparisons over the existing core validation sites and inclusion of candidate sites that can address shortcomings.

SMAP↗
NASA NTRS2021

Delaware Ecological Forecasting: Assessing Land Cover and Soil to Identify Suitable Sites for Tidal Marsh Migration in Delaware

Tidal wetlands provide vital resources for the state of Delaware, crucial not only for maintaining important ecosystem functions, but also for providing human populations with substantial services. Healthy wetland networks offer protection from severe weather, reduce flooding, improve water quality, and provide opportunities for education and recreation. However, human activities in combination with natural events, continue to cause substantial loss of wetland cover and damage wetland health. Over the last thirty years, the state of Delaware has experienced a net loss of roughly 5,000 acres of wetland. In collaboration with the Delaware Department of Natural Resources and Environmental Control (DNREC), the team used NASA Earth observations including Landsat 5 Thematic Mapper (TM), Landsat 8 Operational Land Imager (OLI), Terra Moderate Resolution Imaging Spectroradiometer (MODIS), and Global Precipitation Measurement Integrated Multi-Satellite Retrievals (GPM IMERG) to develop a methodology to monitor recent changes in wetland cover and forecast landward marsh migration due to sea-level rise, changes to climate, and human development. Trend analysis of current and past climate conditions in precipitation and temperature revealed an overall increase in both metrics. Using Land Change Modeler in TerrSet and Suitability Modeler in ArcGIS Pro, the team visualized landcover shifts over the last 20 years, indicating a general pattern of net wetland loss and identified locations where marsh migration could potentially occur in the future. These observations will enable better planning for restoration activities and in form decision-making to preserve wetland health and ecosystem functions.

McKenna Brahler↗
NASA NTRS2010

Satellite Sampling and Retrieval Errors in Regional Monthly Rain Estimates from TMI AMSR-E, SSM/I, AMSU-B and the TRMM PR

Passive and active microwave rain sensors onboard earth-orbiting satellites estimate monthly rainfall from the instantaneous rain statistics collected during satellite overpasses. It is well known that climate-scale rain estimates from meteorological satellites incur sampling errors resulting from the process of discrete temporal sampling and statistical averaging. Sampling and retrieval errors ultimately become entangled in the estimation of the mean monthly rain rate. The sampling component of the error budget effectively introduces statistical noise into climate-scale rain estimates that obscure the error component associated with the instantaneous rain retrieval. Estimating the accuracy of the retrievals on monthly scales therefore necessitates a decomposition of the total error budget into sampling and retrieval error quantities. This paper presents results from a statistical evaluation of the sampling and retrieval errors for five different space-borne rain sensors on board nine orbiting satellites. Using an error decomposition methodology developed by one of the authors, sampling and retrieval errors were estimated at 0.25 resolution within 150 km of ground-based weather radars located at Kwajalein, Marshall Islands and Melbourne, Florida. Error and bias statistics were calculated according to the land, ocean and coast classifications of the surface terrain mask developed for the Goddard Profiling (GPROF) rain algorithm. Variations in the comparative error statistics are attributed to various factors related to differences in the swath geometry of each rain sensor, the orbital and instrument characteristics of the satellite and the regional climatology. The most significant result from this study found that each of the satellites incurred negative longterm oceanic retrieval biases of 10 to 30%.

Fisher, Brad↗
NASA NTRS2012

Sensitivity Analysis for Atmospheric Infrared Sounder (AIRS) CO2 Retrieval

The Atmospheric Infrared Sounder (AIRS) is a thermal infrared sensor able to retrieve the daily atmospheric state globally for clear as well as partially cloudy field-of-views. The AIRS spectrometer has 2378 channels sensing from 15.4 micrometers to 3.7 micrometers, of which a small subset in the 15 micrometers region has been selected, to date, for CO2 retrieval. To improve upon the current retrieval method, we extended the retrieval calculations to include a prior estimate component and developed a channel ranking system to optimize the channels and number of channels used. The channel ranking system uses a mathematical formalism to rapidly process and assess the retrieval potential of large numbers of channels. Implementing this system, we identifed a larger optimized subset of AIRS channels that can decrease retrieval errors and minimize the overall sensitivity to other iridescent contributors, such as water vapor, ozone, and atmospheric temperature. This methodology selects channels globally by accounting for the latitudinal, longitudinal, and seasonal dependencies of the subset. The new methodology increases accuracy in AIRS CO2 as well as other retrievals and enables the extension of retrieved CO2 vertical profiles to altitudes ranging from the lower troposphere to upper stratosphere. The extended retrieval method for CO2 vertical profile estimation using a maximum-likelihood estimation method. We use model data to demonstrate the beneficial impact of the extended retrieval method using the new channel ranking system on CO2 retrieval.

sensitivity analysis↗
NASA NTRS2004

User Evaluation of the NASA Technical Report Server Recommendation Service

We present the user evaluation of two recommendation server methodologies implemented for the NASA Technical Report Server (NTRS). One methodology for generating recommendations uses log analysis to identify co-retrieval events on full-text documents. For comparison, we used the Vector Space Model (VSM) as the second methodology. We calculated cosine similarities and used the top 10 most similar documents (based on metadata) as 'recommendations'. We then ran an experiment with NASA Langley Research Center (LaRC) staff members to gather their feedback on which method produced the most 'quality' recommendations. We found that in most cases VSM outperformed log analysis of co-retrievals. However, analyzing the data revealed the evaluations may have been structurally biased in favor of the VSM generated recommendations. We explore some possible methods for combining log analysis and VSM generated recommendations and suggest areas of future work.

Nelson, Michael L.↗
NASA NTRS2004

User Evaluation of the NASA Technical Report Server Recommendation Service

We present the user evaluation of two recommendation server methodologies implemented for the NASA Technical Report Server (NTRS). One methodology for generating recommendations uses log analysis to identify co-retrieval events on full-text documents. For comparison, we used the Vector Space Model (VSM) as the second methodology. We calculated cosine similarities and used the top 10 most similar documents (based on metadata) as recommendations . We then ran an experiment with NASA Langley Research Center (LaRC) staff members to gather their feedback on which method produced the most quality recommendations. We found that in most cases VSM outperformed log analysis of co-retrievals. However, analyzing the data revealed the evaluations may have been structurally biased in favor of the VSM generated recommendations. We explore some possible methods for combining log analysis and VSM generated recommendations and suggest areas of future work.

Nelson, Michael L.↗
NASA NTRS2003

A Physical Model to Determine Snowfall over Land by Microwave Radiometry

Because microwave brightness temperatures emitted by snow covered surfaces are highly variable, snowfall above such surfaces is difficult to observe using window channels that occur at low frequencies (v less than 100 GHz). Furthermore, at frequencies v less than or equal to 37 GHz, sensitivity to liquid hydrometeors is dominant. These problems are mitigated at high frequencies (v greater than 100 GHz) where water vapor screens the surface emission and sensitivity to frozen hydrometeors is significant. However the scattering effect of snowfall in the atmosphere at those higher frequencies is also impacted by water vapor in the upper atmosphere. This work describes the methodology and results of physically-based retrievals of snow falling over land surfaces. The theory of scattering by randomly oriented dry snow particles at high microwave frequencies appears to be better described by regarding snow as a concatenation of equivalent ice spheres rather than as a sphere with the effective dielectric constant of an air-ice mixture. An equivalent sphere snow scattering model was validated against high frequency attenuation measurements. Satellite-based high frequency observations from an Advanced Microwave Sounding Unit (AMSU-B) instrument during the March 5-6, 2001 New England blizzard were used to retrieve snowfall over land. Vertical distributions of snow, temperature and relative humidity profiles were derived from the Pennsylvania State University-National Center for Atmospheric Research (PSU-NCAR) fifth-generation Mesoscale Model (MM5). Those data were applied and modified in a radiative transfer model that derived brightness temperatures consistent with the AMSU-B observations. The retrieved snowfall distribution was validated with radar reflectivity measurements obtained from the National Oceanic and Atmospheric Administration (NOAA) National Weather Service (NWS) ground-based radar network.

Skofronick-Jackson, G.↗
NASA NTRS2011

Canopy Spectral Invariants: Application to Classification of Forest Types from Hyperspectral Data - Part 2

Many studies have been conducted to demonstrate the ability of hyperspectral data to discriminate plant dominant species. Most of them have employed the use of empirically based techniques, which are site specific, requires some initial training based on characteristics of known leaf and/or canopy spectra and therefore may not be extendable to operational use or adapted to changing or unknown land cover. In this paper we propose a physically based approach for separation of dominant forest type using hyperspectral data. The radiative transfer theory of canopy spectral invariants underlies the approach, which facilitates parameterization of the canopy reflectance in terms of the leaf spectral scattering and two spectrally invariant and structurally varying variables - recollision and directional escape probabilities. The methodology is based on the idea of retrieving spectrally invariant parameters from hyperspectral data first, and then relating their values to structural characteristics of three-dimensional canopy structure. Theoretical and empirical analyses of ground and airborne data acquired by Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) over two sites in New England, USA, suggest that the canopy spectral invariants convey information about canopy structure at both the macro- and micro-scales. The total escape probability (one minus recollision probability) varies as a power function with the exponent related to the number of nested hierarchical levels present in the pixel. Its base is a geometrical mean of the local total escape probabilities and accounts for the cumulative effect of canopy structure over a wide range of scales. The ratio of the directional to the total escape probability becomes independent of the number of hierarchical levels and is a function of the canopy structure at the macro-scale such as tree spatial distribution, crown shape and size, within-crown foliage density and ground cover. These properties allow for the natural separation of dominant forest classes based on the location of points on the total escape probability vs the ratio log-log plane.

Schull, M. A.↗
NASA NTRS2016

Evaluation of the Validated Soil Moisture Product from the SMAP Radiometer

NASA's Soil Moisture Active Passive (SMAP) mission launched on January 31, 2015 into a sun-synchronous 6 am/6 pm orbit with an objective to produce global mapping of high-resolution soil moisture and freeze-thaw state every 2-3 days using an L-band (active) radar and an L-band (passive) radiometer. The SMAP radiometer began acquiring routine science data on March 31, 2015 and continues to operate nominally. SMAP's radiometer-derived soil moisture product (L2_SM_P) provides soil moisture estimates posted on a 36 km fixed Earth grid using brightness temperature observations from descending (6 am) passes and ancillary data. A beta quality version of L2_SM_P was released to the public in September, 2015, with the fully validated L2_SM_P soil moisture data expected to be released in May, 2016. Additional improvements (including optimization of retrieval algorithm parameters and upscaling approaches) and methodology expansions (including increasing the number of core sites, model-based intercomparisons, and results from several intensive field campaigns) are anticipated in moving from accuracy assessment of the beta quality data to an evaluation of the fully validated L2_SM_P data product.

Ocean Salinity↗
NASA NTRS2024

Absolute Intercalibration of Spaceborne Microwave Radiometers

Absolute calibration of spaceborne microwave radiometer observations consists of accurate determination of antenna cold space spillover, cross-polarization contamination, and nonlinearity coefficients of the receivers. We deem the GMI sensor to be the most accurate calibrated spaceborne microwave radiometer due to its unique calibration design features and its carefully planned orbit maneuvers. We demonstrate how to transfer the GMI calibration to other spaceborne radiometers, whose operations have sufficient time overlap with GMI. Specifically, we show results for WindSat and AMSR2. The sensor intercalibration is based on brightness temperature matchups between GMI and the other instruments over both open ocean and rainforest scenes. To assess the calibration accuracy, we compare the intercalibrated brightness temperatures with radiative transfer model calculations. In addition, we provide in situ validation results for wind speed and water vapor retrievals from the intercalibrated sensors. The intercalibration methodology allows for the creation of a multidecadal climate data record from passive microwave satellite observations. Significance Statement Creating a long-term climate data record of satellite observations of ocean winds, water vapor, and other variables requires careful and accurate calibration of the various sensors that are used. In particular, it is important to achieve the best possible consistency between the measurements from all the different instruments. This is a challenging task as the configuration and accuracy of these instruments can differ widely. The purpose of our paper is to demonstrate and validate the basic methodology for performing this intercalibration. The backbone of our method is data observed by a well-calibrated sensor that measures the passive microwave emission from Earth’s surface and atmosphere. We show how to transfer its calibration standard to other sensors.

Katherine Wentz↗
NASA NTRS2021

Implementation and Analysis of the Dual-channel Algorithm for the Retrieval of Soil Moisture and Vegetation Optical Depth for SMAP

In August 2020, SMAP released a new version of its soil moisture (SM) and vegetation optical depth (VOD) products. In this work, we review the methodology followed by the SMAP regularized dual-channel (DCA) retrieval algorithm. We show that the new implementation generated SM retrievals that not only satisfy the SMAP accuracy requirements but also show a performance comparable to the single-channel algorithm that uses the V polarized brightness temperature (SCA-V). Due to a lack of in situ measurements we cannot evaluate the accuracy of the VOD, but in this work, we will show analysis with the intention of providing an understanding of the VOD product.

O’Neill, P.↗