Search NASA⌕ Search

SEARCH · Search NASA

Results for “data retrieval”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Production of long-term global water vapor and liquid water data set using ultra-fast methods to assimilate multi-satellite and radiosonde observations

During the next decade, many programs and experiments under the Global Energy and Water Cycle Experiment (GEWEX) will utilize present day and future data sets to improve our understanding of the role of moisture in climate, and its interaction with other variables such as clouds and radiation. An important element of GEWEX will be the GEWEX Water Vapor Project (GVaP), which will eventually initiate a routine, real-time assimilation of the highest quality, global water vapor data sets including information gained from future data collection systems, both ground and space based. The comprehensive global water vapor data set being produced by METSAT Inc. uses a combination of ground-based radiosonde data, and infrared and microwave satellite retrievals. This data is needed to provide the desired foundation from which future GEWEX-related research, such as GVaP, can build. The first year of this project was designed to use a combination of the best available atmospheric moisture data including: radiosonde (balloon/acft/rocket), HIRS/MSU (TOVS) retrievals, and SSM/I retrievals, to produce a one-year, global, high resolution data set of integrated column water vapor (precipitable water) with a horizontal resolution of 1 degree, and a temporal resolution of one day. The time period of this pilot product was to be det3ermined by the availability of all the input data sets. January 1988 through December 1988 were selected. In addition, a sample of vertically integrated liquid water content (LWC) was to be produced with the same temporal and spatial parameters. This sample was to be produced over ocean areas only. Three main steps are followed to produce a merged water vapor and liquid water product. Input data from Radiosondes, TOVS, and SSMI/I is quality checked in steps one and two. Processing is done in step two to generate individual total column water vapor and liquid water data sets. The third step, and final processing task, involves merging the individual output products to produce the integrated water vapor product. A final quality control is applied to the merged data sets.

Vonderhaar, T. H.↗

KARL: A Knowledge-Assisted Retrieval Language

Data classification and storage are tasks typically performed by application specialists. In contrast, information users are primarily non-computer specialists who use information in their decision-making and other activities. Interaction efficiency between such users and the computer is often reduced by machine requirements and resulting user reluctance to use the system. This thesis examines the problems associated with information retrieval for non-computer specialist users, and proposes a method for communicating in restricted English that uses knowledge of the entities involved, relationships between entities, and basic English language syntax and semantics to translate the user requests into formal queries. The proposed method includes an intelligent dictionary, syntax and semantic verifiers, and a formal query generator. In addition, the proposed system has a learning capability that can improve portability and performance. With the increasing demand for efficient human-machine communication, the significance of this thesis becomes apparent. As human resources become more valuable, software systems that will assist in improving the human-machine interface will be needed and research addressing new solutions will be of utmost importance. This thesis presents an initial design and implementation as a foundation for further research and development into the emerging field of natural language database query systems.

Dominick, Wayne D.↗

Tropospheric Ozone during the TRACE-P Mission: Comparison between TOMS Satellite Retrievals and Aircraft Lidar Data, March 2001

Over the past several years, we have developed two new tropospheric ozone retrievals from the TOMS (Total Ozone Mapping Spectrometer) satellite instrument that are of sufficient resolution to follow pollution episodes. The modified-residual technique uses v. 7 TOMS total ozone and is applicable to tropical regimes in which the wave-one pattern in total ozone is observed. The TOMS-direct method ('TDOT' = TOMS Direct Ozone in the Troposphere) represents a new algorithm that uses TOMS radiances directly to extract tropospheric ozone in regions of constant stratospheric ozone. It is not geographically restricted, using meteorological regimes as the basis for classifying TOMS radiances and for selecting appropriate comparison data. TDOT is useful where tropospheric ozone displays high mixing ratios and variability characteristic of pollution. Some of these episodes were observed downwind of Asian biomass burning during the TRACE-P (Transport and Atmospheric Chemical Evolution-Pacific) field experiment in March 2001. This paper features comparisons among TDOT tropospheric ozone column depth, integrated uv-DIAL measurements made from NASA's DC-8, and ozonesonde data.

Frolov, A. D.↗

Using Ground-Based Measurements and Retrievals to Validate Satellite Data

The proposed research is to use the DOE ARM ground-based measurements and retrievals as the ground-truth references for validating satellite cloud results and retrieving algorithms. This validation effort includes four different ways: (1) cloud properties on different satellites, therefore different sensors, TRMM VIRS and TERRA MODIS; (2) cloud properties at different climatic regions, such as DOE ARM SGP, NSA, and TWP sites; (3) different cloud types, low and high level cloud properties; and (4) day and night retrieving algorithms. Validation of satellite-retrieved cloud properties is very difficult and a long-term effort because of significant spatial and temporal differences between the surface and satellite observing platforms. The ground-based measurements and retrievals, only carefully analyzed and validated, can provide a baseline for estimating errors in the satellite products. Even though the validation effort is so difficult, a significant progress has been made during the proposed study period, and the major accomplishments are summarized in the follow.

Dong, Xiquan↗

Incomplete fuzzy data processing systems using artificial neural network

In this paper, the implementation of a fuzzy data processing system using an artificial neural network (ANN) is discussed. The binary representation of fuzzy data is assumed, where the universe of discourse is decartelized into n equal intervals. The value of a membership function is represented by a binary number. It is proposed that incomplete fuzzy data processing be performed in two stages. The first stage performs the 'retrieval' of incomplete fuzzy data, and the second stage performs the desired operation on the retrieval data. The method of incomplete fuzzy data retrieval is proposed based on the linear approximation of missing values of the membership function. The ANN implementation of the proposed system is presented. The system was computationally verified and showed a relatively small total error.

Patyra, Marek J.↗

The wet tropospheric range correction - Product intercomparisons and the simulated effect for tropical Pacific altimeter retrievals

Four data sets used to correct satellite altimetry for the effects of tropospheric water vapor over the tropical Pacific Ocean are evaluated statistically, with a focus on the period 1979-1983. Satellite altimeter measurements are simulated by degrading model sea-level solutions with selected water-vapor data, and seasonal and interannual variations are investigated. The results are presented in extensive contour maps and characterized in detail. The standard deviation between two satellite-based data sets (Nimbus-7 SMMR and TOVS) was found to be 2-4 cm, while both the rms difference between seasonal cycles of the two sets and the difference between the mean fields were 1-2 cm. Larger differences (4-8 cm) were found between these data sets and those based on operational analyses (ECMWF and Fleet Numerical Oceanography Center). The maximum interannual anomaly in the water-vapor correction was 12 cm, for the eastern Pacific at the peak of the 1982-1983 ENSO event.

Zimbelman, Darrell F.↗

MISR photogrammetric data reduction for geophysical retrievals

The theoretical concept, based on modern photogrammetric methods, underlying the design of the MISR science data processing system responsible for the autonomous and continuous georectification of multi-angle imagery is the subject of this paper.

photogrammetric↗

Cirrus cloud retrieval using infrared sounding data: Multilevel cloud errors

In this study we perform an error analysis for cloud-top pressure retrieval using the High-Resolution Infrared Radiometric Sounder (HIRS/2) 15-microns CO2 channels for the two-layer case of transmissive cirrus overlying an overcast, opaque stratiform cloud. This analysis includes standard deviation and bias error due to instrument noise and the presence of two cloud layers, the lower of which is opaque. Instantaneous cloud pressure retrieval errors are determined for a range of cloud amounts (0.1-1.0) and cloud-top pressures (850-250 mb). Large cloud-top pressure retrieval errors are found to occur when a lower opaque layer is present underneath an upper transmissive cloud layer in the satellite field of view (FOV). Errors tend to increase with decreasing upper-cloud effective cloud amount and with decreasing cloud height (increasing pressure). Errors in retrieved upper-cloud pressure result in corresponding errors in derived effective cloud amount. For the case in which a HIRS FOV has two distinct cloud layers, the difference between the retrieved and actual cloud-top pressure is positive in all cases, meaning that the retrieved upper-cloud height is lower than the actual upper-cloud height. In addition, errors in retrieved cloud pressure are found to depend upon the lapse rate between the low-level cloud top and the surface. We examined which sounder channel combinations would minimize the total errors in derived cirrus cloud height caused by instrument noise and by the presence of a lower-level cloud. We find that while the sounding channels that peak between 700 and 1000 mb minimize random errors, the sounding channels that peak at 300-500 mb minimize bias errors. For a cloud climatology, the bias errors are most critical.

Baum, Bryan A.↗

Status on Iterative Transform Phase Retrieval Applied to the GBT Data

This slide presentation reviews the use of iterative transform phase retrieval in the analysis of the Green Bank Radio Telescope (GBT) Data. It reviews the NASA projects that have used phase retrieval, and the testbed for the algorithm to be used for the James Webb Space Telescope. It shows the comparison of phase retrieval with an interferometer, and reviews the two approaches used for phase retrieval, iterative transform (ITA) or parametric (non-linear least squares model fitting). The concept of ITA Phase Retrieval is reviewed, and the application to Radio Antennas is reviewed. The presentation also examines the National Radio Astronomy Observatory (NRAO) data from the GBT, and the Fourier model that NRAO uses to analyze the data. The challenge for ITA phase retrieval is reviewed, and the coherent approximation for incoherent data is shown. The validity of the approximation is good for a large tilt. There is a review of the proof of concept of the Phase Review simulation using the input wavefront, and the initial sampling parameters estimate from the focused GBT data.

Dean, Bruce↗

Thermodynamic and cloud parameter retrieval using infrared spectral data

High-resolution infrared radiance spectra obtained from near nadir observations provide atmospheric, surface, and cloud property information. A fast radiative transfer model, including cloud effects, is used for atmospheric profile and cloud parameter retrieval. The retrieval algorithm is presented along with its application to recent field experiment data from the NPOESS Airborne Sounding Testbed - Interferometer (NAST-I). The retrieval accuracy dependence on cloud properties is discussed. It is shown that relatively accurate temperature and moisture retrievals can be achieved below optically thin clouds. For optically thick clouds, accurate temperature and moisture profiles down to cloud top level are obtained. For both optically thin and thick cloud situations, the cloud top height can be retrieved with an accuracy of approximately 1.0 km. Preliminary NAST-I retrieval results from the recent Atlantic-THORPEX Regional Campaign (ATReC) are presented and compared with coincident observations obtained from dropsondes and the nadir-pointing Cloud Physics Lidar (CPL).

Zhou, Daniel K.↗

Servo control and data synchronization study

Magnetic tape recorder-reproducer to accept data pulses at varying rates, record data at constant rate, and retrieve recorded data at rate synchronized to external clock

SYNCHRONIZATION↗

New Approach to Monitor Transboundary Particulate Pollution over Northeast Asia

A new approach to more accurately monitor and evaluate transboundary particulate matter (PM) pollution is introduced based on aerosol optical products from Korea's Geostationary Ocean Color Imager (GOCI). The area studied is Northeast Asia (including eastern parts of China, the Korean peninsula and Japan), where GOCI has been monitoring since June 2010. The hourly multi-spectral aerosol optical data that were retrieved from GOCI sensor onboard geostationary satellite COMS (Communication, Ocean, and Meteorology Satellite) through the Yonsei aerosol retrieval algorithm were first presented and used in this study. The GOCI-retrieved aerosol optical data are integrated with estimated aerosol distributions from US EPA Models-3/CMAQ (Community Multi-scale Air Quality) v4.5.1 model simulations via data assimilation technique, thereby making the aerosol data spatially continuous and available even for cloud contamination cells. The assimilated aerosol optical data are utilized to provide quantitative estimates of transboundary PM pollution from China to the Korean peninsula and Japan. For the period of 1 April to 31 May, 2011 this analysis yields estimates that AOD as a proxy for PM2.5 or PM10 during long-range transport events increased by 117-265% compared to background average AOD (aerosol optical depth) at the four AERONET sites in Korea, and average AOD increases of 121% were found when averaged over the entire Korean peninsula. This paper demonstrates that the use of multi-spectral AOD retrievals from geostationary satellites can improve estimates of transboundary PM pollution. Such data will become more widely available later this decade when new sensors such as the GEMS (Geostationary Environment Monitoring Spectrometer) and GOCI-2 are scheduled to be launched.

Data Assimilation↗

Assimilation of GPM-retrieved Ocean Surface Meteorology Data for Two Snowstorm Events during ICE-POP 2018

As a component of the National Aeronautics and Space Administration (NASA) Weather Focus Area and Global Precipitation Measurement (GPM) Ground Validation participation in the International Collaborative Experiments for PyeongChang 2018 Olympic and Paralympic Winter Games (ICE-POP 2018) field research and forecast demonstration programs, hourly ocean surface meteorology properties were retrieved from the GPM microwave observations for January – March 2018. In this study, the retrieved ocean surface meteorological products – 2-m temperature, 2-m specific humidity, and 10-m wind speed were assimilated into a regional numerical weather prediction (NWP) framework to explore the application of these observations for two heavy snowfall events during the ICE-POP 2018: 27-28 February, and 7-8 March 2018. The Weather Research and Forecasting (WRF) model and the community Gridpoint Statistical Interpolation (GSI) were used to conduct high resolution simulations and data assimilation experiments. The results indicate that the data assimilation has a large influence on surface thermodynamic and wind fields in the model initial condition for both events. With cycled data assimilation, significantly positive influence of the retrieved surface observation was found for the March case with improved quantitative precipitation forecast and reduced error in temperature forecast. A slightly smaller yet positive impact was also found in the forecast of the February case.

assimilation↗

Surface reflectance factor retrieval from Thematic Mapper data

Based on the absolute radiometric calibration of the TM and the use of a radiative transfer program for atmospheric correction, ground reflectances were retrieved for several fields of crops and bare soil in TM bands 1-4 for six TM scenes acquired over a 12-month period. These reflectances were compared to those measured using ground-based and low-altitude, aircraft-mounted radiometers. When, for four TM acquisitions, the comparison was made between areas that had been carefully selected for their high uniformity, the reflectance factors agreed to + or - 0.01 over the reflectance range 0.02-0.55. When the comparison was made for two of the above acquisitions and two others on different dates, for larger areas not carefully selected to be of uniform reflectance, the reflectance factors agreed to + or - 0.02 (1 sigma RMS), over same reflectance range.

Holm, Ronald G.↗

Design and Construction of a NASA Airborne and Field Investigation Inventory

NASA conducts airborne and field investigations that produce a wealth of valuable research data. Unfortunately, this data is often scattered across individual scientist hard drives or NASA Distributed Active Archive Centers and it can be difficult to locate and retrieve. Although satellite data has been successfully consolidated by tools such as EarthData Search, airborne and field investigation data present unique challenges stemming from the variability of temporal, spatial, platform, and instrument metadata. To address these difficulties with data retrieval and metadata variability, the Interagency Implementation and Concepts Team established an Airborne Data Management Group to improve airborne data search, understanding, access, and use. Surveys have been conducted of end users in order to build query lists that will drive the augmentation and standardization of existing metadata. Detailed metadata was then laboriously compiled from present and historic airborne and field investigations to build a database that will enable intelligent data search and retrieval. The inventory structure and function will be described and demonstrated. The purpose of this presentation is to bring awareness to this effort, to highlight and describe the issues and complications in development, and to increase user interest prior to public release in 2020.

Davis, Carson↗

Chapter 6: Fundamental Satellite Precipitation Data Records

The observation and measurement of precipitation across a range of temporal and spatial scales is of great importance for many user requirements and applications. Precipitation is a key component of the global energy and water cycle moving water, and its’ associated energy, through the Earth system at relatively fine spatial and temporal scales. At the societal level, precipitation provides fresh water and moderates our climate, but can also be destructive through storms, droughts and spreading diseases. Monitoring and measuring the distribution and quantities of precipitation, across the Earth’s surface is therefore crucial to physical and social applications, together with changes in precipitation over time. While conventional surface instruments provide a reasonably long record, these tend to be confined to well populated land surface areas: most ocean regions and sparsely populated regions have few measurements. Satellite-based precipitation products can provide global measurements, although the timespan of such products is limited and the data record is comprised of different instruments that operate over different periods of record. The challenge of any climate record is to provide a consistent product over the full period of record. Many satellite precipitation products incorporate ancillary data, such as surface gauge data or model data, which may limit their utility in the validation or verification of other climate data records. This chapter provides a review of the importance of precipitation to the climate system, the basis of satellite precipitation retrievals, climate data records of satellite data for precipitation retrievals and the development of fundamental precipitation data records for climate applications.

Climate data record↗

NASA biological and physical sciences databases: who’s the FAIRest of them all?

Conceptual models are a key part of the foundation of scientific study. Scientific data discovery and retrieval are often inaccurate and incomplete because these models are not sufficiently well-incorporated into data retrieval systems. Systems often don’t provide the necessary tools to those producing scientific data to fully and unambiguously annotate them and the result is consumers of the data cannot find them efficiently. The capability of data archives to provide these tools to link data to underlying conceptual models is one of dimensions of the recently developed “FAIR” principles (https://www.go-fair.org/fair-principles/ ), and is key to many automated processes being able to operate on these data, particularly analytics involving artificial intelligence. We used an open-source web service to measure the FAIR compliance of the three data archives operated by NASA for the biological and physical sciences: the Life Sciences Data Archive, the Physical Sciences Informatics database, and GeneLab. The service ingests references to data sets in these archives, and then executes domain-non-specific examinations of these data and metadata that test compliance to the FAIR principles. Of the 22 metrics tested, GeneLab passed 11 (50%), and PSI and LSDA each passed 7 (32%). These data were gathered using only one representative data set from each archive and we anticipate variability in results as we continue to apply these metrics to other data. A preliminary study of the failure traces for each metric suggests there is a wide range of effort and complexity in the enhancements required for each system to elevate FAIR compliance, and this is the subject of continued investigation. This information has been and will likely continue to be important information in planning these enhancements, with the goal of increased readiness of the data for automated processes.

database↗

Solar heating and cooling technical data and systems analysis

The acquisition and processing of selected parametric data for inclusion in a computerized Data Base using the Marshall Information Retrieval and Data System (MIRADS) developed by NASA-MSFC is discussed. This data base provides extensive technical and socioeconomic information related to solar energy heating and cooling on a national scale. A broadly based research approach was used to assist in the support of program management and the application of a cost-effective program for solar energy development and demonstration.

Christensen, D. L.↗