Search NASA⌕ Search

SEARCH · Search NASA

Results for “data retrieval”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

What You Need to Know About the OMI NO2 Data Product for Air Quality Studies

The standard nitrogen dioxide (NO2) data product, produced from measurements by the Ozone Monitoring Instrument (OMI), are publicly available online from the NASA GESDISC facility. Important data fields include total and tropospheric column densities, as well as collocated data for cloud fraction and cloud top height, surface albedo and snow/ice coverage, at the resolution of the OMI instrument (12 km x 26 km, at nadir). The retrieved NO2 data have been validated, principally under clear-sky conditions. The first public-release version has been available since September 2006. An improved version of the data product, which includes a number of new data fields, and improved estimates of the retrieval uncertainties will be released by the end of 2007. This talk will describe the standard NO2 data product, including details that are essential for the use of the data for air quality studies. We will also describe the principal improvements with the new version of the data product.

Celarier, E. A.↗

Preliminary results of an assessment of FGGE 'special effort' data and its impact on GLAS model analyses and forecasts

Attempts to improve the handling of satellite temperature and cloud-derived data during the FGGE experiment are compared with results gained during the trials. The satellite data were edited by assigning quality indicators to temperature soundings by means of the IR TV camera on the Tiros-N spacecraft, and to cloud-tracked wind data from GEO satellites. The data quality were assayed on the basis of horizontal, vertical, and temporal consistency of observed synoptic conditions. The data interpreter-operator retrieved all available data for an area, determined which regions were data-sparse, then used data-rich areas nearby to supply smoothed gradients into the zones with insufficient data. Results are presented for measurements taken during Jan.-Feb., and May 1979 over Alaska. It was found that enhanced and operational IR soundings were mostly equivalent. Some improvements were implemented in the 1000-300 mb layer thickness and intensification of atmospheric thermal gradients. Interactive processing was concluded to be an aid to processing Tiros-N data. The data-improvements treatment was found to significantly modify large scale analyses.

Atlas, R.↗

The Space Station Data Management System - Avionics that integrate

The Space Station Data Management System (DMS) comprises the networked computers, mass storage, workstations, and instrumentation interfaces required to support onboard systems and payload operations. This paper gives an overview of the current DMS architecture and discusses its role as onboard integrator in four of its major functional areas: (1) data communication; (2) data processing; (3) data administration, storage and retrieval; and (4) data presentation at the human-computer interface.

Whitelaw, Virginia↗

Ozone profile retrievals from the ESA GOME instrument

The potential of the ESA Global Ozone Monitoring Experiment (GOME) to produce ozone profile information has been examined by carrying out two sample retrievals using simulated GOME data. The first retrieval examines the potential of the GOME instrument to produce stratospheric ozone profiles using the traditional back-scatter ultraviolet technique, while the second examines the possibility of obtaining tropospheric profile information, and improving the quality of the stratospheric profile retrievals, by exploiting the temperature dependence of the ozone Huggins bands.

Munro, Rosemary↗

Investigations into mirror fabrication metrology analysis

This final report describes the work performed under this delivery order from June 1993 through August 1994. The scope of work included three distinct tasks in support of the AXAF-I program. The objective of the first task was to perform investigations of the grinding and polishing characteristics of the zerodur material by fabricating several samples. The second task was to continue the development of the integrated optical performance modeling software for AXAF-I. The purpose of third and final task was to develop and update the database of AXAF technical documents for an easy and rapid access. The MSFC optical and metrology shops were relocated from the B-wing of Building 4487 to Room BC 144 of Building 4466 in the beginning of this contract. This included dismantling, packing, and moving the equipment from its old location, and then reassembling it at the new location. A total of 65 zerodur samples, measuring 1 inch x 2 inches x 6 inches were ground and polished to a surface figure of lambda/10 p-v, and a surface finish of 5A rms were fabricated for coating tests. A number of special purpose tools and metal mirrors were also fabricated to support various AXAF-I development activities. In the metrology area, the ZYGO Mark 4 interferometer was relocated and also upgraded with a faster and more powerful processor. Surface metrology work was also performed on the coating samples and other optics using ZYGO interferometer and WYKO profilometer. A number of new features have been added to the GRAZTRACE program to enhance its analysis and modeling capabilities. A number of new commands have been added to the command mode GRAZTRACE program to provide a better control to the user on the program execution and data manipulation. Some commands and parameter entries have been reorganized for a uniform format. The command mode version of the convolution program CONVOLVE has been developed. An on-line help system and a user's manual have also been developed for the benefit of the users. The database of AXAF technical documents continues to progress. The titles, company name, date, and location of over 390 documents have been entered in this database. This database provides both a data search and retrieval function, and a data adding function. These functions allow a user to quickly search the data files for documents or add new information. A detailed user's guide has also been prepared. This user guide includes a document classification guide, a list of abbreviations, and a list of acronyms, which have been used in compiling this database of AXAF-I technical documents.

Dimmock, John O.↗

CropEx Web-Based Agricultural Monitoring and Decision Support

CropEx is a Web-based agricultural Decision Support System (DSS) that monitors changes in crop health over time. It is designed to be used by a wide range of both public and private organizations, including individual producers and regional government offices with a vested interest in tracking vegetation health. The database and data management system automatically retrieve and ingest data for the area of interest. Another stores results of the processing and supports the DSS. The processing engine will allow server-side analysis of imagery with support for image sub-setting and a set of core raster operations for image classification, creation of vegetation indices, and change detection. The system includes the Web-based (CropEx) interface, data ingestion system, server-side processing engine, and a database processing engine. It contains a Web-based interface that has multi-tiered security profiles for multiple users. The interface provides the ability to identify areas of interest to specific users, user profiles, and methods of processing and data types for selected or created areas of interest. A compilation of programs is used to ingest available data into the system, classify that data, profile that data for quality, and make data available for the processing engine immediately upon the data s availability to the system (near real time). The processing engine consists of methods and algorithms used to process the data in a real-time fashion without copying, storing, or moving the raw data. The engine makes results available to the database processing engine for storage and further manipulation. The database processing engine ingests data from the image processing engine, distills those results into numerical indices, and stores each index for an area of interest. This process happens each time new data is ingested and processed for the area of interest, and upon subsequent database entries, the database processing engine qualifies each value for each area of interest and conducts a logical processing of results indicating when and where thresholds are exceeded. Reports are provided at regular, operator-determined intervals that include variances from thresholds and links to view raw data for verification, if necessary. The technology and method of development allow the code base to easily be modified for varied use in the real-time and near-real-time processing environments. In addition, the final product will be demonstrated as a means for rapid draft assessment of imagery.

Harvey. Craig↗

TESS Data Release Notes: Sector 59, DR84

TESS Sector 59 observations include physical orbits 125 and 126 of the spacecraft around the Earth. Data collection was paused for a total of 0.63 days to download data. Data were downloaded approximately every seven days, once near apogee of each orbit and once near perigee. Note that the Sector 59 data were briefly made available on 2023 January 18–19 before an issue was identified that required reprocessing. Data have since been reprocessed. The reprocessing has a minimal impact on the final light curves, but resulted in a different set of TCEs than initially released. Users should re-download the data if retrieved before January 19th. In total, there are 25.79 days of science data collected in Sector 59.

TESS↗

Estimating effective data density in a satellite retrieval or an objective analysis

An attempt is made to formulate consistent objective definitions of the concept of 'effective data density' applicable both in the context of satellite soundings and more generally in objective data analysis. The definitions based upon various forms of Backus-Gilbert 'spread' functions are found to be seriously misleading in satellite soundings where the model resolution function (expressing the sensitivity of retrieval or analysis to changes in the background error) features sidelobes. Instead, estimates derived by smoothing the trace components of the model resolution function are proposed. The new estimates are found to be more reliable and informative in simulated satellite retrieval problems and, for the special case of uniformly spaced perfect observations, agree exactly with their actual density. The new estimates integrate to the 'degrees of freedom for signal', a diagnostic that is invariant to changes of units or coordinates used.

Purser, R. J.↗

Remote Sensing of Rain

The first problem addressed concerns passive-microwave rain retrievals. Most current approaches start by building off-line a cloud-model-derived database. Given data, the retrieval algorithms search the database for the microwave temperatures "closest" to the observed data, then after some fine-tuning (performed in different ways by different implementations) the rain is estimated to be that which corresponds to the selected (and fine-tuned) set of database temperatures. These approaches have three drawbacks: they cannot properly take into account the ambiguities which arise from the fact that several rain scenarios can produce the same observed temperatures; they are quite inefficient since they require manipulating a large database along with often complex "fine-tuning" procedures; and they cannot refine their estimates if additional data is available. This past year we have derived closed formulae relating observed microwave brightness temperatures, T(sub b), and the underlying rain rates, R: average T(sub b) =f (rain) and average rain = g (T(sub b)), along with the corresponding covariance matrices. These results are sufficient to describe the conditional probabilities p(R/T(sub b)) and p(T(sub b)/R) to second order. Progress has also been made towards deriving a robust description of the rain drop size distribution (DSD). The widespread approach consisting in parameterizing the DSD as a gamma-distribution in terms of the drop diameter D suffers from the facts that, in reality, the DSD is not a smooth function of D and that the largely arbitrary Gamma model imposes unintended behavior, which has implications on any quantities derived from the DSD model. We have therefore developed a non-parametric yet practical description of the DSD, which is particularly well-suited for use in remote-sensing applications. The diagram on the left shows a comparison between an actual DSD sample and the truncated non-parametric representation. One figure shows the relation between radar reflectivity and rain rate derived using this representation. Validation of the Tropical Rainfall Measuring Mission (TRMM) radar-radiometer combined R and DSD algorithm is underway. This algorithm was designed to make optimal use of the instantaneous reflectivity profiles measured by the TRMM radar and the microwave brightness temperatures measured by the TRMM passive radiometer. So far, it appears to be the most reliable TRMM rain algorithm.

Haddad, Ziad S.↗

Arctic Sea Ice Parameters from AMSR-E Data using Two Techniques, and Comparisons with Sea Ice from SSM

We use two algorithms to process AMSR-E data in order to determine algorithm dependence, if any, on the estimates of sea ice concentration, ice extent and area, and trends and to evaluate how AMSR-E data compare with historical SSM/I data. The monthly ice concentrations derived from the two algorithms from AMSR-E data (the AMSR-E Bootstrap Algorithm, or ABA, and the enhanced NASA Team algorithm, or NT2) differ on average by about 1 to 3%, with data from the consolidated ice region being generally comparable for ABA and NT2 retrievals while data in the marginal ice zones and thin ice regions show higher values when the NT2 algorithm is used. The ice extents and areas derived separately from AMSR-E using these two algorithms are, however, in good agreement, with the differences (ABA-NT2) being about 6.6 x 10(exp 4) square kilometers on average for ice extents and -6.6 x 10(exp 4) square kilometers for ice area which are small compared to mean seasonal values of 10.5 x 10(exp 6) and 9.8 x 10(exp 6) for ice extent and area: respectively. Likewise, extents and areas derived from the same algorithm but from AMSR-E and SSM/I data are consistent but differ by about -24.4 x 10(exp 4) square kilometers and -13.9 x 10(exp 4) square kilometers, respectively. The discrepancies are larger with the estimates of extents than area mainly because of differences in channel selection and sensor resolutions. Trends in extent during the AMSR-E era were also estimated and results from all three data sets are shown to be in good agreement (within errors).

Comiso, Josefino C.↗

UAS Reports (UREPs): EnablingExchange of Observation Data Between UAS Operations

As the volume of small unmanned aircraft systems (UAS) operations increases, the lack of weather products to support these operations becomes more problematic. One early solution to obtaining more information about weather conditions is to allow operators to share their observations and measurements with other airspace users. This is analogous to the AIREP and PIREP reporting systems in traditional aviation wherein pilots report weather phenomena they have observed or experienced to provide better situational awareness to other pilots. Given the automated nature of the small (under 55 lbs.) UAS platforms and operations, automated reporting of relevant information should also be supported. To promote automated exchange of these data, a well-defined data schema needs to be established along with the mechanisms for sending and retrieving the data. This paper examines this concept and offers an initial definition of the necessary elements to allow for immediate implementation and use.

UAS↗

pyQuARC: Preparing for Full Release

Metadata holds the contextual information about data and is the underlying structure for many data search portals. High quality metadata optimizes search results, allowing users to quickly retrieve the data they need. With the abundant volume and diversity of Earth observation datasets, data discovery and metadata quality are critical for end users. The Common Metadata Repository (CMR), for example, currently hosts metadata for over 9,000 Earth observation data products archived across 12 NASA Distributed Active Archive Centers (DAACs). The Analysis and Review of CMR (ARC) Team, located at Marshall Space Flight Center, assesses the completeness, correctness, and consistency of these metadata records to ensure they are accessible, usable, and discoverable. In 2021, ARC began developing pyQuARC, an open source library for Earth Observation Metadata Quality Assessment to automate this effort. The tool uses ARC’s existing metadata quality framework to provide prioritized recommendations for metadata improvement. During initial testing, pyQuARC automatically identified 58% of metadata findings when compared with a sample of manually reviewed records. Using the results from initial testing, this presentation will focus on recent advancements and improvements of the tool as the ARC team prepares for pyQuARC’s full release. It will also demonstrate pyQuARC's enrichment value, not only for the ARC team, but the broader EOSDIS metadata community as well.

Essence Raphael↗

Validation of Long-Term Global Aerosol Climatology Project Optical Thickness Retrievals Using AERONET and MODIS Data

A comprehensive set of monthly mean aerosol optical thickness (AOT) data from coastal and island AErosol RObotic NETwork (AERONET) stations is used to evaluate Global Aerosol Climatology Project (GACP) retrievals for the period 1995-2009 during which contemporaneous GACP and AERONET data were available. To put the GACP performance in broader perspective, we also compare AERONET and MODerate resolution Imaging Spectroradiometer (MODIS) Aqua level-2 data for 2003-2009 using the same methodology. We find that a large mismatch in geographic coverage exists between the satellite and ground-based datasets, with very limited AERONET coverage of open-ocean areas. This is especially true of GACP because of the smaller number of AERONET stations at the early stages of the network development. Monthly mean AOTs from the two over-the-ocean satellite datasets are well-correlated with the ground-based values, the correlation coefficients being 0.81-0.85 for GACP and 0.74-0.79 for MODIS. Regression analyses demonstrate that the GACP mean AOTs are approximately 17%-27% lower than the AERONET values on average, while the MODIS mean AOTs are 5%-25% higher. The regression coefficients are highly dependent on the weighting assumptions (e.g., on the measure of aerosol variability) as well as on the set of AERONET stations used for comparison. Comparison of over-the-land and over-the-ocean MODIS monthly mean AOTs in the vicinity of coastal AERONET stations reveals a significant bias. This may indicate that aerosol amounts in coastal locations can differ significantly from those in adjacent open-ocean areas. Furthermore, the color of coastal waters and peculiarities of coastline meteorological conditions may introduce biases in the GACP AOT retrievals. We conclude that the GACP and MODIS over-the-ocean retrieval algorithms show similar ranges of discrepancy when compared to available coastal and island AERONET stations. The factors mentioned above may limit the performance of the validation procedure and cause us to caution against a direct extrapolation of the presented validation results to the entirety of the GACP dataset.

MODIS (radiometry)↗

Combined UV and IR Ozone Profile Retrieval from TROPOMI and CrIS Measurements

Vertical ozone profiles from combined spectral measurements in the ultraviolet and infrared spectral range were retrieved by using data from the TROPOspheric Monitoring Instrument on the Sentinel-5 Precursor (TROPOMI/S5P) and the Cross-track Infrared Sounder on the Suomi National Polar-orbiting Partnership (CrIS/Suomi-NPP), which are flying in loose formation 3 min apart in the same orbit. A previous study of ozone profiles retrieved exclusively from TROPOMI UV spectra showed that the vertical resolution in the troposphere is clearly limited (Mettig et al., 2021). The vertical resolution and the vertical extent of the ozone profiles is improved by combining both wavelength ranges compared to retrievals limited to UV or IR spectral data only. The combined retrieval particularly improves the accuracy of the retrieved tropospheric ozone and to a lesser degree stratospheric ozone up to 30 km. An increase in the degrees of freedom (DOF) by 1 DOF was found in the UV + IR retrieval compared to the UV-only retrieval. Compared to previous publications, which investigated combinations of UV and IR observations from the Ozone Monitoring Instrument and Tropospheric Emission Spectrometer (OMI and TES) and Global Ozone Monitoring Experiment version 2 and Infrared Atmospheric Sounding Interferometer (GOME-2 and IASI) pairs, the degree of freedom is lower, which is attributed to the reduced spectral resolution of CrIS compared to TES or IASI. Tropospheric lidar and ozonesondes were used to validate the ozone profiles and tropospheric ozone content (TOC). In their comparison with tropospheric lidars, both ozone profiles and TOCs show smaller biases for the retrieved data from the combined UV + IR observation than from the UV observations alone. For the ozone profiles below 10 km, the mean differences are around ±10 % and the mean TOC varies around ±3 DU. We show that TOCs from the combined retrieval agree better with ozonesonde results at northern latitudes than the UV-only and IR-only retrievals and also have lower scatter. In the tropics, the IR-only retrieval shows the best agrement with TOCs derived from ozonesondes. While in general the TOCs show good agreement with ozonesonde data, the profiles have a positive bias of around 30 % between 10 and 15 km. The reason is probably a positive stratospheric bias from the IR retrieval. The comparison of the UV + IR and UV ozone profiles up to 30 km with the Microwave Limb Sounder (MLS) demonstrates the improvement of the UV + IR profile in the stratosphere above 18 km. In comparison to the UV-only approach the retrieval shows improvements of up to 10 % depending on latitude but can also show worse results in some regions and latitudes.

Ozone↗

AVIRIS Reflectance Retrievals: UCSB Users Manual

The following write-up is designed to help students and researchers take Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) radiance data and retrieve surface reflectance. In the event that the software is not available, but a user has access to a reflectance product, this document is designed to provide a better understanding of how AVIRIS reflectance was retrieved. This guide assumes that the reader has both a basic understanding of the UNIX computing environment, and that of spectroscopy. Knowledge of the Interactive Data Language (IDL) and the Environment for Visualizing Images (ENVI) is helpful. This is a working document, and many of the fine details described in the following pages have been previously undocumented. After having read this document the reader should be able to process AVIRIS to reflectance, provided access to all of the code is possible. The AVIRIS radiance data itself is pre-processed at the Jet Propulsion Laboratory (JPL) in Pasadena, California. The first section of this paper describes how to read data from tape and byte-swap the data. Section 2 describes the procedure in preparing support files before running the 'h2o' suite of programs. Section 3 describes the four programs used in the process, h2olut9.f, h2ospl9.f, vlsfit9.f and rfl9.f.

Roberts, Dar A.↗

Space environment effects on fiber optics systems

The performance survivability of hardened fiber optic data link design for application in future spacecraft systems was assessed. The effects of space environmental conditions on link performance was analyzed. The integration and operation of new fiber optic link components exhibiting increased hardening to radiation environments is emphasized. The opportunity to expose operational fiber optic data links to an actual space environment for 6 months or longer and to retrieve the data links for analysis are discussed. Reliable design criteria for future spacecraft application, relative to the long term low dose space radiation effects as a function of temperature are outlined.

Taylor, E. W.↗