Search NASA⌕ Search

SEARCH · Search NASA

Results for “DATA RETRIEVAL”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

The Space Station Data Management System - Avionics that integrate

The Space Station Data Management System (DMS) comprises the networked computers, mass storage, workstations, and instrumentation interfaces required to support onboard systems and payload operations. This paper gives an overview of the current DMS architecture and discusses its role as onboard integrator in four of its major functional areas: (1) data communication; (2) data processing; (3) data administration, storage and retrieval; and (4) data presentation at the human-computer interface.

Whitelaw, Virginia↗

Ozone profile retrievals from the ESA GOME instrument

The potential of the ESA Global Ozone Monitoring Experiment (GOME) to produce ozone profile information has been examined by carrying out two sample retrievals using simulated GOME data. The first retrieval examines the potential of the GOME instrument to produce stratospheric ozone profiles using the traditional back-scatter ultraviolet technique, while the second examines the possibility of obtaining tropospheric profile information, and improving the quality of the stratospheric profile retrievals, by exploiting the temperature dependence of the ozone Huggins bands.

Munro, Rosemary↗

Investigations into mirror fabrication metrology analysis

This final report describes the work performed under this delivery order from June 1993 through August 1994. The scope of work included three distinct tasks in support of the AXAF-I program. The objective of the first task was to perform investigations of the grinding and polishing characteristics of the zerodur material by fabricating several samples. The second task was to continue the development of the integrated optical performance modeling software for AXAF-I. The purpose of third and final task was to develop and update the database of AXAF technical documents for an easy and rapid access. The MSFC optical and metrology shops were relocated from the B-wing of Building 4487 to Room BC 144 of Building 4466 in the beginning of this contract. This included dismantling, packing, and moving the equipment from its old location, and then reassembling it at the new location. A total of 65 zerodur samples, measuring 1 inch x 2 inches x 6 inches were ground and polished to a surface figure of lambda/10 p-v, and a surface finish of 5A rms were fabricated for coating tests. A number of special purpose tools and metal mirrors were also fabricated to support various AXAF-I development activities. In the metrology area, the ZYGO Mark 4 interferometer was relocated and also upgraded with a faster and more powerful processor. Surface metrology work was also performed on the coating samples and other optics using ZYGO interferometer and WYKO profilometer. A number of new features have been added to the GRAZTRACE program to enhance its analysis and modeling capabilities. A number of new commands have been added to the command mode GRAZTRACE program to provide a better control to the user on the program execution and data manipulation. Some commands and parameter entries have been reorganized for a uniform format. The command mode version of the convolution program CONVOLVE has been developed. An on-line help system and a user's manual have also been developed for the benefit of the users. The database of AXAF technical documents continues to progress. The titles, company name, date, and location of over 390 documents have been entered in this database. This database provides both a data search and retrieval function, and a data adding function. These functions allow a user to quickly search the data files for documents or add new information. A detailed user's guide has also been prepared. This user guide includes a document classification guide, a list of abbreviations, and a list of acronyms, which have been used in compiling this database of AXAF-I technical documents.

Dimmock, John O.↗

CropEx Web-Based Agricultural Monitoring and Decision Support

CropEx is a Web-based agricultural Decision Support System (DSS) that monitors changes in crop health over time. It is designed to be used by a wide range of both public and private organizations, including individual producers and regional government offices with a vested interest in tracking vegetation health. The database and data management system automatically retrieve and ingest data for the area of interest. Another stores results of the processing and supports the DSS. The processing engine will allow server-side analysis of imagery with support for image sub-setting and a set of core raster operations for image classification, creation of vegetation indices, and change detection. The system includes the Web-based (CropEx) interface, data ingestion system, server-side processing engine, and a database processing engine. It contains a Web-based interface that has multi-tiered security profiles for multiple users. The interface provides the ability to identify areas of interest to specific users, user profiles, and methods of processing and data types for selected or created areas of interest. A compilation of programs is used to ingest available data into the system, classify that data, profile that data for quality, and make data available for the processing engine immediately upon the data s availability to the system (near real time). The processing engine consists of methods and algorithms used to process the data in a real-time fashion without copying, storing, or moving the raw data. The engine makes results available to the database processing engine for storage and further manipulation. The database processing engine ingests data from the image processing engine, distills those results into numerical indices, and stores each index for an area of interest. This process happens each time new data is ingested and processed for the area of interest, and upon subsequent database entries, the database processing engine qualifies each value for each area of interest and conducts a logical processing of results indicating when and where thresholds are exceeded. Reports are provided at regular, operator-determined intervals that include variances from thresholds and links to view raw data for verification, if necessary. The technology and method of development allow the code base to easily be modified for varied use in the real-time and near-real-time processing environments. In addition, the final product will be demonstrated as a means for rapid draft assessment of imagery.

Harvey. Craig↗

TESS Data Release Notes: Sector 59, DR84

TESS Sector 59 observations include physical orbits 125 and 126 of the spacecraft around the Earth. Data collection was paused for a total of 0.63 days to download data. Data were downloaded approximately every seven days, once near apogee of each orbit and once near perigee. Note that the Sector 59 data were briefly made available on 2023 January 18–19 before an issue was identified that required reprocessing. Data have since been reprocessed. The reprocessing has a minimal impact on the final light curves, but resulted in a different set of TCEs than initially released. Users should re-download the data if retrieved before January 19th. In total, there are 25.79 days of science data collected in Sector 59.

TESS↗

Estimating effective data density in a satellite retrieval or an objective analysis

An attempt is made to formulate consistent objective definitions of the concept of 'effective data density' applicable both in the context of satellite soundings and more generally in objective data analysis. The definitions based upon various forms of Backus-Gilbert 'spread' functions are found to be seriously misleading in satellite soundings where the model resolution function (expressing the sensitivity of retrieval or analysis to changes in the background error) features sidelobes. Instead, estimates derived by smoothing the trace components of the model resolution function are proposed. The new estimates are found to be more reliable and informative in simulated satellite retrieval problems and, for the special case of uniformly spaced perfect observations, agree exactly with their actual density. The new estimates integrate to the 'degrees of freedom for signal', a diagnostic that is invariant to changes of units or coordinates used.

Purser, R. J.↗

Remote Sensing of Rain

The first problem addressed concerns passive-microwave rain retrievals. Most current approaches start by building off-line a cloud-model-derived database. Given data, the retrieval algorithms search the database for the microwave temperatures "closest" to the observed data, then after some fine-tuning (performed in different ways by different implementations) the rain is estimated to be that which corresponds to the selected (and fine-tuned) set of database temperatures. These approaches have three drawbacks: they cannot properly take into account the ambiguities which arise from the fact that several rain scenarios can produce the same observed temperatures; they are quite inefficient since they require manipulating a large database along with often complex "fine-tuning" procedures; and they cannot refine their estimates if additional data is available. This past year we have derived closed formulae relating observed microwave brightness temperatures, T(sub b), and the underlying rain rates, R: average T(sub b) =f (rain) and average rain = g (T(sub b)), along with the corresponding covariance matrices. These results are sufficient to describe the conditional probabilities p(R/T(sub b)) and p(T(sub b)/R) to second order. Progress has also been made towards deriving a robust description of the rain drop size distribution (DSD). The widespread approach consisting in parameterizing the DSD as a gamma-distribution in terms of the drop diameter D suffers from the facts that, in reality, the DSD is not a smooth function of D and that the largely arbitrary Gamma model imposes unintended behavior, which has implications on any quantities derived from the DSD model. We have therefore developed a non-parametric yet practical description of the DSD, which is particularly well-suited for use in remote-sensing applications. The diagram on the left shows a comparison between an actual DSD sample and the truncated non-parametric representation. One figure shows the relation between radar reflectivity and rain rate derived using this representation. Validation of the Tropical Rainfall Measuring Mission (TRMM) radar-radiometer combined R and DSD algorithm is underway. This algorithm was designed to make optimal use of the instantaneous reflectivity profiles measured by the TRMM radar and the microwave brightness temperatures measured by the TRMM passive radiometer. So far, it appears to be the most reliable TRMM rain algorithm.

Haddad, Ziad S.↗

Arctic Sea Ice Parameters from AMSR-E Data using Two Techniques, and Comparisons with Sea Ice from SSM

We use two algorithms to process AMSR-E data in order to determine algorithm dependence, if any, on the estimates of sea ice concentration, ice extent and area, and trends and to evaluate how AMSR-E data compare with historical SSM/I data. The monthly ice concentrations derived from the two algorithms from AMSR-E data (the AMSR-E Bootstrap Algorithm, or ABA, and the enhanced NASA Team algorithm, or NT2) differ on average by about 1 to 3%, with data from the consolidated ice region being generally comparable for ABA and NT2 retrievals while data in the marginal ice zones and thin ice regions show higher values when the NT2 algorithm is used. The ice extents and areas derived separately from AMSR-E using these two algorithms are, however, in good agreement, with the differences (ABA-NT2) being about 6.6 x 10(exp 4) square kilometers on average for ice extents and -6.6 x 10(exp 4) square kilometers for ice area which are small compared to mean seasonal values of 10.5 x 10(exp 6) and 9.8 x 10(exp 6) for ice extent and area: respectively. Likewise, extents and areas derived from the same algorithm but from AMSR-E and SSM/I data are consistent but differ by about -24.4 x 10(exp 4) square kilometers and -13.9 x 10(exp 4) square kilometers, respectively. The discrepancies are larger with the estimates of extents than area mainly because of differences in channel selection and sensor resolutions. Trends in extent during the AMSR-E era were also estimated and results from all three data sets are shown to be in good agreement (within errors).

Comiso, Josefino C.↗

UAS Reports (UREPs): EnablingExchange of Observation Data Between UAS Operations

As the volume of small unmanned aircraft systems (UAS) operations increases, the lack of weather products to support these operations becomes more problematic. One early solution to obtaining more information about weather conditions is to allow operators to share their observations and measurements with other airspace users. This is analogous to the AIREP and PIREP reporting systems in traditional aviation wherein pilots report weather phenomena they have observed or experienced to provide better situational awareness to other pilots. Given the automated nature of the small (under 55 lbs.) UAS platforms and operations, automated reporting of relevant information should also be supported. To promote automated exchange of these data, a well-defined data schema needs to be established along with the mechanisms for sending and retrieving the data. This paper examines this concept and offers an initial definition of the necessary elements to allow for immediate implementation and use.

UAS↗

pyQuARC: Preparing for Full Release

Metadata holds the contextual information about data and is the underlying structure for many data search portals. High quality metadata optimizes search results, allowing users to quickly retrieve the data they need. With the abundant volume and diversity of Earth observation datasets, data discovery and metadata quality are critical for end users. The Common Metadata Repository (CMR), for example, currently hosts metadata for over 9,000 Earth observation data products archived across 12 NASA Distributed Active Archive Centers (DAACs). The Analysis and Review of CMR (ARC) Team, located at Marshall Space Flight Center, assesses the completeness, correctness, and consistency of these metadata records to ensure they are accessible, usable, and discoverable. In 2021, ARC began developing pyQuARC, an open source library for Earth Observation Metadata Quality Assessment to automate this effort. The tool uses ARC’s existing metadata quality framework to provide prioritized recommendations for metadata improvement. During initial testing, pyQuARC automatically identified 58% of metadata findings when compared with a sample of manually reviewed records. Using the results from initial testing, this presentation will focus on recent advancements and improvements of the tool as the ARC team prepares for pyQuARC’s full release. It will also demonstrate pyQuARC's enrichment value, not only for the ARC team, but the broader EOSDIS metadata community as well.

Essence Raphael↗

Validation of Long-Term Global Aerosol Climatology Project Optical Thickness Retrievals Using AERONET and MODIS Data

A comprehensive set of monthly mean aerosol optical thickness (AOT) data from coastal and island AErosol RObotic NETwork (AERONET) stations is used to evaluate Global Aerosol Climatology Project (GACP) retrievals for the period 1995-2009 during which contemporaneous GACP and AERONET data were available. To put the GACP performance in broader perspective, we also compare AERONET and MODerate resolution Imaging Spectroradiometer (MODIS) Aqua level-2 data for 2003-2009 using the same methodology. We find that a large mismatch in geographic coverage exists between the satellite and ground-based datasets, with very limited AERONET coverage of open-ocean areas. This is especially true of GACP because of the smaller number of AERONET stations at the early stages of the network development. Monthly mean AOTs from the two over-the-ocean satellite datasets are well-correlated with the ground-based values, the correlation coefficients being 0.81-0.85 for GACP and 0.74-0.79 for MODIS. Regression analyses demonstrate that the GACP mean AOTs are approximately 17%-27% lower than the AERONET values on average, while the MODIS mean AOTs are 5%-25% higher. The regression coefficients are highly dependent on the weighting assumptions (e.g., on the measure of aerosol variability) as well as on the set of AERONET stations used for comparison. Comparison of over-the-land and over-the-ocean MODIS monthly mean AOTs in the vicinity of coastal AERONET stations reveals a significant bias. This may indicate that aerosol amounts in coastal locations can differ significantly from those in adjacent open-ocean areas. Furthermore, the color of coastal waters and peculiarities of coastline meteorological conditions may introduce biases in the GACP AOT retrievals. We conclude that the GACP and MODIS over-the-ocean retrieval algorithms show similar ranges of discrepancy when compared to available coastal and island AERONET stations. The factors mentioned above may limit the performance of the validation procedure and cause us to caution against a direct extrapolation of the presented validation results to the entirety of the GACP dataset.

MODIS (radiometry)↗

Combined UV and IR Ozone Profile Retrieval from TROPOMI and CrIS Measurements

Vertical ozone profiles from combined spectral measurements in the ultraviolet and infrared spectral range were retrieved by using data from the TROPOspheric Monitoring Instrument on the Sentinel-5 Precursor (TROPOMI/S5P) and the Cross-track Infrared Sounder on the Suomi National Polar-orbiting Partnership (CrIS/Suomi-NPP), which are flying in loose formation 3 min apart in the same orbit. A previous study of ozone profiles retrieved exclusively from TROPOMI UV spectra showed that the vertical resolution in the troposphere is clearly limited (Mettig et al., 2021). The vertical resolution and the vertical extent of the ozone profiles is improved by combining both wavelength ranges compared to retrievals limited to UV or IR spectral data only. The combined retrieval particularly improves the accuracy of the retrieved tropospheric ozone and to a lesser degree stratospheric ozone up to 30 km. An increase in the degrees of freedom (DOF) by 1 DOF was found in the UV + IR retrieval compared to the UV-only retrieval. Compared to previous publications, which investigated combinations of UV and IR observations from the Ozone Monitoring Instrument and Tropospheric Emission Spectrometer (OMI and TES) and Global Ozone Monitoring Experiment version 2 and Infrared Atmospheric Sounding Interferometer (GOME-2 and IASI) pairs, the degree of freedom is lower, which is attributed to the reduced spectral resolution of CrIS compared to TES or IASI. Tropospheric lidar and ozonesondes were used to validate the ozone profiles and tropospheric ozone content (TOC). In their comparison with tropospheric lidars, both ozone profiles and TOCs show smaller biases for the retrieved data from the combined UV + IR observation than from the UV observations alone. For the ozone profiles below 10 km, the mean differences are around ±10 % and the mean TOC varies around ±3 DU. We show that TOCs from the combined retrieval agree better with ozonesonde results at northern latitudes than the UV-only and IR-only retrievals and also have lower scatter. In the tropics, the IR-only retrieval shows the best agrement with TOCs derived from ozonesondes. While in general the TOCs show good agreement with ozonesonde data, the profiles have a positive bias of around 30 % between 10 and 15 km. The reason is probably a positive stratospheric bias from the IR retrieval. The comparison of the UV + IR and UV ozone profiles up to 30 km with the Microwave Limb Sounder (MLS) demonstrates the improvement of the UV + IR profile in the stratosphere above 18 km. In comparison to the UV-only approach the retrieval shows improvements of up to 10 % depending on latitude but can also show worse results in some regions and latitudes.

Ozone↗

AVIRIS Reflectance Retrievals: UCSB Users Manual

The following write-up is designed to help students and researchers take Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) radiance data and retrieve surface reflectance. In the event that the software is not available, but a user has access to a reflectance product, this document is designed to provide a better understanding of how AVIRIS reflectance was retrieved. This guide assumes that the reader has both a basic understanding of the UNIX computing environment, and that of spectroscopy. Knowledge of the Interactive Data Language (IDL) and the Environment for Visualizing Images (ENVI) is helpful. This is a working document, and many of the fine details described in the following pages have been previously undocumented. After having read this document the reader should be able to process AVIRIS to reflectance, provided access to all of the code is possible. The AVIRIS radiance data itself is pre-processed at the Jet Propulsion Laboratory (JPL) in Pasadena, California. The first section of this paper describes how to read data from tape and byte-swap the data. Section 2 describes the procedure in preparing support files before running the 'h2o' suite of programs. Section 3 describes the four programs used in the process, h2olut9.f, h2ospl9.f, vlsfit9.f and rfl9.f.

Roberts, Dar A.↗

Space environment effects on fiber optics systems

The performance survivability of hardened fiber optic data link design for application in future spacecraft systems was assessed. The effects of space environmental conditions on link performance was analyzed. The integration and operation of new fiber optic link components exhibiting increased hardening to radiation environments is emphasized. The opportunity to expose operational fiber optic data links to an actual space environment for 6 months or longer and to retrieve the data links for analysis are discussed. Reliable design criteria for future spacecraft application, relative to the long term low dose space radiation effects as a function of temperature are outlined.

Taylor, E. W.↗

Team 2: AIRS Only Retrieval

This slide presentation makes the case for the retrieval of data from the Atmospheric Infrared Sounder (AIRS) Advanced Microwave Sounding Unit (AMSU). AIRS only retrieval is not only a risk reduction for failure of AMSU, but also important because NWP centers are reluctant to assimilate AMSU twice.

cloudy regression↗

Analysis of CrIs/ATMS Using AIRS Version-7 Retrieval and QC Methodology

The objective of this research is to develop and implement an algorithm to analyze a long term data record of CrIS/ATMS observations so as to produce monthly mean gridded Level-3 products which are consistent with, and will serve as a seamless follow on to, those of AIRS Version-7. We feel the best way to achieve this result is to analyze CrIS/ATMS data using retrieval and Quality Control (QC) methodologies which are scientifically equivalent to those used in AIRS Version-7. We developed and implemented a single retrieval program that uses as input either AIRS/AMSU or CrIS/ATMS radiance observations, and has appropriate switches that take into account the spectral and radiometric differences between CrIS and AIRS. Our methodology is call CHART (Climate Heritage AIRS Retrieval Technique).

Susskind, Joel↗

Retrieval of biophysical parameters with AVIRIS and ISM: The Landes Forest, south west France

The first steps of an experiment for investigating the capability of airborne spectrometer data for retrieval of biophysical parameters of vegetation, especially water conditions are presented. Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) and ISM data were acquired in the frame of the 1991 NASA/JPL and CNES campaigns on the Landes, South west France, a large and flat forest area with mainly maritime pines. In-situ measurements were completed at that time; i.e. reflectance spectra, atmospheric profiles, sampling for further laboratory analyses of elements concentrations (lignin, water, cellulose, nitrogen,...). All information was integrated in an already existing data base (age, LAI, DBH, understory cover,...). A methodology was designed for (1) obtaining geometrically and atmospherically corrected reflectance data, (2) registering all available information, and (3) analyzing these multi-source informations. Our objective is to conduct comparative studies with simulation reflectance models, and to improve these models, especially in the MIR.

Zagolski, F.↗