Search NASA⌕ Search

SEARCH · Search NASA

Results for “data retrieval”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Improved Surface Parameter Retrievals using AIRS/AMSU Data

The AIRS Science Team Version 5.0 retrieval algorithm became operational at the Goddard DAAC in July 2007 generating near real-time products from analysis of AIRS/AMSU sounding data. This algorithm contains many significant theoretical advances over the AIRS Science Team Version 4.0 retrieval algorithm used previously. Two very significant developments of Version 5 are: 1) the development and implementation of an improved Radiative Transfer Algorithm (RTA) which allows for accurate treatment of non-Local Thermodynamic Equilibrium (non-LTE) effects on shortwave sounding channels; and 2) the development of methodology to obtain very accurate case by case product error estimates which are in turn used for quality control. These theoretical improvements taken together enabled a new methodology to be developed which further improves soundings in partially cloudy conditions. In this methodology, longwave C02 channel observations in the spectral region 700 cm(exp -1) to 750 cm(exp -1) are used exclusively for cloud clearing purposes, while shortwave C02 channels in the spectral region 2195 cm(exp -1) 2395 cm(exp -1) are used for temperature sounding purposes. This allows for accurate temperature soundings under more difficult cloud conditions. This paper further improves on the methodology used in Version 5 to derive surface skin temperature and surface spectral emissivity from AIRS/AMSU observations. Now, following the approach used to improve tropospheric temperature profiles, surface skin temperature is also derived using only shortwave window channels. This produces improved surface parameters, both day and night, compared to what was obtained in Version 5. These in turn result in improved boundary layer temperatures and retrieved total O3 burden.

Susskind, Joel↗

Performance and Reliability Assessment of the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) Data Advisor (ADA)

The Atmospheric Radiation Measurement (ARM) User Facility provides one of the world's largest openly accessible repositories of atmospheric observations through the ARM Data Discovery platform. Although the repository contains more than three decades of measurements collected from permanent observatories, mobile facilities, aircraft campaigns, and field experiments, identifying appropriate datasets can be challenging, particularly for new users unfamiliar with ARM instrumentation and datastream organization. To improve data accessibility, the ARM Data Center developed the ARM Data Advisor (ADA), an artificial intelligence-powered assistant designed to facilitate scientific data discovery, dataset interpretation, and user guidance. This report evaluates ADA's performance as a domain-specific scientific assistant using realistic atmospheric science workflows. The evaluation examines five key capabilities: data retrieval and curation efficiency, hallucination resistance, scientific reasoning, response to ambiguous queries, and content retention and session continuity. Representative prompts were developed to simulate typical interactions between researchers and the ARM Data Discovery platform, and ADA's responses were assessed for retrieval completeness, scientific accuracy, consistency, and practical usefulness. In these representative tests, ADA reduced the complexity of discovering and accessing ARM datasets by recommending appropriate datastreams, explaining instrumentation, interpreting metadata, and assisting with data processing workflows. ADA also exhibits strong domain knowledge of atmospheric science terminology and generally resists hallucination by acknowledging unavailable datasets and requesting clarification when appropriate. Overall, the results indicate that ADA represents a promising advancement in scientific data discovery within the ARM User Facility and has considerable potential to improve researcher productivity, particularly for new users and interdisciplinary scientists seeking efficient access to ARM observations.

Salvador, Christian [ORNL] (ORCID:0000000283287777↗

STARBASE: Database software for the automated plate scanner

The Automated Plate Scanner (APS) of the University of Minnesota, a unique high speed 'flying spot' laser scanner, is currently being used to scan and digitize the 936 O and E plate pairs of the first epoch Palomar Sky Survey. The resultant database will be used to produce a catalog of approximately a billion stars and several million galaxies. The authors describe the ongoing development of a dedicated APS database management system which will be made available to the astronomical community via INTERNET. A specialized DBMS called STARBASE has been written to provide fast access to the hundreds of millions of images collected by the APS. This system provides an initial reduction mode for parameterizing APS images and classifying image types using a novel set of neural network image classifiers. A second analysis mode, which will be that commonly used by the general user, provides for searches of the database which may be constrained by any combination of physical and positional parameters. Through the use of pointer hash trees, the system has been optimized for extremely fast positional searches using either right ascension and declination on the sky or linear X and Y positions on the POSS field. In addition to fast data retrieval, the system provides a graphical interface for displaying scatter plots or histograms of the collected data. In addition, a specialized image display system is being developed to allow the user to view densitometric data for all objects classified as extended by the neural network system. Finally, STARBASE has a flexible programmable interface which allows other programs to access information in the database. This allows users to write applications suited to their particular needs to process APS data.

Odewahn, S. C.↗

Automation of Data Analysis Programs Used in the Cryogenic Characterization of Superconducting Microwave Resonators

Knowledge of the microwave properties at cryogenic temperatures of components fabricated using High-Temperature-Superconductors (HTS) is useful in the design of HTS-based microwave circuits. Therefore, fast and reliable characterization techniques have been developed to study the aforementioned properties. In this paper, we discuss computer analysis techniques employed in the cryogenic characterization of HTS-based resonators. The revised data analysis process requires minimal user input. and organizes the data in a form that is easily accessible by the user for further examination. These programs retrieve data generated during the cryogenic characterization at microwave frequencies of HTS based resonators and use it to calculate parameters such as the loaded and unloaded quality factors (Q and Q(sub o), respectively), the resonant frequency (f(sub o)), and the coupling coefficient (k), which are important quantities in the evaluation of HTS resonators. While the data are also stored for further use, the programs allow the user to obtain a graphical representation of any of the measured parameters as a function of temperature soon after the completion of the cryogenic measurement cycle. Although these programs were developed to study planar HTS-based resonators operating in the reflection mode, they could also be used in the cryogenic characterization of two ports (i.e., reflection/transmission) resonators.

Creason, A. S.↗

Medical Data Architecture Capabilities and Design

Mission constraints will challenge the delivery of medical care on a long-term, deep space explorationmission. This type of mission will be restricted in the availability of medical knowledge, skills, procedures and resourcesto prevent, diagnose, and treat in-flight medical events. Challenges to providing medical care are anticipated, includingresource and resupply constraints, delayed communications and no ability for medical evacuation. The Medical DataArchitecture (MDA) project will enable medical care capability in this constrained environment.The first version of thesystem, called Test Bed 1, includes capabilities for automated data collection, data storage and data retrieval to provideinformation to the Crew Medical Officer (CMO). Test Bed 1 seeks to establish a data architecture foundation and developa scalable data management system through modular design and standardized interfaces. In addition, it will demonstrateto stakeholders the potential for an improved, automated, flow of data to and from the medical system over the currentmethods employed on the International Space Station (ISS). It integrates a set of external devices, software andprocesses, and a Subjective, Objective, Assessment, and Plan (SOAP) note commonly used by clinicians. Medical datalike electrocardiogram plots, heart rate, skin temperature, respiration rate, medications taken, and more are collectedfrom devices and stored in the Electronic Medical Records (EMR) system, and reported to crew and clinician. Devicesintegrated include the Astroskin biosensor vest and IMED CARDIAX electrocardiogram (ECG) device with INEED MDECG Glove, and the NASA-developed Medical Dose Tracker application.The system is designed to be operated as astandalone system, and can be deployed in a variety of environments, from a laptop to a data center. The system isprimarily composed of open-source software tools, and is designed to be modular, so new capabilities can be added. Thesoftware components and integration methods will be discussed.

Exploration medical system↗

Potomac River Basin Water Resources: Assessing Water Quality and Quantity in the National Capital Region Using NASA Earth Observations

The Potomac River Basin (PRB) is responsible for providing drinking water to over 5 million residents and plays a significant role in the health of the Chesapeake Bay. Therefore, it is important to understand the relationship between water quality, landcover, and the hydrological cycle within the PRB. The National Park Service (NPS) has monitored 37 streams within the National Park Units in Maryland, Virginia, West Virginia and Washington, D.C. This project aimed to help the NPS better understand trends in water quality to supplement their ability to monitor changes in the National Capital Region Network (NCRN). Google Earth Engine, ArcGIS Pro, R, and Python were used for data retrieval, visualization, and analysis. Earth observations included Landsat 5 TM and Landsat 8 OLI/TIRS imagery. Ancillary data included the USDA Cropland Data Layer, Climate Hazards Group InfraRed Precipitation with Station Data (CHIRPS), and soil moisture data from the Famine Early Warning Systems Network (FEWS NET) Land Data Assimilation System (FLDAS). We compared Land use/land cover (LULC), Normalized Difference Vegetation Index (NDVI), precipitation and soil moisture data to water quality data provided by the NPS at a watershed level. LULC change maps were also generated for the PRB between 2008 and 2022. We found significant correlations between precipitation, soil moisture, NDVI, and water quality. Correlations were found between certain land use types and water quality metrics, but findings varied greatly between watersheds. These insights emphasize the imperative of strategic watershed management in preserving the integrity of key aquatic systems.

Landsat↗

Medical Data Architecture Project Capabilities and Design

Mission constraints will challenge the delivery of medical care on a long-term, deep space exploration mission. This type of mission will be restricted in the availability of medical knowledge, skills, procedures and resources to prevent, diagnose, and treat in-flight medical events. Challenges to providing medical care are anticipated, including resource and resupply constraints, delayed communications and no ability for medical evacuation. The Medical Data Architecture (MDA) project will enable medical care capability in this constrained environment. The first version of the system, called "Test Bed 1," includes capabilities for automated data collection, data storage and data retrieval to provide information to the Crew Medical Officer (CMO). Test Bed 1 seeks to establish a data architecture foundation and develop a scalable data management system through modular design and standardized interfaces. In addition, it will demonstrate to stakeholders the potential for an improved, automated, flow of data to and from the medical system over the current methods employed on the International Space Station (ISS). It integrates a set of external devices, software and processes, and a Subjective, Objective, Assessment, and Plan (SOAP) note commonly used by clinicians. Medical data like electrocardiogram plots, heart rate, skin temperature, respiration rate, medications taken, and more are collected from devices and stored in the Electronic Medical Records (EMR) system, and reported to crew and clinician. Devices integrated include the Astroskin biosensor vest and IMED CARDIAX electrocardiogram (ECG) device with INEED MD ECG Glove, and the NASA-developed Medical Dose Tracker application. The system is designed to be operated as a standalone system, and can be deployed in a variety of environments, from a laptop to a data center. The system is primarily composed of open-source software tools, and is designed to be modular, so new capabilities can be added. The software components and integration methods will be discussed.

Data architecture↗

Obtaining Remote-Sensing Reflectance from Multiple Instrument Systems

Obtaining accurate in situ measurements of Apparent Optical Properties (AOPs) is critical to maintaining satellite data quality. One approach to ensure accuracy is to deploy several independent instruments to measure the same phenomenon. During a cruise in June 2012, off the lee coast of the island of Hawaii, repeated profiles were made with two separate radiometric systems, one from Satlantic, Inc. (Hyperpro) and the other from Biospherical Instruments, Inc. (C-Ops). The C-Ops is multispectral, while the Hyperpro is hyperspectral. Both measure above-water solar irradiance (E(sub s)), downwelling in-water irradiance (E(sub d)), and upwelling in-water radiance (L(sub u)). From these measurements remotely-sensed reflectance (R(sub rs))can be calculated and compared with satellite data. All instruments were calibrated shortly before use, and while differences are to be expected due to temporal changes and spectral weighting differences, these should be consistent and minimal. We explore these differences, and compare to data retrieved from the NASA Moderate Resolution Imaging Spectroradiometer onboard Aqua (MODIS Aqua) when available. We also examine data collection and processing protocols for these systems.

Carbon↗

Transformation of the NASA Life Sciences Portal to a FAIR Data Point

The FAIR principles emphasize optimizing metadata, the vast majority of which are textual in nature, and often organized into attribute name-value pairs. This uniformity has led to the development of guidelines and best practices for providing programmatic access to scientific data through their metadata, yielding the first iteration of the FAIR Data Point Specifications (FDPS). A key feature of the FDPS is its support for automated agents seeking and fetching data without first needing to learn a plethora of different application programming interfaces. These software agents can interrogate metadata catalogs that adhere to FDPS in a uniform manner because each catalog describes itself and its metadata schema consistently. This approach enhances the sustainability of data retrieval support, allowing systems to refine and update their metadata schemas as needed and without requiring data-seeking software agents to change how they interrogate FDPS catalogs. An essential aspect of the FDPS is the standardization of data catalog semantics, which formalizes concepts such as “metadata” and “metadata service” and links them to other concepts specifications including the Data Catalog Vocabulary (DCAT), a W3C standard that is also the basis of NASA-STD-2831 “Metadata Standard for Data Discoverability,” authored by NASA’s Office of the Chief Information Officer. The FDPS references DCAT (version 2) elements which focus on the distribution of datasets and support the goal of stream-lined catalog integration across repositories for improved data discovery. Additionally, the FDPS also prescribe the use of Linked Data Platform elements for data catalog-metadata record containment descriptions, allowing users to ascertain which data and metadata belong to which catalogs. NASA’s Life Sciences Portal is implementing the FDPS while formalizing its metadata schema to support the accelerated synthesis of knowledge from space life sciences investigations.

platform↗

Inversion of stratospheric aerosol and gaseous constituents from spacecraft solar extinction data in the 0.38-1.0-micron wavelength region

The paper discusses a possible data retrieval technique for the spaceborne Stratospheric Aerosol and Gas Experiment (SAGE). The SAGE instrument has four radiometric channels located at selected intervals in the 0.38-1.0-micron wavelength range. A data reduction procedure is described for minimization of experimental errors on the basis of a detailed simulation of the measurement sequence. An efficient and accurate inversion method is then used for the retrieval of all the constituent vertical profiles. Also, the effects of horizontally inhomogeneous distributions of the constituent vertical profiles are studied based on available data of their global distributions. A simple horizontally inhomogeneous model of stratospheric aerosol and ozone is employed to estimate the perturbation on the retrieval accuracies.

Chu, W. P.↗

Mars Observer remote science operations

The objectives and the background of the Mars Observer mission are briefly reviewed with emphasis on the remote science operations portion of the mission. In particular, the discussion covers observational planning and instrument sequences, data retrieval, instrument health monitoring, and science analysis. Attention is also given to workstation technology utilization, science team, project data base, common data formats, and security.

Kahn, Peter B.↗

User's Manual for the Naval Interactive Data Analysis System-Climatologies (NIDAS-C), Version 2.0

This technical note provides the user's manual for the NIDAS-C system developed for the naval oceanographic office. NIDAS-C operates using numerous oceanographic data categories stored in an installed version of the Naval Environmental Operational Nowcast System (NEONS), a relational database management system (rdbms) which employs the ORACLE proprietary rdbms engine. Data management, configuration, and control functions for the supporting rdbms are performed externally. NIDAS-C stores and retrieves data to/from the rdbms but exercises no direct internal control over the rdbms or its configuration. Data is also ingested into the rdbms, for use by NIDAS-C, by external data acquisition processes. The data categories employed by NIDAS-C are as follows: Bathymetry - ocean depth at

USER M ANUALS↗

Compressed sensing methods with applications to advanced air sampling

Environmental sampling methods developed by the Savannah River National Laboratory (SRNL) employ collectors with sorbent media tubes set at various locations to collect airborne emissions. Laboratory analyses of these tubes results in one-dimensional signals regarding what chemicals are being released and transported within the atmosphere. The analysis process is time consuming especially when analyzing a full year’s worth of tubes (hourly sample collection results in nearly 9,000 tubes per year). Using a signal processing method such as compressed sensing allows for recreation of the full signal while greatly reducing the number of analyzed samples required. Due to the sparsity of data retrieved from the air tubes, it is possible to use measurements a fraction of the size of the original data to gain much of the same information. This would improve the overall time and cost of analysis when modeling one-dimensional sampling signals.

54 ENVIRONMENTAL SCIENCES↗

Compressed Sensing Methods with Applications to Advanced Air Sampling [Poster]

Environmental sampling methods developed by the Savannah River National Laboratory (SRNL) employ collectors with sorbent media tubes set at various locations to collect airborne emissions. Laboratory analyses of these tubes results in one-dimensional signals regarding what chemicals are being released and transported within the atmosphere. The analysis process is time consuming especially when analyzing a full year’s worth of tubes (hourly sample collection results in nearly 9,000 tubes per year). Using a signal processing method such as compressed sensing allows for recreation of the full signal while greatly reducing the number of analyzed samples required. Due to the sparsity of data retrieved from the air tubes, it is possible to use measurements a fraction of the size of the original data to gain much of the same information. This would improve the overall time and cost of analysis when modeling one-dimensional sampling signals.

Campbell, Cassidy [Savannah River National Laborat↗

Automatic cataloguing and characterization of Earth science data using SE-trees

In the future, NASA's Earth Observing System (EOS) platforms will produce enormous amounts of remote sensing image data that will be stored in the EOS Data Information System. For the past several years, the Intelligent Data Management group at Goddard's Information Science and Technology Office has been researching techniques for automatically cataloguing and characterizing image data (ADCC) from EOS into a distributed database. At the core of the approach, scientists will be able to retrieve data based upon the contents of the imagery. The ability to automatically classify imagery is key to the success of contents-based search. We report results from experiments applying a novel machine learning framework, based on Set-Enumeration (SE) trees, to the ADCC domain. We experiment with two images: one taken from the Blackhills region in South Dakota; and the other from the Washington DC area. In a classical machine learning experimentation approach, an image's pixels are randomly partitioned into training (i.e. including ground truth or survey data) and testing sets. The prediction model is built using the pixels in the training set, and its performance is estimated using the testing set. With the first Blackhills image, we perform various experiments achieving an accuracy level of 83.2 percent, compared to 72.7 percent using a Back Propagation Neural Network (BPNN) and 65.3 percent using a Gaussain Maximum Likelihood Classifier (GMLC). However, with the Washington DC image, we were only able to achieve 71.4 percent, compared with 67.7 percent reported for the BPNN model and 62.3 percent for the GMLC.

Rymon, Ron↗

Subsurface Emission Effects in AMSR-E Measurements: Implications for Land Surface Microwave Emissivity Retrieval

An analysis of land surface microwave emission time series shows that the characteristic diurnal signature associated with subsurface emission in sandy deserts carry over to arid and semi-arid region worldwide. Prior work found that diurnal variation of Special Sensor Microwave/Imager (SSM/I) brightness temperatures in deserts was small relative to International Satellite Cloud Climatology Project land surface temperature (LST) variation and that the difference varied with surface type and was largest in sand sea regions. Here we find more widespread subsurface emission effects in Advanced Microwave Scanning Radiometer-EOS (AMSR-E) measurements. The AMSR-E orbit has equator crossing times near 01:30 and 13 :30 local time, resulting in sampling when near-surface temperature gradients are likely to be large and amplifying the influence of emission depth on effective emitting temperature relative to other factors. AMSR-E measurements are also temporally coincident with Moderate Resolution Imaging Spectroradiometer (MODIS) LST measurements, eliminating time lag as a source of LST uncertainty and reducing LST errors due to undetected clouds. This paper presents monthly global emissivity and emission depth index retrievals for 2003 at 11, 19, 37, and 89 GHz from AMSR-E, MODIS, and SSM/I time series data. Retrieval model fit error, stability, self-consistency, and land surface modeling results provide evidence for the validity of the subsurface emission hypothesis and the retrieval approach. An analysis of emission depth index, emissivity, precipitation, and vegetation index seasonal trends in northern and southern Africa suggests that changes in the emission depth index may be tied to changes in land surface moisture and vegetation conditions

Galantowicz, John F.↗