Search NASA⌕ Search

SEARCH · Search NASA

Results for “data retrieval”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

HP-MDR: High-performance and Portable Data Refactoring and Progressive Retrieval with Advanced GPUs

Scientific applications produce vast amounts of data, posing grand challenges in the underlying data management and analytic tasks. Progressive compression is a promising way to address this problem, as it allows for on-demand data retrieval with significantly reduced data movement cost. However, most existing progressive methods are designed for CPUs, leaving a gap for them to unleash the power of today’s heterogeneous computing systems with GPUs.In this work, we propose HP-MDR, a high-performance and portable data refactoring and progressive retrieval framework for GPUs. Our contributions are four-fold: (1) We carefully optimize the bitplane encoding and lossless encoding, two key stages in progressive methods, to achieve high performance on GPUs; (2) We propose pipeline optimization and incorporate it with data refactoring and progressive retrieval workflows to further enhance the performance for large data process; (3) We leverage our framework to enable high-performance data retrieval with guaranteed error control for common Quantities of Interest; (4) We evaluate HP-MDR and compare it with state of the arts using five real-world datasets. Experimental results demonstrate that HP-MDR delivers an average 13.68 × and 6.31 × throughput in data refactoring and progressive retrieval tasks, respectively. It also leads to 11.22 × throughput for recomposing required data representations under Quantity-of-Interest error control and 6.04 × performance for the corresponding end-to-end data retrieval, when compared with state-of-the-art solutions.

Li, Yanliang [University of Oregon]↗
DOE OSTI2024

Radio Frequency Spectrum Audit to Inventory Private Cellular Base Station Infrastructure

The ever-changing cellular communication landscape makes it difficult to identify, map, and localize cellular base stations. Localizing cellular base stations provides various advantages, including information security, cybersecurity, spectrum management, and interference detection. For example, the MITRE ATT&CK® (Adversarial Tactics, Techniques, and Common Knowledge architecture) [1] and Common Attack Pattern Enumeration and Classification [2] emphasize the importance of being able to minimize the cyber security threat presented by unregulated private cellular base stations (PCBS). The majority of published research looks at the malicious use of PCBSs and focuses on using data retrieved from user equipment (UE), data obtained from an application on the UE, or data shared between the UE and a mobile network to locate it. This innovative strategy, however, focuses on the passively discovered uniqueness of radio frequency (RF) transmissions from commercial cellular infrastructure received in a designated monitoring position (DMP).

42 ENGINEERING↗
NASA NTRS1973

A survey of compatibility of materials with high pressure oxygen service.

The literature on high pressure oxygen compatibility has been surveyed in order to present the existing state of knowledge. Searches have been conducted of NASA and NBS data retrieval systems. In addition, many individuals, active in the field, were contacted in order to retrieve useful unpublished information. Compatibility data, such as mechanical impact, pneumatic impact, ignition temperature, and flash-and-fire point, were compiled for pressures above 200 bar. Lower pressure data were included if they were useful for extrapolation to pressures above 200 bar. These data, too numerous to be given here, are available from the authors. Brief descriptions of the trends of these data are given. Recommendations for additional high pressure studies are included.

Hust, J. G.↗
NASA NTRS1978

Multispectral scanner system parameter study and analysis software system description, volume 2

The author has identified the following significant results. The integration of the available methods provided the analyst with the unified scanner analysis package (USAP), the flexibility and versatility of which was superior to many previous integrated techniques. The USAP consisted of three main subsystems; (1) a spatial path, (2) a spectral path, and (3) a set of analytic classification accuracy estimators which evaluated the system performance. The spatial path consisted of satellite and/or aircraft data, data correlation analyzer, scanner IFOV, and random noise model. The output of the spatial path was fed into the analytic classification and accuracy predictor. The spectral path consisted of laboratory and/or field spectral data, EXOSYS data retrieval, optimum spectral function calculation, data transformation, and statistics calculation. The output of the spectral path was fended into the stratified posterior performance estimator.

Landgrebe, D. A.↗
NASA NTRS1992

Diabatic dynamic initialization

A generalized dynamical adjustment procedure was applied to a diabatic model to produce balanced initial conditions. Namely, backward adiabatic model integration is followed by forward diabatic model integration, with a high frequency (low pass) filter in the form of the Euler-backward time differencing scheme being applied throughout the whole integration. As a result of the application of such a diabatic dynamic initialization procedure within the Goddard Laboratory for Atmospheres (GLA) 4-D data assimilation system, the following properties of forecasts from initialized fields are achieved right from the beginning of the usual forecast integration: (1) the forecast tendencies (and fields) are free of any noise due to imbalance in initial conditions; (2) the shocks related to an initial imbalance between model physics and dynamics, and especially the substantial initial imbalance of precipitation and evaporation fields, or the initial spin-up effect, are practically removed. Diabatic dynamic initialization has been compared with implicit nonlinear normal mode initialization, and found to be superior in removing the initial spin-up effect, and also in improving the tropical structure. The diabatic dynamic initialization procedure was successfully tested for the GLA system with the use of all conventional data and the GLA satellite data retrievals. It allows a smooth data insertion without any shocks or imbalances, which is highly desirable for efficient functioning of 4-D data assimilation systems. The developed initialization procedure is computationally efficient and in principle easily applicable to different forecast models.

Fox-Rabinovitz, Michael S.↗
NASA NTRS2017

Development of Gridded Innovations and Observations Supplement to MERRA-2

Atmospheric reanalysis have become an important source of data for weather and climate research, owing to the continuity of the data, but especially because of the multitude of observational data included (radiosondes, commercial aircraft, retrieved data products and radiances). However, the presence of assimilated observations can vary based on numerous factors, and so it is difficult or impossible for a researcher to say with any degree of certainty how many and what type of observations contributed to the reanalysis data they are using at any give point in time or space. For example, quality control, transmission interruptions, and station outages can occasionally affect data availability. While orbital paths can be known, drift in certain instruments and the large number of available instruments makes it challenging to know which satellite is observing any region at any point in the diurnal cycle. Furthermore, there is information from the statistics generated by the data assimilation that can help understand the model and the quality of the reanalysis. Typically, the assimilated observations and their innovations are in observation-space data formats and have not been made easily available to reanalysis users.A test data set has been developed to make the MERRA-2 assimilated observations available for rapid and general use, by simplifying the data format. The observations are binned to a grid similar as MERRA-2 and saved as netCDF. This data collection includes the mean and number of observations in the bin as well as its variance. The data will also include the innovations from the data assimilation, the forecast departure and the analysis increment, as well as bias correction (for satellite radiances). We refer to this proof-of-concept data as the MERRA-2 Gridded Innovations and Observations (GIO). In this paper, we present the data format and its strengths and limitations with some initial testing and validation of the methodology.

SSMI↗
NASA NTRS2018

Development of Gridded Innovations and Observations Supplement to MERRA-2

Atmospheric reanalysis have become an important source of data for weather and climate research, owing to the continuity of the data, but especially because of the multitude of observational data included (radiosondes, commercial aircraft, retrieved data products and radiances). However, the presence of assimilated observations can vary based on numerous factors, and so it is difficult or impossible for a researcher to say with any degree of certainty how many and what type of observations contributed to the reanalysis data they are using at any give point in time or space, or their contribution to the eventual analyzed fields. For example, quality control, transmission interruptions, and station outages can occasionally affect data availability. While orbital paths are known, drift in certain instruments, cloud clearing, and the large number of available instruments makes it challenging to know which satellite is observing any region at any point in the diurnal cycle. Furthermore, there is information from the statistics generated by the data assimilation that can help understand the model and the quality of the reanalysis. Typically, the assimilated observations and their innovations are saved in observation-space data formats and are not easily made available to reanalysis users.Here, we present an early version of a data set has been developed to make the MERRA-2 assimilated observations available for rapid and general use, by simplifying the data format. The observations are binned to a grid similar as MERRA-2 and saved as netCDF. This data collection includes the mean and number of observations in the bin as well as its variance. The data will also include the innovations from the data assimilation, the forecast departure and the analysis increment, as well as bias correction (for satellite radiances). In this paper, we present the data format (called MERRA-2 Gridded Innovations and Observations or GIO) and its strengths and limitations with some initial testing and validation of the methodology.

Bosilovich, Michael G.↗
NASA NTRSDate not supplied

Global Solar Activity Data Portal for Studying 3D Dynamics and Activity of the Sun

The main problems with understanding and predicting solar activity are tightly linked to limitations in describing the global evolution of the Sun from the deep interior to the corona. Because of the complexity of interactions in a wide range of dynamical, turbulent, and spatial scales and dramatic changes in thermodynamic and magnetic field conditions, only physics-based models can provide essential background to generate reliable solar activity forecasts. However, performing accurate model calibration and estimating uncertainties is often challenging due to the unavailability of a long time series of observations. To mitigate these limitations, we have developed the Global Solar Activity (GSA) Data Portal, which enables convenient access to a variety of modern and historical data. The portal supports a dynamic visualization for 1D time series (such as the sunspot number and solar irradiance) and quick-look visualization for 2D datasets (e.g., synoptic magnetograms, the solar internal rotation, and flows). The GSA portal includes a search engine that enables data retrieval from user-specified data sources and time intervals. In this presentation, we will discuss the current and upcoming capabilities of the data portal and its potential applications for space weather studies.

SMD↗
NASA NTRS2013

Emissions Estimation from Satellite Retrievals: a Review of Current Capability

Since the mid-1990s a new generation of Earth-observing satellites has been able to detect tropospheric air pollution at increasingly high spatial and temporal resolution. Most primary emitted species can be measured by one or more of the instruments. This review article addresses the question of how well we can relate the satellite measurements to quantification of primary emissions and what advances are needed to improve the usability of the measurements by U.S. air quality managers. Built on a comprehensive literature review and comprising input by both satellite experts and emission inventory specialists, the review identifies several targets that seem promising: large point sources of NOx and SO2, species that are difficult to measure by other means (NH3 and CH4, for example), area sources that cannot easily be quantified by traditional bottom-up methods (such as unconventional oil and gas extraction, shipping, biomass burning, and biogenic sources), and the temporal variation of emissions (seasonal, diurnal, episodic). Techniques that enhance the usefulness of current retrievals (data assimilation, oversampling, multi-species retrievals, improved vertical profiles, etc.) are discussed. Finally, we point out the value of having new geostationary satellites like GEO-CAPE and TEMPO over North America that could provide measurements at high spatial (few km) and temporal (hourly) resolution.

air quality↗
NASA NTRS1997

Comparison of Ice Cloud Particle Sizes Retrieved From Satellite Data Derived From In Situ Measurements

Cloud microphysical parameterizations have attracted a great deal of attention in recent years due to their effect on cloud radiative properties and cloud-related hydrological processes in large-scale models. The parameterization of cirrus particle size has been demonstrated as an indispensable component in the climate feedback analysis. Therefore, global-scale, long-term observations of cirrus particle sizes are required both as a basis of and as a validation of parameterizations for climate models. While there is a global scale, long-term survey of water cloud droplet sizes (Han et al. 1994), there is no comparable study for cirrus ice crystals. In this paper a near-global survey of cirrus ice crystal sizes is conducted using ISCCP satellite data analysis. The retrieval scheme uses phase functions based upon hexagonal crystals calculated by a ray tracing technique. The results show that global mean values of D(e) are about 60 micro-m. This study also investigates the possible reasons for the significant difference between satellite retrieved effective radii (approx. 60 micro-m) and aircraft measured particle sizes (approx. 200 micro-m) during the FIRE I IFO experiment. They are (1) vertical inhomogeneity of cirrus particle sizes; (2) lower limit of the instrument used in aircraft measurements; (3) different definitions of effective particle sizes; and (4) possible inappropriate phase functions used in satellite retrieval.

Han, Qingyuan↗
NASA NTRS2018

Advanced Analytics and Big Earth Data

NASA's Earth Science Data Systems process, archive and distribute petabytes of Earth Observation data to a variety of end users. These end users will face dramatically increased data size in the near future, bringing about new challenges and opportunities in analyzing those data. One area of particular ferment currently is Machine Learning. Many Machine Learning methods are black boxes, limiting direct insight into the data's properties. However, they can be used for a variety of data enhancement purposes, such as parameter retrieval, data fusion and image classification and segmentation. The Earth Observing System Data and Information System is also evolving to host large data volumes in the cloud, enabling data proximal analysis. As part of this effort, an Analytics framework is being developed to support and enhance user analysis of the data. By using standards based services in the framework, diverse user communities can be served, while also allowing inter-system collaboration in the analysis process.

Cloud Computing↗
NASA NTRS1984

A Strategy for Successful Deep Space Information Transmission in Bad Weather

To retrieve data during bad weather, most missions slow the data rate to accommodate a certain amount of attenuation, or to allow for all but a very small percentage of all-weather conditions. This system has two well-known and balancing disadvantages: no data is received reliably during very bad weather, and the data rate is slowed during good weather. A system of processing is described that encodes the most critical data more heavily, allowing it to be retrieved under bad conditions, while at the same time allowing most of the data to be sent at a higher data rate.

Swanson, L.↗
NASA NTRSDate not supplied

RadLab: A Comprehensive Database and Graphical and Programming Interfaces for Biologically Relevant Space Radiation Data

RadLab, a new component of the NASA Open Science Data Repository (OSDR), is a platform built upon a database of radiation data relevant to space biology. RadLab provides visual and programmatic interfaces for interrogation of its database, as well as a submission process for inclusion of data from investigators. The RadLab application programming interface (API) implements a request syntax enabling users to retrieve data filtered by various combinations of parameters (detector type, location, direction, timespan, etc), which are delivered in machine-readable text formats, ready to be ingested by downstream analysis pipelines; while the graphical user interface (GUI) provides easy means to iteratively modify query parameters and incorporates a number of standard analyses and visualizations (time series plots, geospatial visualizations, detector comparison). Investigators from many countries, including US, Russia, Japan, Canada, the Czech Republic, Germany, Hungary, and Italy, have committed to provide data from their instruments located on the ISS; RadLab will also include data from other spacecraft in LEO (e.g., the Space Shuttle, the Mir space station), BLEO (e. g. BioSentinel, Mars Orbiter, among others), and on other celestial bodies (e. g. Chang’e 4, Curiosity). The first release of RadLab has been made available to the public. Once fully operational, RadLab will provide a comprehensive and ever-growing compendium of space radiation data, facilitating straightforward access to multiple types of readings and enabling space biology researchers to perform intercomparisons of detectors and to determine the radiation environment of research missions, both via programmatic retrieval of these data and via the graphical analysis toolkit; as well as a user-friendly submission portal for ingesting data from space agencies and research institutions. Radiation scientists will be able to use RadLab to gain a deeper understanding of the space radiation environment for future human space exploration. The RadLab Working Group has been formed to foster close collaborations among data contributors and users, to identify data sources, to put in place standards for data normalization, to guide the development of features of the analysis toolkit, to establish the use of RadLab in space radiation biology research, and eventually to provide a forum for discussing relevant research issues that can take advantage of RadLab's capabilities.

radiation↗
NASA NTRS1998

Atmospheric and Spectroscopic Research in the Far Infrared

The spectroscopic measurements of molecular parameters constitute one of the major areas of our research program. This part of our program has been conducted in close collaboration with Smithsonian Astrophysical Observatory (SAO) and National Institute of Standards and Technology (NIST). The references on HO2, OH, and O2 that appear on the publication list are examples of this type of work completed during the grant period. These pressure-broadening studies have provided the kind of improvements needed in the database for retrieving atmospheric profiles from far infrared limb sensing data. One example of this linkage between the pressure broadening studies and the improvements in data retrieval is described in the paper on HBr (paper #4, publication list). The retrieval of the concentration profile of this important species from the IBEX data was facilitated by a number of performance improvement factors, not the least of which was the database improvements.

Park, Kwangjai↗
NASA NTRS1987

Space station integrated propulsion and fluid systems study

This Databook addresses the integration of fluid systems of the Space Station program. It includes a catalog of components required for the Space Station elements fluid systems and information on potential hardware commonality. The components catalog is in four parts. The first part lists the components defined for all the fluid systems identified in EP 2.1, Space Station Program Fluid Systems Configuration Databook. The components are cross-referenced in three sections. Section 2.1 lists the components by the fluid system in which they are used. Section 2.2 lists the components by type. Section 2.3 lists by the type of fluid media handled by the component. The next part of the catalog provides a description of the individual component. This section (2.4) is made up of data retrieved from Martin Marietta Denver Aerospace component data base. The third part is an assessment of propulsion hardware technology requirements. Section 2.5 lists components identified during the study as requiring development prior to flight qualification. Finally, Section 2.6 presents the results of the evaluation of commonality between components. The specific requirements of each component have been reviewed and duplication eliminated.

Rose, L.↗
NASA NTRS1992

NASA/DOD Aerospace Knowledge Diffusion Research Project. Report 14: Engineering work and information use in aerospace: Results of a telephone survey

A telephone survey of U.S. aerospace engineers and scientists who were on the Society of Automotive Engineers (SAE) mailing list was conducted between August 14-26, 1991. The survey was undertaken to obtain information on the daily work activities of aerospace engineers and scientists, to measure various practices used by aerospace engineers and scientists to obtain STI, and to ask aerospace engineers and scientists about their use of electronic networks. Co-workers were found important sources of information. Co-workers are used to obtain technical information because the information they have is relevant, not because co-workers are accessible. As technical uncertainty increases, so does the need for information internal and external to the organization. Electronic networks enjoy widespread use within the aerospace community. These networks are accessible and they are used to contact people at remote sites. About 80 percent of the respondents used electronic mail, file transfer, and information or data retrieval to commercial or in-house data bases.

Pinelli, Thomas E.↗