Search NASA⌕ Search

SEARCH · Search NASA

Results for “data integration.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68
All sourcesNASA NTRSDOE OSTI
DOE OSTI2015

Delta: Data Reduction for Integrated Application Workflows

Integrated Application Workflows (IAWs) run multiple simulation workflow components concurrently on an HPC resource connecting these components using compute area resources and compensating for any performance or data processing rate mismatches. These IAWs require high frequency and high volume data transfers between compute nodes and staging area nodes during the lifetime of a large parallel computation. The available network band-width between the two areas may not be enough to efficiently support the data movement. As the processing power available to compute resources increases, the requirements for this data transfer will become more difficult to satisfy and perhaps will not be satisfiable at all since network capabilities are not expanding at a comparable rate. Furthermore, energy consumption in HPC environments is expected to grow by an order of magnitude as exascale systems become a reality. The energy cost of moving large amounts of data frequently will contribute to this issue. It is necessary to reduce the volume of data without reducing the quality of data when it is being processed and analyzed. Delta resolves the issue by addressing the lifetime data transfer operations. Delta removes subsequent identical copies of already transmitted data during transfers and restores those copies once the data has reached the destination. Delta is able to identify duplicated information and determine the most space efficient way to represent it. Initial tests show about 50% reduction in data movement while maintaining the same data quality and transmission frequency.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Effect of Nuclear Data Covariances on Integral Experiment Design with Sensitivity and Uncertainty Analysis

Washington River Protection Solutions (WRPS) uses MCNP6.2 and the Whisper code for criticality safety analyses of the Hanford Tank Farm. Together the codes derive baseline upper subcritical limits (USLs) for the waste models using experimental benchmarks. Whisper returns higher USLs, i.e. , has less of a conservative penalty, when the neutronic similarity of the experimental benchmarks to the application is high. Unfortunately, few critical benchmarks have high similarity to the Hanford tanks. The waste in the tanks is highly dilute in plutonium and contains large masses of weakly neutron-absorbing elements like iron and manganese. Experimental benchmarks typically have low sensitivity to these absorbers because they are present as structural materials. Lacking similar benchmarks, new Thermal Epithermal eXperiment (TEX) configurations with high Pu content and interstitial iron absorbers have been designed for the criticality safety validation. The features of the design have been iterated upon to maximize the similarity between the experiment and different Hanford waste models. The similarity is quantified with sensitivity analysis and uncertainty quantification using the representativity coefficient, or c k . The representativity calculation requires nuclear data covariances, which may differ between nuclear data libraries and between library versions. Because of these variations, the optimal design may depend on the nuclear data covariances library. A scenario can be envisioned where an experiment is designed, and c k is maximized, with one set of covariance data. However, when the covariance data is changed, say from ENDF/B-VII.1 to ENDF/B-VIII.0, and the benchmark is used in a criticality safety evaluation, the experiment becomes suboptimal with respect to c k . In this paper, we present how the optimal design of the new TEX experiments varied depending on the nuclear data covariances used to calculate c k . We compare ENDF/B-VII.1 and ENDF/B-VIII.0, as if the library had been updated since the design of the experiment. Additionally, we use JEFF3.3 to simulate if the covariance data of a different library had been used. The results show that the covariances do have an important effect on the designs, less so for thermal systems (where the data are more consistent between evaluations) and more so for epithermal systems where more differences exist.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Energy Materials Chemistry Integrating Theory, Experiment and Data Science (Final Report)

The Energy Materials Chemistry Integrating Theory, Experiment and Data Science (EM-CITED) project is a multidisciplinary research effort focused on accelerating discovery of scientific knowledge via incorporation of data science and artificial intelligence in materials chemistry research. The project aims to advance materials chemistry-aware data science to unify theory and experiment knowledge streams. The work resulted in foundational AI frameworks for materials chemistry – Deep Reasoning Networks (DRNets), Hierarchical Correlation Learning for Multi-property Prediction (H-CLMP), and Material-to-Spectrum (Mat2Spec) prediction – as well as a host of strategies for accelerated scientific discoveries through principled incorporation of data science in computational and experimental research.

36 MATERIALS SCIENCE↗
DOE OSTI2016

Principles of proteome allocation are revealed using proteomic data and genome-scale models

Integrating omics data to refine or make context-specific models is an active field of constraint-based modeling. Proteomics now cover over 95% of the Escherichia coli proteome by mass. Genome-scale models of Metabolism and macromolecular Expression (ME) compute proteome allocation linked to metabolism and fitness. Using proteomics data, we formulated allocation constraints for key proteome sectors in the ME model. The resulting calibrated model effectively computed the “generalist” (wild-type) E. coli proteome and phenotype across diverse growth environments. Across 15 growth conditions, prediction errors for growth rate and metabolic fluxes were 69% and 14% lower, respectively. The sector-constrained ME model thus represents a generalist ME model reflecting both growth rate maximization and “hedging” against uncertain environments and stresses, as indicated by significant enrichment of these sectors for the general stress response sigma factor σS. Finally, the sector constraints represent a general formalism for integrating omics data from any experimental condition into constraint-based ME models. The constraints can be fine-grained (individual proteins) or coarse-grained (functionally-related protein groups) as demonstrated here. Furthermore, this flexible formalism provides an accessible approach for narrowing the gap between the complexity captured by omics data and governing principles of proteome allocation described by systems-level models.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1984

Definition, analysis and development of an optical data distribution network for integrated avionics and control systems. Part 2: Component development and system integration

Fiber optic transmission is emerging as an attractive concept in data distribution onboard civil aircraft. Development of an Optical Data Distribution Network for Integrated Avionics and Control Systems for commercial aircraft will provide a data distribution network that gives freedom from EMI-RFI and ground loop problems, eliminates crosstalk and short circuits, provides protection and immunity from lightning induced transients and give a large bandwidth data transmission capability. In addition there is a potential for significantly reducing the weight and increasing the reliability over conventional data distribution networks. Wavelength Division Multiplexing (WDM) is a candidate method for data communication between the various avionic subsystems. With WDM all systems could conceptually communicate with each other without time sharing and requiring complicated coding schemes for each computer and subsystem to recognize a message. However, the state of the art of optical technology limits the application of fiber optics in advanced integrated avionics and control systems. Therefore, it is necessary to address the architecture for a fiber optics data distribution system for integrated avionics and control systems as well as develop prototype components and systems.

Yen, H. W.↗
DOE OSTI2016

The ADAQ framework: An integrated toolkit for data acquisition and analysis with real and simulated radiation detectors

Here, the ADAQ framework is a collection of software tools that is designed to streamline the acquisition and analysis of radiation detector data produced in modern digital data acquisition (DAQ) systems and in Monte Carlo detector simulations. The purpose of the framework is to maximize user scientific pro-ductivity by minimizing the effort and expertise required to fully utilize radiation detectors in a variety of scientific and engineering disciplines. By using a single set of tools to span the real and simulation domains, the framework eliminates redundancy and provides an integrated workflow for high-fidelity comparison between experimental and simulated detector performance. Built on the ROOT data analysis framework, the core of the ADAQ framework is a set of Cþþ and Python libraries that enable high-level control of digital DAQ systems and detector simulations with data stored into standardized binary ROOT files for further analysis. Two graphical user interface programs utilize the libraries to create powerful tools: ADAQAcquisition handles control and readout of real-world DAQ systems and ADAQAnalysis provides data analysis and visualization methods for experimental and simulated data. At present, the ADAQ framework supports digital DAQ hardware from CAEN S.p.A. and detector simulations performed in Geant4; however, the modular design will facilitate future extension to other manufacturers and simulation platforms.

detector simulation↗
DOE OSTI2020

Integration of Soft Data Into Geostatistical Simulation of Categorical Variables

Uncertain or indirect “soft” data, such as geologic interpretation, driller’s logs, geophysical logs or imaging, offer potential constraints or “soft conditioning” to stochastic models of discrete categorical subsurface variables in hydrogeology such as hydrofacies. Previous bivariate geostatistical simulation algorithms have not fully addressed the impact of data uncertainty in formulation of the (co) kriging equations and the objective function in simulated annealing (or quenching). This paper introduces the geostatistical simulation code tsim-s, which accounts for categorical data uncertainty through a data “hardness” parameter. In generating geostatistical realizations with tsim-s, the uncertainty inherent to soft conditioning is factored into both 1) the data declustering and spatial correlation functions in cokriging and 2) the acceptance probability for change of category in simulated quenching. The degree or sensitivity to which soft data conditions a realization as a function of hardness can be quantified by mapping category probabilities derived from multiple realizations. In addition to point or borehole data, arrays of data (e.g., as derived from a depth-dependency function, probability map, or “prior realization”) can be used as soft conditioning. The tsim-s algorithm provides a theoretically sound and general framework for integrating datasets of variable location, resolution, and uncertainty into geostatistical simulation of categorical variables. A practical example shows how tsim-s is capable of generating a large-scale three-dimensional simulation including curvilinear features.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1982

Integration of Fish and Wildlife Data with Geobased and Remotely Sensed Land Use/land Cover Data: a Demonstration Using Sites in Pennsylvania

The U.S. Fish and Wildlife Service developed a statewide fish and wildlife data base for the Pennsylvania Game Commission that includes 125 categories of information on each of the 844 species. This species data base is integrated with geobased and remotely-sensed land use/land cover data from two sites in Pennsylvania. One site is an energy development project; the other is a high-energy use area. Analyses using the combined animal and land use data bases can be demonstrated for a variety of land use/land cover types at both sites. The ability to make "what if" analysis prior to project implementation is presented.

Cushwa, C. T.↗
NASA NTRS1984

An integrated voice and data multiple-access scheme for a land-mobile satellite system

An analytical study is performed of the satellite requirements for a land mobile satellite system (LMSS). The spacecraft (MSAT-X) would be in GEO and would be compatible with multiple access by mobile radios and antennas and fixed stations. The FCC has received a petition from NASA to reserve the 821-825 and 866-870 MHz frequencies for the LMSS, while communications with fixed earth stations would be in the Ku band. MSAT-X transponders would alter the frequencies of signal and do no processing in the original configuration considered. Channel use would be governed by an integrated demand-assigned, multiple access protocol, which would divide channels into reservation and information channels, governed by a network management center. Further analyses will cover tradeoffs between data and voice users, probability of blocking, and the performance impacts of on-board switching and variable bandwidth assignment. Initial calculations indicate that a large traffic volume can be handled with acceptable delays and voice blocking probabilities.

Li, V. O. K.↗
NASA NTRS1986

Total-dose radiation effects data for semiconductor devices. 1985 Supplement. Volume 2, part B

Steady-state, total-dose radiation test data are provided in graphic format, for use by electronic designers and other personnel using semiconductor devices in a radiation environment. The data were generated by JPL for various NASA space programs. The document is in two volumes: Volume 1 provides data on diodes, bipolar transistors, field effect transistors, and miscellaneous semiconductor types, and Volume 2 (Parts A and B) provides data on integrated circuits. The data are presented in graphic, tabular, and/or narrative format, depending on the complexity of the integrated circuit. Most tests were done steady-state 2.5-MeV electron beam. However, some radiation exposures were made with a Cobalt-60 gamma ray source, the results of which should be regarded as only an approximate measure of the radiation damage that would be incurred by an equivalent electron dose. All data were generated in support of NASA space programs by the JPL Radiation Effects and Testing Group (514).

Martin, K. E.↗
DOE OSTI2021

Development of data‐driven exponential integrators with application to modeling of delay photocurrents

Abstract Radiation‐induced photocurrent effects represent a threat to microelectronic components operating in space, manmade and terrestrial radiation environments. Analysis of these threats by circuit simulations requires accurate and computationally efficient compact models. Most existing compact models are based on closed form analytic solutions of the governing equations and require empirical assumptions and idealizations that can limit their validity. In this paper we formulate an alternative numerical, data‐driven approach that learns a compact model from data representative of the type of measurements one can obtain in an experimental facility. To develop the model we start from a generic discrete‐time dynamical system and then use physics knowledge to refine its structure. Numerical studies demonstrate the potential of the model and establish some empirical guidelines for its training.

Bochev, Pavel↗
NASA NTRS2012

Integrating NASA Satellite Data Into USDA World Agricultural Outlook Board Decision Making Environment To Improve Agricultural Estimates

The USDA World Agricultural Outlook Board (WAOB) is responsible for monitoring weather and climate impacts on domestic and foreign crop development. One of WAOB's primary goals is to determine the net cumulative effect of weather and climate anomalies on final crop yields. To this end, a broad array of information is consulted. The resulting agricultural weather assessments are published in the Weekly Weather and Crop Bulletin, to keep farmers, policy makers, and commercial agricultural interests informed of weather and climate impacts on agriculture. The goal of the current project is to improve WAOB estimates by integrating NASA satellite precipitation and soil moisture observations into WAOB's decision making environment. Precipitation (Level 3 gridded) is from the TRMM Multi-satellite Precipitation Analysis (TMPA). Soil moisture (Level 2 swath and Level 3 gridded) is generated by the Land Parameter Retrieval Model (LPRM) and operationally produced by the NASA Goddard Earth Sciences Data and Information Services Center (GBS DISC). A root zone soil moisture (RZSM) product is also generated, via assimilation of the Level 3 LPRM data by a land surface model (part of a related project). Data services to be available for these products include GeoTIFF, GDS (GrADS Data Server), WMS (Web Map Service), WCS (Web Coverage Service), and NASA Giovanni. Project benchmarking is based on retrospective analyses of WAOB analog year comparisons. The latter are between a given year and historical years with similar weather patterns and estimated crop yields. An analog index (AI) was developed to introduce a more rigorous, statistical approach for identifying analog years. Results thus far show that crop yield estimates derived from TMPA precipitation data are closer to measured yields than are estimates derived from surface-based precipitation measurements. Work is continuing to include LPRM surface soil moisture data and model-assimilated RZSM.

Teng, William↗
NASA NTRS1986

Total-dose radiation effects data for semiconductor devices. 1985 supplement. Volume 2, part A

Steady-state, total-dose radiation test data, are provided in graphic format for use by electronic designers and other personnel using semiconductor devices in a radiation environment. The data were generated by JPL for various NASA space programs. This volume provides data on integrated circuits. The data are presented in graphic, tabular, and/or narrative format, depending on the complexity of the integrated circuit. Most tests were done using the JPL or Boeing electron accelerator (Dynamitron) which provides a steady-state 2.5 MeV electron beam. However, some radiation exposures were made with a Cobalt-60 gamma ray source, the results of which should be regarded as only an approximate measure of the radiation damage that would be incurred by an equivalent electron dose.

Martin, K. E.↗
NASA NTRS2012

Making an Informed Decision on Freshwater Management by Integrating Remote Sensing Data with Traditional Data

The US National Research Council (NRC) recommended that: "The U.S. government, working in concert with the private sector, academe, the public, and its international partners, should renew its investment in Earth-observing systems and restore its leadership in Earth science and applications." in response to the NASA Earth Science Division's request to prioritize research areas, observations, and notional missions to make those objectives. In this presentation, we will discuss our approach to connect remote sensing science to decision support applications by establishing a framework to integrate direct measurements, earth system models, inventories, and other information to accurately estimate fresh water resources in global, regional, and local scales. We will discuss our demonstration projects and lessons learned from the experience. Deploying a monitoring system that offers sustained, accurate, transparent and relevant information represents a challenge and opportunity to a broad community spanning earth science, water resource accounting and public policy. An introduction to some of the scientific and technical infrastructure issues associated with monitoring systems is offered here to encourage future treatment of these topics by other contributors as a concluding remark.

climate↗
DOE OSTI2024

Improving streamflow predictions across CONUS by integrating advanced machine learning models and diverse data

Accurate streamflow prediction is crucial to understand climate impacts on water resources and develop effective adaption strategies. A global long short-term memory (LSTM) model, using data from multiple basins, can enhance streamflow prediction, yet acquiring detailed basin attributes remains a challenge. To overcome this, we introduce the Geo-vision transformer (ViT)-LSTM model, a novel approach that enriches LSTM predictions by integrating basin attributes derived from remote sensing with a ViT architecture. Applied to 531 basins across the Contiguous United States, our method demonstrated superior prediction accuracy in both temporal and spatiotemporal extrapolation scenarios. Geo-ViT-LSTM marks a significant advancement in land surface modeling, providing a more comprehensive and effective tool for better understanding the environment responses to climate change.

Tayal, Kshitij↗
DOE OSTI2022

Sparse Data Machine Learning Integration with Theory, Experiment and Uncertainty Quantification: Process-Structure-Property-Performance of Friction Deformation Processing

Computer vision and deep learning tools that advance the ability to establish processing-structure-property-performance (PSPP) relations are presented. The Bayesian binning method for image segmentation enables quantitative analysis of microstructural features in an automated way, while the analysis of shapes and relative orientation of these features reveals local deformation maps indicative of both, material flow and residual stresses due to materials processing. The deep learning method leads to the previous knowledge agnostic mapping of empirically observed microstructural zones in friction stir welding (FSW) process and synthetic microstructure generation capability that is statistically equivalent to experimentally collected data.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2009

Auto-Generated Semantic Processing Services

Auto-Generated Semantic Processing (AGSP) Services is a suite of software tools for automated generation of other computer programs, denoted cross-platform semantic adapters, that support interoperability of computer-based communication systems that utilize a variety of both new and legacy communication software running in a variety of operating- system/computer-hardware combinations. AGSP has numerous potential uses in military, space-exploration, and other government applications as well as in commercial telecommunications. The cross-platform semantic adapters take advantage of common features of computer- based communication systems to enforce semantics, messaging protocols, and standards of processing of streams of binary data to ensure integrity of data and consistency of meaning among interoperating systems. The auto-generation aspect of AGSP Services reduces development time and effort by emphasizing specification and minimizing implementation: In effect, the design, building, and debugging of software for effecting conversions among complex communication protocols, custom device mappings, and unique data-manipulation algorithms is replaced with metadata specifications that map to an abstract platform-independent communications model. AGSP Services is modular and has been shown to be easily integrable into new and legacy NASA flight and ground communication systems.

Davis, Rodney↗