Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data engineering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Experimental evaluation of a flexible I/O architecture for accelerating workflow engines in ultrascale environments

The increasing volume of scientific data and the limited scalability and performance of storage systems are currently presenting a significant limitation for the productivity of the scientific workflows running on both high-performance computing (HPC) and cloud platforms. Clearly needed is better integration of storage systems and workflow engines to address this problem. This paper presents and evaluates a novel solution that leverages codesign principles for integrating Hercules—an in-memory data store—with a workflow management system. We consider four main aspects: workflow representation, task scheduling, task placement, and task termination. As a result, the experimental evaluation on both cloud and HPC systems demonstrates significant performance and scalability improvements over existing state-of-the-art approaches.

97 MATHEMATICS AND COMPUTING↗

Editorial: Data-driven machine learning for advancing hydrological and hydraulic predictability

The growing influence of machine learning (ML) in every aspect of our lives has led to revolutionary advancements in our understanding, prediction, and decision-making capabilities. One field that stands to benefit greatly from applying these techniques includes hydrology and hydraulics. The ability to predict hydrological and hydraulic phenomena with greater accuracy and reliability is of utmost importance, given the increasing threats posed by climate change and extreme weather/climate events. In this editorial, we explore the significant contributions made by four recent studies that aim to advance hydrological and hydraulic predictability through data-driven ML.

42 ENGINEERING↗

Contrastive Machine Learning with Gamma Spectroscopy Data Augmentations for Detecting Shielded Radiological Material Transfers

Data analysis techniques can be powerful tools for rapidly analyzing data and extracting information that can be used in a latent space for categorizing observations between classes of data. Machine learning models that exploit learned data relationships can address a variety of nuclear nonproliferation challenges like the detection and tracking of shielded radiological material transfers. The high resource cost of manually labeling radiation spectra is a hindrance to the rapid analysis of data collected from persistent monitoring and to the adoption of supervised machine learning methods that require large volumes of curated training data. Instead, contrastive self-supervised learning on unlabeled spectra can enhance models that are built on limited labeled radiation datasets. This work demonstrates that contrastive machine learning is an effective technique for leveraging unlabeled data in detecting and characterizing nuclear material transfers demonstrated on radiation measurements collected at an Oak Ridge National Laboratory testbed, where sodium iodide detectors measure gamma radiation emitted by material transfers between the High Flux Isotope Reactor and the Radiochemical Engineering Development Center. Label-invariant data augmentations tailored for gamma radiation detection physics are used on unlabeled spectra to contrastively train an encoder, learning a complex, embedded state space with self-supervision. A linear classifier is then trained on a limited set of labeled data to distinguish transfer spectra between byproducts and tracked nuclear material using representations from the contrastively trained encoder. The optimized hyperparameter model achieves a balanced accuracy score of 80.30%. Any given model—that is, a trained encoder and classifier—shows preferential treatment for specific subclasses of transfer types. Regardless of the classifier complexity, a supervised classifier using contrastively trained representations achieves higher accuracy than using spectra when trained and tested on limited labeled data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Reynolds-Averaged Turbulence Modeling Using Deep Learning with Local Flow Features: An Empirical Approach

Reynolds-Averaged Navier-Stoke (RANS) models offer an alternative avenue in predicting flow characteristics when the corresponding experiments are difficult to achieve due to geometry complexity, limited budget, or knowledge. RANS models require the knowledge of subgrid scale physics to solve conservation equations for mass, energy, and momentum. Mechanistic turbulence models, such as k-epsilon, are generally evaluated and calibrated for specific flow conditions with various degrees of uncertainty. These models have limited capability to assimilate a substantial amount of data due to model form constraints. Meanwhile, deep learning (DL) has been proven to be universal approximators with the potential to assimilate available, relevant, and adequately evaluated data. Moreover, deep neural networks (DNNs) can create surrogate models without knowing function forms. Such a data-driven approach can be used in updating fluid models based on observations as opposed to hard-wiring models with precalibrated correlations. The paper presents progress in applying DNNs to model Reynolds stress using two machine learning (ML) frameworks. A novel flow feature coverage mapping is proposed to quantify the physics coverage of DL-based closures. It can be used to examine the sufficiency of training data and input flow features for data-driven turbulence models. The case of a backward-facing step is formulated to demonstrate that not only can DNNs discover underlying correlation behind fluid data but also they can be implemented in RANS to predict flow characteristics without numerical stability issues. Finally, the presented research is a crucial stepping-stone toward the data-driven turbulence modeling, which potentially benefits the design of data-driven experiments that can be used to validate fluid models with ML-based fluid closures.

42 ENGINEERING↗

Advanced Combustion and Fuels; NREL (National Renewable Energy Laboratory)

Presented at the U.S. Department of Energy Vehicle Technologies Office 2015 Annual Merit Review and Peer Evaluation Meeting, held June 8-12, 2015, in Arlington, Virginia. It addresses technical barriers of inadequate data and predictive tools for fuel and lubricant effects on advanced combustion engines, with the strategy being through collaboration, develop techniques, tools, and data to quantify critical fuel physico-chemical effects to enable development of advanced combustion engines that use alternative fuels.

33 ADVANCED PROPULSION SYSTEMS↗

An Experimental Study of Uncertainty Considerations Associated with Predicting Auto-ignition Timing using Livengood-Wu Integral Method

The application of the Livengood-Wu (LW) integral method as a tool to estimate knock onset in spark ignited (SI) engines and combustion phasing in advanced compression ignition (ACI) engines has been demonstrated through simulations several times. In this study, the effect of uncertainties associated with parameters required for the LW integral method, when used as a tool for model based control of ignition timing in an ACI engine, were experimentally studied using five full boiling range gasoline fuels. As a first step, the method was applied to experimental data from a rapid compression machine and it was found that the ability of the LW integral method to predict ignition timing was very sensitive to the performance of the chemical kinetic model of each fuel. The method was subsequently applied to experimental data from a single-cylinder gasoline engine with simple approximations for the LW integral input parameters, and it was found that the predicted time of ignition was significantly different from the actual start of combustion. Systematic evaluation of various parametric uncertainties conducted thereafter showed that the uncertainty in cylinder charge temperature has the greatest influence. Improved methods of estimating cylinder charge temperature are proposed to account for the previously determined corrections, to enable the use of the LW integral method for model based control of ignition timing.

Compression Ignition↗

Data Efficiency Assessment of Generative Adversarial Networks for Critical Heat Flux Synthetic Data Generation

This study investigates the application of generative artificial intelligence techniques, particularly conditional generative adversarial networks (cGAN), in real-world engineering contexts, with a specific focus on synthetic data generation for critical heat flux (CHF). Utilizing a dataset comprising more than 20,000 real experimental CHF measurements, we conduct a series of experiments to examine cGAN’s behavior. These experiments encompass varying sizes of the training dataset, training cGAN on data from diverse experimental sources to generate new data on unseen experimental setups, and assessing the impact of excluding various input features on cGAN’s data generation accuracy. Our findings underscore the pronounced data dependency of cGAN for reliable performance, with decreased efficacy observed with smaller training dataset sizes. Notably, cGAN exhibits varying performance when trained on data from different experiments, with superior predictive capabilities observed for certain experiment sources compared to others. For instance, when cGAN was trained on data from Smolin et al.’s experiments or Zenkevich et al., it exhibited relatively good performance in generating the data from Becker et al., Kirillov et al., and Alekseev et al. experiments. In contrast, when trained with Alekseev et al.’s data and tasked with generating other experimental setups, cGAN showed notably poor performance. In both scenarios, cGAN’s performance was inferior compared to training on samples from all experiments concurrently. A feature importance analysis highlights the significant influence of parameters such as mass flux and heated length on accurate CHF generation, while other parameters like diameter and pressure have less impact. Inlet temperature is identified as a moderating factor by cGAN.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Understanding Data Structures by Extracting Memory Access Graphs

Understanding the data structures employed by a program is important for reverse engineering activities and can improve the results of automated software analysis techniques. In a compiled binary, access to data structure fields and array indices defined in the source program are replaced by raw pointer arithmetic. We present a representation for capturing the essential details of how a program accesses memory regions, which we call a Memory Access Graph (MAG), and a static analysis for automatically extracting this information from a program binary. The static analysis to extract the MAGs from the program is straightforward and does not require sophisticated integer or pointer analysis. The MAGs are readily understood by reverse engineers; they are generally able to perceive the data structure definition corresponding to a MAG. We briefly discuss automatic extraction of structure definitions outlining some of the difficulties in doing so.

97 MATHEMATICS AND COMPUTING↗

Dynamic responses of submerged components in advanced reactors: experimental and numerical studies

The seismic design of an advanced nuclear reactor must consider the interaction of vessel internal components with the surrounding coolant: fluid–structure interaction (FSI). Available analytical solutions for FSI of submerged components do not accommodate multiple-component, intense seismic inputs and complex reactor and internal geometries. Physical testing of reactor vessels and internals to inform seismic design is impractical and cost-prohibitive, leaving the use of verified and validated, robust numerical models as the only plausible option for analysis and design. Physical data that could be used for validating such numerical models for multi-component shaking are not available. This article describes an experimental program performed on a 6-degree-of-freedom earthquake simulator to generate data that could support validation of seismic FSI numerical models for submerged components in commercial finite element codes. A scaled model of a base-supported reactor vessel with simplified representations of submerged internals was tested to generate submerged-component response histories for a range of seismic inputs. The generated data were used to validate numerical models in the finite element code LS-DYNA. Numerical models were validated for calculation of hydrodynamic pressure responses on internals, in-water frequencies of internals, and acceleration responses of internals. The generated data and the analysis recommendations could aid engineering analysts designing submerged components and systems for seismic effects.

Engineering↗

Lemnos interoperable security project.

With the Lemnos framework, interoperability of control security equipment is straightforward. To obtain interoperability between proprietary security appliance units, one or both vendors must now write cumbersome 'translation code.' If one party changes something, the translation code 'breaks.' The Lemnos project is developing and testing a framework that uses widely available security functions and protocols like IPsec - to form a secure communications channel - and Syslog, to exchange security log messages. Using this model, security appliances from two or more different vendors can clearly and securely exchange information, helping to better protect the total system. Simplify regulatory compliance in a complicated security environment by leveraging the Lemnos framework. As an electric utility, are you struggling to implement the NERC CIP standards and other regulations? Are you weighing the misery of multiple management interfaces against committing to a ubiquitous single-vendor solution? When vendors build their security appliances to interoperate using the Lemnos framework, it becomes practical to match best-of-breed offerings from an assortment of vendors to your specific control systems needs. The Lemnos project is developing and testing a framework that uses widely available open-source security functions and protocols like IPsec and Syslog to create a secure communications channel between appliances in order to exchange security data.

42 ENGINEERING↗

Local composition activity coefficient model for mixed-gas adsorption equilibria

Taking into consideration the adsorbate–adsorbent interactions, a novel activity coefficient model is derived from the non-random two-liquid theory for mixed-gas adsorption equilibria. In contrast with the conventional activity coefficient models developed for bulk liquids, the new model correctly predicts negative deviations from ideality for adsorbed phase mixtures including azeotropic behavior exhibited by selected gas-adsorbent systems. Here, the requiring a single binary interaction parameter per adsorbate–adsorbate pair, the model successfully correlates wide varieties of binary adsorption isotherm data and it should be a powerful engineering thermodynamic tool in correlating and predicting mixed-gas adsorption equilibria.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Flexible and Scalable Data-Acquisition Using the artdaq Toolkit

The Real-Time Systems Engineering Department of the Scientific Computing Division at Fermilab is developing a flexible, scalable, and powerful data-acquisition (DAQ) toolkit which serves the needs of experiments from bench-top hardware tests to large high-energy physics experiments. The toolkit provides data transport and event building capabilities with the option for experimenters to inject art analysis code at key points in the DAQ for filtering or monitoring. The toolkit also provides configuration management, run control, and low-level hardware communication utilities. Firmware blocks for several commercial data acquisition boards are provided, allowing experimenters to approach the DAQ from a high level. A fully-functional DAQ "solution" of the toolkit is provided in otsdaq, sacrificing some flexibility in favor of being ready-to-use. artdaq is being used for several current and upcoming experiments, and will continue to be refined and expanded for use in the next generation of neutrino and muon experiments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Toward 3D data visualization using virtual reality tools

Virtual Reality (VR) offers the opportunity to display data, instrumentation, and experimental setups in three dimensions and gives the user the ability to interact with the objects. This technology moves visualization beyond two-dimensional projections on a flat screen with a fixed field of view in which a keyboard or another similar controller is needed to change the view. Advances in both hardware and software for VR make it possible for the non-expert to develop visualization tools for scientific applications both for viewing and for sharing data or diagnostic hardware between users in three dimensions. Furthermore, this manuscript describes application development using two VR software tools, Unity gaming engine and A-frame, for visualizing data and high energy physics targets.

47 OTHER INSTRUMENTATION↗

A comprehensive experimental and kinetic modeling study of di-isobutylene isomers: Part 1

We report di-isobutylene has received significant attention as a promising fuel blendstock, as it can be synthesized via biological routes and is a short-listed molecule from the Co-Optima initiative. Di-isobutylene is also popularly used as an alkene representative in multi-component surrogate models for engine studies of gasoline fuels. However, there is limited experimental data available in the literature for neat di-isobutylene under engine-like conditions. Hence, most existing di-isobutylene models have not been extensively validated, particularly at lower temperatures (< 1000 K). Most gasoline surrogate models include the di-isobutylene sub-mechanism published by Metcalfe et al. with little or no modification. The current study is undertaken to develop a detailed kinetic model for di-isobutylene and validate the model using a wide range of relevant experimental data. Part 1 of this study exclusively focuses on the low- to intermediate temperature kinetics of di-isobutylene. An upcoming part 2 discusses the high-temperature model development and validation of the relevant experimental targets. Ignition delay time measurements for the di-isobutylene isomers were performed at pressures ranging from 15 - 30 bar at equivalence ratios of 0.5, 1.0, and 2.0 diluted in air and in the temperature range 650 - 900 K using two independent rapid compression machine facilities. In addition, measurements of species identified during the oxidation of these isomers were performed in a jet-stirred reactor and in a rapid compression machine. A detailed kinetic model for the di-isobutylene isomers is developed to capture the wide range of new experimental targets. For the first time, a comprehensive low-temperature chemistry submodel is included. The differences in the important reaction pathways for the accurate prediction of the oxidation of the two DIB isomers are compared using reaction path analysis. In conclusion, the most sensitive reactions controlling the ignition delay times of the DIB isomers under the pressure and temperature conditions necessary for autoignition in engines are identified.

09 BIOMASS FUELS↗

DOE BSSD Performance Management Metrics Report Q1

Microbes play key roles in our biosphere, from driving global nutrient cycling to impacting plant, animal and human health and disease. Complex data from microbial genomes, proteins, and metabolites provide a window into these tiny engines that drive life on our planet. Yet these data are dispersed among researchers’ laboratories and various repositories, making it difficult to access. This calls for new ways of managing data, improving data interoperability, advancing community standards, and creating an infrastructure where data are shared efficiently. We have built the National Microbiome Data Collaborative (NMDC) to advance how scientists create, use, and reuse data to redefine the way we understand and harness the power of microbes. The vision of the National Microbiome Data Collaborative (NMDC) is to drive a microbiome data sharing network connecting data, people, and ideas to advance microbiome innovation and discovery. The NMDC was launched in 2019 and brought together DOE National Laboratories to collaborate across resources, capabilities, and expertise. The NMDC team was strategically assembled to include software developers, microbial researchers, metadata experts, and multi-omics specialists. The diversity of the NMDC team reflects the inherently interdisciplinary nature of microbiome science, and we leverage the strengths of the DOE National Laboratory system. Towards BER’s goal of advancing an iterative systems biology approach to the understanding of microbial genomes, the NMDC serves as a foundation for infrastructure, data standards, and community building. Together with the flagship DOE User Facilities, the Joint Genome Institute (JGI) and the Environmental Molecular Sciences Laboratory (EMSL), we are developing core capabilities in metadata standards for environmental descriptors and sample handling and processing; standardized bioinformatic workflows; an interface for data search and access; and robust community engagement activities. The NMDC production platform supports long-term data infrastructure and community building for BER’s bioenergy and environmental research goals. Our approach leverages lessons learned and an ambitious framework for collaborative, interdisciplinary data infrastructure to support microbiome research. The NMDC supports data, information, and knowledge access through three defined software tools – the Submission Portal, NMDC EDGE, and the Data Portal – driven by community needs. Herein, we describe the value proposition for the microbiome research community, our overarching strategy, and challenges and opportunities for developing the NMDC as both an infrastructure and community engagement program.

59 BASIC BIOLOGICAL SCIENCES↗

An actuarial approach to retrofit savings in buildings

An actuarial method has been developed for determining energy savings from retrofits from energy use data for a number of buildings. This method should be contrasted with the traditional method of using pre- and post-retrofit data on the same building. This method supports the U.S. Department of Energy Building Performance Database of real building performance data and related tools that enable engineering and financial practitioners to evaluate retrofits. The actuarial approach derives, from the database, probability density functions (PDFs) for energy savings from retrofits by creating peer groups for the user’s pre post buildings. From the energy use distribution of the two groups, the savings PDF is derived. This provides the basis for engineering analysis as well as financial risk analysis leading to investment decisions. Several technical issues are addressed: The savings PDF is obtained from the pre- and post-PDF through a convolution. Smoothing using kernel density estimation is applied to make the PDF more realistic. The low data density problem can be mitigated through a neighborhood methodology. Correlations between pre and post buildings are addressed to improve the savings PDF. Sample size effects are addressed through the Kolmogorov--Smirnov tests and quantile-quantile plots.

Subbarao, Krishnappa↗

HEP Science Network Requirements--Final Report

The Energy Sciences Network (ESnet) is the primary provider of network connectivity for the US Department of Energy Office of Science, the single largest supporter of basic research in the physical sciences in the United States. In support of the Office of Science programs, ESnet regularly updates and refreshes its understanding of the networking requirements of the instruments, facilities, scientists, and science programs that it serves. This focus has helped ESnet to be a highly successful enabler of scientific discovery for over 20 years. In August 2009 ESnet and the Office of High Energy Physics (HEP), of the DOE Office of Science, organized a workshop to characterize the networking requirements of the programs funded by HEP. The International HEP community has been a leader in data intensive science from the beginning. HEP data sets have historically been the largest of all scientific data sets, and the communty of interest the most distributed. The HEP community was also the first to embrace Grid technologies. The requirements identified at the workshop are summarized below, and described in more detail in the case studies and the Findings section: (1) There will be more LHC Tier-3 sites than orginally thought, and likely more Tier-2 to Tier-2 traffic than was envisioned. It it not yet known what the impact of this will be on ESnet, but we will need to keep an eye on this traffic. (2) The LHC Tier-1 sites (BNL and FNAL) predict the need for 40-50 Gbps of data movement capacity in 2-5 years, and 100-200 Gbps in 5-10 years for HEP program related traffic. Other key HEP sites include LHC Tier-2 and Tier-3 sites, many of which are located at universities. To support the LHC, ESnet must continue its collaborations with university and international networks. (3) While in all cases the deployed 'raw' network bandwidth must exceed the user requirements in order to meet the data transfer and reliability requirements, network engineering for trans-Atlantic connectivity is more complex than network engineering for intra-US connectivity. This is because transoceanic circuits have lower reliability and longer repair times when compared with land-based circuits. Therefore, trans-Atlantic connectivity requires greater deployed bandwidth and diversity to ensure reliability and service continuity of the user-level required data transfer rates. (4) Trans-Atlantic traffic load and patterns must be monitored, and projections adjusted if necessary. There is currently a shutdown planned for the LHC in 2012 that may affect projections of trans-Atlantic bandwidth requirements. (5) There is a significant need for network tuning and troubleshooting during the establishment of new LHC Tier-2 and Tier-3 facilities. ESnet will work with the HEP community to help new sites effectively use the network. (6) SLAC is building the CCD camera for the LSST. This project will require significant bandwidth (up to 30Gbps) to NCSA over the next few years. (7) The accelerator modeling program at SLAC could require the movement of 1PB simulation data sets from the Leadership Computing Facilities at Argonne and Oak Ridge to SLAC. The data sets would need to be moved overnight, and moving 1PB in eight hours requires more than 300Gbps of throughput. This requirement is dependent on the deployment of analysis capabilities at SLAC, and is about five years away. (8) It is difficult to achieve high data transfer throughput to sites in China. Projects that need to transfer data in or out of China are encouraged to deploy test and measurement infrastructure (e.g. perfSONAR) and allow time for performance tuning.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗