Search NASA⌕ Search

SEARCH · Search NASA

Results for “training efficiency”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Transferable predictions of energetic and structural properties for refractory solid solution alloys across chemical compositions

We present a data-efficient approach to train graph neural networks (GNNs) on density functional theory (DFT) data for accurate and transferable predictions of energetic and structural properties of refractory solid solution alloys in the niobium-tantalum-vanadium (Nb-Ta-V) chemical space. We start by training the GNN model only on DFT data that describes refractory binary alloys niobium-tantalum (Nb-Ta), niobium-vanadium (Nb-V), and tantalum-vanadium (Ta-V) to predict formation enthalpy and root mean squared displacement. Once trained, the GNN predictions are tested on DFT data describing refractory ternary alloys Nb-Ta-V. While, unsurprisingly, direct transferability from binary to ternary is not sufficiently accurate, augmenting the training with only 1% of the available ternary data (uniformly distributed across the entire range of chemical compositions) improves significantly the quality of the GNN predictions. For comparison, we assess the transferability in the opposite direction by training GNN models on ternary Nb-Ta-V data and making predictions on binaries Nb-Ta, Nb-V, and Ta-V, which exhibits notably higher predictive errors. The proposed methodology, which favors transferability from lower-component to higher-component alloys, offers an efficient path towards avoiding the curse of dimensionality incurred when collecting DFT data for discovery and design of multi-component disordered alloys.

Density functional theory calculations↗

Construction Methodology Transformation for the Benefit of Workforce Development

Construction is a key economic engine driving both national and global economies. While manual, onsite construction methods dominate the U.S. construction industry, a major shift towards offsite methods has been underway due to its efficiency, speed, and potential cost savings. The workforce necessary for offsite construction growth does not exist in its current form because of the focus on onsite methodologies and the lack of exposure to offsite building methods at all levels of a student’s learning journey. The growth of the U.S. construction industry and competitiveness in an increasingly global construction market over the coming decades can only be supported by a dramatic increase in the use of offsite methods, which requires ramping up workforce training for certain skillsets. The goal of Construction Methodology Transformation for the Benefit of Workforce Development was to understand the opportunities and barriers in both education and industry and to identify best practices for offering curriculum and training to educators, industry, and students that would support skills needed for careers in offsite construction. Our team proposed combining three offsite construction workforce development needs: content development, exposure and training, and job placement - under a single Platform model that would increase experience and career opportunities for students and help match them with potential industry members. Through our proposed solution we expected to see: developed offsite curriculum being utilized by educators and students; an increase in the identification of construction technology and offsite construction methods; an average increase in knowledge gain of at least 25% after participation in pilots; better equipped candidates who are prepared for jobs in offsite construction; and a beta workforce development platform that helps build more pathways for students looking for careers in offsite construction. The two pilots included almost 250 students and resulted in an average knowledge gain of 37 percent. Our research has identified areas of opportunity, for both education and industry to make collaborative training programs more efficient and successful. The chosen techniques for this program are extremely effective when both the school and factory have solid processes and cultures in place to accept students into training programs. This project serves as an important stepping stone to industrywide collaboration to move workforce development for offsite construction forward across the country. With continued collaboration programs like this can provide much needed early exposure and training in offsite construction and we can begin to fill important positions for the future of construction.

99 GENERAL AND MISCELLANEOUS↗

Intelligent scenario generation for simulation-based training

A training scenario generator object database was developed to serve as a general-purpose mechanism for constructing the context needed to define a simulation scenario. It is found that the ability to automate the development of the input parameters required to produce a challenging simulation scenario targeted at a specific trainee can greatly enhance the efficiency of intelligent training systems. The approach described was used successfully in the payload-assist module deploy/intelligent computer-aided training system.

Loftin, R. Bowen↗

Wyandotte Integrated Renewable Energy Strategy (WIRES 2) (Final Technical Report)

Wyandotte Municipal Services (WMS), a Michigan Municipal Utility offering electric generation, transmission & distribution, water filtration & distribution and Broadband/Video sought to deploy a set of renewable energy projects for their Electric Utility that contributed to reducing the City’s environmental and energy impact, provided examples that would encourage businesses and citizens to adopt cleaner energy practices and help WMS meet the required renewable energy standards of the State of Michigan (10% in 2015, 15% in 2021). WMS generates and delivers roughly 280,000 megawatt hours (MWh) of electricity annually to more than 10,000 homes and 1,000 businesses within the City of Wyandotte. The Wyandotte Integrated Renewable Energy Strategy – WIRES 2 resulted in deployment of a set of community-scale micro-wind turbines, evaluation and installation of energy-efficient and low-maintenance light-emitting diode (LED) street lights and park lights in highly visible locations in the City and expansion of the geothermal heating and cooling district that already included residential geothermal systems, to include larger scale business/institutional systems at the Utility’s largest electric customer and at the City Library. Finally, WMS identified the need for job training in energy efficiency and renewable energy technologies to further develop a local skilled workforce in these areas. Partially funded by the grant, the wind turbine project provides a benchmark for WMS, local businesses and residents in the evaluation of utility-scale wind v. micro-wind in an urban environment as a renewable energy strategy. Also partially funded by the grant, the LED project benefited the City of Wyandotte by reducing load on the electric system for the public utility but also reduced City costs for streetlighting, parking lot lighting and park lighting without a compromise in security. The project also resulted in a visual success that has led to additional approvals for non-Grant related LED lighting installations resulting in further reduction in the electric load in the City. Commercial Geothermal installations resulted in the Utility being able to eliminate steam customers who formerly utilized the byproduct of steam from WMS electric production. Due to the reduction in natural gas prices and the overall reduction in market purchased power, it was no longer feasible for WMS to operate its Power Plant as a base load plant and to only operate on a market dispatch philosophy when market prices dictated that WMS could produce electricity cheaper than the market purchase price. This has resulted in fewer operating days for the WMS Power Plant, resulting in less environmental impact. WMS has now completely exited the steam business and the ability to offer a geothermal option to two (2) former steam customers (BASF-Wyandotte and the Bacon Memorial Library) allowed for that. In addition, peak loads have been shaved for these two (2) large customers due to the consistent temperature offered by geothermal heating and cooling, reducing the swings associated with thermostat changes caused by outside temperature changes during extreme high and low temperatures. Finally, energy efficiency and renewable energy college-level classes at Wayne County Community College allowed a group of interested students to pursue studies in those technologies through grant provided tuition, books and course materials. This effort provided a foundation of potential future employees not only for WMS but other energy efficiency/renewable energy employers such as Franklin Energy, a partner with WMS in energy optimization efforts with Wyandotte businesses.

17 WIND ENERGY↗

Neural network approaches for parameterized optimal control

Here, we consider numerical approaches for deterministic, finite-dimensional optimal control problems whose dynamics depend on unknown or uncertain parameters. We seek to amortize the solution over a set of relevant parameters in an offline stage to enable rapid decision-making and be able to react to changes in the parameter in the online stage. To tackle the curse of dimensionality arising when the state and/or parameter are high-dimensional, we represent the policy using neural networks. We compare two training paradigms: First, our model-based approach leverages the dynamics and definition of the objective function to learn the value function of the parameterized optimal control problem and obtain the policy using a feedback form. Second, we use actor-critic reinforcement learning to approximate the policy in a data-driven way. Using an example involving a two-dimensional convection-diffusion equation, which features high-dimensional state and parameter spaces, we investigate the accuracy and efficiency of both training paradigms. While both paradigms lead to a reasonable approximation of the policy, the model-based approach is more accurate and considerably reduces the number of PDE solves.

97 MATHEMATICS AND COMPUTING↗

Micromechanical Surrogate Machine Learning Model for Creep Deformation Modeling

Process variability during the manufacture of gas turbine engine hot section components can significantly affect the material’s resulting microstructure. In casting, for instance, geometric variation within a component (thin sections versus thick sections, radial location) influences cooling rates and the resulting grain size. The high temperature creep response is known to be sensitive to grain size owing to a diffusional creep mechanism which occurs more readily along grain boundaries. Microstructural variation correspondingly drives mechanical behavior which propagates into component scale performance uncertainty. These factors are essential when planning inspection, maintenance, and repair strategies within a reliability framework. These benefits provide opportunities to increase overall energy efficiency through refined margins. Critically, there is an opportunity to bolster existing data-driven reliability models using physics-driven process-structure-property relations. Here we present recent work establishing a framework for evaluating the probabilistic creep performance of high-temperature materials. A novel microstructure-sensitive crystal plasticity finite element model is established that captures both grain boundary and crystallographic deformation effects. The computationally expensive physics model is calibrated using a statistical approach and this high-fidelity model is subsequently used to train a computationally efficient machine learning surrogate model. The surrogate model is essential for sampling a large ensemble of simulated structure-property pair results. The ensemble data are then mined to extract salient trends to be incorporated into a microstructure-sensitive reliability model. The proposed approach represents a novel way to capture microstructure-sensitive trends from physics-based models within a modern reliability framework.

Fernandez-Zelaia, Patxi [ORNL]↗

Real-Time and Adaptive Reservoir Computing With Application to Profile Prediction in Fusion Plasma

Nuclear fusion is a promising alternative to address the problem of sustainable energy production. The tokamak is an approach to fusion based on magnetic plasma confinement, constituting a complex physical system with many control challenges. Here we study the characteristics and optimization of reservoir computing (RC) for real-time and adaptive prediction of plasma profiles in the DIII-D tokamak. Our experiments demonstrate that RC achieves comparable results to state-of-the-art (deep) convolutional neural networks (CNNs) and long short-term memory (LSTM) models, with a significantly easier and faster training procedure. This efficient approach allows for fast and frequent adaptation of the model to new situations, such as changing plasma conditions or different fusion devices.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

QUBO formulations for training machine learning models

Abstract Training machine learning models on classical computers is usually a time and compute intensive process. With Moore’s law nearing its inevitable end and an ever-increasing demand for large-scale data analysis using machine learning, we must leverage non-conventional computing paradigms like quantum computing to train machine learning models efficiently. Adiabatic quantum computers can approximately solve NP-hard problems, such as the quadratic unconstrained binary optimization (QUBO), faster than classical computers. Since many machine learning problems are also NP-hard, we believe adiabatic quantum computers might be instrumental in training machine learning models efficiently in the post Moore’s law era. In order to solve problems on adiabatic quantum computers, they must be formulated as QUBO problems, which is very challenging. In this paper, we formulate the training problems of three machine learning models—linear regression, support vector machine (SVM) and balanced k-means clustering—as QUBO problems, making them conducive to be trained on adiabatic quantum computers. We also analyze the computational complexities of our formulations and compare them to corresponding state-of-the-art classical approaches. We show that the time and space complexities of our formulations are better (in case of SVM and balanced k-means clustering) or equivalent (in case of linear regression) to their classical counterparts.

97 MATHEMATICS AND COMPUTING↗

ReLIC: Full-Scale Realization of Reinforcement Learning for Infrastructure Control

Prior efforts have shown that deep reinforcement learning (DRL) may provide a new method for controlling networked power systems. Though successful, prior approaches have not yet demonstrated their behavior on systems of realistic scale. This effort examined multiple theoretical and technical approaches to allow a DRL model to operate over a system of 2,000 buses or more. We find that allowing the DRL models to run training episodes in parallel provides near limitless efficiency gains, allowing us to train successful agents to behave on our Kuramoto transmission model of up to 4,000 buses. We further show that we can expand our PowerWorld DRL implementation to systems of up to 25 buses but struggle to go beyond this limit due to PowerWorld’s inability to run multiple instances at once. Finally, we examine a multi-agent approach and find that it performs as well if not better than our existing centralized approach.

97 MATHEMATICS AND COMPUTING↗

Efficient quantum state tomography with mode-assisted training

Neural networks (NNs) representing quantum states are typically trained using Markov chain Monte Carlo based methods. However, unless specifically designed, such samplers only consist of local moves, making the slow-mixing problem prominent even for extremely simple quantum states. Here, we propose to use mode-assisted training that provides global information via the modes of the NN distribution. Further, applied to quantum state tomography using restricted Boltzmann machines, this method improves the quality of reconstructed quantum states by orders of magnitude. The method is applicable to other types of NNs and may efficiently tackle problems previously unmanageable.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Active learning strategy for high fidelity short-term data-driven building energy forecasting

The quality of a data-driven model is heavily dependent on the quality of data. Data from building operation often have data bias problems, which means that the data sample is collected in a way that some members of the intended data population are less likely to be included than others. Data-driven energy forecasting models built on such data hence are biased and could lead to large forecasting errors. Active learning—an effective method to defying data bias—is rarely studied or applied in the area of data-driven building energy forecasting modeling. This paper attempts to fill this gap and explores the application of active learning in data-driven building energy forecasting. The developed strategy in this paper efficiently generate informative training data within a time budget and uses block design to passively consider weather disturbances. The developed active learning strategy is applied and evaluated in both virtual and real-building testbeds against traditional data-driven methods. Via these virtual and real-building evaluation cases, we have demonstrated that the data bias problem typically exists in building operation data is resolved by applying the developed active learning strategy. Furthermore, building energy forecasting models trained from data generated from the active learning strategy have shown improved performances in both model accuracy and model extendibility perspectives. The effectiveness of the block design module is also validated to effectively consider the impact of weather conditions on active learning design.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A pulsed current-mode class-D low-voltage high-bandwidth power amplifier for portable NMR systems

Low-field NMR has seen growing interest in recent years, especially for portable applications. The lower homogeneity magnets used for portable applications require short RF pulses to ensure enough transmit bandwidth to excite the sample volume and also support short echo periods. Furthermore, the preferred use of a high-Q coil to improve signal-to-noise ratio (SNR) prolongs the pulse transients. Thus, at such low Larmor frequencies, the excitation pulse transients become comparable or longer than the pulse length, such that the transmit bandwidth begins to limit measurement SNR. This paper describes the design of a pulsed current-mode class-D power (PCMCD) transmitter that addresses this issue by generating high power in a tuned sample coil while maintaining short transients, thus resulting in high output bandwidth. The transmitter also uses a charge recycling mechanism to maximize power efficiency for RF train excitation, which also results in faster pulse repetition rate and reduces allowable echo time. In this work, experimental results from a small form-factor PCMCD transmitter are presented. This design generates a peak RF power of 240 W into a 9.16 µH coil at 4 MHz while operating off a single 12 V power supply. NMR measurement results using the transmitter are also described, showing minimum achievable echo time of 70 µs and 25 µs depending on the transmitter mode of operation.

47 OTHER INSTRUMENTATION↗

Defect Diffusion Graph Neural Networks for Materials Discovery in High-Temperature Energy Applications

Here, the migration of crystallographic defects dictates material properties and performance for a plethora of technological applications. Density functional theory (DFT)-based nudged elastic band (NEB) calculations are a powerful computational technique for predicting defect migration activation energy barriers, yet they become prohibitively expensive for high-throughput screening of defect diffusivities. Without introducing hand-crafted (i.e., chemistry- or structure-specific) descriptors, we propose a generalized deep learning approach to train surrogate models for NEB energies of vacancy migration by hybridizing graph neural networks with transformer encoders and simply using pristine host structures as input. With sufficient training data, computationally efficient and simultaneous inference of vacancy defect thermodynamics and migration activation energies can be obtained to compute temperature-dependent vacancy diffusivities and to down-select candidates for more thorough DFT analysis or experiments. Thus, as we specifically demonstrate for potential water-splitting materials, candidates with desired defect thermodynamics, kinetics, and host stability properties can be more rapidly targeted from open-source databases of experimentally validated or hypothetical materials.

14 SOLAR ENERGY↗

Transfer Learning Meets Embedded Correlated Wavefunction Theory for Chemically Accurate Molecular Simulations: Application to Calcium Carbonate Ion Pairing

Achieving chemical accuracy for molecular simulations remains a central challenge in computational chemistry. Here, we present an embedded correlated wavefunction transfer learning (ECW-TL) framework for accurately simulating molecular dynamics in the condensed phase. ECW-TL incorporates high-level electron exchange and correlation effects in ECW theory while preserving the training and computational efficiency of machine-learned interatomic potentials. We demonstrate the framework on Ca 2+ –CO 3 2– ion pairing in aqueous solution, a key process underlying CO 2 mineralization in seawater. As proof of principle, we first show that fine-tuning a DFT-revPBE-D3(BJ) baseline model with embedded-DFT-SCAN data reproduces the DFT-SCAN free-energy surface within 1 kcal/mol across all solvation states. Extending the framework to embedded MP2 and localized natural-orbital CCSD(T) further refines the free-energy profile, revealing the crucial role of exact electron exchange and correlation in determining ion-pair stability and structure. The computed ion-pair association free energy is in quantitative agreement with experimental measurements, further validating the accuracy of the ECW-TL framework. ECW-TL thus provides a general, data-efficient route for transferring CW accuracy to efficient simulations of complex aqueous and interfacial chemical processes.

cluster chemistry↗

Unsupervised learning-enabled pulsed infrared thermographic microscopy of subsurface defects in stainless steel

Metallic structures produced with laser powder bed fusion (LPBF) additive manufacturing method (AM) frequently contain microscopic porosity defects, with typical approximate size distribution from one to 100 microns. Presence of such defects could lead to premature failure of the structure. In principle, structural integrity assessment of LPBF metals can be accomplished with nondestructive evaluation (NDE). Pulsed infrared thermography (PIT) is a non-contact, one-sided NDE method that allows for imaging of internal defects in arbitrary size and shape metallic structures using heat transfer. PIT imaging is performed using compact instrumentation consisting of a flash lamp for deposition of a heat pulse, and a fast frame infrared (IR) camera for measuring surface temperature transients. However, limitations of imaging resolution with PIT include blurring due to heat diffusion, sensitivity limit of the IR camera. We demonstrate enhancement of PIT imaging capability with unsupervised learning (UL), which enables PIT microscopy of subsurface defects in high strength corrosion resistant stainless steel 316 alloy. PIT images were processed with UL spatial–temporal separation-based clustering segmentation (STSCS) algorithm, refined by morphology image processing methods to enhance visibility of defects. The STSCS algorithm starts with wavelet decomposition to spatially de-noise thermograms, followed by UL principal component analysis (PCA), fine-tuning optimization, and neural learning-based independent component analysis (ICA) algorithms to temporally compress de-noised thermograms. The compressed thermograms were further processed with UL-based graph thresholding K-means clustering algorithm for defects segmentation. The STSCS algorithm also includes online learning feature for efficient re-training of the model with new data. For this study, metallic specimens with calibrated microscopic flat bottom hole defects, with diameters in the range from 203 to 76 µm, were produced using electro discharge machining (EDM) drilling. While the raw thermograms do not show any material defects, using STSCS algorithm to process PIT images reveals defects as small as 101 µm in diameter. To the best of our knowledge, this is the smallest reported size of a sub-surface defect in a metal imaged with PIT, which demonstrates the PIT capability of detecting defects in the size range relevant to quality control requirements of LPBF-printed high-strength metals.

36 MATERIALS SCIENCE↗

Developing reliable machine learning interatomic potential for Fe–Cr–Ni austenitic alloys

Gaining atomistic understanding of mechanical behavior of heat-resistant structural materials such as Fe–Cr–Ni-based alloys requires an approach with an accuracy close to density functional theory (DFT) that considers the intrinsic properties of the bulk lattice and important defects such as stacking faults, grain boundaries, and surfaces. This work aims to develop reliable machine learning interatomic potential (MLIAP) at cross-scale for Fe–Cr–Ni ternary alloys with a focus on the face-centered-cubic (fcc) solid solution structure. Leveraging the advantages of moment tensor potentials, which typically necessitate a relatively small training dataset and enable rapid calculations using the large-scale atomic/molecular massively parallel simulator package, we ensure the stability and accuracy of the trained potentials. Important defects such as stacking faults, grain boundaries, and surfaces for wide-range compositions are investigated. Structural, thermal, elastic, and defect properties are determined from molecular dynamics simulations comprising several thousand atoms, generated via canonical Monte Carlo simulations guided by the trained potential. The trained potential allows efficient atomic simulations of structural, thermal, and mechanical properties of fcc Fe–Cr–Ni solid solution alloys as a function of composition and temperature. Therefore, the MLIAP approach represents a major advancement from DFT calculations that are limited to small simulation sizes and traditional molecular dynamics simulations using relatively low accuracy potentials. Furthermore, this work outlines a practical foundation for further investigating the structural evolution and mechanical behavior of austenitic stainless steel and nickel-based alloys in a wide array of applications in extreme environments.

Crystal structure↗

Noise-Resilient Quantum Machine Learning for Stability Assessment of Power Systems

Transient stability assessment (TSA) is a cornerstone for resilient operations of todays interconnected power grids. This paper is a confluence of quantum computing, data science and machine learning to potentially address the power system TSA issue. Here, we devise a quantum TSA (QTSA) method to enable scalable and efficient data-driven transient stability prediction for bulk power systems, which is the first attempt to tackle the TSA issue with quantum computing. Our contributions are three-fold: 1) A high expressibility, low-depth (HELD) quantum circuit is designed for accurate and noise-resilient TSA; 2) A quantum natural gradient descent algorithm is developed for efficient HELD circuit training; 3) A systematical analysis on QTSAs performance under various quantum factors is per-formed. QTSA underpins a foundation of quantum-enabled and data-driven power grid stability analytics. It renders the intractable TSA straightforward and effortless in the Hilbert space, and therefore provides stability information for power system operations. Extensive experiments on quantum simulators and real quantum computers verify the accuracy, noise-resilience, scalability and universality of QTSA.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Uncertainty Quantification of Fatigue Behavior of Rough AM Surfaces and Microstructures to Enable Hydrogen Gas Turbine Combustion

Modification of fossil-fueled industrial gas turbines to accept no/low carbon fuels (Hydrogen, H2/natural gas blends) is a significant undertaking. Successful deployment of this technology sits at the intersection of three design criteria (1) new functional fuel injectors that can burn these fuels, (2) manufacturability to meet cost and time-to-market targets, and (3) durability in the harsh environment of an operating turbine. Additive manufacturing (AM) provides accelerated product development. However, uncertainty remains around the durability of parts with rough AM surfaces. A fully experimental approach towards quantifying fatigue performance of rough AM microstructures is costly and laborious. Instead, Solar Turbines Incorporated (Solar) proposes the use of a crystal plasticity finite element (CPFE) model to quantify the factors that drive AM surface fatigue behavior. Solar will use the CPFE results, along with targeted experimental data, to train a computationally efficient surrogate model that can be incorporated into existing turbine part lifing methods.

08 HYDROGEN↗