Search NASA⌕ Search

SEARCH · Search NASA

Results for “training efficiency”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Final Report for ARPA-E LOCOMOTIVES Advanced Locomotive Technology and Rail Infrastructure Optimization System (ALTRIOS) Project

The Advanced Locomotive Technology and Rail Infrastructure Optimization System (ALTRIOS) is a unique, fully integrated, open-source software tool used to evaluate strategies for cost-effectively deploying advanced locomotive technologies and associated infrastructure. ALTRIOS simulates freight-demand-driven train scheduling, mainline meet-pass planning, locomotive dynamics, train dynamics, energy conversion efficiencies, and energy storage dynamics of line-haul train operations. Because new locomotives represent a significant long-term capital investment and new technologies must be thoroughly demonstrated before deployment, this tool provides guidance on the risk/reward trade-offs and operation integration of different technology rollout strategies. An open, integrated simulation tool is valuable for identifying future research needs and making decisions on technology development, routes, and train selection. This final report details the ALTRIOS software architecture, major modules and components, and data validation process. It demonstrates the software's utility through a 30-year rollout case study targeting high penetration of advanced powertrain technologies by 2050 for two BNSF Railway routes: loaded taconite ore trains from Hibbing, Minnesota, to Superior, Wisconsin, and mixed-freight trains from Superior to Minneapolis, Minnesota.

33 ADVANCED PROPULSION SYSTEMS↗

Patch2Self2: Self-supervised Denoising on Coresets via Matrix Sketching

Diffusion MRI (dMRI) non-invasively maps brain white matter yet necessitates denoising due to low signal-to-noise ratios. Patch2Self (P2S) employing self-supervised techniques and regression on a Casorati matrix effectively denoises dMRI images and has become the new de-facto standard in this field. P2S however is resource intensive both in terms of running time and memory usage as it uses all voxels (n) from all-but-one held-in volumes (d-1) to learn a linear mapping Phi : \mathbb R ^ n x(d-1) \mapsto \mathbb R ^ n for denoising the held-out volume. The increasing size and dimensionality of higher resolution dMRI acquisitions can make P2S infeasible for large-scale analyses. This work exploits the redundancy imposed by P2S to alleviate its performance issues and inspect regions that influence the noise disproportionately. Specifically this study makes a three-fold contribution: (1) We present Patch2Self2 (P2S2) a method that uses matrix sketching to perform self-supervised denoising. By solving a sub-problem on a smaller sub-space so called coreset we show how P2S2 can yield a significant speedup in training time while using less memory. (2) We present a theoretical analysis of P2S2 focusing on determining the optimal sketch size through rank estimation a key step in achieving a balance between denoising accuracy and computational efficiency. (3) We show how the so-called statistical leverage scores can be used to interpret the denoising of dMRI data a process that was traditionally treated as a black-box. Experimental results on both simulated and real data affirm that P2S2 maintains denoising quality while significantly enhancing speed and memory efficiency achieved by training on a reduced data subset.

Fadnavis, Shreyas↗

Training Data Regarding Optimal Power Flow For Efficient Machine Learning

The code is intended to take the data outputted by the MATPOWER OPF solver tools and restructures the data in a way that is best suited for machine learning. The variables are read and the desired values are taken and added to an array in the correct format. This array is then converted into a python array for future use. The code also utilizes MATPOWER's ability to construct different power flow scenarios and repeat them a chosen number of times. Each iteration will add a new line to the formatted array so that the final output is a matrix has a height equal to the number of repetition used.

Seidel, RachaelI↗

Transferable predictions of energetic and structural properties for refractory solid solution alloys across chemical compositions

We present a data-efficient approach to train graph neural networks (GNNs) on density functional theory (DFT) data for accurate and transferable predictions of energetic and structural properties of refractory solid solution alloys in the niobium-tantalum-vanadium (Nb-Ta-V) chemical space. We start by training the GNN model only on DFT data that describes refractory binary alloys niobium-tantalum (Nb-Ta), niobium-vanadium (Nb-V), and tantalum-vanadium (Ta-V) to predict formation enthalpy and root mean squared displacement. Once trained, the GNN predictions are tested on DFT data describing refractory ternary alloys Nb-Ta-V. While, unsurprisingly, direct transferability from binary to ternary is not sufficiently accurate, augmenting the training with only 1% of the available ternary data (uniformly distributed across the entire range of chemical compositions) improves significantly the quality of the GNN predictions. For comparison, we assess the transferability in the opposite direction by training GNN models on ternary Nb-Ta-V data and making predictions on binaries Nb-Ta, Nb-V, and Ta-V, which exhibits notably higher predictive errors. The proposed methodology, which favors transferability from lower-component to higher-component alloys, offers an efficient path towards avoiding the curse of dimensionality incurred when collecting DFT data for discovery and design of multi-component disordered alloys.

Density functional theory calculations↗

Construction Methodology Transformation for the Benefit of Workforce Development

Construction is a key economic engine driving both national and global economies. While manual, onsite construction methods dominate the U.S. construction industry, a major shift towards offsite methods has been underway due to its efficiency, speed, and potential cost savings. The workforce necessary for offsite construction growth does not exist in its current form because of the focus on onsite methodologies and the lack of exposure to offsite building methods at all levels of a student’s learning journey. The growth of the U.S. construction industry and competitiveness in an increasingly global construction market over the coming decades can only be supported by a dramatic increase in the use of offsite methods, which requires ramping up workforce training for certain skillsets. The goal of Construction Methodology Transformation for the Benefit of Workforce Development was to understand the opportunities and barriers in both education and industry and to identify best practices for offering curriculum and training to educators, industry, and students that would support skills needed for careers in offsite construction. Our team proposed combining three offsite construction workforce development needs: content development, exposure and training, and job placement - under a single Platform model that would increase experience and career opportunities for students and help match them with potential industry members. Through our proposed solution we expected to see: developed offsite curriculum being utilized by educators and students; an increase in the identification of construction technology and offsite construction methods; an average increase in knowledge gain of at least 25% after participation in pilots; better equipped candidates who are prepared for jobs in offsite construction; and a beta workforce development platform that helps build more pathways for students looking for careers in offsite construction. The two pilots included almost 250 students and resulted in an average knowledge gain of 37 percent. Our research has identified areas of opportunity, for both education and industry to make collaborative training programs more efficient and successful. The chosen techniques for this program are extremely effective when both the school and factory have solid processes and cultures in place to accept students into training programs. This project serves as an important stepping stone to industrywide collaboration to move workforce development for offsite construction forward across the country. With continued collaboration programs like this can provide much needed early exposure and training in offsite construction and we can begin to fill important positions for the future of construction.

99 GENERAL AND MISCELLANEOUS↗

Wyandotte Integrated Renewable Energy Strategy (WIRES 2) (Final Technical Report)

Wyandotte Municipal Services (WMS), a Michigan Municipal Utility offering electric generation, transmission & distribution, water filtration & distribution and Broadband/Video sought to deploy a set of renewable energy projects for their Electric Utility that contributed to reducing the City’s environmental and energy impact, provided examples that would encourage businesses and citizens to adopt cleaner energy practices and help WMS meet the required renewable energy standards of the State of Michigan (10% in 2015, 15% in 2021). WMS generates and delivers roughly 280,000 megawatt hours (MWh) of electricity annually to more than 10,000 homes and 1,000 businesses within the City of Wyandotte. The Wyandotte Integrated Renewable Energy Strategy – WIRES 2 resulted in deployment of a set of community-scale micro-wind turbines, evaluation and installation of energy-efficient and low-maintenance light-emitting diode (LED) street lights and park lights in highly visible locations in the City and expansion of the geothermal heating and cooling district that already included residential geothermal systems, to include larger scale business/institutional systems at the Utility’s largest electric customer and at the City Library. Finally, WMS identified the need for job training in energy efficiency and renewable energy technologies to further develop a local skilled workforce in these areas. Partially funded by the grant, the wind turbine project provides a benchmark for WMS, local businesses and residents in the evaluation of utility-scale wind v. micro-wind in an urban environment as a renewable energy strategy. Also partially funded by the grant, the LED project benefited the City of Wyandotte by reducing load on the electric system for the public utility but also reduced City costs for streetlighting, parking lot lighting and park lighting without a compromise in security. The project also resulted in a visual success that has led to additional approvals for non-Grant related LED lighting installations resulting in further reduction in the electric load in the City. Commercial Geothermal installations resulted in the Utility being able to eliminate steam customers who formerly utilized the byproduct of steam from WMS electric production. Due to the reduction in natural gas prices and the overall reduction in market purchased power, it was no longer feasible for WMS to operate its Power Plant as a base load plant and to only operate on a market dispatch philosophy when market prices dictated that WMS could produce electricity cheaper than the market purchase price. This has resulted in fewer operating days for the WMS Power Plant, resulting in less environmental impact. WMS has now completely exited the steam business and the ability to offer a geothermal option to two (2) former steam customers (BASF-Wyandotte and the Bacon Memorial Library) allowed for that. In addition, peak loads have been shaved for these two (2) large customers due to the consistent temperature offered by geothermal heating and cooling, reducing the swings associated with thermostat changes caused by outside temperature changes during extreme high and low temperatures. Finally, energy efficiency and renewable energy college-level classes at Wayne County Community College allowed a group of interested students to pursue studies in those technologies through grant provided tuition, books and course materials. This effort provided a foundation of potential future employees not only for WMS but other energy efficiency/renewable energy employers such as Franklin Energy, a partner with WMS in energy optimization efforts with Wyandotte businesses.

17 WIND ENERGY↗

Neural network approaches for parameterized optimal control

Here, we consider numerical approaches for deterministic, finite-dimensional optimal control problems whose dynamics depend on unknown or uncertain parameters. We seek to amortize the solution over a set of relevant parameters in an offline stage to enable rapid decision-making and be able to react to changes in the parameter in the online stage. To tackle the curse of dimensionality arising when the state and/or parameter are high-dimensional, we represent the policy using neural networks. We compare two training paradigms: First, our model-based approach leverages the dynamics and definition of the objective function to learn the value function of the parameterized optimal control problem and obtain the policy using a feedback form. Second, we use actor-critic reinforcement learning to approximate the policy in a data-driven way. Using an example involving a two-dimensional convection-diffusion equation, which features high-dimensional state and parameter spaces, we investigate the accuracy and efficiency of both training paradigms. While both paradigms lead to a reasonable approximation of the policy, the model-based approach is more accurate and considerably reduces the number of PDE solves.

97 MATHEMATICS AND COMPUTING↗

Micromechanical Surrogate Machine Learning Model for Creep Deformation Modeling

Process variability during the manufacture of gas turbine engine hot section components can significantly affect the material’s resulting microstructure. In casting, for instance, geometric variation within a component (thin sections versus thick sections, radial location) influences cooling rates and the resulting grain size. The high temperature creep response is known to be sensitive to grain size owing to a diffusional creep mechanism which occurs more readily along grain boundaries. Microstructural variation correspondingly drives mechanical behavior which propagates into component scale performance uncertainty. These factors are essential when planning inspection, maintenance, and repair strategies within a reliability framework. These benefits provide opportunities to increase overall energy efficiency through refined margins. Critically, there is an opportunity to bolster existing data-driven reliability models using physics-driven process-structure-property relations. Here we present recent work establishing a framework for evaluating the probabilistic creep performance of high-temperature materials. A novel microstructure-sensitive crystal plasticity finite element model is established that captures both grain boundary and crystallographic deformation effects. The computationally expensive physics model is calibrated using a statistical approach and this high-fidelity model is subsequently used to train a computationally efficient machine learning surrogate model. The surrogate model is essential for sampling a large ensemble of simulated structure-property pair results. The ensemble data are then mined to extract salient trends to be incorporated into a microstructure-sensitive reliability model. The proposed approach represents a novel way to capture microstructure-sensitive trends from physics-based models within a modern reliability framework.

Fernandez-Zelaia, Patxi [ORNL]↗

Real-Time and Adaptive Reservoir Computing With Application to Profile Prediction in Fusion Plasma

Nuclear fusion is a promising alternative to address the problem of sustainable energy production. The tokamak is an approach to fusion based on magnetic plasma confinement, constituting a complex physical system with many control challenges. Here we study the characteristics and optimization of reservoir computing (RC) for real-time and adaptive prediction of plasma profiles in the DIII-D tokamak. Our experiments demonstrate that RC achieves comparable results to state-of-the-art (deep) convolutional neural networks (CNNs) and long short-term memory (LSTM) models, with a significantly easier and faster training procedure. This efficient approach allows for fast and frequent adaptation of the model to new situations, such as changing plasma conditions or different fusion devices.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

QUBO formulations for training machine learning models

Abstract Training machine learning models on classical computers is usually a time and compute intensive process. With Moore’s law nearing its inevitable end and an ever-increasing demand for large-scale data analysis using machine learning, we must leverage non-conventional computing paradigms like quantum computing to train machine learning models efficiently. Adiabatic quantum computers can approximately solve NP-hard problems, such as the quadratic unconstrained binary optimization (QUBO), faster than classical computers. Since many machine learning problems are also NP-hard, we believe adiabatic quantum computers might be instrumental in training machine learning models efficiently in the post Moore’s law era. In order to solve problems on adiabatic quantum computers, they must be formulated as QUBO problems, which is very challenging. In this paper, we formulate the training problems of three machine learning models—linear regression, support vector machine (SVM) and balanced k-means clustering—as QUBO problems, making them conducive to be trained on adiabatic quantum computers. We also analyze the computational complexities of our formulations and compare them to corresponding state-of-the-art classical approaches. We show that the time and space complexities of our formulations are better (in case of SVM and balanced k-means clustering) or equivalent (in case of linear regression) to their classical counterparts.

97 MATHEMATICS AND COMPUTING↗

ReLIC: Full-Scale Realization of Reinforcement Learning for Infrastructure Control

Prior efforts have shown that deep reinforcement learning (DRL) may provide a new method for controlling networked power systems. Though successful, prior approaches have not yet demonstrated their behavior on systems of realistic scale. This effort examined multiple theoretical and technical approaches to allow a DRL model to operate over a system of 2,000 buses or more. We find that allowing the DRL models to run training episodes in parallel provides near limitless efficiency gains, allowing us to train successful agents to behave on our Kuramoto transmission model of up to 4,000 buses. We further show that we can expand our PowerWorld DRL implementation to systems of up to 25 buses but struggle to go beyond this limit due to PowerWorld’s inability to run multiple instances at once. Finally, we examine a multi-agent approach and find that it performs as well if not better than our existing centralized approach.

97 MATHEMATICS AND COMPUTING↗

Efficient quantum state tomography with mode-assisted training

Neural networks (NNs) representing quantum states are typically trained using Markov chain Monte Carlo based methods. However, unless specifically designed, such samplers only consist of local moves, making the slow-mixing problem prominent even for extremely simple quantum states. Here, we propose to use mode-assisted training that provides global information via the modes of the NN distribution. Further, applied to quantum state tomography using restricted Boltzmann machines, this method improves the quality of reconstructed quantum states by orders of magnitude. The method is applicable to other types of NNs and may efficiently tackle problems previously unmanageable.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Active learning strategy for high fidelity short-term data-driven building energy forecasting

The quality of a data-driven model is heavily dependent on the quality of data. Data from building operation often have data bias problems, which means that the data sample is collected in a way that some members of the intended data population are less likely to be included than others. Data-driven energy forecasting models built on such data hence are biased and could lead to large forecasting errors. Active learning—an effective method to defying data bias—is rarely studied or applied in the area of data-driven building energy forecasting modeling. This paper attempts to fill this gap and explores the application of active learning in data-driven building energy forecasting. The developed strategy in this paper efficiently generate informative training data within a time budget and uses block design to passively consider weather disturbances. The developed active learning strategy is applied and evaluated in both virtual and real-building testbeds against traditional data-driven methods. Via these virtual and real-building evaluation cases, we have demonstrated that the data bias problem typically exists in building operation data is resolved by applying the developed active learning strategy. Furthermore, building energy forecasting models trained from data generated from the active learning strategy have shown improved performances in both model accuracy and model extendibility perspectives. The effectiveness of the block design module is also validated to effectively consider the impact of weather conditions on active learning design.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A pulsed current-mode class-D low-voltage high-bandwidth power amplifier for portable NMR systems

Low-field NMR has seen growing interest in recent years, especially for portable applications. The lower homogeneity magnets used for portable applications require short RF pulses to ensure enough transmit bandwidth to excite the sample volume and also support short echo periods. Furthermore, the preferred use of a high-Q coil to improve signal-to-noise ratio (SNR) prolongs the pulse transients. Thus, at such low Larmor frequencies, the excitation pulse transients become comparable or longer than the pulse length, such that the transmit bandwidth begins to limit measurement SNR. This paper describes the design of a pulsed current-mode class-D power (PCMCD) transmitter that addresses this issue by generating high power in a tuned sample coil while maintaining short transients, thus resulting in high output bandwidth. The transmitter also uses a charge recycling mechanism to maximize power efficiency for RF train excitation, which also results in faster pulse repetition rate and reduces allowable echo time. In this work, experimental results from a small form-factor PCMCD transmitter are presented. This design generates a peak RF power of 240 W into a 9.16 µH coil at 4 MHz while operating off a single 12 V power supply. NMR measurement results using the transmitter are also described, showing minimum achievable echo time of 70 µs and 25 µs depending on the transmitter mode of operation.

47 OTHER INSTRUMENTATION↗

Defect Diffusion Graph Neural Networks for Materials Discovery in High-Temperature Energy Applications

Here, the migration of crystallographic defects dictates material properties and performance for a plethora of technological applications. Density functional theory (DFT)-based nudged elastic band (NEB) calculations are a powerful computational technique for predicting defect migration activation energy barriers, yet they become prohibitively expensive for high-throughput screening of defect diffusivities. Without introducing hand-crafted (i.e., chemistry- or structure-specific) descriptors, we propose a generalized deep learning approach to train surrogate models for NEB energies of vacancy migration by hybridizing graph neural networks with transformer encoders and simply using pristine host structures as input. With sufficient training data, computationally efficient and simultaneous inference of vacancy defect thermodynamics and migration activation energies can be obtained to compute temperature-dependent vacancy diffusivities and to down-select candidates for more thorough DFT analysis or experiments. Thus, as we specifically demonstrate for potential water-splitting materials, candidates with desired defect thermodynamics, kinetics, and host stability properties can be more rapidly targeted from open-source databases of experimentally validated or hypothetical materials.

14 SOLAR ENERGY↗

Transfer Learning Meets Embedded Correlated Wavefunction Theory for Chemically Accurate Molecular Simulations: Application to Calcium Carbonate Ion Pairing

Achieving chemical accuracy for molecular simulations remains a central challenge in computational chemistry. Here, we present an embedded correlated wavefunction transfer learning (ECW-TL) framework for accurately simulating molecular dynamics in the condensed phase. ECW-TL incorporates high-level electron exchange and correlation effects in ECW theory while preserving the training and computational efficiency of machine-learned interatomic potentials. We demonstrate the framework on Ca 2+ –CO 3 2– ion pairing in aqueous solution, a key process underlying CO 2 mineralization in seawater. As proof of principle, we first show that fine-tuning a DFT-revPBE-D3(BJ) baseline model with embedded-DFT-SCAN data reproduces the DFT-SCAN free-energy surface within 1 kcal/mol across all solvation states. Extending the framework to embedded MP2 and localized natural-orbital CCSD(T) further refines the free-energy profile, revealing the crucial role of exact electron exchange and correlation in determining ion-pair stability and structure. The computed ion-pair association free energy is in quantitative agreement with experimental measurements, further validating the accuracy of the ECW-TL framework. ECW-TL thus provides a general, data-efficient route for transferring CW accuracy to efficient simulations of complex aqueous and interfacial chemical processes.

cluster chemistry↗