Search NASA⌕ Search

SEARCH · Search NASA

Results for “machine learning optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Training NuGraph2 for ICARUS

This presentation describes the process of training NuGraph2, a Graphical Neural Network for event reconstruction, on simulated ICARUS neutrino event data. This began with an investigation into filtering ICARUS spacepoint data. Then NuGraph2 was repeatedly trained on three event samples, which were used for finding optimized machine-learning parameters and to find and fix the causes of several crashes in NuGraph2 s preprocessing and training scripts.

43 PARTICLE ACCELERATORS↗
DOE OSTI2023

An intelligent Data Delivery Service for and beyond the ATLAS experiment

The intelligent Data Delivery Service (iDDS) has been developed to cope with the huge increase of computing and storage resource usage in the coming LHC data taking. It has been designed to intelligently orchestrate workflows and data management systems, decoupling data pre-processing, delivery, and primary processing in large scale workflows. It is an experiment-agnostic service that has been deployed to serve data carousel (orchestrating efficient processing of tape-resident data), machine learning hyperparameter optimization, active learning, and other complex multi-stage workflows defined via DAG (Directed Acyclic Graph), CWL (Common Workflow Language) and other descriptions, including a growing number of analysis workflows. We will at first introduce some deployed use cases in a summary. Then we will focus on new improvements and use cases under developments in ATLAS, Rubin Observatory and sPHENIX, together with future efforts.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Ps and Qs: Quantization-Aware Pruning for Efficient Low Latency Neural Network Inference

Efficient machine learning implementations optimized for inference in hardware have wide-ranging benefits, depending on the application, from lower inference latency to higher data throughput and reduced energy consumption. Two popular techniques for reducing computation in neural networks are pruning, removing insignificant synapses, and quantization, reducing the precision of the calculations. In this work, we explore the interplay between pruning and quantization during the training of neural networks for ultra low latency applications targeting high energy physics use cases. Techniques developed for this study have potential applications across many other domains. We study various configurations of pruning during quantization-aware training, which we term quantization-aware pruning, and the effect of techniques like regularization, batch normalization, and different pruning schemes on performance, computational complexity, and information content metrics. We find that quantization-aware pruning yields more computationally efficient models than either pruning or quantization alone for our task. Further, quantization-aware pruning typically performs similar to or better in terms of computational efficiency compared to other neural architecture search techniques like Bayesian optimization. Surprisingly, while networks with different training configurations can have similar performance for the benchmark application, the information content in the network can vary significantly, affecting its generalizability.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Impact of Color Space and Color Resolution on Vehicle Recognition Models

In this study, we analyze both linear and nonlinear color mappings by training on versions of a curated dataset collected in a controlled campus environment. We experiment with color space and color resolution to assess model performance in vehicle recognition tasks. Color encodings can be designed in principle to highlight certain vehicle characteristics or compensate for lighting differences when assessing potential matches to previously encountered objects. The dataset used in this work includes imagery gathered under diverse environmental conditions, including daytime and nighttime lighting. Experimental results inform expectations for possible improvements with automatic color space selection through feature learning. Moreover, we find there is only a gradual decrease in model performance with degraded color resolution, which suggests the need for simplified data collection and processing. By focusing on the most critical features, we could see improved model generalization and robustness, as the model becomes less prone to overfitting to noise or irrelevant details in the data. Such a reduction in resolution will lower computational complexity, leading to quicker training and inference times.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Cooperation in Transmission Expansion Planning: Enhancing Grid Reliability and Efficiency Under a Changing Climate

Electricity grids are challenged to maintain reliability during more intense and frequent extreme weather events due to climate change. This challenge is exacerbated by multi-sector electrification and power sector decarbonization through increased reliance on variable renewable energy, which necessitates the expansion of transmission infrastructure. However, transmission expansion planning is often complicated by intertwined planning authorities and jurisdictions, and allocation of large capital investment needs. These factors cause authorities to manage transmission investments individually (i.e., only/mostly intraregional planning), which can lead to suboptimal transmission networks. This study investigates the potential benefits of cooperative transmission expansion planning (i.e., both intraregional and interregional planning that optimizes transmission investments across the entire physical system). Using sectoral and economic optimization, and machine learning models, it analyzes the impact of different levels of cooperation among transmission planning regions within U.S. Western Interconnection in 2019 and 2059 via an iterative investment process. Furthermore, it examines the effects of future climate change on transmission cooperation by simulating historical heat waves from 2019 under conditions of 2059. The results indicate that cooperative transmission planning leads to lower wholesale electricity prices, decreased energy outages, and reduced greenhouse gas emissions. However, the advantages of collaboration diminish during widespread heat waves, despite remaining beneficial especially for regions like California Independent System Operator with substantial solar installations. The study underscores the importance of transmission cooperation in reducing costs and enhancing reliability, emphasizing the need for strategic investments in storage to address challenges posed by future extreme weather events with varying spatial scales.

Capacity Expansion Model↗
DOE OSTI2024

Collaborative Design of Robust Adaptation Pathways for Urban Flooding Resilience in Baltimore

Urban pluvial flooding poses a growing threat to the city of Baltimore, driven by changes in climate and rainfall, increased impervious area, aging infrastructure, and severe social inequity. Adaptations to urban flooding should strengthen community-scale resilience while navigating the uncertainties associated with future actions. However, the highly uncertain future climate and conflicting stakeholder objectives complicate the selection of effective and socially acceptable strategies. This study addresses these challenges through a community-informed Multi Objective Robust Decision Making (MORDM) process, coupled with Dynamic Adaptation Policy Pathways (DAPP). Community stakeholders are engaged on a large scale through community partnerships, including priority identification sessions, focus groups, and metric identification workshops. The combination of community partnership, MORDM, and DAPP will create an original set of adaptation pathways which are aligned with community goals and values, and furthermore are adjustable under changing future constraints and conditions. This framework will enhance the city's capacity to respond to evolving pluvial flood conditions while accounting for diverse stakeholder interests and will provide guidance for addressing both the immediate and long-term challenges of urban flooding in Baltimore.

BSEC↗
DOE OSTI2026

Application of Machine Learning to Improve Biobased Glucaric Acid Production: Cooperative Research and Development Final Report, CRADA Number CRD-20-17260

The Agile Biofoundry (ABF) is a multi-national lab consortium funded by the DOE Bioenergy Technologies Office that has developed a biofoundry that enables the rapid deployment of bioproducts into the market. Working with four ABF laboratory members (National Laboratory of the Rockies (NLR), Pacific Northwest National Laboratory (PNNL), Lawrence Berkeley National Laboratory (LBNL), and Argonne National Laboratory (ANL)), Kalion will use advanced high throughput techniques, advanced analytics, and machine learning to optimize the production environment for glucaric acid. Low-cost, high-purity glucaric acid enables products in a wide range of fields to improve the chemical properties of products and applications ranging from water treatment, polymers & textiles, coatings, detergents, and pharmaceuticals. With its broad range of applications, glucaric acid has the potential to demonstrate how such bio-based materials offer great benefit to the US economy.

09 BIOMASS FUELS↗
NASA NTRS1990

The mGA1.0: A common LISP implementation of a messy genetic algorithm

Genetic algorithms (GAs) are finding increased application in difficult search, optimization, and machine learning problems in science and engineering. Increasing demands are being placed on algorithm performance, and the remaining challenges of genetic algorithm theory and practice are becoming increasingly unavoidable. Perhaps the most difficult of these challenges is the so-called linkage problem. Messy GAs were created to overcome the linkage problem of simple genetic algorithms by combining variable-length strings, gene expression, messy operators, and a nonhomogeneous phasing of evolutionary processing. Results on a number of difficult deceptive test functions are encouraging with the mGA always finding global optima in a polynomial number of function evaluations. Theoretical and empirical studies are continuing, and a first version of a messy GA is ready for testing by others. A Common LISP implementation called mGA1.0 is documented and related to the basic principles and operators developed by Goldberg et. al. (1989, 1990). Although the code was prepared with care, it is not a general-purpose code, only a research version. Important data structures and global variations are described. Thereafter brief function descriptions are given, and sample input data are presented together with sample program output. A source listing with comments is also included.

Goldberg, David E.↗
NASA NTRS2016

Multi-Objective Reinforcement Learning for Cognitive Radio-Based Satellite Communications

Previous research on cognitive radios has addressed the performance of various machine-learning and optimization techniques for decision making of terrestrial link properties. In this paper, we present our recent investigations with respect to reinforcement learning that potentially can be employed by future cognitive radios installed onboard satellite communications systems specifically tasked with radio resource management. This work analyzes the performance of learning, reasoning, and decision making while considering multiple objectives for time-varying communications channels, as well as different cross-layer requirements. Based on the urgent demand for increased bandwidth, which is being addressed by the next generation of high-throughput satellites, the performance of cognitive radio is assessed considering links between a geostationary satellite and a fixed ground station operating at Ka-band (26 GHz). Simulation results show multiple objective performance improvements of more than 3.5 times for clear sky conditions and 6.8 times for rain conditions.

software defined radio↗
NASA NTRS2016

Multi-Objective Reinforcement Learning for Cognitive Radio Based Satellite Communications

Previous research on cognitive radios has addressed the performance of various machine learning and optimization techniques for decision making of terrestrial link properties. In this paper, we present our recent investigations with respect to reinforcement learning that potentially can be employed by future cognitive radios installed onboard satellite communications systems specifically tasked with radio resource management. This work analyzes the performance of learning, reasoning, and decision making while considering multiple objectives for time-varying communications channels, as well as different crosslayer requirements. Based on the urgent demand for increased bandwidth, which is being addressed by the next generation of high-throughput satellites, the performance of cognitive radio is assessed considering links between a geostationary satellite and a fixed ground station operating at Ka-band (26 GHz). Simulation results show multiple objective performance improvements of more than 3:5 times for clear sky conditions and 6:8 times for rain conditions.

ionosphere↗
NASA NTRS2022

Control Implemented on Quantum Computers: Effects of Noise, Non-Determinism, and Entanglement

Quantum computing has advanced in recent years to the point that there are now some quantum computers and quantum simulators available to the public for use. In addition, quantum computing is beginning to receive attention within the process systems engineering community for directions such as machine learning and optimization. A logical next step for its evaluation within process systems engineering is for control, specifically, for computing control actions to be applied to process systems. In this work, we provide some initial studies regarding the implementation of control on quantum computers, including the implementation of a single-input/single-output proportional control law on a quantum simulator with noise, evaluation of potential impacts of non-determinism on theory for advanced control laws, and discussion of consequences of the way that entanglement works for next-generation manufacturing communication objectives.

Kip Nieman↗
NASA NTRS2026

Thermoplastic Matrix Composite Design for Cryotanks Using Multiscale Modeling and Bayesian Optimization

Designing lightweight, robust cryogenic storage tanks is critical for future launch vehicles, in-space propellant storage, and hydrogen powered aircraft. This work presents a multiscale modeling and Bayesian optimization framework for the design of thermoplastic matrix composite cryotanks. Molecular dynamics simulations are first used to determine temperature-dependent constituent properties for candidate thermoplastic matrices, which are homogenized to the lamina scale using NASA’s Multiscale Analysis Tool (NASMAT). These lamina properties, in combination with laminate family generation rules, are evaluated in HyperX structural optimization software to identify stacking sequences that meet all cryogenic load requirements. A Bayesian optimization framework is applied, with HyperX in the loop (via the HyperX API) to efficiently search across material and laminate design variables, yielding an optimized cryotank configuration with significant reductions in design cycle time compared to exhaustive search approaches.

thermoplastics↗
NASA NTRS2026

Benchmarking Bayesian Optimization Frameworks and Acquisition Strategies for Materials Discovery and Autonomous Laboratories

Bayesian optimization (BO) can accelerate materials discovery by guiding expensive experiments toward the most promising processing conditions. We systematically compare five BO surrogate and framework combinations (Gaussian processes in Ax, Gaussian processes and Monte-Carlo neural networks in BayBE, random forests in Lolopy, and tree-structured Parzen (TPE) estimators in Hyperopt) on three benchmarks that mimic common materials design tasks (a discrete solid-electrolyte composition space, a hybrid discrete/continuous laminate-composite design problem solved with micromechanics modeling, and the continuous Ishigami analytic function which is a standard optimization benchmark). Each BO surrogate is paired with posterior mean, probability of improvement, and expected improvement acquisition functions and run for 100 trials from randomized initial samples with uniform random search providing a control. Across five random seeds per setting, BayBE’s Gaussian-process surrogate with expected improvement consistently reached ≥95 % of the known optimum in the fewest evaluations, while Lolopy’s random forest matched or exceeded GP performance on purely categorical or mixed spaces at a higher computational cost. Posterior mean alone often stagnated at local optima, underscoring the need for exploration, whereas probability and expected improvement balanced exploration and exploitation leading to better optimization in fewer trials. Execution times ranged from milliseconds for TPE to minutes for neural-network and random-forest surrogates. These results establish baseline expectations for BO in automated materials laboratories and highlight expected improvement with Gaussian processes as a reliable first choice, with random forests offering a strong alternative when categorical variables dominate. The benchmark suite and code are released to facilitate future surrogate, acquisition, and constraint-handling research in data-driven materials optimization.

Bayesian optimization↗
DOE OSTI2021

High-Temperature Multi-Process Sensor Development and Demonstration at a Full-scale PC Combustion System

The main objective of this research program is to design, manufacture, and demonstrate a miniaturized, multi-process, monitoring system (mMPMS) for boiler condition management and easy system deployment to obtain a higher spatial resolution. This system will facilitate a Condition-Based Maintenance (CBM) philosophy that actively monitors the health of assets to predict and prevent failures and maximize availability and generating capacity at a reduced cost. CBM systems can provide boiler data that the advanced process control (APC) system can utilize for plant performance optimization, which is increasingly relevant as coal power plants shift from predominantly base-load operation to predominantly transient operation involving large load swings. The mMPMS is based on an electrochemical sensor that provides a real-time indication of the risk of damage to key locations in the radiant or convective section of a coal-fired boiler such as metal loss rates, heat flux, metal surface temperature, and deposit thickness. These indications can be utilized to optimize boiler performance as well as improve boiler availability in conjunction with corresponding operating conditions. This monitoring system was developed and tested in the high-temperature regions of coal-fired utility boilers in this project but can be applied to many other industries and applications as well. This project leveraged the existing electrochemical noise-based monitoring system and the new sensor design is small enough to be installed through the webbing of the waterwalls without the need for long shut-downs to bend tubes and to make it feasible to obtain high spatial resolution in the boiler. Data is transferred to the plant distributed control system (DCS) and any other control system. The sensor body that houses the sensor assembly was designed to ensure good conductive contact with boiler tubes to ensure the sensor is held at an identical temperature to the tube surface temperature. The data acquisition and signal conditioning modules were redesigned into a small footprint with optimized cooling of the module. System software was developed specifically for the new signal conditioning module and is compatible with plant PLCs. After the preliminary testing at a pilot-scale facility, the three mMPMS were installed at a full-scale pulverized coal-fired plant, PacifiCorp’s Hunter 3. The systems were demonstrated over 20,000 hours at the plant during regular operation. Also, the sensor data was fed to the plant’s advanced process control system to evaluate the corrosion control by the operation changes and utilized to understand the impacts of load cycling with different ramping up and down speeds. At the end of the project, the systems were converted to the permanent installation at the power plant to be used with the advanced process control system installed at the plant.

Advanced Sensors, Corrosion, Ash Deposition, Optim↗
DOE OSTI2024

How to Build a Quantum Supercomputer: Scaling from Hundreds to Millions of Qubits

In the span of four decades, quantum computation has evolved from an intellectual curiosity to a potentially realizable technology. Today, small-scale demonstrations have become possible for quantum algorithmic primitives on hundreds of physical qubits and proof-of-principle error-correction on a single logical qubit. Nevertheless, despite significant progress and excitement, the path toward a full-stack scalable technology is largely unknown. There are significant outstanding quantum hardware, fabrication, software architecture, and algorithmic challenges that are either unresolved or overlooked. These issues could seriously undermine the arrival of utility-scale quantum computers for the foreseeable future. Here, we provide a comprehensive review of these scaling challenges. We show how the road to scaling could be paved by adopting existing semiconductor technology to build much higher-quality qubits, employing system engineering approaches, and performing distributed quantum computation within heterogeneous high-performance computing infrastructures. These opportunities for research and development could unlock certain promising applications, in particular, efficient quantum simulation/learning of quantum data generated by natural or engineered quantum systems. To estimate the true cost of such promises, we provide a detailed resource and sensitivity analysis for classically hard quantum chemistry calculations on surface-code error-corrected quantum computers given current, target, and desired hardware specifications based on superconducting qubits, accounting for a realistic distribution of errors. Furthermore, we argue that, to tackle industry-scale classical optimization and machine learning problems in a cost-effective manner, heterogeneous quantum-probabilistic computing with custom-designed accelerators should be considered as a complementary path toward scalability.

Mohseni, Masoud↗
DOE OSTI2024

Blockchain-based decentralized computing

An exemplary blockchain-based decentralized computing system and method are disclosed for industrial analytics applications. The exemplary system and method leverage blockchain technology to deliver and execute privacy-preserving decentralized predictive analytics, machine learning, and optimization operations for various industrial applications using a set of self-contained analytics block smart contracts that can be readily utilized and in analytics applications to deploy across multiple sites.

Ramanan, Paritosh P.↗