Search NASA⌕ Search

SEARCH · Search NASA

Results for “learning control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Multi-objective automatic discovery of optimized metamaterials for varying velocity impact protection

Mechanical metamaterials have demonstrated exceptional impact performance while remaining lightweight. Impact resistance has traditionally been investigated using quasi-static simulations, often with the assumption that performance will translate to high-velocity impact scenarios. However, critical crash protection parameters—such as peak stress and absorbed energy—are highly sensitive to impact velocity, leading to inconsistent performance under dynamic loading. To address this, we introduce a strain-rate-aware, active deep learning framework that enables multi-objective optimization of impact protection metrics across a wide range of impact velocities. Our framework captures the strain-rate sensitivity of architected lattices by learning to control spatial gradation in cellular metamaterials, resulting in over 200 % enhancement in impact protection relative to state-of-the-art designs such as Voronoi and re-entrant lattices. We demonstrate its practical utility by designing next-generation lattice structures for automotive bumper systems that satisfy multiple, velocity-specific safety criteria—capabilities beyond those of conventional designs. More than just a predictive tool, this framework marks the first step towards enabling adaptable impact-resistant structures across dynamic regimes.

Deep learning↗
DOE OSTI2020

Chapter Nine - Automated Optimal Control in Energy Systems: The Reinforcement Learning Approach

With the development of smart grid technologies an increasing number of new devices and participants have joined modern energy systems and are inevitably making them more complicated and interdependent than ever. Optimally controlling such a complex energy system and maintaining its operation in a high-efficient, secure, and resilient manner are challenging tasks to the system operators. Fortunately, the revolution in deep learning and artificial intelligence (AI), both from hardware and algorithms perspectives, has provided new ideas and solutions to many previously intractable problems. As a result, this advance in computer science also sparked great research interests in utilizing AI in solving engineering problems related to the modern energy systems. Among many AI techniques, deep reinforcement learning (DRL) has demonstrated great potential for solving sequential optimization problems, which are very common in the engineering domains. Its ability to handle nonlinearity and stochasticity in controlled systems has out-competed many traditional optimal control algorithms. Therefore in this chapter, we focus on the state-of-the-art of DRL concepts and related algorithms, compare their pros and cons with traditional optimal control approaches and discuss the typical workflow for leveraging RL in solving complex problems in modern energy systems.

artificial intelligence↗
DOE OSTI2024

Local convergence analysis of an inexact trust-region method for nonsmooth optimization

In Baraldi, we introduced an inexact trust-region algorithm for minimizing the sum of a smooth nonconvex function and a nonsmooth convex function in Hilbert space—a class of problems that is ubiquitous in data science, learning, optimal control, and inverse problems. Furthermore, this algorithm has demonstrated excellent performance and scalability with problem size. In this paper, we enrich the convergence analysis for this algorithm, proving strong convergence of the iterates with guaranteed rates. In particular, we demonstrate that the trust-region algorithm recovers superlinear, even quadratic, convergence rates when using a second-order Taylor approximation of the smooth objective function term.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Co-orchestration of multiple instruments to uncover structure–property relationships in combinatorial libraries

The rapid growth of automated and autonomous instrumentation brings forth opportunities for the co-orchestration of multimodal tools that are equipped with multiple sequential detection methods or several characterization techniques to explore identical samples. This is exemplified by combinatorial libraries that can be explored in multiple locations via multiple tools simultaneously or downstream characterization in automated synthesis systems. In co-orchestration approaches, information gained in one modality should accelerate the discovery of other modalities. Correspondingly, an orchestrating agent should select the measurement modality based on the anticipated knowledge gain and measurement cost. Herein, we propose and implement a co-orchestration approach for conducting measurements with complex observables, such as spectra or images. The method relies on combining dimensionality reduction by variational autoencoders with representation learning for control over the latent space structure and integration into an iterative workflow via multi-task Gaussian Processes (GPs). This approach further allows for the native incorporation of the system's physics via a probabilistic model as a mean function of the GPs. We illustrate this method for different modes of piezoresponse force microscopy and micro-Raman spectroscopy on a combinatorial Sm-BiFeO3 library. However, the proposed framework is general and can be extended to multiple measurement modalities and arbitrary dimensionality of the measured signals.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Machine Learning for Optimized Polarization at Jefferson Lab

Polarized cryo-targets and polarized photon beams are widely used in experiments at Jefferson Lab. Traditional methods for maintaining the optimal polarization involve manual adjustments throughout data taking by human shift takers. This may introduce some level of inconsistency simply due to the wide variety of experience and expertise of the shift takers themselves. Implementing machine learning-based control systems can improve the stability of the polarization without relying on human intervention. The cryo-target polarization is influenced by temperature, microwave energy, the distribution of paramagnetic radicals, as well as operational conditions including the radiation dose. Diamond radiators are used to generate linearly polarized photons from a primary electron beam. The energy spectrum of these photons can drift over time due to changes in the primary electron beam conditions and diamond degradation. As a first step towards automating the continuous optimization and control processes, uncertainty aware surrogate models have been developed to predict the polarization based on historical data. This talk will provide an overview of the use cases and models developed, highlighting the collaboration between data scientists and physicists at Jefferson Lab.

Jeske, Torri [Thomas Jefferson National Accelerato↗
DOE OSTI2026

An overview of 3D field optimization for control of transport and edge instabilities on KSTAR

An international team from several laboratories and universities has made key advances over the last few years in the control of plasma transport and edge instabilities with applied 3D fields in the KSTAR tokamak to optimize long pulse operation scenarios. This overview begins with the optimization of both core and edge resonant magnetic perturbations (RMP) to improve fast ion confinement to avoid excessive limiter heat loads due to fast ion losses and successful modeling of the experimental results. Integrated and advanced plasma control techniques with machine learning (ML) and adaptive control were then used to optimize the 3D field spectrum in real-time to control edge localized modes (ELMs) while avoiding core locked modes that could disrupt the plasma. Accelerating the offline model of 3D fields with a surrogate ML model can optimize ELM suppression in the edge while limiting the impact of the applied RMP fields deeper in the plasma core in real-time. In addition, the impact of the 3D fields on the divertor heat load has been modeled and compared with experimental measurements. An analysis of a multi-machine database including KSTAR has been performed to better understand the metrics for the observed RMP thresholds for ELM suppression and the resulting plasma performance. Predictive modeling of the operational space for ELM suppression and density pumpout due to RMP has shown the importance of magnetic islands in the plasma edge and their impact on plasma turbulence. This research has culminated in the development of successful long pulse operational scenarios on KSTAR while attempting to overcome challenges of the new tungsten divertor.

3D fields↗
DOE OSTI2025

ACTIVE

The Automated Control Testbed for Integration, Verification, and Emulation (ACTIVE) framework is a software platform designed to support the optimized operation and management of a wide range of building types. It enables the development, testing, and validation of diverse control strategies, including AI-based, rule-based, and model-based approaches. The platform facilitates a seamless transition from simulation-based evaluation of control strategies to real-world field validation and deployment. ACTIVE supports the full building management lifecycle, encompassing data acquisition and management, system monitoring, optimized control, adaptive learning services, device dispatch and coordination, as well as advanced analytics and visualization. Together, these capabilities provide an integrated environment for improving building performance, operational efficiency, reducing energy cost, and reliability.

Smith, Robert [Oak Ridge National Laboratory (ORNL↗
DOE OSTI2023

Controlling Optical Cavities using Machine Learning

The GQuEST experiment endeavors to investigate the unification of Quantum Mechanics and General Relativity within the realm of quantum gravity. This pursuit constitutes a well-established conundrum in the field of physics, characterized by its formidable nature due to the infinitesimal effects manifesting at the Planck scale, which measures a mere 10 35 meters. A remarkable facet of the GQuEST experiment is its capacity to predict observable manifestations of Quantum Gravity on a larger and more accessible scale.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Koopman-based Differentiable Predictive Control for the Dynamics-Aware Economic Dispatch Problem

The dynamics-aware economic dispatch (DED) problem embeds low-level generator dynamics and operational constraints to enable near real-time scheduling of generation units in a power network. DED produces a more dynamic supervisory control policy than traditional economic dispatch (T-ED) that reduces overall generation costs. However, the incorporation of differential equations that govern the system dynamics makes DED an optimization problem that is computationally prohibitive to solve. In this work, we present a new data-driven approach based on differentiable programming to efficiently obtain offline parametric solutions to the underlying DED problem. In particular, we employ the recently proposed differentiable predictive control (DPC) for offline learning of explicit neural control policies based on identified Koopman operator (KO) model of the system dynamics. We demonstrate the high solution quality and five orders of magnitude computational-time savings of the DPC method over the original optimization-based DED approach on a 9-bus test power grid network.

King, Ethan↗
NASA NTRS1990

Program Aids Simulation Of Neural Networks

Computer program NETS - Tool for Development and Evaluation of Neural Networks - provides simulation of neural-network algorithms plus software environment for development of such algorithms. Enables user to customize patterns of connections between layers of network, and provides features for saving weight values of network, providing for more precise control over learning process. Consists of translating problem into format using input/output pairs, designing network configuration for problem, and finally training network with input/output pairs until acceptable error reached. Written in C.

Baffes, Paul T.↗