Search NASA⌕ Search

SEARCH · Search NASA

Results for “Learning control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

Physics and Control of Locked Modes in the DIII-D Tokamak

This Final Technical Report summarizes an investigation, carried out under the auspices of the DOE Early Career Award, of the physics and control of non-rotating magnetic islands (“locked modes”) in tokamak plasmas. Locked modes are one of the main causes of disruptions in present tokamaks, and could be an even bigger concern in ITER, due to its relatively high beta (favoring the formation of Neoclassical Tearing Mode islands) and low rotation (favoring locking). For these reasons, this research had the goal of studying and learning how to control locked modes in the DIII-D National Fusion Facility under ITER-relevant conditions of high pressure and low rotation. Major results included: the first full suppression of locked modes and avoidance of the associated disruptions; the demonstration of error field detection from the interaction between locked modes, applied rotating fields and intrinsic errors; the analysis of a vast database of disruptive locked modes, which led to criteria for disruption prediction and avoidance.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Human-in-the-Loop: The Future of Machine Learning in Automated Electron Microscopy

Machine learning (ML) methods are progressively gaining acceptance in the electron microscopy community for de-noising, semantic segmentation, and dimensionality reduction of data post-acquisition. The introduction of the application programming interfaces (APIs) by major instrument manufacturers now allows the deployment of ML workflows in microscopes, not only for data analytics but also for real-time decision-making and feedback for microscope operation. However, the number of use cases for real-time ML remains remarkably small. Furthermore, we discuss some considerations in designing ML-based active experiments and pose that the likely strategy for the next several years will be human-in-the-loop automated experiments (hAE). In this paradigm, the ML learning agent directly controls beam position and image and spectroscopy acquisition functions, and a human operator monitors experiment progression in real and feature space of the system and tunes the policies of the ML agent to steer the experiment toward specific objectives.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Unique optical excitations in topological insulators (Final Technical Report)

The overall objective of this research is to understand how light interacts with topological insulator (TI) films and layered structures. Unlike normal materials, the electrons in TI films are trapped at the top and bottom surfaces of the film. These electrons have unusual properties, including low mass and high velocity. Light shining on these trapped electrons will excite electron density waves, called plasmons, which inherit the unusual properties of the electrons. This project aims to understand how these plasmons interact with each other and how the plasmon properties change as the film dimensions change. By controlling the physical properties of the films, the optical response of the film can also be controlled. In addition to single TI films, the project will also investigate the properties of stacks of TI films layered with normal insulating films. Stacking these materials results in multiple layers of trapped electrons whose plasmons can interact in ever more complex ways. After these interactions are understood, we can begin to engineer complex TI structures to obtain designer optical phenomena in the far-infrared and THz, wavelength ranges of interest for environmental monitoring and chemical sensing. This research directly addresses DOE Grand Challenges, including understanding how properties of matter emerge from complex electronic correlations and learning how to control these properties as well as the mission of the Basic Energy Sciences program to understand and control matter at the electronic/atomic level.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Nanostructures for Electrical Energy Storage (NEES) (2020 Final Technical Report)

Nanostructures for Electrical Energy Storage (NEES, www.efrc.umd.edu) was an Energy Frontier Research Center supported by the DOE Office of Science, Basic Energy Sciences, from 8/1/2009 to 7/31/2020. Led by the University of Maryland, NEES enjoyed extensive collaborations with its funded partners, including two DOE Laboratories and six universities. The NEES vision has been to reveal a set of scientific insights and design principles that can underpin a next-generation electrical energy storage approach, building on advances in nanoscale science and technology to achieve simultaneous high power and high energy over extended charge/discharge cycling. The vision is motivated by the recognition that scaling into the nano regime opens the door to new physical phenomena and that the tools enlisted in nanoscale research provide major new opportunities for the synthesis not only of materials at molecular scale but for structures at nano scale and above. NEES has translated this vision into its research program based on two observations. First, while the behavior of ions and electrons in electrolytes and in electrode materials is crucial to electrical energy storage (or more appropriately electrochemical energy storage), it is the transport of ion and electron charge between different structural components of a storage device that ultimately determine its performance. With it well recognized that the choice of electrode materials typically constrain ion transport kinetics as well as maximum ion concentration, the search for better electrode materials has been a primary driver of battery research. At the same time the synthesis of electrodes is typically based on aggregation of particles with varying size, shape, and orientation in the electrode. Together with the presence of additional materials to impart electrical conductivity and cohesion to the composite electrode, change in electrode materials is necessarily accompanied by structural changes at the nano/micro scale that are difficult to categorize and manage. From the beginning, NEES’ vision has been to create and study simpler, highly controlled spatial arrangements of known materials as battery components (electrodes, current collectors, and electrolyte) and to understand how design and structure above the molecular scale determines the energy storage performance available from known materials. Second, advances in nanoscience dramatically expanded the portfolio of synthesis methods, structural motifs, and new phenomena available for research. Some of these gave rapid access to new building blocks at the deep nanoscale (e.g., carbon nanotubes grown by self-assembly, nanoscale arrays formed by electrochemical self-alignment, monolayer films controlled by self-limiting reaction). Such advances served as the enabler for the NEES vision to be pursued experimentally through study of 3D structures created and controlled at the nano, micro, and meso scales. Here, we use meso as in the BES MESO Report, implying not only intermediate or varying length scales, but very much the way behavior is influenced by other factors including aggregation of nanocomponents at different densities and spatial configurations, statistical variations in the aggregates, hierarchical architectures in which they can be assembled, or local 3D configurations that result from the architectures. Over its life cycle, NEES has pursued two overarching goals: (1) to understand the scientific fundamentals of electrochemical storage from the nanoscale to the mesoscale; and (2) to create and learn from innovative, controlled, heterogeneous nanostructures, where such nanostructures can enable the first goal and serve as models for future paradigms in energy storage. Specific goals have included: Synthesize heterogeneous nanostructures comprised of multiple materials arranged in controlled fashion and characterize their behavior; Demonstrate and elucidate design principles for achieving simultaneous high power and high energy; Develop materials processes which enable precision control of thin layers and 3D structures; Investigate the impact of artificial interphases on electrode stability during ion insertion/deinsertion; Create dense arrays of nanostructures to understand how the architecture of these assemblies, along with nanostructure design, influences energy storage behavior at the mesoscale; Identify and understand the consequences of nanoconfinement and local inhomogeneities in 3D mesoscale arrays; Develop and apply computational models to stimulate, guide and interpret experiments.

25 ENERGY STORAGE↗
DOE OSTI2022

Differentiable Predictive Control with Safety Guarantees: A Control Barrier Function Approach

In this paper, we develop a novel form of differentiable predictive control (DPC) with safety and robustness guarantees. DPC is a form of approximate model predictive control (MPC), wherein the control policy is a neural network that learns a receding horizon, optimal control law. The proposed approach exploits a new form of sampled-data barrier function to enforce safety, while only interrupting the neural network-based controller near the boundary of the safe set. The effectiveness of the proposed approach is demonstrated in simulation.

Shaw Cortez, Wenceslao E.↗
DOE OSTI2018

A Scalable HPC Insider Threat Monitoring System

Cyber Equations, Inc. is reporting on the results of its DOE SBIR Phase I project for the development of a Scalable HPC Insider Threat Monitoring System. This final report to the Department of Energy for Task DE-FOA-0001618 covers the period from 02/21/2017 to 02/20/2018 and summarizes the larger research accomplishments, which can be divided in theoretical and laboratory experiments. One of the many challenges for the U.S. Department of Energy (DOE) is the support of the high-performance computing (HPC) centers while providing quality information services, strategic vision, leadership, technical expertise, and capabilities necessary to enable the DOE to deliver effective, efficient, economical, and secure HPC services. In order to realize a secure DOE laboratory enterprise, DOE facilities operations must counter a wide range of cyber insider threats, from unsophisticated adversaries up to advanced, nation state sponsored actors. The DOE laboratories also presents an enormous insider attack surface of an ever-growing number of computers, networks, and devices all running a myriad of software. In addition, the DOE laboratories are connected to a variety of external organizations which multiplies the possibility of insider threat. During this SBIR project Cyber Equations developed a strategic combination of supervised and unsupervised machine learning techniques to control scale and classify whether entities, such as hosts, actors, or documents, are showing suspicious insider behavior. We conducted experiments using real cyber data to show that changes in observable behavior (e.g., changes in outbound traffic patterns) are indicative of attacks executing (e.g., insiders exfiltrating data, bots calling home, or an attack spreading). The features and methods we use, have been used in the anomaly detection research and development community for a significant amount of time and robust implementations are openly available. K-Means clustering, Decision Trees, and Support Vector Machine based classifiers are readily available through the R language and open source H20 machine learning framework. The Cyber Equations approach is novel in its use of these classifiers combined with Hadoop based parallel processing technology. The five stages of processing used by CyberInsider improve scalability and reduce the high number of false positives normally associated with network anomaly detection. In summary, the Cyber Equations has successfully accomplished all of its Phase I tasks and demonstrated the feasibility of the Insider Threat Monitoring System.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Minimizing Energy Consumption from Connected Signalized Intersections by Reinforcement Learning

Explicit energy minimization objectives are often discouraged in signal optimization algorithms due to its negative impact on mobility performance. One potential direction to solve this problem is to provide a balanced objective function to achieve desired mobility with minimized energy consumption. This research developed a reinforcement learning (RL) based control with reward functions considering energy and mobility in a joint manner-a penalty function is introduced for number of stops. Further, we proposed a clustering-based technique to make the state-space finite which is critical for a tractable implementation of the RL algorithm. We implemented the algorithm in a calibrated NG-SIM network within a traffic micro-simulator-PTV VISSIM. With sole focus on energy, we report 47% reduction in energy consumption when compared with existing signal control schemes, however causing a 65.6% increase in system travel time. In contrast, the control strategy focusing on energy minimization with penalty for stops yields 6.7% reduction in energy consumption with 27% increase in system travel time. The developed RL algorithm with a flexible penalty function in the reward will achieve desired energy goals for a network of signalized intersections without compromising on the mobility performance.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

An Integrated Framework for Risk Assessment of Safety-related Digital Instrumentation and Control Systems in Nuclear Power Plants: Methodology Advancement and Application

This report documents activities performed by Idaho National Laboratory (INL) during fiscal year (FY) 2024 for the U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program, Risk Informed Systems Analysis (RISA) Pathway, Digital Instrumentation and Control (DI&C) Risk Assessment project. The goal of the RISA Pathway is to optimize safety margins and minimize uncertainties to achieve economic efficiencies while maintaining high levels of safety. This is accomplished by providing scientific basis to better represent safety margins and factors that contribute to cost and safety, and by developing new technologies that reduce operating costs. The research efforts for FY 2024 encompass methodology refinement and exploration. The efforts include: (1) The implementation of a natural language processing tool to expedite key aspects of the reliability analysis methods developed by INL; (2) advances to support intersystem CCF analysis by providing guidance for and identification of coupling mechanisms that may contribute to CCF; (3) the investigation of how generative artificial intelligence tools can aid in hazard analysis and diversity and defense in depth (i.e., D3) assessments; (4) Industry collaboration, allowing the demonstration of and INL's risk assessment tools to support risk assessment of DI&C systems at early and late stages of development; (4) a roadmap for the development of a software for each of INL's risk assessment tools; (5) The development of a theory and methodology manual for a risk quantification methodology; (6) the development of a reliability analysis for machine learning (ML)-integrated control systems.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Safety-assured, real-time neural active fault management for resilient microgrids integration

Federated-learning-based active fault management (AFM) is devised to achieve real-time safety assurance for microgrids and the main grid during faults. AFM was originally formulated as a distributed optimization problem. Here, federated learning is used to train each microgrid's network with training data achieved from distributed optimization. The main contribution of this work is to replace the optimization-based AFM control algorithm with a learning-based AFM control algorithm. The replacement transfers computation from online to offline. With this replacement, the control algorithm can meet real-time requirements for a system with dozens of microgrids. By contrast, distributed-optimization-based fault management can output reference values fast enough for a system with several microgrids. More microgrids, however, lead to more computation time with optimization-based method. Distributed-optimization-based fault management would fail real-time requirements for a system with dozens of microgrids. Controller hardware-in-the-loop real-time simulations demonstrate that learning-based AFM can output reference values within 10 ms irrespective of the number of microgrids.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Model scripts associated with “Revisiting controls on hyporheic respiration with knowledge-guided machine learning at continental scale”

NOTE: The manuscript associated with this data package is currently in review. The data/scripts may be revised based on reviewer feedback. Upon manuscript acceptance, this data package will be updated with the final scripts and additional metadata. This data package is associated with the publication “Revisiting controls on hyporheic respiration with knowledge-guided machine learning at continental scale” submitted to Environmental Science & Technology (Zheng et al. 2026). The project combines mechanistic process modeling with knowledge-guided machine learning (KGML) to evaluate how organic matter chemistry, microbial biomass, and physical substrate accessibility regulate realized respiration rates across river corridors. All data used in this paper have been previously published and can be accessed at https://data.ess-dive.lbl.gov/datasets/doi:10.15485/1729719 (Goldman et al., 2020). This data package contains 3 R-markdown (Rmd) preprocessing scripts for the previously published data and subsequent modelling workflows. The full workflow with input and output data can be found in the associated GitHub repository at https://github.com/jianqiuz/KGML-WHONDRS.

Biogeochemistry↗
DOE OSTI2020

3D xRAGE simulation of inertial confinement fusion implosion with imposed mode 2 laser drive asymmetry

Low-mode asymmetries represent an important obstacle to achieving high-gain inertial confinement fusion implosions. As a step in learning how to control such effects, an OMEGA experiment with imposed mode 2 laser drive asymmetries was done to study the expected signatures of this type of asymmetry [M. Gatu Johnson et al., PRE 2018]. In the present work, a 3D xRAGE simulation including the stalk mount has been brought to bear on the data from that experiment. Furthermore, comprehensive comparisons between simulated and measured observables are made. Good agreement between simulated and measured x-ray image-inferred shell trajectories, bang times and neutron emission widths are seen, showing that the hydrodynamics are well captured in the simulation. Asymmetries seen in simulated and measured time-resolved and time-integrated x-ray images and areal densities also compare well, showing impact of both stalk and mode 2. On the other hand, important differences in measured and simulated neutron emission histories, yield, and ion temperature (T ion ) asymmetries are seen, suggesting that the simulation is overestimating shock yield. Overall, the results clearly demonstrate the importance of considering all asymmetry sources when interpreting measured signatures of asymmetry.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Nuclear safety Enhanced: A Deep dive into current and future RAVEN applications

As the horizon of nuclear energy expands with the advent of small modular reactors, IV generation reactors, and fusion reactors, there is a growing perspective that the licensing process could benefit from a more comprehensive approach. Moving beyond traditional deterministic and PRA analysis might pave the way for a novel safety analysis paradigm propelled by the increasing computational power at our disposal. This paper explores different methodologies that can improve the outcomes of nuclear safety analysis. These range from uncertainty quantification techniques, aimed at enhancing the precision of safety margins, to deploying dynamic event trees by driving system code simulations, capturing the potential evolutions of severe accidents. These methodologies introduce innovative dimensions to safety analysis, considering the consequences of postulated events and the dynamics of accident sequences. However, they also bring forth challenges, especially in managing the complexity and sheer volume of potential scenarios. The paper touches upon some strategies to counter these challenges, emphasizing the importance of adaptability and continuous evolution in the face of emerging nuclear safety concerns. Additionally, the paper sheds light on the need for advanced tools to apply these methodologies. Among these tools is RAVEN, an open-source software designed for parametric and probabilistic analyses. Its core components, including distribution, sampler, and reduced order model, enable various applications, from risk assessment and mitigation to dynamic learning and plant control logic simulations.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Identifying the Gate-Opening Mechanism in the Flexible Metal–Organic Framework UTSA-300

Atomic-level understanding of the gate-opening phenomenon in flexible porous materials is an important step toward learning how to control, design, and engineer them for applications such as the separation of gases from complex mixtures. Here, we report such mechanistic insight through an in-depth study of the pressure-induced gate-opening phenomenon in our earlier reported metal–organic framework (MOF) Zn(dps) 2 (SiF 6 ) (dps = 4,4'-dipyridylsulfide), also called UTSA-300, using isotherm and calorimetry measurements, in situ infrared spectroscopy, and ab initio simulations. UTSA-300 is shown to selectively adsorb acetylene (C 2 H 2 ) over ethylene (C 2 H 4 ) and ethane (C 2 H 6 ) and undergoes an abrupt gate-opening phenomenon, making this framework a highly selective gas separator of this complex mixture. The selective adsorption is confirmed by pressure-dependent in situ infrared spectroscopy, which, for the first time, shows the presence of multiple C 2 H 2 species with varying strengths of bonding. A rare energetic feature at the gate-opening condition of the flexible MOF is observed in our differential heat energies, directly measured by calorimetry, showcasing the importance of this tool in adsorption property exploration of flexible frameworks and offering an energetic benchmark for further energy-based fundamental studies. Based on the agreement of this feature with ab initio-based adsorption energies of C 2 H 2 in the closed-pore structure UTSA-300a (“a” refers to the activated form), this feature is assigned to the weakening of the H-bond C–H···F formed between C 2 H 2 and fluorine of the MOF. Furthermore, our analysis identifies the weakening of this H-bond, the expansion of the closed-pore MOF upon successive C 2 H 2 coadsorption until its volume is close to that of the open-pore MOF, and the spontaneous gate opening to energetically favor C 2 H 2 adsorption in the open-pore structure as crucial steps in the gate-opening mechanism in this system.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Giant electron–phonon coupling of the breathing plane oxygen phonons in the dynamic stripe phase of $\hbox {La}_{1.67}\hbox {Sr}_{0.33}\hbox {NiO}_4$

Doped antiferromagnets host a vast array of physical properties and learning how to control them is one of the biggest challenges of condensed matter physics. La 1.67 Sr 0.33 NiO 4 (LSNO) is a classic example of such a material. At low temperatures holes introduced via substitution of La by Sr segregate into lines to form boundaries between magnetically ordered domains in the form of stripes. The stripes become dynamic at high temperatures, but LSNO remains insulating presumably because an interplay between magnetic correlations and electron–phonon coupling localizes charge carriers. Magnetic degrees of freedom have been extensively investigated in this system, but phonons are almost completely unexplored. We searched for electron–phonon anomalies in LSNO by inelastic neutron scattering. Giant renormalization of plane Ni–O bond-stretching modes that modulate the volume around Ni appears on entering the dynamic charge stripe phase. Other phonons are a lot less sensitive to stripe melting. Dramatic overdamping of the breathing modes indicates that dynamic stripe phase may host small polarons. We argue that this feature sets electron–phonon coupling in nickelates apart from that in cuprates where breathing phonons are not overdamped and point out remarkable similarities with the colossal magnetoresistance manganites.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Building workflows for an interactive human-in-the-loop automated experiment (hAE) in STEM-EELS

Exploring the structural, chemical, and physical properties of matter on the nano- and atomic scales has become possible with the recent advances in aberration-corrected electron energy-loss spectroscopy (EELS) in scanning transmission electron microscopy (STEM). However, the current paradigm of STEM-EELS relies on the classical rectangular grid sampling, in which all surface regions are assumed to be of equal a priori interest. However, this is typically not the case for real-world scenarios, where phenomena of interest are concentrated in a small number of spatial locations, such as interfaces, structural and topological defects, and multi-phase inclusions. One of the foundational problems is the discovery of nanometer- or atomic-scale structures having specific signatures in EELS spectra. Herein, we systematically explore the hyperparameters controlling deep kernel learning (DKL) discovery workflows for STEM-EELS and identify the role of the local structural descriptors and acquisition functions in experiment progression. In agreement with the actual experiment, we observe that for certain parameter combinations the experiment path can be trapped in the local minima. We demonstrate the approaches for monitoring the automated experiment in the real and feature space of the system and knowledge acquisition of the DKL model. Based on these, we construct intervention strategies defining the human-in-the-loop automated experiment (hAE). This approach can be further extended to other techniques including 4D STEM and other forms of spectroscopic imaging. The hAE library is available on Github at https://github.com/utkarshp1161/hAE/tree/main/hAE.

Pratiush, Utkarsh [Univ. of Tennessee, Knoxville, ↗
DOE OSTI2021

Low-temperature emergent neuromorphic networks with correlated oxide devices

Significance Designing neuromorphic hardware for cryoelectronics is an important area of research as the field of computing paradigms beyond complementary metal-oxide-semiconductor (CMOS) progresses. Superconductivity and metal−insulator transitions are two of the most celebrated emergent, collective properties found in quantum materials such as strongly correlated oxides. Here, we present simulations of artificial neural networks that can be designed by combining superconducting devices (e.g. Josephson junctions) with Mott metal−insulator transition−based tunable resistor devices. Our simulations show that 1) neurons and synapses can be seamlessly created, 2) their functions can be tuned via learning, and 3) controlling disorder by incorporating light ions enables exponential multiplicity of states. The results open up directions for incorporating emergent behavior seen in condensed matter into hardware design for artificial intelligence.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Implementing two-qubit gates at the quantum speed limit

The speed of elementary quantum gates, particularly two-qubit gates, ultimately sets the limit on the speed at which quantum circuits can operate. In this work, we experimentally demonstrate commonly used two-qubit gates at nearly the fastest possible speed allowed by the physical interaction strength between two superconducting transmon qubits. We achieve this quantum speed limit by implementing experimental gates designed using a machine-learning-inspired optimal control method. Importantly, our method only requires the single-qubit drive strength to be moderately larger than the interaction strength to achieve an arbitrary two-qubit gate close to its analytical speed limit with high fidelity. Thus the method is applicable to a variety of platforms, including those with comparable single-qubit and two-qubit gate speeds, or those with always-on interactions. We expect our method to offer significant speedups for non-native two-qubit gates that are typically achieved with a long sequence of single-qubit and native two-qubit gates.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Evaluating Efficiency and Security of Connected and Autonomous Vehicle Applications

Evaluating efficiency and security of Connected and Autonomous Vehicles (CAVs) requires an environment that can support applications and measurements under real-world conditions. This work introduces our implementation and evaluation of a Connected and Autonomous Vehicle Research Environment (CAVRE). We implement and evaluate an existing CAV application called Cooperative Adaptive Cruise Control (CACC) using physical Vehicle-to-Vehicle (V2V) communications between a virtual agent and a real autonomous vehicle operating on a steerable dynamometer. CAVRE allows the follower to autonomously control longitudinal behavior on the dynamometer in order to maintain a steady following time gap from the leader. The effects of a wireless jamming attack on CACC and fuel efficiency is also evaluated. By executing attacks in a controlled environment, we learn how compromised communications can degrade CAV applications. We show that jamming V2V communications can impact CACC’s string stability and decrease fuel efficiency by more than 50%.

Taylor, Curtis↗