Search NASA⌕ Search

SEARCH · Search NASA

Results for “feedback based control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Atomic-scale friction control by vibration using friction force microscope

Manipulation of friction at the nanoscale has been traditionally approached by chemical means (lubrication). Recent friction force microscopy (FFM) experiments demonstrated that it can be done mechanically by applying vibration to accessible elements of the system. This paper provides analytic understanding on why vibration can reduce friction based on a 1D model imitating the FFM tip moving on a substrate. Open-loop stability is first studied, and a feedback vibration control is then designed using the accessible variable. Comparing to the open-loop system, friction force is significantly reduced in the closed-loop system. Numerical simulations show satisfactory performances.

Guo, Yi↗

Bi-Level Dynamic Optimization with Feedback

This paper considers a bi-level real-time algorithmic framework for networked systems, consisting of several local controllers and a central controller. The central controller issues setpoints to the local controllers to optimize their operational objectives while satisfying system-wide constraints. In this context, the paper develops an online algorithm for tracking the optimal solution of the underlying dynamic optimization problem. The design of the algorithm is based on a projected-gradient method, suitably modified to accommodate appropriate measurements (i.e., feedback). Optimality claims are established in terms of the dynamic regret of the algorithm; the latter is a natural performance criterion in nonstationary environments associated with real-time control problems. Finally, the application of the algorithm to real-time control of power setpoints in an electrical grid is illustrated.

24 POWER TRANSMISSION AND DISTRIBUTION↗

WE-G-BRA-07: Analyzing the Safety Implications of a Brachytherapy Process Improvement Project Utilizing a Novel System-Theory-Based Hazard-Analysis Technique

Purpose: To investigate the hazards in cervical-cancer HDR brachytherapy using a novel hazard-analysis technique, System Theoretic Process Analysis (STPA). The applicability and benefit of STPA to the field of radiation oncology is demonstrated. Methods: We analyzed the tandem and ring HDR procedure through observations, discussions with physicists and physicians, and the use of a previously developed process map. Controllers and their respective control actions were identified and arranged into a hierarchical control model of the system, modeling the workflow from applicator insertion through initiating treatment delivery. We then used the STPA process to identify potentially unsafe control actions. Scenarios were then generated from the identified unsafe control actions and used to develop recommendations for system safety constraints. Results: 10 controllers were identified and included in the final model. From these controllers 32 potentially unsafe control actions were identified, leading to more than 120 potential accident scenarios, including both clinical errors (e.g., using outdated imaging studies for planning), and managerial-based incidents (e.g., unsafe equipment, budget, or staffing decisions). Constraints identified from those scenarios include common themes, such as the need for appropriate feedback to give the controllers an adequate mental model to maintain safe boundaries of operations. As an example, one finding was that the likelihood of the potential accident scenario of the applicator breaking during insertion might be reduced by establishing a feedback loop of equipment-usage metrics and equipment-failure reports to the management controller. Conclusion: The utility of STPA in analyzing system hazards in a clinical brachytherapy system was demonstrated. This technique, rooted in system theory, identified scenarios both technical/clinical and managerial in nature. These results suggest that STPA can be successfully used to analyze safety in brachytherapy and may prove to be an alternative to other hazard analysis techniques.

60 APPLIED LIFE SCIENCES↗

Reconfigurable Two‐Dimensional DNA Lattices: Static and Dynamic Angle Control

Abstract Branched DNA motifs serve as the basic construction elements for all synthetic DNA nanostructures. However, precise control of branching orientation remains a key challenge to further heighten the overall structural order. In this study, we use two strategies to control the branching orientation. The first one is based on immobile Holliday junctions which employ specific nucleotide sequences at the branch points which dictate their orientation. The second strategy is to use angle‐enforcing struts to fix the branching orientation with flexible spacers at the branch points. We have also demonstrated that the branching orientation control can be achieved dynamically, either by canonical Watson–Crick base pairing or non‐canonical nucleobase interactions (e.g., i‐motif and G‐quadruplex). With precise angle control and feedback from the chemical environment, these results will enable novel DNA nanomechanical sensing devices, and precisely‐ordered three‐dimensional architectures.

Wang, Wen↗

Long-term measurements in a mixed-grass prairie reveal a change in soil organic carbon recalcitrance and its environmental sensitivity under warming

Soil respiration, the major pathway for ecosystem carbon (C) loss, has the potential to enter a positive feedback loop with the atmospheric CO2 due to climate warming. For reliable projections of climate-carbon feedbacks, accurate quantification of soil respiration and identification of mechanisms that control its variability are essential. Process-based models simulate soil respiration as functions of belowground C input, organic matter quality, and sensitivity to environmental conditions. However, evaluation and calibration of process-based models against the long-term in situ measurements are rare. Here, we evaluate the performance of the Terrestrial ECOsystem (TECO) model in simulating total and heterotrophic soil respiration measured during a 16-year warming experiment in a mixed-grass prairie; calibrate model parameters against these and other measurements collected during the experiment; and explore whether the mechanisms of C dynamics have changed over the years. Calibrating model parameters against observations of individual years substantially improved model performance in comparison to pre-calibration simulations, explaining 79–86% of variability in observed soil respiration. Interannual variation of the calibrated model parameters indicated increasing recalcitrance of soil C and changing environmental sensitivity of microbes. Overall, we found that (1) soil organic C became more recalcitrant in intact soil compared to root-free soil; (2) warming offset the effects of increasing C recalcitrance in intact soil and changed microbial sensitivity to moisture conditions. Furthermore, these findings indicate that soil respiration may decrease in the future due to C quality, but this decrease may be offset by warming-induced changes in C cycling mechanisms and their responses to moisture conditions.

59 BASIC BIOLOGICAL SCIENCES↗

EKF-Based Enhanced Performance Controller Design for Nonlinear Stochastic Systems

In this paper, a novel control algorithm is presented to enhance the performance of tracking property for a class of non-linear dynamic stochastic systems with unmeasurable variables. To minimize the entropy of tracking errors without changing the existing closed loop with PI controller, the enhanced performance loop is constructed based on the state estimation by extended Kalman Filter and the new controller is designed by full state feedback following this presented control algorithm. Besides, the conditions are obtained for the stability analysis in the mean square sense. In the end, the comparative simulation results are given to illustrate the effectiveness of proposed control algorithm.

Complex industrial process↗

Microstructural-Level Fuel Performance Modeling of U-Mo Monolithic Fuel

As the physics that governs the microstructural evolution of nuclear fuel span various time and spatial scales, to fully understand the fuel behavior inevitably involves atomic to mesoscale resolution that can be difficult to determine experimentally. Microstructural-level modeling and simulations can be used to develop physics-based materials models that can provide physical understanding to inform fabrication process control, as well as a valuable feedback mechanism between post-irradiation examination (PIE) results and fabrication parameters. In accordance with the program schedule, the primary goals of the microstructure modeling effort are to: 1. Address critical microstructural questions and provide practical guidance to the fabricator via the fuel product specification; 2. Provide mechanistic inputs for the existing fuel performance code to improve its descriptive and predictive capability at the macroscopic scale. In fiscal year (FY)-21, the work scope consisted of six main facets: (1) the effect of carbides on fuel performance; (2) gas diffusivity in different phases; (3) integration of microstructural fuel performance modeling; (4) property degradation; (5) irradiation creep; and (6) historical analysis of microstructure data. Brief summaries of each are included below.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A Fully Passive Daily Load-follow Operation in a Small PWR System

An innovative fully passive load-follow operation (PLFO) concept, based only on the negative reactivity feedbacks, is proposed by the authors. The new design concept requires no control rod adjustment or boron utilization for achieving load-follow operation in pressurized water reactors (PWRs). PLFO is motivated by the need for developing next-generation PWRs with enhanced power maneuvering capabilities, increased level of autonomism, and less dependence on active controllers. Enhanced power maneuvering capabilities are required to allow next-generation PWRs to actively contribute to electrical grid stability. Meanwhile, increased level of autonomism and less dependence on active controllers are required for safety and reliability of next-generation PWRs. However, developing an autonomous thermal reactor is challenging due to its strong thermal and xenon (Xe) reactivity feedback. Therefore, enhancing power maneuvering capabilities and simultaneously increasing the level of autonomy with less dependence on active controllers is very challenging in PWRs. However, PLFO is a promising solution. For the feasibility of PLFO, the coolant temperature coefficient (CTC) should be always clearly negative and this requires a soluble boron-free (SBF) coolant system. An SBF coolant system is also favorable in terms of reactor safety. Nevertheless, utilizing soluble boron in load-following operation is not favorable, as the change in boron concentration is a quite slow process. The power demand can be either regular (repeated pattern in a daily-basis) or irregular (varying demand). The feasibility of PLFO for regular demand was demonstrated by the authors in other works. This paper is dedicated for summarizing the feasibility of PLFO for irregular demand, and to point out the impact of Xe reactivity on PLFO for a varying power demand.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

PID-Regulated Heating System for PIP-II Reference Line

The Proton Improvement Project-2 centers on building a new superconducting linear particle accelerator (Linac) at Fermilab. At the heart of the accelerator is the reference line, a critical system that defines the ideal path for the particle beam as it passes through magnets, RF cavities, and other beamline elements. Temperature stability is crucial for the reliable operation of RF components, such as mixers and filters. Fluctuations affect key performance parameters like conversion loss, isolation, and linearity. To mitigate any drift caused by ambient temperature changes, a heating plate assembly is utilized to maintain key components at a controlled temperature of 40°C. The system utilizes an aluminum 36”x36”x0.5” heat plate powered by a MOSFET-based control circuit, delivering approximately 460 W of thermal energy through a resistor array. Real-time temperature feedback is provided by a PT100 Resistance Temperature Detector (RTD), which interfaces with a Proportional–Integral–Derivative (PID) control algorithm to maintain closed-loop temperature regulation. The control signal actively modulates the gate voltage of an N channel MOSFET, dynamically adjusting power delivery in response to deviations from the temperature setpoint. Simulations and LTspice models validate the functionality and responsiveness of the circuit under varying conditions. The prototype has successfully demonstrated stable thermal control, paving the way for integration into the PIP-II infrastructure. The final design will feature an expanded resistor array, as well as communication with a PLC for continuous data acquisition and diagnostics. This work directly supports Fermilab’s broader mission by contributing to the stability and reliability of core accelerator systems, enhancing the precision of particle beam delivery for future physics experiments.

Mosher, Alexander [Fermilab]↗

Wind/Wave Testing of a 1:70-Scale Performance-Matched Model of the IEA Wind 15 MW Reference Wind Turbine with Real-Time ROSCO Control and Floating Feedback

Experimental results from the Floating Offshore-wind and Controls Advanced Laboratory (FOCAL) experimental program, which tested a performance-matched model of the IEA Wind 15 MW Reference Turbine on a 1:70 scale floating semisubmersible platform, are compared with OpenFAST simulations. Four experimental campaigns were performed, and data from the fourth campaign, which focused on wind and wave testing of the scaled floating wind turbine system, are considered. Simulations of wave-only, wind-only, and wind/wave environments are performed in OpenFAST, and results for key metrics are compared with the experiment. Performance of the real-time Reference OpenSource COntroller (ROSCO) in above-rated wind conditions, including the effects of the floating feedback loop, are investigated. Results show good agreement in mean values for key metrics, and hydrodynamic effects are matched well. Differences in the surge resonant behavior of the platform are identified and discussed. The effect of the controller and floating feedback loop is evident in both the experiment and OpenFAST, showing significant reduction in platform pitch response and tower base bending load near the platform pitch natural frequency.

17 WIND ENERGY↗

3D printed graphene-based self-powered strain sensors for smart tires in autonomous vehicles

The transition of autonomous vehicles into fleets requires an advanced control system design that relies on continuous feedback from the tires. Smart tires enable continuous monitoring of dynamic parameters by combining strain sensing with traditional tire functions. Here, we provide breakthrough in this direction by demonstrating tire-integrated system that combines direct mask-less 3D printed strain gauges, flexible piezoelectric energy harvester for powering the sensors and secure wireless data transfer electronics, and machine learning for predictive data analysis. Ink of graphene based material was designed to directly print strain sensor for measuring tire-road interactions under varying driving speeds, normal load, and tire pressure. A secure wireless data transfer hardware powered by a piezoelectric patch is implemented to demonstrate self-powered sensing and wireless communication capability. Combined, this study significantly advances the design and fabrication of cost-effective smart tires by demonstrating practical self-powered wireless strain sensing capability.

33 ADVANCED PROPULSION SYSTEMS↗

Controlling colloidal crystals via morphing energy landscapes and reinforcement learning

We report a feedback control method to remove grain boundaries and produce circular shaped colloidal crystals using morphing energy landscapes and reinforcement learning–based policies. We demonstrate this approach in optical microscopy and computer simulation experiments for colloidal particles in ac electric fields. First, we discover how tunable energy landscape shapes and orientations enhance grain boundary motion and crystal morphology relaxation. Next, reinforcement learning is used to develop an optimized control policy to actuate morphing energy landscapes to produce defect-free crystals orders of magnitude faster than natural relaxation times. Morphing energy landscapes mechanistically enable rapid crystal repair via anisotropic stresses to control defect and shape relaxation without melting. This method is scalable for up to at least N = 10 3 particles with mean process times scaling as N 0.5 . Further scalability is possible by controlling parallel local energy landscapes (e.g., periodic landscapes) to generate large-scale global defect-free hierarchical structures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Optical emission and nanoparticle generation in Al plasmas using ultrashort laser pulses temporally optimized by real-time spectroscopic feedback

With an interest in pulsed laser deposition and remote spectroscopy techniques, we explore here the potential of laser pulses temporally tailored on ultrafast time scales to control the expansion and the excitation degree of various ablation products including atomic species and nanoparticulates. Taking advantage of automated pulse-shaping techniques, an adaptive procedure based on spectroscopic feedback is applied to regulate the irradiance and enhance the optical emission of monocharged aluminum ions with respect to the neutral signal. This leads to optimized pulses usually consisting in a series of femtosecond peaks distributed on a longer picosecond sequence. The ablation features induced by the optimized pulse are compared with those determined by picosecond pulses generated by imposed second-order dispersion or by double pulse sequences with adjustable picosecond separation. This allows to analyze the influence of fast- and slow-varying envelope features on the material heating and the resulting plasma excitation degree. Using various optimal pulse forms including designed asymmetric shapes, we analyze the establishment of surface pre-excitation that enables conditions of enhanced radiation coupling. Thin films elaborated by unshaped femtosecond laser pulses and by optimized, stretched, or double pulse sequences are compared, indicating that the nanoparticles generation efficiency is strongly influenced by the temporal shaping of the laser irradiation. A thermodynamic scenario involving supercritical heating is proposed to explain enhanced ionization rates and lower particulates density for optimal pulses. Numerical one-dimensional hydrodynamic simulations for the excited matter support the interpretation of the experimental results in terms of relative efficiency of various relaxation paths for excited matter above or below the thermodynamic stability limits. The calculation results underline the role of the temperature and density gradients along the ablated plasma plume which lead to the spatial distinct locations of excited species. Moreover, the nanoparticles sizes are computed based on liquid layer ejection followed by a Rayleigh and Taylor instability decomposition, in good agreement with the experimental findings.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Transient stability and control of renewable generators based on Hamiltonian surface shaping and power flow control. Part II, analysis.

The swing equations for renewable generators connected to the grid are developed and a wind turbine is used as an example. The swing equations for the renewable generators are formulated as a natural Hamiltonian system with externally applied non-conservative forces. A two-step process referred to as Hamiltonian Surface Shaping and Power Flow Control (HSSPFC) is used to analyze and design feedback controllers for the renewable generators system. This formulation extends previous results on the analytical verification of the Potential Energy Boundary Surface (PEBS) method to nonlinear control analysis and design and justifies the decomposition of the system into conservative and non-conservative systems to enable a two-step, serial analysis and design procedure. The first step is to analyze the system as a conservative natural Hamiltonian system with no externally applied non-conservative forces. The Hamiltonian surface of the swing equations is related to the Equal-Area Criterion and the PEBS method to formulate the nonlinear transient stability problem. This formulation demonstrates the effectiveness of proportional feedback control to expand the stability region. The second step is to analyze the system as natural Hamiltonian system with externally applied non-conservative forces. The time derivative of the Hamiltonian produces the work/rate (power flow) equation which is used to ensure balanced power flows from the renewable generators to the loads. The Second Law of Thermodynamics is applied to the power flow equations to determine the stability boundaries (limit cycles) of the renewable generators system and enable design of feedback controllers that meet stability requirements while maximizing the power generation and flow to the load. Necessary and sufficient conditions for stability of renewable generators systems are determined based on the concepts of Hamiltonian systems, power flow, exergy (the maximum work that can be extracted from an energy flow) rate, and entropy rate. This paper will present the analysis and numerical simulation results for two nonlinear control design examples that include: (1) the One-Machine Infinite Bus (OMIB) system with a Unified Power Flow Controller (UPFC) and (2) the swing equation for a wind turbine connected to an infinite bus through a UPFC to determine the required performance of the UPFC to enable the maximum power output of a wind turbine subject to stochastic inputs while meeting the power system constraints on frequency and phase. The energy storage requirements will also be identified from the UPFC and/or FACTS devices while working in combination with the wind turbine.

17 WIND ENERGY↗

Long-Term Carbon Injection Field Test for 90% Mercury Removal for a PRB Unit a Spray Dryer and Fabric Filter

The power industry in the U.S. is faced with meeting regulations to reduce the emissions of mercury compounds from coal-fired plants. Injecting a sorbent such as powdered activated carbon (PAC) into the flue gas represents one of the simplest and most mature approaches to controlling mercury emissions from coal-fired boilers. The purpose of this test program was to evaluate the long-term mercury removal capability, long-term mercury emissions variability, and operating and maintenance (O&M) costs associated with sorbent injection on a configuration being considered for many new plants. Testing was conducted by ADA Environmental Solutions (ADA) at Rocky Mountain Power’s (RMP) Hardin Station through funding provided by DOE/NETL, RMP, and other industry partners. The Hardin Station is a new plant rated at 121 MW gross that was first brought online in April of 2006. Hardin fires a Powder River Basin (PRB) coal and is configured with selective catalytic reduction (SCR) for NOx control, a spray dryer absorber (SDA) for SO2 control, and a fabric filter (FF) for particulate control. Based upon previous testing at PRB sites with SCRs, very little additional mercury oxidation from the SCR was expected at Hardin. In addition, based upon results from DOE/NETL Phase II Round I testing at Holcomb Station and results from similarly configured sites, low native mercury removal was expected across the SDA and FF. The main goal of this project was met—sorbent injection was used to economically and effectively achieve 90% mercury control as measured from the air heater (AH) outlet to the stack for a period of ten months. This goal was achieved with DARCO® Hg-LH, Calgon FLUEPAC®-MC PLUS and ADA Power PAC PREMIUM brominated activated carbons at nominal loadings of 1.5–2.5 lb/MMacf. An economic analysis determined the twenty-year levelized cost to be 0.87 mills/kW-hr, or $15,000/lb Hg removed. No detrimental effects on other equipment or plant operations were observed. The results of this project also filled a data gap for plants firing PRB coal and configured with an SCR, SDA, and FF, as many new plants are being designed today. Another goal of the project was to evaluate, on a short-term basis, the mercury removal associated with coal additives and coal blending with western bituminous coal. The additive test showed that, at this site, the coal additive known as KNX was affective at increasing mercury removal while decreasing sorbent usage. Coal blending was conducted with two different western bituminous coals, and West Elk coal increased native capture from nominally 10% to 50%. Two additional co-benefits were discovered at this site. First, it was found that native capture increased from nominally 10% at full load to 50% at low load. The effect is believed to be due to an increase in mercury oxidation across the SCR caused by a corresponding decrease in ammonia injection when the plant reduces load. Less ammonia means more active oxidation sites in the SCR for the mercury. The second co-benefit was the finding that high ammonia concentrations can have a negative impact on mercury removal by powdered activated carbon. For a period of time, the plant operated with a high excess of ammonia injection necessitated by the plugging of one-third of the SCR. Under these conditions and at high load, the mercury control system could not maintain 90% removal even at the maximum feed rate of 3.5 lb/MMacf (pounds of mercury per million actual cubic feet). The plant was able to demonstrate that mercury removal was directly related to the ammonia injection rate in a series of tests where the ammonia rate was decreased, causing a corresponding increase in mercury removal. Also, after the SCR was refurbished and ammonia injection levels returned to normal, the mercury removal performance also returned to normal. Another goal of the project was to install a commercial-grade activated carbon injection (ACI) system and integrate it with new-generation continuous emissions monitors for mercury (Hg-CEMs) to allow automatic feedback control on outlet mercury emissions. This was accomplished and the plant can now be operated to control carbon injection based on either the overall mercury removal or an outlet mercury emission rate. By integrating these systems, it was determined that the plant could reduce powdered activated carbon consumption, especially at low load, because, at Hardin, native mercury capture increases from less than 20% to about 50% at low load and the carbon injection rate can be decreased accordingly. Currently, the plant is operating to automatically control emissions to below 0.9 lb/TBtu (pounds of mercury per million British thermal units) at carbon loadings of 0.5 to 1.5 lb/MMacf. During the final phase of the Long-Term test, the ACI system was operated by plant personnel. The estimated O&M cost for a single Hg-CEM system is $15,500/yr. The Hg-CEMs performed well throughout the project. This project began shortly after Thermo Fisher first offered the Mercury Freedom System™ on a commercial basis and progressed though several iterations, improvements, and upgrades to the hardware and software. Indeed, there was a ten-fold increase in the precision and accuracy of the units during the course of the project due to several successful upgrades. In their present condition, the Hg-CEMs measure mercury to a precision of about ± 0.05 μg/wscm (micrograms of mercury per wet standard cubic meter of gas), and only require occasional fine-tuning of the calibration coefficients. The quality assurance/quality control (QA/QC) protocol required to keep the units operating at their optimal performance was also developed and perfected during the course of the project. ADA Environmental Solutions (ADA) developed a daily calibration procedure that surpasses the requirements specified in the Clean Air Mercury Rule (CAMR), and a weekly diagnostic program that ensures that the systems are operating properly and receive the necessary maintenance. For the most part, the systems passed the daily, weekly, and quarterly QA/QC requirements as well as four performance verification tests using the Ontario Hydro (O-H) and Sorbent Trap Methods (STM) for the first test and the EPA Method 30A (M30A) procedure for the remaining three. However, some improvements are still necessary before the system can meet all of the requirements. These involve tests that challenge the system with oxidized mercury (Hg+2). These tests could not be passed at Hardin in spite of trying several improvements suggested by ADA or Thermo Fisher.

20 FOSSIL-FUELED POWER PLANTS↗

Simultaneous control of the electron temperature and safety factor profiles in DIII-D using model-based optimal control techniques

Future tokamak power plants will likely operate using a single, well-defined plasma scenario, either in steady state or for very long pulse lengths. In order to enhance the robustness of the scenario, feedback controllers for a variety of plasma properties will be necessary to counteract any disturbances and ensure safe operation. However, only a limited set of actuators will be available to control many different quantities. Because of this, it is necessary to develop controllers that are able to regulate multiple plasma properties using a limited set of actuators. To this end, a controller has been developed for the simultaneous regulation of both the electron temperature and safety factor profiles in DIII-D. This algorithm uses a linear quadratic integral control synthesis approach based on a linearized model of the dynamics of the two profiles. Two neural network surrogate models, NubeamNet and MMMnet, are included to improve the fidelity of the model. Furthermore, the controller has been tested in simulation using COTSIM, and has demonstrated the ability to simultaneously track changes in both the electron temperature and safety factor targets, including changes in both the magnitude and the shape of the profiles.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Neural network approaches for parameterized optimal control

Here, we consider numerical approaches for deterministic, finite-dimensional optimal control problems whose dynamics depend on unknown or uncertain parameters. We seek to amortize the solution over a set of relevant parameters in an offline stage to enable rapid decision-making and be able to react to changes in the parameter in the online stage. To tackle the curse of dimensionality arising when the state and/or parameter are high-dimensional, we represent the policy using neural networks. We compare two training paradigms: First, our model-based approach leverages the dynamics and definition of the objective function to learn the value function of the parameterized optimal control problem and obtain the policy using a feedback form. Second, we use actor-critic reinforcement learning to approximate the policy in a data-driven way. Using an example involving a two-dimensional convection-diffusion equation, which features high-dimensional state and parameter spaces, we investigate the accuracy and efficiency of both training paradigms. While both paradigms lead to a reasonable approximation of the policy, the model-based approach is more accurate and considerably reduces the number of PDE solves.

97 MATHEMATICS AND COMPUTING↗

Multi-scale, Multi-disciplinary, and Multi-agent Explainable AI with Koopman-Undergirded Learning, Prediction, and Analysis (M3EA KULPA) (Project Closeout Report)

The goal of this project was to develop and use domain-aware machine learning formulations, based on the Koopman Operator (KO), for modelling multi-scale, multi-disciplinary (e.g., multi-physics), and/or multi-agent systems. The project developed these formulations for the following cases: • Systems with dynamics at two separate time scales, • Systems with a bi-level hierarchical control structure, • Systems with bi-level hierarchical control and dynamics at two separate time scales (the lower level controls operating at the faster time scale), and • Systems with n separate but interacting agents/disciplines (with/without control, respectively); the controls for each agent could include bi-level hierarchical control and dynamics at two separate time scales as described above. The project then defined a set of dynamical systems consisting of different nonlinear oscillators that could be used to test these different formulations and then subsequently learned the KO models for those systems. With the KO models, we were able to do the following: • Quantify system stability, including both long-term and transient behavior, • Quantify the effects of feedbacks between the different time scales and agents/disciplines in terms of those feedbacks’ effects on system stability, • Replace a standard Proportional-Integral (PI) control in the hierarchical control structure with a KO-based Linear-Quadratic Regular (LQR), a form of optimal control, • Calculate optimal supervisory control policies a) with and without time scale separated dynamics at the lower level control levels and b) with both PI and KO-based LQR lower level control policies, and • Calculate dynamic Nash equilibria for multi-agent systems where each agent makes its own control decisions.

97 MATHEMATICS AND COMPUTING↗