Search NASA⌕ Search

SEARCH · Search NASA

Results for “feedback based control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Neural network approaches for parameterized optimal control

Here, we consider numerical approaches for deterministic, finite-dimensional optimal control problems whose dynamics depend on unknown or uncertain parameters. We seek to amortize the solution over a set of relevant parameters in an offline stage to enable rapid decision-making and be able to react to changes in the parameter in the online stage. To tackle the curse of dimensionality arising when the state and/or parameter are high-dimensional, we represent the policy using neural networks. We compare two training paradigms: First, our model-based approach leverages the dynamics and definition of the objective function to learn the value function of the parameterized optimal control problem and obtain the policy using a feedback form. Second, we use actor-critic reinforcement learning to approximate the policy in a data-driven way. Using an example involving a two-dimensional convection-diffusion equation, which features high-dimensional state and parameter spaces, we investigate the accuracy and efficiency of both training paradigms. While both paradigms lead to a reasonable approximation of the policy, the model-based approach is more accurate and considerably reduces the number of PDE solves.

97 MATHEMATICS AND COMPUTING↗

Multi-scale, Multi-disciplinary, and Multi-agent Explainable AI with Koopman-Undergirded Learning, Prediction, and Analysis (M3EA KULPA) (Project Closeout Report)

The goal of this project was to develop and use domain-aware machine learning formulations, based on the Koopman Operator (KO), for modelling multi-scale, multi-disciplinary (e.g., multi-physics), and/or multi-agent systems. The project developed these formulations for the following cases: • Systems with dynamics at two separate time scales, • Systems with a bi-level hierarchical control structure, • Systems with bi-level hierarchical control and dynamics at two separate time scales (the lower level controls operating at the faster time scale), and • Systems with n separate but interacting agents/disciplines (with/without control, respectively); the controls for each agent could include bi-level hierarchical control and dynamics at two separate time scales as described above. The project then defined a set of dynamical systems consisting of different nonlinear oscillators that could be used to test these different formulations and then subsequently learned the KO models for those systems. With the KO models, we were able to do the following: • Quantify system stability, including both long-term and transient behavior, • Quantify the effects of feedbacks between the different time scales and agents/disciplines in terms of those feedbacks’ effects on system stability, • Replace a standard Proportional-Integral (PI) control in the hierarchical control structure with a KO-based Linear-Quadratic Regular (LQR), a form of optimal control, • Calculate optimal supervisory control policies a) with and without time scale separated dynamics at the lower level control levels and b) with both PI and KO-based LQR lower level control policies, and • Calculate dynamic Nash equilibria for multi-agent systems where each agent makes its own control decisions.

97 MATHEMATICS AND COMPUTING↗

Additive Manufacturing – A New Challenge for Automation and Robotics

Additive manufacturing (AM) is a rapidly growing technology descended from the first stereolithography systems. AM describes a variety of material deposition technologies for forming objects in a digital manner layer-by-layer under computer control. Now commonly known as 3D printing, AM quickly branched out into several key directions – material extrusion, sheet lamination, direct energy deposition, vat polymerization, powder bed fusion, binder jetting, and material jetting. The common factor in all AM branches is a foundation in robotics and automation. While most of the mechanical 3D printing structures are based on simple gantry systems, there are Gough-Stewart platforms and, more recently, six or more DoF manipulator-based systems that have been developed. Currently available commercial systems are based on open-loop control with minimum sensing capabilities; the latest systems in development are starting to take advantage of complex feedback loops and layers of advanced sensing and data logging. The Manufacturing Demonstration Facility of Oak Ridge National Laboratory is leading the efforts in applying advanced robotics in the creation of large-scale 3D printers. The recent demonstration of an additively manufactured excavator at the CONEXPO 2017 exhibition in Las Vegas showed that the use of cutting edge robotics and automation is essential for the next generation of additive systems. The future of AM will heavily rely on advanced robotics, machine learning, and the internet of things. This paper summarizes progress in AM; presents the practical aspects, challenges, and lessons learned in developing robotic-based AM systems; and outlines the needs and future directions of robotics for AM.

Nycz, Andrzej↗

In Situ High-Temperature Ultrafast Electron Diffraction through Integrated Furnace and MEMS Platforms

Temperature fundamentally governs phase stability, defect evolution, and transport behavior in materials. Despite its central role, direct measurements of structural evolution at elevated temperatures on ultrafast timescales have remained limited. Here, we report the design, integration, and validation of 2 complementary in situ heating platforms that substantially extend the thermal operating range of ultrafast electron diffraction (UED). A compact furnace-type heating stage enables stable diffraction measurements from room temperature to 800 K with ±0.1 K stability under ultrahigh vacuum, achieved through multi-sensor feedback control, dual air-cooling channels, and a thermally isolated motion stage. In parallel, a microelectromechanical system (MEMS)-based heating platform provides rapid thermal response and access to extreme temperatures ≥1,373 K with ±0.1 K stability over hundreds-micrometer regions while supporting simultaneous electrical biasing for electrothermal coupling studies. Absolute temperature calibration is established using diffraction-based thermometry via aluminum lattice expansion and independently validated through in situ melting of bismuth thin films. UED measurements further reveal pronounced temperature-dependent nonequilibrium lattice dynamics in bismuth, including modifications to electron–phonon coupling and Debye–Waller behavior, as well as enhanced ultrafast diffuse scattering in aluminum at elevated temperatures. Together, these developments establish a practical framework for quantitative, time-resolved studies of temperature-driven kinetics and nonequilibrium structural dynamics under extreme thermal environments.

Bai, Qianqian [Chinese Academy of Sciences (CAS), ↗

Reinforcement Learning of Structured Stabilizing Control for Linear Systems With Unknown State Matrix

This paper delves into designing feedback control gains for a continuous-time linear quadratic regulator (LQR) problem that is constrained to certain predefined structure with unknown state matrix. We bring forth the ideas from reinforcement learning (RL) in conjunction with sufficient stability and performance guarantees in order to design these structured gains using the trajectory measurements of states and controls. Here we first formulate a model-based framework using dynamic programming (DP) to embed the structural constraint to the LQR gain computation in the continuous-time setting, and then subsequently, formulate a policy iteration RL algorithm that can alleviate the requirement of known state matrix in conjunction with maintaining the feedback gain structure. The design enables a distributed learning control design which is necessary for many large-scale cyber-physical systems. Theoretical guarantees are provided for stability and convergence of the structured reinforcement learning (SRL) algorithm. We validate our theoretical results with numerical simulations on a multi-agent networked linear time-invariant (LTI) dynamic system.

42 ENGINEERING↗

Version pressure feedback mechanisms for speculative versioning caches

Mechanisms are provided for controlling version pressure on a speculative versioning cache. Raw version pressure data is collected based on one or more threads accessing cache lines of the speculative versioning cache. One or more statistical measures of version pressure are generated based on the collected raw version pressure data. A determination is made as to whether one or more modifications to an operation of a data processing system are to be performed based on the one or more statistical measures of version pressure, the one or more modifications affecting version pressure exerted on the speculative versioning cache. An operation of the data processing system is modified based on the one or more determined modifications, in response to a determination that one or more modifications to the operation of the data processing system are to be performed, to affect the version pressure exerted on the speculative versioning cache.

97 MATHEMATICS AND COMPUTING↗

Diagnostic options for radiative divertor feedback control on NSTX-U

A radiative divertor technique is used in present tokamak experiments and planned for ITER to mitigate high heat loads on divertor plasma-facing components (PFCs) to prevent excessive material erosion and thermal damage. In NSTX, a large spherical tokamak with lithium-coated graphite PFCs and high divertor heat flux (q{sub peak} Less-Than-Or-Slanted-Equal-To 15 MW/m{sup 2}), radiative divertor experiments have demonstrated a significant reduction of divertor peak heat flux simultaneously with good core H-mode confinement using pre-programmed D{sub 2} or CD{sub 4} gas injections. In this work diagnostic options for a new real-time feedback control system for active radiative divertor detachment control in NSTX-U, where steady-state peak divertor heat fluxes are projected to reach 20-30 MW/m{sup 2}, are discussed. Based on the NSTX divertor detachment measurements and analysis, the control diagnostic signals available for NSTX-U include divertor radiated power, neutral pressure, spectroscopic deuterium recombination signatures, infrared thermography of PFC surfaces, and thermoelectric scrape-off layer current. In addition, spectroscopic 'security' monitoring of possible confinement or pedestal degradation is recommended. These signals would be implemented in a digital plasma control system to manage the divertor detachment process via an actuator (impurity gas seeding rate).

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Control Strategies for HCCI Mixed-Mode Combustion

Delphi Automotive Systems and ORNL established this CRADA to expand the operational range of Homogenous Charge Compression Ignition (HCCI) mixed-mode combustion for gasoline en-gines. ORNL has extensive experience in the analysis, interpretation, and control of dynamic engine phenomena, and Delphi has extensive knowledge and experience in powertrain compo-nents and subsystems. The partnership of these knowledge bases was important to address criti-cal barriers associated with the realistic implementation of HCCI and enabling clean, efficient operation for the next generation of transportation engines. The foundation of this CRADA was established through the analysis of spark-assisted HCCI data from a single-cylinder research engine. This data was used to (1) establish a conceptual kinetic model to better understand and predict the development of combustion instabilities, (2) develop a low-order model framework suitable for real-time controls, and (3) provide guidance in the initial definition of engine valve strategies for achieving HCCI operation. The next phase focused on the development of a new combustion metric for real-time characterization of the combustion process. Rapid feedback on the state of the combustion process is critical to high-speed decision making for predictive control. Simultaneous to the modeling/analysis studies, Delphi was focused on the development of engine hardware and the engine management system. This included custom Delphi hardware and control systems allowing for flexible control of the valvetrain sys-tem to enable HCCI operation. The final phase of this CRADA included the demonstration of conventional and spark assisted HCCI on the multi-cylinder engine as well as the characterization of combustion instabilities, which govern the operational boundaries of this mode of combustion. ORNL and Delphi maintained strong collaboration throughout this project. Meetings were held on a bi-weekly basis with additional reports, presentation, and meetings as necessary to maintain progress. Delphi provided substantial support through modeling, hardware, data exchange, and technical consultation. This CRADA was also successful at establishing important next steps to further expanding the use of an HCCI engine for improved fuel efficiency and emissions. These topics will be address in a follow-on CRADA. The objectives are: (1) Improve fundamental understanding of the development of combustion instabilities with HCCI operation through modeling and experiments; (2) Develop low-order model and feedback combustion metrics which are well suited to real-time predictive controls; and (3) Construct multi-cylinder engine system with advanced Delphi technologies and charac-terize HCCI behavior to better understand limitations and opportunities for expanded high-efficiency operation.

02 PETROLEUM↗

TRANSP-based closed-loop simulations of current profile optimal regulation in NSTX-Upgrade

Active control of the toroidal current density profile is critical for the upgraded National Spherical Torus eXperiment device (NSTX-U) to maintain operation at the desired high-performance, MHD-stable, plasma regime. Initial efforts towards current density profile control have led to the development of a control-oriented, physics-based, plasma-response model, which combines the magnetic diffusion equation with empirical correlations for the kinetic profiles and the non-inductive current sources. The developed control-oriented model has been successfully tailored to the NSTX-U geometry and actuators. Moreover, a series of efforts have been made towards the design of model-based controllers, including a linear-quadratic-integral optimal control strategy that can regulate the current density profile around a prescribed target profile while rejecting disturbances. In this work, the tracking performance of the proposed current-profile optimal controller is tested in numerical simulations based on the physics-oriented code TRANSP. These high-fidelity closed-loop simulations, which are a critical step before experimental implementation and testing, are enabled by a flexible framework recentlydeveloped to perform feedback control design and simulation in TRANSP.

current profile control↗

Model-free adaptive control for MHTGR-based nuclear steam supply systems - 144

Modular high temperature gas-cooled reactor (MHTGR) uses helium as coolant and graphite as both moderator and structural materials. Due to its inherent safety feature, MHTGR has been regarded as an important candidate for next generation of nuclear plants. By coupling with the once-through steam generator (OTSG), MHTGR can be utilized to form the nuclear steam supply system (NSSS) for producing superheated steam, which can be adopted for nuclear plants with high efficiency. Power-level control of is important for the stable and efficient operation of the MHTGR-based NSSS, and it is necessary to develop the power-level control law that is robust to physical and thermal parameters and can guarantee the closed-loop stability in normal and even abnormal conditions. In this paper, a model-free adaptive power-level control law is developed for the MHTGR-based NSSS, which is free from physical and thermal-hydraulic parameters, takes the simple forms of proportional-integral (PI) or proportional-differential (PD) feedback law, and can provide globally asymptotic closed-loop stability. Then, it is applied to the NSSS control of the two modular high temperature gas-cooled nuclear plant HTR-PM. Numerical simulation results in normal power maneuver and some typical abnormal cases show that this new control law can provide satisfactory closed-loop stability as well as transient performance. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Optimal Power Flow With State Estimation in the Loop for Distribution Networks

Here in this article, we propose a framework for running optimal control-estimation synthesis in distribution networks. Our approach combines a primal-dual gradient-based optimal power flow solver with a state estimation feedback loop based on a limited set of sensors for system monitoring, instead of assuming exact knowledge of all states. The estimation algorithm reduces uncertainty on unmeasured grid states based on certain online state measurements and noisy "pseudomeasurements." We analyze the convergence of the proposed algorithm and quantify the statistical estimation errors based on a weighted least-squares estimator. The numerical results on a 4521-node network demonstrate that this approach can scale to extremely large networks and provide robustness to both large pseudomeasurement variability and inherent sensor measurement noise.

24 POWER TRANSMISSION AND DISTRIBUTION↗

On Distributed Model-Free Reinforcement Learning Control with Stability Guarantee

Distributed learning can enable scalable and effective decision making in numerous complex cyber-physical systems such as smart transportation, robotics swarm, power systems, etc. However, the stability of the system is usually not guaranteed in most existing learning paradigms; and this limitation can hinder the wide deployment of machine learning in decision making of safety-critical systems. This paper presents a stability guaranteed distributed reinforcement learning (SGDRL) framework for interconnected linear subsystems, without knowing the subsystem models. While the learning process requires data from a peer-to-peer (p2p) communication architecture, the control implementation of each subsystem is only based on its local state. The stability of the interconnected subsystems will be ensured by a diagonally dominant eigenvalue condition, which will then be used in a model-free RL algorithm to learn the feedback control gains. The RL algorithm structure follows an off-policy iterative framework, with interleaved policy evaluation and policy update steps. We numerically validate our theoretical results by performing simulations on four interconnected sub-systems.

Mukherjee, Sayak↗

Home energy management (HEM) database: A list with coded attributes of 308 devices commercially available in the US

Policymakers worldwide are currently discussing whether to include home energy management (HEM) products in their portfolio of technologies to reduce carbon emissions and improve grid reliability. However, very little data is available about these products. Here we present the results of an extensive review including 308 HEM products available on the US market in 2015–2016. We gathered these data from publicly available sources such as vendor websites, online marketplaces and other vendor documents. A coding guide was developed iteratively during the data collection and utilized to classify the devices. Each product was coded based on 96 distinct attributes, grouped into 11 categories: Identifying information, Product components, Hardware, Communication, Software, Information - feedback, Information - feedforward, Control, Utility interaction, Additional benefits and Usability. The codes describe product features and functionalities, user interaction and interoperability with other devices. A mix of binary attributes and more descriptive codes allow to sort and group data without losing important qualitative information. The information is stored in a large spreadsheet included with this article, along with an explanatory coding guide. This dataset is analyzed and described in a research article entitled “Categories and functionality of smart home technology for energy management” (Ford et al., 2017) [1].

Home automation↗

FPGA-Based Spill Regulation System for the Muon Delivery Ring at Fermilab

The Muon to Electron Experiment (Mu2e) requires a uniform beam profile from the Muon Delivery Ring to meet their experimental needs. A specialized Spill Regulation System (SRS) has been developed to help achieve consistent spill uniformity. The system is based on a custom-designed carrier board featuring an Arria 10 SoC, capable of executing real-time feedback control. The FPGA processes beam pulses of approximately 200 ns every 1.695 $μ$s, allowing for continuous monitoring of the extracted spill intensity through fast bunch integration. The system directly controls three quadrupole magnets, which work in conjunction with sextupole magnets to achieve third-order resonant extraction. Furthermore, the board interfaces with Fermilab's Accelerator Control Network (ACNET), enabling operators to modify spill regulation settings in real-time via the control network while providing diagnostic waveforms. These waveforms help operators monitor the process and fine-tune the feedback mechanisms. This paper presents an overview of the board's architecture and its initial progress toward regulating beam extraction. This initial version of the regulation system aims to evaluate baseline performance to inform future system improvements.

Berlioz, J. R. [Fermilab]↗

FPGA-Based Spill Regulation System for the Muon Delivery Ring at Fermilab

The Muon to Electron Experiment (\acrshort{Mu2e}) requires a uniform beam profile from the Muon Delivery Ring to meet their experimental needs. A specialized Spill Regulation System (\acrshort{SRS}) has been developed to help achieve consistent spill uniformity. The system is based on a custom-designed carrier board featuring an Arria 10 SoC, capable of executing real-time feedback control. The FPGA processes beam pulses of approximately 200 ns every 1.695 microseconds, allowing for continuous monitoring of the extracted spill intensity through fast bunch integration. The system directly controls three quadrupole magnets, which work in conjunction with sextupole magnets to achieve third-order resonant extraction. Furthermore, the board interfaces with Fermilab s Accelerator Control Network (ACNET), enabling operators to modify spill regulation settings in real-time via the control network while providing diagnostic waveforms. These waveforms help operators monitor the process and fine-tune the feedback mechanisms. This paper presents an overview of the board's architecture and its initial progress toward regulating beam extraction. This initial version of the regulation system aims to evaluate baseline performance to inform future system improvements.

Berlioz, Jose Rene [Fermilab]↗

Real-Time Feedback-Based Optimization of Distribution Grids: A Unified Approach

This paper develops an algorithmic framework for real-time optimization of distribution-level distributed energy resources (DERs). The framework optimizes the operation of both DERs that are individually controllable and groups of DERs (i.e., aggregations) that are jointly controlled at an electrical point of connection. From an electrical standpoint, wye and delta single- and multi-phase connections are accounted for. The algorithm enables (groups of) DERs to pursue given performance objectives, while adjusting their (aggregate) powers to respond to services requested by grid operators and to maintain electrical quantities within engineering limits. The design of the algorithm leverages a time-varying bi-level problem formulation capturing various performance objectives and engineering constraints, and an online implementation of primal-dual projected-gradient methods. The gradient steps are suitably modified to accommodate appropriate measurements from the distribution network and the DERs. Stability and convergence claims are established in terms of tracking of the solution of the time-varying optimization problem. Finally, the method is tested in a realistic distribution.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Expanding Robust HCCI Operation with Advanced Valve and Fuel Control Technologies

Delphi Automotive Systems and ORNL established this CRADA to advance the commercialization potential of the homogeneous charge compression ignition (HCCI) advanced combustion strategy for gasoline engine platforms. HCCI combustion has been shown by others to produce high diesel-like efficiency on a gasoline engine platform while simultaneously producing low NOX and particulate matter emissions. However, the commercialization barriers that face HCCI combustion are significant, with requirements for a more active engine control system, likely with next-cycle closed-loop feedback control, and with advanced valve train technologies to enable negative valve overlap conditions. In the partnership between Delphi and ORNL, each organization brought a unique and complementary set of skills to the project. Delphi has made a number of breakthroughs with production-intent valve train technologies and controls in recent years to make a part time production-intent HCCI engine plausible. ORNL has extensive knowledge and expertise with HCCI combustion, and also has a versatile research engine with hydraulic valve actuation (HVA) that is useful for guiding production of a cam-based HCCI system. Partnering these knowledge bases and capabilities was essential towards making progress to better understand HCCI combustion and the commercialization barriers that it faces. ORNL and Delphi maintained strong collaboration throughout the project. Meetings were held regularly, with additional reports, presentations, and meetings as necessary to maintain progress. Delphi provided guidance to ORNL regarding operational strategies to investigate on their single-cylinder research engine with HVA and data from their experimental multi-cylinder engine for modeling. ORNL provided single-cylinder engine data and modeling results.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Aligning theoretical and empirical representations of soil carbon-to-nitrogen stoichiometry with process-based terrestrial biogeochemistry models

Soil carbon-nitrogen (C:N) stoichiometry acts as a control over decomposition and soil organic matter formation and loss, making it a key soil property for understanding ecosystem dynamics and projected ecosystems responses to global environmental change. However, the controls of soil C:N and how they respond to increasing pressures from global change agents are not fully understood. The “foundational” controls on soil C:N, namely plant and microbial C:N, have been used to predict soil C:N, but fail to accurately simulate all ecosystems and may be insufficient for predictions under global environmental change. Here we present an “emerging” representation of controls of soil C:N that includes plant-microbe-mineral feedbacks that have been shown to regulate soil C:N. We argue that including representation of these emerging drivers in process-based terrestrial biogeochemistry models, which include biological N fixation, mycorrhizae, priming, root exudation of organic acids, and mineralogy (including soil texture, mineral composition, and aggregation), will improve mechanistic representation of soil C:N and associated processes. Such improvements will produce models that will better simulate a variety of ecological states and predict soil C:N when global changes modify plant-microbe-mineral interactions. Here, we align our empirical understanding of controls of soil C:N with those controls represented in models, identifying contexts where emerging drivers might be particularly important to represent (e.g., priming and root exudation in nutrient-limited conditions) and areas of future work. Additionally, we show that implementing emerging drivers of soil C:N results in different simulated outcomes at steady state and in response to elevated atmospheric CO2. Our review and preliminary simulations support the need to incorporate emerging drivers of soil C:N into process-based terrestrial biogeochemistry models, allowing for both theoretical exploration of mechanisms and potentially more accurate predictions of land biogeochemical responses to global change.

54 ENVIRONMENTAL SCIENCES↗