Search NASA⌕ Search

SEARCH · Search NASA

Results for “FEEDBACK CONTROL”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Integration of pH Control into Chi.Bio Reactors and Demonstration with Small-Scale Enzymatic Poly(ethylene terephthalate) Hydrolysis

Small-scale bioreactors that are affordable and accessible would be of major benefit to the research community. In previous work, an open-source, automated bioreactor system was designed to operate up to the 30 mL scale with online optical monitoring, stirring, and temperature control, and this system, dubbed Chi.Bio, is now commercially available at a cost that is typically 1–2 orders of magnitude less than commercial bioreactors. In this work, we further expand the capabilities of the Chi.Bio system by enabling continuous pH monitoring and control through hardware and software modifications. For hardware modifications, we sourced low-cost, commercial pH circuits and made straightforward modifications to the Chi.Bio head plate to enable continuous pH monitoring. For software integration, we introduced closed-loop feedback control of the pH measured inside the Chi.Bio reactors and integrated a pH-control module into the existing Chi.Bio user interface. We demonstrated the utility of pH control through the small-scale depolymerization of the synthetic polyester, poly(ethylene terephthalate) (PET), using a benchmark cutinase enzyme, and compared this to 250 mL bioreactor hydrolysis reactions. The results in terms of PET conversion and rate, measured both by base addition and product release profiles, are statistically equivalent, with the Chi.Bio system allowing for a 20-fold reduction of purified enzyme required relative to the 250 mL bioreactor setup. Through inexpensive modifications, the ability to conduct pH control in Chi.Bio reactors widens the potential slate of biochemical reactions and biological cultivations for study in this system, and may also be adapted for use in other bioreactor platforms.

09 BIOMASS FUELS↗
DOE OSTI2026

Autonomous fabrication of tailored defect structures in 2D materials using machine learning-enabled scanning transmission electron microscopy

Materials with tailored quantum properties can be engineered from atomic-scale assembly techniques, but existing methods often lack the agility and accuracy to precisely and intelligently control the manufacturing process. Here, we demonstrate a fully autonomous approach for fabricating atomic-level defects using electron beams in scanning transmission electron microscopy (STEM) that combines advanced machine learning and automated beam control. As a proof of concept, we achieved controlled fabrication of MoS-nanowire (MoS-NW) edge structures by iterative and targeted exposure of MoS 2 monolayer to a focused electron beam to selectively eject sulfur atoms, utilizing high-angle annular dark-field (HAADF) imaging for feedback-controlled monitoring of structural evolution of defects. A machine learning framework combining a random forest model and a convolutional neural network (CNN) was developed to decode the HAADF image and accurately identify atomic positions and species. This atomic-level information was then integrated into an autonomous decision-making platform, which applied predefined fabrication strategies to instruct beam control about atomic sites to be ejected. The selected sites were subsequently exposed to a localized electron beam using an FPGA-controlled scan routine with precise control over beam positioning and duration. While the MoS-NW edge structures produced exhibit promising mechanical and electronic properties, the proposed methods to build the autonomous fabrication framework is material-agnostic and can be extended to other 2D materials for the creation of diverse defect structures and heterostructures beyond Mo S2 .

Engineering↗
DOE OSTI2021

On Distributed Model-Free Reinforcement Learning Control with Stability Guarantee

Distributed learning can enable scalable and effective decision making in numerous complex cyber-physical systems such as smart transportation, robotics swarm, power systems, etc. However, the stability of the system is usually not guaranteed in most existing learning paradigms; and this limitation can hinder the wide deployment of machine learning in decision making of safety-critical systems. This paper presents a stability guaranteed distributed reinforcement learning (SGDRL) framework for interconnected linear subsystems, without knowing the subsystem models. While the learning process requires data from a peer-to-peer (p2p) communication architecture, the control implementation of each subsystem is only based on its local state. The stability of the interconnected subsystems will be ensured by a diagonally dominant eigenvalue condition, which will then be used in a model-free RL algorithm to learn the feedback control gains. The RL algorithm structure follows an off-policy iterative framework, with interleaved policy evaluation and policy update steps. We numerically validate our theoretical results by performing simulations on four interconnected sub-systems.

Mukherjee, Sayak↗
DOE OSTI2025

Multiphysics Modeling of Microreactors with NEAMS codes, and Validation Based on KRUSTY Reactivity Insertion

The NEAMS Multiphysics Applications team continues to assess code usability and functionality for microreactor design and safety analyses, while demonstrating that NEAMS tools capture both steady-state and transient behavior across distinct microreactor concepts. In FY2025, the team advanced full-core, high-fidelity, multiphysics models that solve more complex problems and strengthen verification/validation for several microreactor systems: heat-pipe microreactor (HPMR), gas-cooled microreactor (GCMR), and the KRUSTY experiment. These models employ the MOOSE MultiApp/Transfers architecture with Griffin for neutronics, BISON for heat conduction/thermomechanics, Sockeye for heat pipes, SAM/THM for coolant channels and loops, and SWIFT for hydride behavior, with meshes generated via the MOOSE Reactor Module. The graphite models available in the Grizzly code were also investigated for future analyses. For the HPMR, a Na-HPMR variant was constructed to align with recently validated heat-pipe experiments and Sockeye’s LCVF capability, enabling mechanistic heat-pipe transients and startup modeling. The Na-HPMR will serve as the primary model for HPMR investigations in upcoming tasks. The load-following and single heat-pipe failure scenarios (Griffin/BISON/Sockeye), which were previously modeled for the K-HPMR, were replicated for the Na-HPMR, showing strong negative temperature feedback and highly localized thermal effects, respectively, while the startup case captured vapor-front progression and heat-removal activation. Solid mechanics was added to the previously built K-HPMR full-core model in BISON, showing minimal impact on steady-state reactivity yet enabling stress-field predictions that prepare the path for full-core TRISO performance analyses. For the GCMR, automated steady-state and four transient scenarios were executed using Griffin/BISON/SAM/SWIFT. Results confirm robust inherent safety: power collapses promptly in loss-of-cooling events, the inlet-temperature drop settles to a new equilibrium, and a single-channel blockage yields only a ~30 K local fuel-temperature rise with <0.4% power decrease. SWIFT-predicted hydrogen redistribution affects reactivity during both steady-state and transient conditions, underscoring its importance. A Brayton-cycle balance of plant (BOP) model in SAM/THM demonstrated stable startup behavior, and xenon-driven reactivity during load following was analyzed. To improve TRISO-compact temperature fidelity, a fast multiscale Heat Source Decomposition (HSD) treatment was implemented. Against heterogeneous benchmarks, HSD reduces underprediction of kernel temperatures and lowers predicted peak powers in reactivity-insertion transients compared to previous homogenized models. KRUSTY warm-critical validation progressed from FY2024 baselines: the 15Ȼ insertion shows excellent agreement in peak power (~2% high) and temperature trends, and the 30Ȼ case was automated via a feedback controller that maintained power near 3 kW for ~150 s with close agreement to data. The successful modeling of the warm critical tests has laid a strong foundation for simulating more complex nuclear system tests in the years ahead. Throughout FY2025, developer feedback was provided (e.g., MOOSE batch mesh generation, distributed pre-split meshes, Griffin sweeper on displaced meshes), several new models were contributed to the Virtual Test Bed, and an OECD-NEA WPRS multiphysics benchmark based on the HPMR was initiated to enable broader cross-comparison and best-practice development with the nuclear community at large.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

Real-time avoidance of the L-mode and H-mode density limit via machine-learned stability metrics

Reliable operation of burning plasma tokamaks will require robust control strategies to avoid macroscopic instability limits such as the L-mode and H-mode density limits (LDL, HDL). In this work, we explore closed-loop avoidance of these phenomena at DIII-D using machine-learned risk metrics. Feedback control is implemented via the ‘DL Supervisor’ scheme, which regulates the chosen risk metric by reducing the density target or increasing NBI heating in real-time. Using the LDL 25 risk metric, the LDL is reproducibly suppressed. We also introduce an HDL risk metric in this study, HDL 25 , which reduces the False Positive Rate by 2x compared to the Greenwald fraction. Applying this scaling to a plasma current ramp-down, we successfully avoid an HDL-driven H/L back-transition. These experiments constitute the first demonstration of real-time DL avoidance using machine-learned risk metrics. These instability metrics outline a path to safer high-density operation, more reliable ramp-down scenarios, and improved off-normal control for next-step devices such as ITER and SPARC.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Communication enabled fast-acting imbalance reserve

A system and method for control of dispatchable resources on an electrical power distribution grid is disclosed. The disclosed method provides improved response to power imbalance based on a communications signal independent of system frequency. The communication signal provides a feed-forward control of dispatchable power resources. A communications network is employed to generate a signal to dispatchable resources that a power imbalance has occurred. Due to fast response power transmission network interfaces associated with the dispatchable resources, the respective resources respond in significantly less time than feedback controlled conventional generators which depend on line frequency sensing. The rapid response mitigates the impact of power imbalances and enables greater penetrations of converter-interfaced power generation units such as renewable energy sources to be connected to the grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Entanglement engineering of optomechanical systems by reinforcement learning

Entanglement is fundamental to quantum information science and technology, yet controlling and manipulating entanglement—so-called entanglement engineering—for arbitrary quantum systems remains a formidable challenge. There are two difficulties: the fragility of quantum entanglement and its experimental characterization. We develop a model-free deep reinforcement-learning (RL) approach to entanglement engineering, in which feedback control together with weak continuous measurement and partial state observation is exploited to generate and maintain desired entanglement. We employ quantum optomechanical systems with linear or nonlinear photon–phonon interactions to demonstrate the workings of our machine-learning-based entanglement engineering protocol. In particular, the RL agent sequentially interacts with one or multiple parallel quantum optomechanical environments, collects trajectories, and updates the policy to maximize the accumulated reward to create and stabilize quantum entanglement over an arbitrary amount of time. The machine-learning-based model-free control principle is applicable to the entanglement engineering of experimental quantum systems in general.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

An analysis of controlled detachment by seeding various impurity species in high performance scenarios on DIII-D and EAST

Experiments at DIII-D and EAST have demonstrated simultaneous high confinement, divertor detachment, and active control of detachment level, all of which are required for ITER. Comparing detachment control via T e and J sat , it appears that is the most straightforward sensor to use for accessing detachment onset, while J sat offers more precise control of degree of detachment. Based on these results, control using nitrogen seeding has so far shown the best ability to follow a target value with the low disruptivity and little to no degradation of performance when an Internal Transport Barrier (ITB) is present, but not all facilities allow its use. Neon seeding also can be paired with feedback control with low impact on core performance as long as there is no disruption, however shots with neon seeding commonly disrupted during these experiments. Argon is effective in EAST, but tends to degrade performance (by ≈ 10%β p ) when detachment is achieved. With ideal conditions and strike point position control, data from a single Langmuir probe are an acceptable input to the control algorithm, but this simple system is easily defeated by strike point displacement comparable to the T e or J sat scale lengths. The presence of an ITB seems to be critical to retaining core performance in detachment in these parameter ranges, as the pedestal pressure tends to decrease as a result of impurity seeding.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Data-Driven Linear Parameter-Varying Modeling and Control of Flexible Loads for Grid Services

Flexible loads have great potential to improve the electric grid's flexibility and stability. To effectively control large ensembles of heterogeneous loads, reliable models thereof are required. This paper presents a data-driven modeling and control approach to manage flexible loads for providing grid services. We leverage a linear parameter-varying autoregressive moving average (LPV-ARMA) model to describe the aggregate load response, where the parameters in the model are used to capture external environmental impacts (e.g., weather). A gain-scheduling feedback controller is then developed to adapt to environmental variations. This data-driven approach can be easily applied to different types of loads in various environmental conditions. In addition to the ensemble controller, distributed load controllers are designed to deliver grid services, while maintaining the quality of service of inherent load tasks. We demonstrate the work on the IEEE 37-node distribution system for real-time power regulation services through control of thermostatically controlled loads.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2020

Data-Driven Linear Parameter-Varying Modeling and Control of Flexible Loads for Grid Services: Preprint

Flexible loads have great potential to improve the power grid's flexibility and stability. To effectively control large ensembles of heterogeneous loads, reliable models thereof are required. The paper presents a data-driven modeling and control approach to manage flexible loads for providing grid services. We leverage a linear parameter-varying autoregressive moving average (LPV-ARMA) model to describe the aggregate load response, where the parameters in the model are used to capture external environment impacts (e.g., weather). A gain-scheduling feedback controller is then developed to adapt to environmental variations. This data-driven approach can be easily applied to different types of loads in various environmental conditions. In addition to the ensemble controller, distributed load controllers are designed to deliver grid services, while maintaining the quality of service of inherent load tasks. We demonstrate the work on the IEEE 37-node distribution system for real-time power regulation services through control of thermostatically controlled loads.

control↗
DOE OSTI2021

Asynchronous quadratic control for constrained hidden markov jump linear systems with incomplete MTPM and MOCPM

Abstract This paper investigates the quadratic optimal control problem for constrained Markov jump linear systems with incomplete mode transition probability matrix (MTPM). Considering original system mode is not accessible, observed mode is utilized for asynchronous controller design where mode observation conditional probability matrix (MOCPM), which characterizes the emission between original modes and observed modes is assumed to be partially known. An LMI optimization problem is formulated for such constrained hidden Markov jump linear systems with incomplete MTPM and MOCPM. Based on this, a feasible state-feedback controller can be designed with the application of free-connection weighting matrix method. The desired controller, dependent on observed mode, is an asynchronous one which can minimize the upper bound of quadratic cost and satisfy restrictions on system states and control variables. Furthermore, clustering observation where observed modes recast into several clusters, is explored for simplifying the computational complexity. Numerical examples are provided to illustrate the validity.

Zhu, Jin↗
DOE OSTI2021

Deep Reinforcement Scheduling of Energy Storage Systems for Real-time Voltage Regulation in Unbalanced LV Networks with High PV Penetration

The ever-growing higher penetration of distributed energy resources (DERs) in low-voltage (LV) distribution systems brings both opportunities and challenges to voltage support and regulation. This paper proposes a deep reinforcement learning (DRL)-based scheduling scheme of energy storage systems (ESSs) to mitigate system voltage deviations in unbalanced LV distribution networks. The ESS-based voltage regulation problem is formulated as a multi-stage quadratic stochastic program, with the objective of minimizing the expected total daily voltage regulation cost while satisfying operational constraints. While existing voltage regulation methods are mostly focused on onetime- step control, this paper explores a day-horizon systemwide voltage regulation problem. In other words, the size of action and state spaces are extremely high-dimensional and need to be delicately handled. Furthermore, in order to overcome the difficulty of modeling uncertainties and develop a realtime solution, a learn-to-schedule feedback control framework is proposed by adapting the problem to a model-free DRL setting. The proposed algorithm is tested on a customized 6-bus system and a modified IEEE 34-bus system. Simulation results validate the effectiveness and near-optimality of voltage regulation by ESS in comparison with a deterministic quadratic program solution.

Wang, Shengyi↗
DOE OSTI2020

Correlation approach for quality assurance of additive manufactured parts based on optical metrology

Surface topography and surface finish are two significant factors for evaluating the quality of products in additive manufacturing (AM). AM parts are fabricated layer by layer, which is quite different from traditional formative or subtractive methods. Despite rapid progress in additive manufacturing and associated optical metrology for quality control and in-situ monitoring, limited research has been conducted to investigate the reliability of 3D surface measurement data. The surface topologies scanned by multiple optical systems demonstrated significant differences due to varying sampling mechanisms, resolutions, system noises, etc. The 3D datasets should be trustworthy in order to extract parameters for quality assurance or feedback control from 3D surface measurements. In this paper, we set up new standards to evaluate the reliability of 3D surface measurement data and analyze the variation in the topographical profile. In this study, two non-contact optical methods based on Focus Variation Microscopy (FVM) and Structured Light System (SLS) were adopted to measure the surface topography of the target components. The two optical metrology systems generated two entirely different point cloud datasets. Statistical methods were applied to test the difference between the data obtained from the two systems. By using a data analytics approach for comparison, it was found that the surface roughness estimated from the point cloud data sets of FVM and SLS has no significant difference, though the point cloud data sets were completely different. This paper provides standard validation approach to evaluate the plausibility of metrology data from in-situ real-time surface analysis for process planning of AM.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Nonlinear hydrostatic control of a wave energy converter

Increased energy harvesting is realized using a nonlinear buoy geometry for reactive power generation. By exploiting the nonlinear dynamic coupling between the buoy geometry and the potential wideband frequency spectrum of incoming waves in the controller/buoy design, increased power can be captured in comparison to conventional wave energy converter designs. In particular, the reactive power and energy storage system requirements are inherently embedded in the nonlinear buoy geometry, therefore requiring only simple rate-feedback control.

Wilson, David G.↗
DOE OSTI2025

Observer-Based Nonlinear Control Scheme to Reduce Oscillations and Zero Crossing in Skid-Steer Vehicles

Motion sickness is a common condition experienced by drivers of skid-steer vehicles, primarily caused by zero crossing and oscillations in undamped systems. This study proposes an observer-based nonlinear control scheme to reduce transient oscillations and zero-crossing phenomena in skid-steer vehicles, thereby potentially alleviating motion sickness. Reducing transient oscillations and zero crossing in the transient response may alleviate motion sickness. A nonlinear damping controller is designed to improve transient response by reducing oscillations and zero-crossing. To design the controller, a reduced-order kinematic model based on coordinate transformation is developed. This transformation not only converts the system modeling into a controllable form but also enhances control performance. Modeling error is addressed by considering the distance between the center of the vehicle and the sensor location. Despite these improvements, model uncertainties and external disturbances remain, which may degrade control performance. To ensure robustness and estimate such disturbances, a high-order sliding mode observer (HOSMO) is incorporated. The effectiveness of the proposed method is validated through MATLAB/Simulink and TruckMaker simulations. From the simulation results, it was shown that the proposed method reduced the mean squared error of the tracking error to within 10 % compared to the state feedback controller with the HOSMO.

Seo, Jiwon [Chung-Ang University, Seoul (Korea, Re↗
DOE OSTI2021

Model predictive control for integrated control of air-conditioning and mechanical ventilation, lighting and shading systems

Modern buildings are increasingly automated and often equipped with multiple building services (e.g., air-conditioning and mechanical ventilation (ACMV), dynamic shading, dimmable lighting). These systems are conventionally controlled individually without considering their interactions, affecting the building’s overall energy inefficiency and occupant comfort. A model predictive control (MPC) system that features a multi-objective MPC scheme to enable coordinated control of multiple building services for overall optimized energy efficiency, indoor thermal and visual comfort, as well as a hybrid model for predicting indoor visual comfort and lighting power is proposed. The MPC system was implemented in a test facility having two identical, side-by-side experimental cells to facilitate comparison with a building management system (BMS) employing conventional reactive feedback control. The MPC system coordinated the control of the ACMV, dynamic façade and automated dimmable lighting systems in one cell while the BMS controlled the building services in the other cell in a conventional manner. The MPC side achieved 15.1–20.7% electricity consumption reduction, as compared to the BMS side. Simultaneously, the MPC system improved indoor thermal comfort by maintaining the room within the comfortable range (-0.5 < predicted mean vote < 0.5) for 98.3% of the time, up from 91.8% of the time on the BMS side. Visual comfort, measured by indoor daylight glare probability (DGP) and horizontal illuminance level at work plane height, was maintained for the entire test period on the MPC side, improving from having visual comfort for 94.5% and 85.7% of the time, respectively, on the BMS side.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Formation and reconfiguration of tight multi-lane platoons

Advances in vehicular communication technologies are expected to facilitate cooperative driving in the future. Connected and Automated Vehicles (CAVs) are able to collaboratively plan and execute driving maneuvers by sharing their perceptual knowledge and future plans. In this paper, an architecture for autonomous navigation of tight multi-lane platoons traveling on public roads is presented. Using the proposed approach, CAVs are able to form single or multi-lane platoons of various geometrical configurations. They are able to reshape and adjust their configurations according to changes in the environment. The proposed architecture consists of two main components: an offline motion planner system and an online hierarchical control system. The motion planner uses an optimization-based approach for cooperative formation and reconfiguration in tight spaces. A constrained optimization scheme is used to plan smooth, dynamically feasible and collision-free trajectories for all the vehicles within the platoon. The paper addresses online computation limitations by employing a family of maneuvers precomputed offline and stored on a look-up table on the vehicles. The online hierarchical control system is composed of three levels: a traffic operation system (TOS), a decision-maker, and a path-follower. The TOS determines the desired platoon reconfiguration. The decision-maker checks the feasibility of the reconfiguration plan based on real-time information about the surrounding traffic. The reconfiguration maneuver is executed by a low-level path-following feedback controller in real-time. The effectiveness of the approach is demonstrated through simulations of three case studies: (1) formation reconfiguration (2) obstacle avoidance, and (3) benchmarking against behavior-based planning in which the desired formation is achieved using a sequence of motion primitives.

42 ENGINEERING↗
DOE OSTI2022

Achievements of actively controlled divertor detachment compatible with sustained high confinement core in DIII-D and EAST

The compatibility of efficient divertor detachment with high-performance core plasma is vital to the development of magnetically controlled fusion energy. The joint research on the EAST and DIII-D tokamaks demonstrates successful integration of divertor detachment with excellent core plasma confinement quality, a milestone towards solving the critical plasma–wall-interaction (PWI) issue and core-edge integration for ITER and future reactors. In EAST, actively controlled partial detachment with T et,div ~ 5 eV around the strike point and H 98 > 1 in different H-mode scenarios including the high β P H-mode scenario have been achieved with ITER-like tungsten divertor, by optimizing the detachment access condition and performing detailed experiments for core-edge integration. For active long-pulse detachment feedback control, a 30 s H-mode operation with detachment-control duration being 25 s has been successfully achieved in EAST. DIII-D has achieved actively controlled fully detached divertor with low plasma electron temperature (T et,div ≤ 5 eV across the entire divertor target) and low particle flux (degree of detachment, DoD > 3), simultaneously with very high core performance (β N ~3, β P > 2 and H 98 ~ 1.5) in the high βP scenario being developed for ITER and future reactors. The high-β P high confinement scenario is characterized by an internal transport barrier (ITB) at large radius and a weak edge transport barrier (ETB, or pedestal), which are synergistically self-organized. Both the high-β P scenario and impurity seeding facilitate divertor detachment. The detachment access leads to the reduction of ETB, which facilitates the development of an even stronger ITB at large radius in the high β P scenario. Thus, this strong large radius ITB enables the core confinement improvement during detachment. In conclusion, these significant joint DIII-D and EAST advances on the compatibility of high confinement core and detached divertor show a great potential for achieving a high-performance core plasma suitable for long-pulse operation of fusion reactors with controllable steady-state PWIs.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗