Real-time process monitoring for health diagnostics at the thermal interface
Explore the source record for details and available documents.
Ponciroli, Roberto (ORCID:0000000279413523)↗
Engineering topics
Vilim, Richard B.
Publications and source records attributed to Vilim, Richard B..
Investigation of Abnormal Level Control Oscillations in a BWR Feedwater System
In the long-term operation of nuclear power plants, the aging of systems, structures, and components can lead to maintenance issues that must be dealt with to maintain cost-effective plant operations. One common issue affecting the currently operated boiling water reactors is the onset of unexpected level oscillations in feedwater heaters. This phenomenon can cause excessive cycling of drain valves and lead to premature failures. In this work, we develop a dynamic model of a set of feedwater heaters to determine the root cause of oscillations observed in an operating plant. Simulation results of various transient scenarios were used to investigate the effects of the controller parameters, boundary conditions, and possible valve and instrument issues. The analysis led to the conclusion that the most likely causes of the observed self-sustained oscillations in the system are the nonlinear behaviors of the drain valve and the level transmitter induced by degraded equipment condition. In conclusion, a partial plug of the pressure line used for level sensing in the system can account for a significant deadtime in the level transmitter, a nonlinear effect shown to induce self-sustained oscillatory behaviors.
Boiling water reactors↗
A Data-driven approach to Core Power distribution reconstruction in a Nuclear Reactor
This report presents the initial development of a data-driven approach for reconstructing the core power distribution in a nuclear reactor (power shape synthesis) using ex-core sensors. Traditional techniques rely on deploying a large number of detectors throughout the reactor core. However, this approach is not feasible for innovative reactor concepts like Advanced Reactors and Microreactors. First, the tight lattice pitch, designed to maximize power density, limits the space available for sensors. Secondly, the harsh operating conditions are not compatible with commercially available detectors. The method proposed in this work integrates high-fidelity modeling with data-driven techniques to accurately reconstruct power distribution across various reactor types, thereby reducing the reliance on in-core sensors. Purdue University Reactor One (PUR-1) was selected as the test case. The CAD model representing the latest configuration of the PUR-1 core was imported into the OpenMC simulation framework, and the model was built. Additionally, the previously developed MCNP6 model was updated. The two models were assessed against the data collected during an experimental campaign conducted in July 2024. Thirty gold foils were placed in three Irradiation Assemblies in PUR-1 core. Using the measured activity of the irradiated foils, the neutron flux at different core locations was estimated.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
A safe reinforcement learning algorithm for supervisory control of power plants
Traditional control theory-based methods require tailored engineering for each system and constant fine-tuning. In power plant control, one often needs to obtain a precise representation of the system dynamics and carefully design the control scheme accordingly. Model-free Reinforcement learning (RL) has emerged as a promising solution for control tasks due to its ability to learn from trial-and-error interactions with the environment. It eliminates the need for explicitly modeling the environment’s dynamics, which is potentially inaccurate. However, the direct imposition of state constraints in power plant control raises challenges for standard RL methods. To address this, we propose a chance-constrained RL algorithm based on Proximal Policy Optimization for supervisory control. Our method employs Lagrangian relaxation to convert the constrained optimization problem into an unconstrained objective, where trainable Lagrange multipliers enforce the state constraints. In conclusion, our approach achieves the smallest distance of violation and violation rate in a load-follow maneuver for an advanced Nuclear Power Plant design.
constrained optimization↗
FARM supervisory capabilities for thermal energy storage
The FARM (Feasible Actuator Range Modifier) module is a component of the RAVEN-based FORCE framework for the analysis of Integrated Energy Systems (IES). FARM aids HERON in the solution of the power dispatch problem by evaluating feasible set-point signals to be issued to the control systems of the different IES unit components. Set-points need to satisfy limits on both production variables (i.e., the variables to be optimized such as the electrical power, etc.) and process variables tied to the service life of equipment (e.g., steam flowrate, vessel pressure, turbine firing temperature, etc.). To enforce all these limits, a two-stage approach is adopted. First, the power dispatcher algorithm in HERON module estimates set-points that meet the constraints on the production variables, e.g., power levels and power ramp rate limits. These constraints are called explicit constraints. Then, if necessary, FARM adjusts these set-points to ensure the respect of the limits on the process variables of interest, given the knowledge of the system dynamics acquired through machine learning algorithms. These constraints are called implicit constraints. From this standpoint, FARM constitutes a bridge between the HERON power dispatcher that adopts a simplified description of the IES unit (low-resolution physics) and the HYBRID high-fidelity models (high-resolution physics). In this report, an overview of the major capabilities of the latest release of FARM is provided, along with a summary of the tool demonstration campaign conducted at the Dynamic Energy Technology and Integration Laboratory (DETAIL) facility. These results assess the performance of the control system architecture embedding FARM both as a Validator of the HERON power dispatcher and as a real time Supervisory control scheme. Additionally, the report outlines the areas that FARM might benefit from, along with proposed solutions.
21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
Strategy to Develop a Control Scheme for Core Thermal Performance Optimization
This report outlines a three-year research plan for optimizing reactor core thermal performance through use of a Digital Twin (DT) model and a set of neutron detectors to correspondingly adapt the reactor control strategy. It identifies reactor features and achievable neutron measurements that factor into this optimization task. It considers spatial effects that are important and how they can be managed by a real-time algorithm that controls reactivity actuators. The report presents a set of tasks, along with corresponding methods, for accomplishing this objective. The final task in this set is to validate the combined optimization procedure in the Purdue University’s PUR-1 reactor, for which we have an agreement of understanding. Additionally, we describe an alternative approach for overcoming some of the limitations inherent in the above approach, which includes the computational costs of high-fidelity simulations and achievable integration of neutron measurements into the DT. The proposed algorithms lower the technology readiness level (TRL) of the overall approach as some additional analysis and the development of a new neutron detector concept are necessary. In particular, a sensor measuring the gradient of the neutron flux is required, and the prototype is expected to be validated in the PUR-1 reactor. The potential benefits and the opportunity to significantly push forward the state-of-the-art make this approach worthy of further exploration in the upcoming years.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Physics-informed State-space Neural Networks for transport phenomena
This work introduces Physics -informed State -space neural network Models (PSMs), a novel solution to achieving real-time optimization, flexibility, and fault tolerance in autonomous systems, particularly in transportdominated systems such as chemical, biomedical, and power plants. Traditional data -driven methods fall short due to a lack of physical constraints like mass conservation; PSMs address this issue by training deep neural networks with sensor data and physics -informing using components' Partial Differential Equations (PDEs), resulting in a physics -constrained, end -to -end differentiable forward dynamics model. Further, through two in silico experiments - a heated channel and a cooling system loop - we demonstrate that PSMs offer a more accurate approach than a purely data -driven model. In the former experiment, PSMs demonstrated significantly lower average root -mean -square errors across test datasets compared to a purely data -driven neural network, with reductions of 44 %, 48 %, and 94 % in predicting pressure, velocity, and temperature, respectively. Beyond accuracy, PSMs demonstrate a compelling multitask capability, making them highly versatile. In this work, we showcase two: supervisory control of a nonlinear system through a sequentially updated state -space representation and the proposal of a diagnostic algorithm using residuals from each of the PDEs. The former demonstrates PSMs' ability to handle constant and time -dependent constraints, while the latter illustrates their value in system diagnostics and fault detection.
42 ENGINEERING↗
FARM User Guidance and Instructions
The FARM (Feasible Actuator Range Modifier) module is a component of the RAVEN-based FORCE framework for the analysis of Integrated Energy Systems (IES). FARM aids HERON in the solution of the power dispatch problem by evaluating feasible set-point signals to be issued to the control systems of the different IES unit components. Set-points need to satisfy limits on both production variables (i.e., the variables to be optimized such as the electrical power, etc.) and process variables tied to the service life of equipment (e.g., steam flowrate, vessel pressure, turbine firing temperature, etc.). To enforce all these limits, a two-stage approach is adopted. First, the power dispatcher algorithm in HERON module estimates set-points that meet the constraints on the production variables, e.g., power levels and power ramp rate limits. These constraints are called explicit constraints. Then, if necessary, FARM adjusts these set-points to ensure the respect of the limits on the process variables of interest, given the knowledge of the system dynamics acquired through machine learning algorithms. These constraints are called implicit constraints. From this standpoint, FARM constitutes a bridge between the HERON power dispatcher that adopts a simplified description of the IES unit (low-resolution physics) and the HYBRID high-fidelity models (high-resolution physics). In this report, the general workflow and the software requirements of FARM module are summarized, and the detailed instructions for installing FARM software, running built-in example cases, deriving Linear Parameter-Varying (LPV) state-space models, and using FARM for user-defined power dispatch problems are provided.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Assessments of advanced reactor heat supply to high temperature industrial unit operations: Heat Engines and Heat Pumps
In this report, the feasibility of employing Advanced Nuclear Reactors to supply the necessary high-quality heat to Industrial Processes is investigated. As a first step, the most relevant industrial applications that could benefit from this coupling were identified. Four industries including petroleum refining (distillation, catalyst regeneration, hydro-steam cracking), chemical polymers, steel manufacturing (metals annealing/soaking) and cement manufacturing (calcination of limestone and dolomite industries) were considered. An overview of the heat duties, i.e., the temperatures and thermal powers required by representative plants of the different processes, was provided. Secondly, the thermodynamic conditions of the steam produced by representative designs of Advanced Reactor concepts (Liquid Metal Fast Breeder Reactors, Molten Salt Reactors, and High Temperature Gas-cooled Reactors) were summarized. The comparison between the requirements of the industrial processes and the capabilities of the candidate nuclear power plants showed that only a few processes could benefit from the coupling. Although Advanced Reactors operate at higher temperatures than Light Water Reactors, the thermodynamic conditions of the generated steam flow rates are generally not suitable for the selected applications. At the same time, data indicate that most of the processes can be suitably supplied if the temperature of steam is elevated to 900 °C. One possible solution to boost the quality of the steam from the nuclear island involves the use of a heat pump. Based on a technology similar to that found in refrigerators and air conditioners, heat pumps extract heat from a source, elevate its temperature and transfer it to where it is needed. A simple numerical example illustrating the viability of this method is described. Specifically, the energy conversion cycle of a conventional Pressurized Water Reactor was extended to incorporate a compressor to raise the heating value of the steam produced by the reactor. Two reference configurations, i.e., one where the industrial process coupled to the nuclear power plant exhausts saturated liquid and the other where it exhausts saturated steam, were considered. The thermal efficiencies achievable by increasing the heating value of the reactor steam in this way are significantly greater than by direct electric heating.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Physics-constrained fault diagnosis framework for monitoring a standalone component of a thermal hydraulic system
A method for diagnosing faults includes receiving a description of a component of a thermal hydraulic system, where the description also indicates one or more sensors of the component. The method also includes constructing, based on a physical conservation law and using the description, a physics-based model describing operation of the component, the physics-based model including one or more unknown parameters. The method further includes calibrating the physics-based model by calculating the one or more unknown parameters using historical measurements to produce a calibrated model. Further, the method includes receiving sensor measurements captured by the one or more sensors, and calculating residuals corresponding to differences between measurements predicted by the calibrated model and the sensor measurements. The method also includes determining, based on the calculated residuals, a fault of the component or of a sensor of the one or more sensors, and generating an alert indicating the fault.
Nguyen, Tat Nghia↗
Demonstrate FARM supervisory capabilities for a thermal energy storage problem for the DETAIL facility: IES Simulation Ecosystem Control System Development
The goal of the power dispatch problem for an Integrated Energy System (IES) is to adjust the power output and the heat flow of each component to maximize the profitability of the whole unit. Facilities that can integrate real-time digital signals, mock nuclear power, thermal energy storage and industrial heat use via high-temperature electrolysis were constructed at INL to support the research activities. The Dynamic Energy Technology and Integration Laboratory (DETAIL) houses the Microreactor Agile Non-nuclear Experimental Test Bed (MAGNET) and the Thermal Energy Distribution System (TEDS). In this report, the hierarchical control system architecture proposed in June 2023 milestone for the flexible operation of DETAIL facility is finalized and demonstrated. A brief description of the components and the corresponding Dymola models from the HYRBID repository is first provided. Then, the current control strategy is presented. In particular, the approach for generating the set-point trajectories to be fed to the PI controllers is analyzed, and its limits were identified. To preserve safe operation over both long-time and real-time horizons, the integration of a Supervisory Control layer embedding a modified version of FARM (Feasible Actuator Range Modifier) module is proposed. FARM is a component of the RAVEN-based FORCE framework designed to support HERON module at optimizing the operation of IES units. The proposed control system for DETAIL foresees FARM to be applied twice, i.e., the original version (“FARM-Validator”) aiding the solution of the power dispatch problem, and a modified version (“FARM-Supervisory”) coordinating the PID controllers. Despite the kernel of the two modules is the same, their tasks are quite different. The former intervenes at the beginning of each hour to prevent constraint violations over long time periods, the latter addresses real-time control tasks and monitors the response of constrained variables at a much finer time resolution. A tentative procedure for training the embedded Digital Twins with the experimental data is also proposed. Finally, the capabilities of the designed architecture and the impact of the added Supervisory Control layer are demonstrated by simulating a representative power dispatch scenario.
25 ENERGY STORAGE↗
Preliminary Development of Heat Transfer Model-Based Control Algorithms of Liquid Sodium Purification System: Advanced Sensors and Instrumentation Advanced Controls
Monitoring the operation of sodium purification system is essential for efficient operation of sodium fast reactors. In this work, a heat transfer model has been developed for monitoring the plugging meter and cold trap systems at the Mechanisms Engineering Test Loop (METL) liquid sodium facility at Argonne National Laboratory. The model of the purification system was developed by treating the respective aspects of the cold trap purification loop and plugging meter diagnostic loop as two separate control volumes using information from the METL piping and instrumentation diagram (P&ID). A model predictive controller was designed using first order differential equations with the specified boundary conditions. The system behavior was studied with a tuned optimized procedure using the internal cold trap temperature and plugging meter outlet temperature as control variables, and the air blower temperature as an independent variable respectively. Results of computer simulations obtained in this study compared favorably with experimental data showing very good reference tracking response with negligible overshoot as both plugging meter and cold trap physical models approach the setpoint.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Advanced Monitoring and Control in the ANL METL Facility Using an Engineering Digital Twin
The potential benefits of using an engineering digital twin to achieve greater autonomy for monitoring and control functions in advanced reactors was investigated for the Mechanisms Engineering Test Loop (METL) liquid sodium facility at Argonne National Laboratory. The METL sodium purification system served as a representative system as it requires significant human in-the-loop interaction to accomplish its design function. The objective was to demonstrate how real-time operation could be automated while preserving oversight of the operator for ensuring that the system design functions are met. A digital twin model of the purification system was developed for both the cold trap purification loop and plugging meter diagnostic loop using information from the METL piping and instrumentation diagram (P&ID). Automated monitoring and diagnosis of component degradation in the METL facility was demonstrated in tests using the PRO-AID health monitoring software with the digital twin model incorporated in the library of components. Component failures were introduced and were successfully diagnosed in real time. These tests serve to demonstrate an advanced monitoring capability able to differentiate sensor degradation from component degradation, to generate a rank ordering of probabilities of different failure mechanisms that serves to circumvent the false alarm problem with current anomaly detection methods, and how facility monitoring can be transformed from anomaly detection to identification of a specific fault. Automated control of the purification system was demonstrated through simulations that exercised a model predictive controller designed using the digital twin model. Results of these simulations compared favorably with experimental data showing very good reference tracking response with negligible overshoot. In conclusion, these pilot tests and simulations successfully demonstrated the use of a digital twin for improved automation of monitoring and control. It was shown how the digital twin enables switching between control modes from cold trap operation where impurities are removed to plugging meter operation where impurity concentrations are measured.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Physics-constrained fault diagnosis framework for monitoring a multi-component thermal hydraulic system
A method for diagnosing faults includes receiving a system description of a thermal hydraulic system, the system description indicating a plurality of components and sensors. The method also includes constructing, based on physical conservations laws and using the system description, a plurality of physics-based models for the plurality of components, each of the plurality of physics-based models including unknown parameters. The method further includes receiving historical measurements and calibrating the physics-based models by calculating the unknown parameters of each of the physics-based models using the historical measurements to produce calibrated models. The method also includes receiving sensor measurements of the sensors, and calculating residuals corresponding to differences between measurements predicted by the plurality of calibrated models and the sensor measurements. The method also includes determining, based on the calculated residuals, a fault of a component or a sensor, and generating an alert indicating the fault.
Nguyen, Tat Nghia↗
Direct Bayesian inference for fault severity assessment in Digital-Twin-Based fault diagnosis
For applications in condition-based maintenance of nuclear systems, the assessment of fault severity is crucial. In this work, we developed a framework that allows for direct inference of the probability distributions of possible faults in a system. Here, we employed a model-based approach with model residuals generated from analytical redundancy relations provided by physics-based models of the system components. From real-time sensor readings, the values of the model residuals can be calculated, and the posterior probability distributions of the faults can be computed directly using the methods of Bayesian networks. From the posterior distribution of each fault, one can estimate the fault probability based on a chosen threshold and assess the severity of the fault. By eliminating the discretization and simplifications in middle steps, this approach allows us to leverage the available computational resources to provide more accurate fault probability estimates and severity assessments.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Integrate FARM with PID controllers: IES Simulation Ecosystem Control System Development
The FARM (Feasible Actuator Range Modifier) software module is a component of the RAVEN-based FORCE framework for analysis of Integrated Energy Systems (IES). FARM was designed to support the HERON software module in the solution of the optimal dispatch problem for IES units. As the result of HERON-FARM dispatch simulation, the set-point trajectories are optimized to meet constraints on both the production variables (i.e., the variables to be optimized such as the electrical power, the hydrogen production rate, etc.) and the process variables tied to the service life of equipment (e.g., steam flowrate, vessel pressure, turbine firing temperature, etc.) at a coarse time resolution (every 10 or 100 seconds) over long time horizons (several days or weeks). In case the operational constraints need to be met at finer time resolution, the computational burden of HERON-FARM would linearly increase with the sampling rate, and sub-optimal solutions might be obtained. System responses characterized by overshoots and damped oscillations temporarily violating the imposed constraints might occur during abrupt power transients. In this report, a hierarchical control system architecture for the operation of the Dynamic Energy Technology and Integration Laboratory (DETAIL) facility constructed at INL was proposed. First, the preliminary studies on the proposed control strategy for operating the facility and the designed PI controllers were reviewed. In particular, the current approach for generating the set-point trajectories was studied, and its limits were identified. To this aim, the inclusion of a Supervisory Control layer embedding a modified version of the FARM algorithm for preserving the system safe operation over both long and real-time horizons was proposed. In this way, FARM would be applied twice, i.e., the original version (“FARM Validator”) aiding the solution of the power dispatch problem, and the modified version (“FARM Supervisory” coordinating the PI controllers to address the real-time control tasks. Despite the kernel of the two modules is the same algorithm, their roles, tasks, and capabilities are quite different. A detailed description of the role of FARM at addressing low-level control tasks is provided, along with tentative operational procedures for training the models embedded into the algorithm by using the collected experimental data.
42 ENGINEERING↗
Implementation of a feature selection algorithm in FARM to identify important state variables and time-invariant matrices
The FARM (Feasible Actuator Range Modifier) software module is a component of the RAVEN-based FORCE framework for analysis of Integrated Energy Systems (IES). FARM aids the HERON software module in the evaluation of the optimal dispatch for the different IES components. Set-point trajectories are required to meet limits on both production variables (i.e., the variables to be optimized such as the electrical power, the hydrogen production rate, etc.) and process variables tied to the service life of equipment (e.g., steam flowrate, vessel pressure, turbine firing temperature, etc.). To evaluate the feasibility of HERON generated set-points and to do so in an acceptable time, FARM employs reduced order models to represent the dynamic behavior of the systems to be dispatched. These surrogate models take the form of a linear dynamic system with sets of Linear Parameter Varying (LPV) matrices that are mapped to the system operating space. These matrices are derived from the trajectories of system state variables and system output variables during transients. The accuracy of LPV matrices depends on the selection of state variables. In previous reports, state variables were selected by adopting a complicated workflow requiring multiple software licenses and an advanced level of user expertise. In this report, a new workflow that automates the state variable selection process is presented. It significantly reduces the frequency of user interventions and does not require multiple software licenses. Each module in the new workflow is described in detail, and the input / output examples in each step of the workflow are provided. It was demonstrated that this workflow can greatly reduce the complexity of the state variable selection process, and that the updated FARM-Gamma and FARM-Delta validators can benefit from this workflow when solving the power dispatch problem of a representative IES test case. Finally, some code improvements that can further enhance the efficiency are suggested.
42 ENGINEERING↗
Centrifugal Pump Model for System Codes for Advanced NPP Designs
In this document, a homologous model and one-dimensional line model for centrifugal pump are described to provide the theoretical background of a pump model to be developed in system-level codes. Input and output parameters are proposed, along with a summary of the governing equations for each model. Furthermore, hydraulic performance degradation of centrifugal pump is also modeled in the homologous pump model. This document suggests that system codes provide a homologous and one-dimensional line model for centrifugal pumps, allowing the users to choose the model that best fits their purposes.
21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗