SEARCH · Search NASA

Results for “control simulation testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Deep reinforcement learning control for co-optimizing energy consumption, thermal comfort, and indoor air quality in an office building

With the recent demand for decarbonization and energy efficiency, advanced HVAC control using Deep Reinforcement Learning (DRL) becomes a promising solution. Due to its flexible structures, DRL has been successful in energy reduction for many HVAC systems. However, only a few researches applied DRL agents to manage the entire central HVAC system and control multiple components in both the water loop and the air loop, owing to its complex system structures. Moreover, those researches have not extended their applications by incorporating the indoor air quality, especially both CO2 and PM2.5concentrations, on top of energy saving and thermal comfort, as achieving those objectives simultaneously can cause multiple control conflicts. What's more, DRL agents are usually trained on the simulation environment before deployment, so another challenge is to develop an accurate but relatively simple simulator. Therefore, we propose a DRL algorithm for a central HVAC system to co-optimize energy consumption, thermal comfort, indoor CO2 level, and indoor PM2.5 level in an office building. To train the controller, we also developed a hybrid simulator that decoupled the complex system into multiple simulation models, which are calibrated separately using laboratory test data. The hybrid simulator combined the dynamics of the HVAC system, the building envelope, as well as moisture, CO2, and particulate matter transfer. Three control algorithms (rule-based, MPC, and DRL) are developed, and their performances are evaluated on the hybrid simulator environment with a realistic scenario (i.e., with stochastic noises). The test results showed that, the DRL controller can save 21.4 % of energy compared to a rule-based controller, and has improved thermal comfort, reduced indoor CO2 concentration. The MPC controller showed an 18.6 % energy saving compared to the DRL controller, mainly due to savings from comfort and indoor air quality boundary violations caused by unmeasured disturbances, and it also highlights computational challenges in real-time control due to non-linear optimization. Finally, we provide the practical considerations for designing and implementing the DRL and MPC controllers based on their respective pros and cons.

Guo, Fangzhou↗

DOE OSTI2018

An agent-based hardware-in-the-loop simulation framework for building controls

In general, a hardware-in-the-loop (HIL) building simulation has lower cost and fewer practical limitations (e.g., scheduling issues) than field tests in occupied buildings, while also overcoming limitations of simulations alone by capturing the full behavior of some physical systems, equipment, and components. However, the implementation of an HIL can be difficult due to the scarcity of appropriate tools. Here, this paper presents an agent-based framework for HIL simulation. It can be used for investigation of controller performance via controller-in-the-loop simulations and also HIL for system synthesis. In the latter case, both controllers and major equipment participate in tests to ensure that dynamics of equipment operation are correctly captured in addition to controller performance. The HIL simulation framework presented allows such actual physical parts to be included in the framework while representing others for which behaviors are better known and modeled in simulation models. The mechanism implemented in the framework to synchronize simulations in software with real-time operation of physical equipment is described. Lastly, as an example, use of the HIL simulation framework is illustrated through a brief study of speed control of the supply fan in the air handling unit of a variable-air-volume building heating, ventilating and air-conditioning system.

42 ENGINEERING↗

DOE OSTI2022

Tundra SGS – Critical Importance of Site-Specific Injectivity Testing for Carbon Dioxide Injection Well Simulation Calibration

Paper presented at 16th International Conference on Greenhouse Gas Control Technologies (GHGT-16), October 23–27, 2022, Lyon, France. Brine injectivity tests were conducted on both the Broom Creek (BC) and Deadwood (DW) storage formations in one of the cored stratigraphic test wells prior to finalized simulations. The injectivity tests entailed injection of brine into the formations, followed by shutting in the wells. The shut-in duration represents the fall-off period which was used to carry out pressure transient analyses of the tests. The analysis of injectivity tests indicated that core-indicated and modeled permeability distributions should be conservatively multiplied by 2.5× and 5× in the BC and DW geologic models, respectively, prior to numerical simulations of CO 2 injection using Computer Modelling Group’s (CMG’s) GEM equation-of-state reservoir simulator. The scaler permeability multipliers allowed the fluid flow simulations to fully represent well test-measured injection well rates in the respective formations.

20 FOSSIL-FUELED POWER PLANTS↗

DOE OSTI2025

Fermilab's controls development with virtual accelerator

Control Systems development is often the last thing considered when designing and building new equipment, e.g. a new detector or superconducting RF LINAC; however when the new equipment is installed, it is the first thing desired to be operational for testing. Due to frequent delays in building new equipment and project deadlines, control system development and testing is often curtailed. A way to alleviate this problem is to simulate the control system, though this will be challenging for complex systems.The Fermilab PIP-II (proton improvement plan - II) project is being constructed at Fermilab to deliver $800\,MeV$ protons of $>1\,MW$ beam power to replace the present LINAC for the remainder of the existing accelerator complex. The new LINAC consists of a warm front end (WFE), 23 superconducting RF cryomodules (of 5 types), and a beam transfer line (BTL) to the existing complex.The accelerator physics group has a parallel project to create a digital twin (DT) of the PIP-II accelerator. We have coupled the EPICS controls to this DT and are developing both the DT and EPICS software in parallel. This will allow us to develop the EPICS software framework, the HMIs, sequences, high level physics applications, and other services for use in a fully functional control system.This presentation will detail the work that we have performed to date and show demonstrations of controlling and monitoring the status of the accelerator, as well as future plans for this work.

Hanlet, Pierrick [Fermilab]↗

DOE OSTI2021

Grid-Forming Frequency Shaping Control for Low-Inertia Power Systems

As power systems transit to a state of high renewable penetration, little or no presence of synchronous generators makes the prerequisite of well-regulated frequency for grid-following inverters unrealistic. Thus, there is a trend to resort to grid-forming inverters which set frequency directly. We propose a novel grid-forming frequency shaping control that is able to shape the aggregate system frequency dynamics into a first-order one with the desired steady-state frequency deviation and Rate of Change of Frequency (RoCoF) after a sudden power imbalance. The no overshoot property resulting from the first-order dynamics allows the system frequency to monotonically move towards its new steady-state without experiencing frequency Nadir, which largely improves frequency security. We prove that our grid-forming frequency-shaping control renders the system internally stable under mild assumptions. The performance of the proposed control is verified via numerical simulations on a modified Icelandic Power Network test case.

control systems↗

DOE OSTI2018

Optimal Dispatch Controller for Fuel Cell-Integrated Building: Preprint

Stationary fuel cells can generate both electrical power and heat, making it them a promising local source to serve building loads. In this paper, we develop an optimal energy dispatch controller to operate a fuel cell-integrated building. The controller leverages the inherent thermal in the building to lower reduce its operating cost and allows the building to participate in providing grid services. The proposed controller is tested in a co-simulation setup, where the real building is represented as a high-fidelity model in EnergyPlus.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2019

A multivariate approach to ensure statistical reproducibility of climate model simulations

Effective utilization of novel hybrid architectures of pre-exascale and exascale machines requires transformations to global climate modeling systems that may not reproduce the original model solution bit-for-bit. Round-off level differences grow rapidly in these non-linear and chaotic systems. This makes it difficult to isolate bugs/errors from innocuous growth expected from round-off level differences. Here, we apply two modern multivariate two sample equality of distribution tests to evaluate statistical reproducibility of global climate model simulations using standard monthly output of short (~ 1-year) simulation ensembles of a control model and a modified model of US Department of Energy's Energy Exascale Earth System Model (E3SM). Both the tests are able to identify changes induced by modifications to some model tuning parameters. We also conduct formal power analyses of the tests by applying them on designed suites of short simulation ensembles each with an increasingly different climate from the control ensemble. The results are compared against those from another such test. These power analyses provide a framework to quantify the degree of differences that can be detected confidently by the tests for a given ensemble size (sample size). This will allow model developers using the tests to make an informed decision when accepting/rejecting an unintentional non-bit-for-bit change to the model solution.

Mahajan, Salil↗

DOE OSTI2025

Microreactor Automated Control System - Digital Twin Models and Advanced Control Systems Updates

Automation of control systems is expected to be important in the economic and safe operation of microreactors. Therefore, there is a need to develop and demonstrate automated control for microreactors, along with the development of testbeds for this purpose. This report provides updates on the status of a nonnuclear microreactor automated control system (MACS)—a real-time, hardware-in-the-loop testbed for non-nuclear testing of microreactor control system automation. A real-time hardware-in-the-loop testbed incorporates the realistic dynamics of physical systems into control system development and testing. The collaborative effort between Oak Ridge National Laboratory (ORNL) and Idaho National Laboratory (INL) resulted in the development of a prototypic microreactor plant-level digital twin that includes the reactor and a balance of plant system. Advanced control strategies were incorporated to demonstrate testing of control automation solutions. The gRPC communication protocol, which was implemented in the hardware-in-the-loop testbed by INL, was coupled to a digital twin model developed using the TRANsient Simulation Framework of Reconfigurable Models (TRANSFORM) library in Modelica. This digital twin simulation was tested with the ViBRANT hardware for realistic feedback and visual representation of control action in real time. A modular Python client structure was developed to manage functional mock-up unit-based simulation and real-time gRPC communication. Hardware-in-the-loop testing indicated that the modeled reactor—a natural-convection, molten-salt coolant loop configuration—responds well to control of drum positioning for modulation of reactor core power, as well as system-level control and downstream demand changes. Ongoing research is focused on integrating additional control algorithms that utilize data from newly included sensors within the MACS hardware testbed, as well as demonstrating and assessing the performance of the different automated control algorithms on multiple additional operational scenarios.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2023

The Next-Generation Ecosystem Experiment Arctic Rainfall Simulator: a tool to understand the effects of changing rainfall patterns in the Arctic

Rainfall frequency and intensity are expected to increase in the Arctic, with potential detrimental impacts on permafrost, leading to enhanced thawing and carbon release to the atmosphere. However, there have been very few studies on the effect of discrete rain events on permafrost in the Arctic and sub-Arctic. Conducting controlled rainfall experiments within permafrost landscapes can provide an improved understanding of the effect of changing intensity, duration, and timing of rain events on permafrost tundra ecosystems. Here, we describe the design and implementation of the Next-Generation Ecosystem Experiment Arctic Rainfall Simulator (NARS), a variable intensity (4–82 mm/h) rainfall simulator that can be used to study the effects of rainfall on permafrost stability. The NARS design includes a 3D-printed 4 cm H-flume and uses an eTape resistivity sensor that was calibrated (R 2 = 0.9–0.96) to measure discharge from the system. NARS is designed to be lightweight, simple to construct, and can be easily deployed in remote locations. As a field validation of updated rainfall simulator design and modernized controls, NARS was tested on the Seward Peninsula, AK. Because of its portability, versatility in deployment, dimensions, and rainfall intensity, NARS represents a methodological innovation for researching the impacts of rainfall on permafrost environments.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Coupling TRACE with nodal neutronics code Ants using the Exterior Communications Interface and VTT's multi-physics driver Cerberus

In this paper a recently developed coupling between system code TRACE and nodal neutronics code Ants is presented. The TRAC/RELAP Advanced Computational Engine (TRACE) is a reactor system code developed by U.S. Nuclear Regulatory Commission (NRC). The code has been designed to analyse loss-of-coolant accidents (LOCAs), operational transients and other accident scenarios in light water reactors. Ants is the reduced order nodal neutronics code of the Kraken framework. The diffusion solution method in Ants is based on the Analytic Function Expansion Nodal method (AFEN) and Flux Expansion Nodal Method (FENM). Rectangular, hexagonal and triangular geometries are supported. Both steady state and burnup problems including micro-depletion can be simulated. The coupling is implemented using VTT's multi-physics driver Cerberus and the Exterior Communications Interface (ECI) which is supplied with TRACE and enables the coupling of TRACE without source code modifications. The main focus in the paper is on describing the TRACE-Ants coupling in detail in order to share to other code developers what we have learned from the ECI based coupling process. The coupled code system is briefly tested by simulating a simple transient in a SMR core initiated by control rod movement. The results of the test calculation look reasonable and more complicated test cases will be modelled in the near future.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2023

Model predictive current profile control in tokamaks by exploiting spatially moving electron cyclotron current drives

The plasma control systems in next-generation tokamaks like ITER will balance competing control objectives to achieve the desired level of performance in advanced scenarios while preventing magnetohydrodynamic instabilities and disruptions. During normal tokamak operation, the points of incidence of the electromagnetic waves generated by the electron cyclotron heating and current drives (EC H&CDs) are usually fixed in space. However, the points of incidence can be modified in real-time by changing the angles of the mirrors that reflect the EC H&CD waves. Altering the points of incidence, in turn, varies the ability of the plasma control system to regulate a plasma property. For instance, changing the EC H&CD wave incidence location may place the power demands necessary to achieve a particular plasma target within saturation limits. Therefore, using the EC H&CD deposition location, which is related to the EC H&CD mirror angle, as a supplementary controllable variable may facilitate access to a given target scenario. However, active scenario-control algorithms have not been designed so far to fully exploit this capability in real time. In this work, a model predictive controller that can handle actuation locations as control inputs is developed. In particular, the controller is designed to regulate both the auxiliary powers and the EC H&CD deposition locations in a pre-defined optimal sense to achieve the control objective of attaining and sustaining a target current profile. Further, the proposed controller is tested for a DIII-D tokamak scenario in nonlinear simulations using the Control Oriented Transport SIMulator (COTSIM).

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2022

Deploying Traffic Smoothing Cruise Controllers Learned from Trajectory Data

Autonomous vehicle-based traffic smoothing con- trollers are often not transferred to real-world use due to challenges in calibrating many-agent traffic simulators. We show a pipeline to sidestep such calibration issues by collecting trajectory data and learning controllers directly from trajectory data that are then deployed zero-shot onto the highway. We construct a dataset of 772.3 kilometers of recorded drives on the I-24. We then construct a simple simulator using the recorded drives as the lead vehicle in front of a simulated platoon consisting of one autonomous vehicle and five human followers. Using policy-gradient methods with an asymmetric critic to learn the controller, we show that we are able to improve average MPG by 11% in simulation on congested trajectories. We deploy this controller to a mixed platoon of 4 autonomous Toyota RAV-4’s and 7 human drivers in a validation experiment and demonstrate that the expected time-gap of the controller is maintained in the real world test. Finally, we release the driving dataset [1], the simulator, and the trained controller at https://github.com/nathanlct/trajectory-training-icra.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2024

The hygrothermal performance of continuous and cavity wood fiber insulation

Wood fiber insulation is an emerging material known for its effective thermal performance and moisture management properties, making it a compelling alternative to conventional insulation. Its vapor permeability and ability to regulate indoor humidity contribute to improved building durability and comfort, particularly in varying climate conditions. The goal of this project is to characterize the hygrothermal performance of a new wood fiber insulation product line in U.S. climate zones and to facilitate the design and construction of the product in residential and light commercial building envelopes. This study investigates the thermal and hygrothermal performance of wood fiber insulation, both as continuous and cavity insulation. The research employs an exhaustive simulation task and an environmental chamber test of a wood fiber insulation. Over 400 simulations were conducted to study the hygrothermal characteristics of bio-based wood fiber insulation in various building envelope configurations across four climate zones. Environmental chamber tests were conducted under controlled winter conditions representative of Climate Zone 5A (Chicago, IL) to complement the simulation results. The chamber tests focused on the hygrothermal performance of the wood fiber insulation and the sheathing board to assess the insulation's ability to manage moisture in a cold climate. Simulation and environmental chamber test results were analyzed to evaluate the insulation's consistency and efficacy across diverse climatic zones. Results show that with a proper moisture control strategy, both cavity and continuous wood fiber insulation can work properly in both new and retrofit constructions.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2024

The Hygrothermal Performance of Continuous and Cavity Wood Fiber Insulation

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2021

A large-scale comparison of Artificial Intelligence and Data Mining (AI&DM) techniques in simulating reservoir releases over the Upper Colorado Region

In recent years, the Artificial Intelligence and Data Mining (AI&DM) models have become popular tools in assisting various aspects of reservoir operation. However, the practical uses are still rarely reported. Comparison experiment of many AI&DM models over a large number of reservoir cases is particularly valuable to help reservoir operators first examine the usefulness and transferability of different AI&DM models, and then identify the most stable and reliable AI&DM model in assist of various decision-making processes. In this study, a total of 12 AI&DM models with different parameterizations and simulation scenarios are comprehensively tested out and compared in simulating the controlled reservoir outflows of 33 reservoir cases over the Upper Colorado Region, United States. Results show that the Random Forecast and the Long-Short-Term-Memory model could consistently derive the best statistical performance than other models under the baseline simulation scenario. The employed AI&DM models could obtain satisfactory statistical interquartile ranges (25–75%) between [0.6–0.9], [0.3–0.8], and [0.2–0.8], for CORR, NSE, and KGE measurements, respectively, and [1.5–6.5], [–15 to 20], and [0.5–8.5] for the normalized RMSE, PBIAS and RSR measurements, respectively. Results also show Multi-Layer Perceptron model and Extreme Gradient Boosting Tree Algorithm produced more stable and superior performance than other models under more complex input scenarios. We also found that the performance of different AI&DM models are closely relevant to the reservoir elevations, sizes, and functionalities. Discussions were made about the sensitivity of AI&DM models’ parameterizations and the key advantages of AI&DM models over the rule-based reservoir models. We further identify that the main advantage of AI&DM models is the flexibility in designing input structures, whereas the rule-based simulation model is rather limited. Future studies were suggested regarding the best way reservoir operators and researchers could use, select, and apply different AI&DM models in simulating reservoir releases under different natural and modeling environments. Finally, this comparison study also serves as a reference and a piece of groundwork for further promoting the practical uses of AI&DM models in assisting reservoir operation.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Enhanced cooling tower technology for power plant efficiency increase and operating flexibility

The Final Report describes the results of the work completed during the “Enhanced Cooling Tower Technology for Power Plant Efficiency Increase and Operating Flexibility” project. The objectives of work were to develop and demonstrate the prototype (up to 100 kWth) of an economically viable “all weather” Sub-Dew Point Cooling Tower (SDPCT) with inlet air cooling and dehumidification including testing in laboratory-controlled environment for simulating various ambient conditions. The inlet air is cooled and dehumidified by a Pressure Dehumidifying System (PDHS) installed at the cooling tower inlet.

20 FOSSIL-FUELED POWER PLANTS↗

DOE OSTI2026

Laboratory Evaluation of Federated, Hierarchical Controls for Distribution Power System Management: Preprint

The connection of more loads and distributed energy resources (DERs) to the distribution power system brings both challenges and opportunities to system operators. There are opportunities to aggregate flexible loads and DERs to provide transmission grid services, but the coordinated actions of DERs being managed by independent, third-party DER aggregators to support transmission system operations can present challenges. We developed a federated DER management architecture and control framework that aims to manage heterogeneous DERs to deliver reliable transmission grid services while respecting distribution system constraints. The controls include stochastic day-ahead optimization, model predictive control, and a simple real-time management scheme. We present simulation results obtained from a realistic laboratory test bed of federated controls managing DERs within a substation service area to make the substation net power follow the optimal net power determined by the day-ahead optimization based on cost and limiting reverse power flow.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2019

SPC-2734 Chromalox Oil Heater System Procurement Specification

This specification will supply the necessary technical information to the vendor to allow them to provide the system we need for the Thermal Energy Delivery System (TEDS) construction. TEDS is being constructed within the dynamic energy transport and integration laboratory (DETAIL) facility to test heat transfer components, distribution systems, instruments, and controls that can be monitored and controlled for hybrid generation of electrical power and/or non-electrical products. TEDS is designed to operate as a part of an integrated system or independently to demonstrate component operations, to develop and validate thermal energy transport models and control systems, and to study thermal energy inertia and storage. Within the integrated system, TEDS will be connected to the INL Real Time Digital Simulator (RTDS) test platform to develop and demonstrate monitoring and control systems and to investigate real-time, hardware-in-the-loop response characteristics relative to grid operations. As the basis of the TEDS, Chromalox (the vendor) has been chosen to design and supply a heater, pump, storage tanks, and pressure vessel due to their experience with industrial-scale heat transfer oil systems.

25 ENERGY STORAGE↗