Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed model predictive control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Learning and Fast Adaptation for Grid Emergency Control via Deep Meta Reinforcement Learning

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency control to maintain system reliability and security. Towards this end, great progress has been made in developing deep reinforcement learning (DRL) based grid control solutions in recent years. However, existing DRL-based solutions have two main limitations: 1) they cannot handle well with a wide range of grid operation conditions, system parameters, and contingencies; 2) they generally lack the ability to fast adapt to new grid operation conditions, system parameters, and contingencies, limiting their applicability for real-world applications. Here, in this paper, we mitigate these limitations by developing a novel deep meta-reinforcement learning (DMRL) algorithm. The DMRL combines the meta strategy optimization together with DRL, and trains policies modulated by a latent space that can quickly adapt to new scenarios. We test the developed DMRL algorithm on the IEEE 300-bus system. We demonstrate fast adaptation of the meta-trained DRL polices with latent variables to new operating conditions and scenarios using the proposed method, which achieves superior performance compared to the state-of-the-art DRL and model predictive control (MPC) methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2019

Controlled Design of Phase- and Size-Tunable Monodisperse Ni 2 P Nanoparticles in a Phosphonium-Based Ionic Liquid through Response Surface Methodology

Nanoparticles of nickel phosphide are finding wide ranging utility as catalysts for hydrodesulfurization, hydrogen evolution reaction, and hydrodeoxygenation of bio-oils. Herein, we present a methodology to tailor monodisperse nickel phosphide nanoparticles in terms of size and phase through the use of a statistical response surface methodology. Colloidal nickel phosphide nanoparticles were synthesized by replacing octadecene (ODE), a commonly used organic solvent, by a more sustainable phosphonium-based ionic liquid (IL). The replacement of ODE with the phosphonium-based IL resulted in faster crystallization at lower temperatures to yield phase-pure, monodisperse Ni2P nanoparticles. Using a first-order design, the PPh3/Ni precursor ratio was identified as the most critical factor influencing the resulting size and phase of the nanoparticles. Optimization using a Doehlert matrix for second-order design yielded a second-degree polynomial equation used to predict the mean diameter of the nanoparticles (over a range of 4-12 nm) as a function of the PPh3/Ni precursor ratio and the temperature used during synthesis. The resulting model was validated by performing reactions using randomly chosen sets of conditions; the experimentally determined nanoparticle sizes were in excellent agreement with the theoretical sizes predicted by our model. This demonstrates the utility of a multivariate experimental design as a powerful tool in the development of synthetic strategies toward the preparation of colloidal nanoparticles with highly controlled size, size distribution, and phase.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Predicting the Evolution of Shallow Cumulus Clouds With a Lotka‐Volterra Like Model

Abstract In numerical weather prediction and climate models, boundary‐layer clouds are controlled by a wide range of subgrid‐scale processes. However, understanding the nature of these processes and their role in the evolution of the cloud size distribution as a whole has been elusive. To address this issue, we adopt a novel empirical framework from the field of population dynamics to model the evolution of cloud size statistics by using the shallow cumulus properties obtained from a large‐eddy simulation (LES). Our approach involves representing the cloud size distribution and the total cloud area using a revised Lotka‐Volterra model and ridge linear model, respectively. The physical interpretation of the total cloud area and coefficients obtained from the optimization of the models reveals three stages probably interpreted by dominant processes: the formation of new clouds, the growth of single clouds, and a steady state with organized transitions involving the growth and decay of multiple clouds. Furthermore, we showcase the potential of this framework to serve as a component of scale‐aware parameterizations of shallow‐convective clouds in atmospheric models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning

Distributed energy resources (DERs) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline controller.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2020

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning: Preprint

Distributed energy resources (DER) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline MPC controller.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2021

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning

Distributed energy resources (DER) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline MPC controller.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2024

Hot, cold, or just right? An infrared biometric sensor to improve occupant comfort and reduce overcooling in buildings via closed-loop control

To improve occupant comfort and save energy in buildings, we have developed a closed-loop air conditioning (AC) sensor-controller that predicts occupant thermal sensation from the thermographic measurement of skin temperature distribution, then uses this information to reduce overcooling (cooling-energy overuse that discomforts occupants) by regulating AC output. Taking measures to protect privacy, it combines thermal-infrared (TIR) and color (visible spectrum) cameras with machine vision to measure the skin-surface temperature profile. Since the human thermoregulation system uses skin blood flow to maintain thermoneutrality, the distribution of skin temperature can be used to predict warm, neutral, and cool thermal states. We conducted a series of human-subject thermal-sensation trials in cold-to-hot environments, measuring skin temperatures and recording thermal sensation votes. We then trained random-forest classification machine-learning models (classifiers) to estimate thermal sensation from skin temperatures or skin-temperature differences. The estimated thermal sensation was input to a proportional integral (PI) control algorithm for the AC, targeting a sensation level between neutral and warm. Our sensor-controller includes a sensor assembly, server software, and client software. The server software orients the cameras and transmits images to the client software, which in turn assesses occupant skin temperature distribution, estimates occupant thermal sensation, and controls AC operation. A demonstration conducted in a conference room in an office building near Houston, TX showed that our system reduced overcooling, decreasing AC load by 42% when the room was occupied while improving occupant comfort (fraction of “comfortable” votes) by 15 percentage points.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2019

Engineering Nucleation Kinetics of Graphite Nodules in Inoculated Cast Iron for Reducing Porosity

Inoculation of cast iron with spherical graphite (SGI) controls nucleation kinetics of graphite nodules and is used for improving casting performance and eliminating solidification micro-porosity. In this study, thermodynamic simulations were used to design inoculants. Thermal and chemical stability of different potential heterogeneous nuclei formed in the melt above the liquidus temperature and in the mushy zone during solidification was predicted. Several inoculation treatments of SGI were performed in laboratory heats. An automated SEM/EDX analysis was applied to examine the graphite nodule size distribution and the family of the non-metallic inclusions in the experimental castings. The data were used to reconstruct a relative graphite nodule nucleation rate in the castings. It was shown that the graphite nodule nucleation kinetics in the castings were significantly different from those predicted by classical nucleation models. In inoculated SGI, the observed bi-modal distribution of graphite nodules was related to a continuous nucleation that occurred towards the end of solidification. The origin of the continuous nucleation and the possibility of engineering graphite nodules nucleation kinetics to control SGI casting soundness by inoculation are discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Current distribution monitoring enables quench and damage detection in superconducting fusion magnets

Abstract Fusion magnets made from high temperature superconducting ReBCO CORC ® cables are typically protected with quench detection systems that use voltage or temperature measurements to trigger current extraction processes. Although small coils with low inductances have been demonstrated, magnet protection remains a challenge and magnets are typically operated with little knowledge of the intrinsic performance parameters. We propose a protection framework based on current distribution monitoring in fusion cables with limited inter-cable current sharing. By employing inverse Biot-Savart techniques to distributed Hall probe arrays around CORC ® Cable-In-Conduit-Conductor (CICC) terminations, individual cable currents are recreated and used to extract the parameters of a predictive model. These parameters are shown to be of value for detecting conductor damage and defining safe magnet operating limits. The trained model is then used to predict cable current distributions in real-time, and departures between predictions and inverse Biot-Savart recreated current distributions are used to generate quench triggers. The methodology shows promise for quality control, operational planning and real-time quench detection in bundled CORC ® cables for compact fusion reactors.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Physics vs structure: A systematic benchmark of learning strategies for multi-zone building thermal dynamics

Recent advances in physics-informed and data-driven machine learning promise improved thermal models for advanced building control, yet there is limited quantitative evidence on when added physics structure and architectural complexity are beneficial. Here, this work presents a systematic benchmark of five representative system identification methods for modeling multi-zone building thermal dynamics: linear state-space models, multi-layer perceptrons, neural state-space models, neural ordinary differential equations, and physically-consistent neural networks. The methods are evaluated across multiple data regimes and zone coupling strategies. Using a high-fidelity multi-zone commercial building emulator, we examine short-term and long-term prediction accuracy, computational efficiency, and ease of development. Our results reveal critical trade-offs between prediction performance, model complexity, and physical consistency. We demonstrate that decoupled, nonlinear black-box models consistently outperform coupled physics-constrained architectures in both predictive accuracy and out-of-distribution robustness in majority of the test cases for the building type considered in the study. Our findings quantify the cost of complexity in building thermal modeling and provide concrete, actionable, scenario-based guidelines for selecting model classes for control-oriented applications.

Building thermal modeling↗
DOE OSTI2025

Grain Boundary Segregation Suppresses Local Short‐Range Ordering in Nanocrystalline High‐Entropy Alloys

Multi-principal-element alloys like high-entropy alloys (HEAs) have potential applications in many engineering fields due to their unique mechanical/functional properties. While HEAs are generally considered random solid solutions, recent studies revealed that they are prone to short-range-ordering (SRO) due to the complex multi-pair-wise interactions among the constituent elements. Meanwhile, SROs' evolution can sometimes be deleterious, and it is necessary to have control over their evolution. Examining the AlCoCrFe-Zr model alloy, long-range ordering occurs following the expectation of enthalpic predictions. Advanced characterization techniques—transmission electron microscopy, high-energy synchrotron X-ray diffraction/pair distribution function, and atom probe tomography, reveal that SRO is suppressed in as-milled and GB-decorated NC-(AlCoCrFe)100-xZrx (x = 0–1.5 atomic %). Warren-Cowley coefficient calculations are further used to validate the suppression of SRO. Besides the low segregation enthalpies of Cr, Fe, and Zr, and the high-mixing enthalpy of Cr and Fe, the short diffusion path to GBs due to high-GB density in the NC-HEAs and the higher energy state of the GBs than the matrix promotes GB-segregation that further alters the matrix chemistry and consequently disfavors SRO formation within the matrix. Despite the GB-segregation of Cr, Fe, and Zr, the matrices and GBs remain in a random solid solution.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Hamilton: Flexible, Open Source $10 Wireless Sensor System for Energy Efficient Building Operation

Sensors for improving building performance are rapidly populating the market, driven in part by the drive to reduce greenhouse gas emissions resulting from energy production as well as improve the interior environment for healthy and more productive spaces. UC Berkeley has led wireless sensor development over the past 25 years (e.g., Telos mote), with the Hamilton (named after Alexander Hamilton on the US $10 bill) as the most recent. The Hamilton sensor was designed as a low-cost high-performance sensor that is modular and interoperable. The objective of the Hamilton project was to create, evaluate and establish the technological foundations for secure and easy to deploy building energy efficiency applications utilizing pervasive, low-cost wireless sensors integrated with traditional Building Management Systems (BMS), consumer-sector building components, and powerful data analytics. The project included iterative hardware design, incorporating a high-performance database (BTrDb, http://btrdb.io/), creating and iterating the development of secure data middleware (BOSSwave, WAVE/WAVEMQ), working with and pushing the development of an open-source tiny operating system RiotOS, and implementing and improving protocols such as Thread/OpenThread and TCP/IP. The hardware benefited from careful design to drive down the cost; the design included a System-on-a-Chip (SoC), chip antenna, single crystal and five passive components. Careful design of the operating system created a low-power design to enable a long life with small batteries. The hardware included several sensors: temperature, radiant temperature, relative humidity, magnetometer, accelerometer, and light, with an optional occupancy (Passive InfraRed) sensor. The project was the basis of several applications, both internal to the research team and other researchers and professionals at other institutions. Several applications used the sensor hardware as the basis for other complex devices. Other applications used the sensors to improve building performance through interoperating with the building Heating Ventilation and Air-Conditioning (HVAC) system, such as using occupancy and/or distributed temperature sensing to reduce HVAC zone energy while still providing thermal comfort and to reduce peak loads in small commercial buildings. We demonstrated cloud-based energy analytics, implemented a schedule and a Model Predictive Controller in a small commercial building to optimize HVAC energy, occupancy and electricity price. Initial integration of these technological innovations was performed through the creation of execution containers containing the WAVE agent and various driver, proxy, or building system function logic. The research added to the understanding of efficient sensor hardware, secure middleware, time-series data management (high performance database), efficient communication protocols, and interoperating with applications and building systems. The project showed the technical effectiveness and economic feasibility of creating a low-cost, modular, and easy-to-deploy sensor. Through conversations with multiple end users, the research team discovered that many customers wanted data management and services in addition to the sensors. HamiltonIOT developed packages of sensors, border router, and data services to provide a seamless “plug-and-play” sensor deployment. Some customers were willing to pay for higher quality sensors (such as light); some customers wanted a robust enclosure (waterproof).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Adaptive Deep Reinforcement Learning Algorithm for Distribution System Cyber Attack Defense With High Penetration of DERs

With grid modernization, smart inverters are increasingly used to execute advanced controls for distribution network reliability. However, this also increases the cyber-attack space. Here this paper focuses on the defense approaches to restore the system to normal operation circumstances in the presence of cyber-attacks. A unique deep reinforcement learning (DRL) method is developed to minimize voltage violations and reduce power losses for impacted feeders. The defense problem is reformulated as a Markov decision-making process to dynamically control DERs while minimizing load shedding. This is achieved via an improved soft actor-critic (SAC)-based DRL algorithm, which can govern DER set points and load-shedding scenarios in discrete and continuous modes via the auto-tune entropy and Gaussian policy features. Numerical comparison results on the modified IEEE 123-node system with other control approaches, such as Volt-VAR (VV), Volt-Watt (VW), and model predictive control (MPC) show that the proposed method can eliminate voltage violations and provide feasible control actions that perform complete mitigation of cyber-threats.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Investigation of an Intermittent Binary Control Strategy for Distributed Aerodynamic Control Devices for Load Alleviation in Wind Turbine Blades

A study was conducted of an intermittent binary control strategy for trailing edge flaps and leading edge spoilers installed on wind turbine blades for the purpose of load alleviation. Cost estimation models were developed for the systems to predict overall impact on levelized cost of energy over the lifecycle of the turbine system. Aeroelastic simulations of turbines with the control strategy implemented showed improved levelized cost for some, but not all cases.

17 WIND ENERGY↗
DOE OSTI2024

Maps of plant functional type (PFT), PFT fractional cover, and uncertainty derived from AVIRIS-NG data, 2019, Seward Peninsula

Remote sensing maps of plant functional type (PFT), PFT fractional cover (fCover), and fCover uncertainty maps derived from NASA’s Airborne Visible / Infrared Imaging Spectrometer – Next Generation (AVIRIS-NG). The AVIRIS-NG imaging spectroscopy data (380 ~ 2510 nm) was collected as a part of the collaboration between NASA’s Arctic-Boreal Vulnerability Experiment (ABoVE; Miller et al., 2019) and DOE’s Next Generation Ecosystem Experiment in the Arctic (NGEE-Arctic). This package includes maps for flights over Teller, Kougarok, and Council watersheds created using eight AVIRIS-NG imagery collected in July, 2019. The map data and metadata are provided as image (ENVI, *.png) and text (*.txt, *hdr) formats. Additional supporting map quicklooks are provided as GIS *.kml files. Detailed description of the methods for each map are provided in Yang et al., (2023). These datasets are provided in support of Yang et al., (In revision) “Topography and Functional Traits Control the Distribution of Key Shrub Plant Functional Types in Low-Arctic Tundra”.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Surface-mediated spontaneous emulsification of the acylated peptide, semaglutide

Acylated peptides composed of glucagon-like peptide-1 receptor agonists modified with a fatty acid side chain are an important class of therapeutics for type 2 diabetes and obesity but are susceptible to an unusual physical instability in the presence of hydrophobic surfaces, i.e., spontaneous emulsification, also known as ouzo formation in practice. In this work, light scattering, small-angle X-ray scattering, and circular dichroism measurements are used to characterize the physical properties of the semaglutide colloidal phase, including size distribution, shape, secondary structure, internal structure, and internal composition, as a function of solution physico-chemical conditions. The existence and size of the colloids formed are successfully predicted by a classical Rayleigh model, which identifies the parameters controlling their size and formation. Colloid formation is found to be catalyzed by hydrophobic surfaces, and formation rates are modeled as an autocatalytic reaction, enabling the formation of a master curve for various surfaces that elucidates the mechanism. Surfaces differ due to differences in surface wettability, which can be correlated with Hansen solubility parameters. This work provides insights into this unusual colloidal phenomenon and guides the peptide synthesis process and drug product formulation in the pharmaceutical industry.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

A new dynamic zOnal model with air-diffuser (DOMA) - Application to thermal comfort prediction

A new Dynamic zOnal Model with Air-diffuser (DOMA) was developed. Several case studies were investigated and tested to evaluate and validate this program using measurement data. This new model was integrated into a TRaNsient SYstems Simulation program library and coupled with the multi-zone thermal model. The DOMA/TRNSYS coupled model was then used to predict room temperature distribution over an entire day of a single-zone building. The results show that increasing the heating outputs of the electric floor system, for example, from 75 to 200 W/m 2 , would not effectively improve the indoor thermal comfort, since the thermostat will reach the set point first and then turn off the system before the room gets enough heat and reach a comfortable level. This indicates the importance of selecting an appropriate location and set point for the thermostat when using a floor heating system. This potential thermal comfort issue can only be identified through the two-node model with a dynamic zonal model rather than the conventional PMV model, which thus suggests that for optimizing indoor thermal comfort of a building equipped with a time-sensitive control strategy and/or HVAC system, the TSENS results obtained from the two-node model integrated with DOMA are more appropriate than PMVs.

Construction & Building Technology↗
DOE OSTI2018

Prediction of Cooling Curves for Controlled Unidirectional Solidification Under the Influence of Shrinkage: A Semi-analytical Approach

Quality of casting products can be significantly improved by controlling the crystal growth rate. Both dendritic and equiaxed grain structures depend strongly on crystal growth rate along the crystallographic direction. Uncontrolled solidification processes may lead to the formation of porous and columnar material with an extremely non-homogeneous composition distribution. These undesirable micro-structures can be avoided by adopting an optimal cooling rate (K/s) during the crystal growth. The present work focuses on determining suitable cooling curves to obtain desired unidirectional crystal growth rates, by implementing a semi-analytical model. Here, we defined cooling curve as the time history of temperature evolution at the cold boundary. The proposed semi-analytical heat transfer model is diffusion driven and accounts for shrinkage effect during solidification. The proposed model is found capable of predicting cooling curves for prescribed interface velocities. The model is self-sufficient in validating itself by means of solving inverse and forward problems. The cooling curve prediction by the model is validated by using it as the transient boundary condition for an existing enthalpy updating scheme-based numerical model. The proposed model is also applied to empirical data reported in literature, to validate the model against experimental results. All the validations showcased excellent fit. The proposed model will facilitate controlled unidirectional crystal growth rate by providing cooling rate (K/s) as an input for the experiments involving directional solidification.

36 MATERIALS SCIENCE↗