Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Charging-driven coarsening and melting of a colloidal nanoparticle monolayer at an ionic liquid–vacuum interface

In this work, we induce and investigate the coarsening and melting dynamics of an initially static nanoparticle colloidal monolayer at an ionic liquid–vacuum interface, driven by a focused, scanning electron beam. Coarsening occurs through grain interface migration and larger-scale motions such as grain rotations, often facilitated by sliding dislocations. The progressive decrease in area fraction that drives melting of the monolayer is explained using an electrowetting model whereby particles at the interface are solvated once their accumulating charge recruits sufficient counterions to subsume the particle. Subject to stochastic particle removal from the monolayer, melting is recapitulated in simulations with a Lennard-Jones potential. This new driving mechanism for colloidal systems, whose dynamical timescales we show can be controlled with the accelerating voltage, opens the possibility to manipulate particle interactions dynamically without need to vary particle intrinsic properties or surface treatments. Furthermore, the decrease in particle size availed by electron imaging presents opportunities to observe force and time scales in a lesser-explored regime intermediate between typical colloidal and molecular systems.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Stochasticity and positive feedback enable enzyme kinetics at the membrane to sense reaction size

Here, we present detailed kinetic analyses of a panel of soluble lipid kinases and phosphatases, as well as Ras activating proteins, acting on their respective membrane surface substrates. The results reveal that the mean catalytic rate of such interfacial enzymes can exhibit a strong dependence on the size of the reaction system—in this case membrane area. Experimental measurements and kinetic modeling reveal how stochastic effects stemming from low molecular copy numbers of the enzymes alter reaction kinetics based on mechanistic characteristics of the enzyme, such as positive feedback. For the competitive enzymatic cycles studied here, the final product—consisting of a specific lipid composition or Ras activity state—depends on the size of the reaction system. Furthermore, we demonstrate how these reaction size dependencies can be controlled by engineering feedback mechanisms into the enzymes.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Effect of diffusion constant on the morphology of dendrite growth in lithium metal batteries

Lithium dendrites can lead to a short circuit and battery failure, and developing strategies for their suppression is of considerable importance. In this work, we study the growth of dendrites in a simple model system where the solvent is a continuum and the lithium ions are hard spheres that can deposit by sticking to existing spheres or the electrode surface. Using stochastic dynamics simulations, we investigate the effect of applied voltage and diffusion constant on the growth of dendrites. We find that the diffusion constant is the most significant factor, and the inhomogeneity of the electric field does not play a significant role. Additionally, the growth is most pronounced when the applied voltage and diffusion constant are both low. We observe a structural change from broccoli to cauliflower shape as the diffusion constant is increased. The simulations suggest that a control of electrolyte parameters that impact lithium diffusion might be an attractive route to controlling dendrite growth.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Sensor Incipient Fault Impacts on Building Energy Performance: A Case Study on a Multi-Zone Commercial Building

Existing studies show sensor faults/error could double building energy consumption and carbon emissions compared with the baseline. Those studies assume that the sensor error is fixed or constant. However, sensor faults are incipient in real conditions and there were extremely limited studies investigating the incipient sensor fault impacts systematically. This study filled in this research gap by studying time-developing sensor fault impacts to rule-based controls on a 10-zone office building. The control sequences for variable air volume boxes (VAV) with an air handling unit (AHU) system were selected based on ASHRAE Guideline 36-2018: High-Performance Sequences of Operation for HVAC Systems. Large-scale simulations on cloud were conducted (3600 cases) through stochastic approach. Results show (1) The site energy differences could go –3.3% lower or 18.1% higher, compared with baseline. (2) The heating energy differences could go –66.5% lower or 314.4% higher, compared with baseline. (3) The cooling energy differences could go –11.5% lower or 65.0% higher, compared with baseline. (4) The fan energy differences could go 0.15% lower or 6.9% higher, compared with baseline.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Experimental Validation of a Command and Control Traffic Detection Model

Network intrusion detection systems (NIDS) are commonly used to detect malware communications, including command-and-control (C2) traffic from botnets. NIDS performance assessments have been studied for decades, but mathematical modeling has rarely been used to explore NIDS performance. This paper details a mathematical model that describes a NIDS performing packet inspection and its detection of malware's C2 traffic. Here, the paper further describes an emulation testbed and a set of cyber experiments that used the testbed to validate the model. These experiments included a commonly used NIDS (Snort) and traffic with contents from a pervasive malware (Emotet). Results are presented for two scenarios: a nominal scenario and a “stressed” scenario in which the NIDS cannot process all incoming packets. Model and experiment results match well, with model estimates mostly falling within 95 % confidence intervals on the experiment means. Model results were produced 70-3000 times faster than the experimental results. Consequently, the model's predictive capability could potentially be used to support decisions about NIDS configuration and effectiveness that require high confidence results, quantification of uncertainty, and exploration of large parameter spaces. Furthermore, the experiments provide an example for how emulation testbeds can be used to validate cyber models that include stochastic variability.

mathematical model↗
DOE OSTI2021

Thermal Energy Storage Model Development within the Integrated Energy Systems Hybrid Repository

This publication details newly created energy storage models developed within the HYBRID Modelica repository as part of the Department of Energy Office of Nuclear Energy (DOE-NE) Integrated Energy Systems (IES) program, led by Idaho National Laboratory (INL). Model development to-date includes creation of dynamic systems-level models of concrete, latent heat, and packed-bed thermocline energy storage technologies for deployment in the IES-based HYBRID repository. Models are developed using the latest publicly available data and incorporate the possibility of control strategy inclusion for use with the existing IES modeling, analysis, and optimization toolset. Simulations showcase the abilities of each technology to cyclically charge and discharge when exposed to time-varying boundary conditions. In addition, low-level surrogate models for some of the thermal energy storage technologies were created using Python. These lower order Python files are much cheaper to run (i.e., computationally faster) and thus operate well when incorporated within the stochastic optimization problems run for the IES program. Moreover, economic data was collected for use within the INL-developed Framework for Optimization of ResourCes and Economics (FORCE). This information is incorporated within the FORCE platform. This work has resulted in creation of systems-level models for concrete, latent heat, and thermocline thermal energy storage systems with associated control systems. Now that these models are available, they can be utilized within different integrated energy park concepts to understand optimal system operation, control, and dispatching. Moreover, given the generic nature of the models, industrial partner technologies (e.g., Storworks Power, EnergyNest) can be quickly added to the repository using the existing models as a basis. Additional dynamic models for thermal energy storage concepts can be developed and added to the HYBRID repository as needed.

25 ENERGY STORAGE↗
DOE OSTI2020

From pools to flow: The PROMISE framework for new insights on soil carbon cycling in a changing world

Soils represent the largest terrestrial reservoir of organic carbon, and the balance between soil organic carbon (SOC) formation and loss will drive powerful carbon-climate feedbacks over the coming century. To date, efforts to predict SOC dynamics have rested on pool-based models, which assume classes of SOC with internally homogenous physicochemical properties. However, emerging evidence suggests that soil carbon turnover is not dominantly controlled by the chemistry of carbon inputs, but rather by restrictions on microbial access to organic matter in the spatially heterogeneous soil environment. The dynamic processes that control the physicochemical protection of carbon translate poorly to pool-based SOC models; as a result, we are challenged to mechanistically predict how environmental change will impact movement of carbon between soils and the atmosphere. In this study, we propose a novel conceptual framework to explore controls on belowground carbon cycling: Probabilistic Representation of Organic Matter Interactions within the Soil Environment (PROMISE). In contrast to traditional model frameworks, PROMISE does not attempt to define carbon pools united by common thermodynamic or functional attributes. Rather, the PROMISE concept considers how SOC cycling rates are governed by the stochastic processes that influence the proximity between microbial decomposers and organic matter, with emphasis on their physical location in the soil matrix. We illustrate the applications of this framework with a new biogeochemical simulation model that traces the fate of individual carbon atoms as they interact with their environment, undergoing biochemical transformations and moving through the soil pore space. We also discuss how the PROMISE framework reshapes dialogue around issues related to SOC management in a changing world. We intend the PROMISE framework to spur the development of new hypotheses, analytical tools, and model structures across disciplines that will illuminate mechanistic controls on the flow of carbon between plant, soil, and atmospheric pools.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Reinforcement Learning-based Output Structured Feedback for Distributed Multi-Area Power System Frequency Control

Load frequency control (LFC) is a key factor to maintain the stable frequency in multi-area power systems. As the modern power systems evolve from centralized to decentralized paradigm, LFC needs to consider the decentralized scheme that considers limited information from the information-exchange graph for the generator control of each interconnected area. This paper aims to solve a data-driven constrained LQR problem with mean-variance risk constraints and output structured feedback, and applies this framework to solve the LFC problem in multi-area power systems. By reformulating the constrained optimization problem into a minimax problem, the stochastic gradient descent max-oracle (SGDmax) algorithm with zero-order policy gradient (ZOPG) is adopted to find the optimal feedback gain from the learning, while guaranteeing the convergence. In addition, to improve the adaptation of the proposed learning method to new or varying models, we construct an emulator grid that approximates the dynamics of a physical grid and performs training based on this model. Once the feedback gain is obtained from the emulator grid, it is applied to the physical grid with a robustness test to check whether the controller from the approximated emulator applies to the actual system. Numerical tests show that the obtained feedback controller can successfully control the frequency of each area, while mitigating the uncertainty from the loads, with reliable robustness that ensures the adaptability of the obtained feedback gain to the actual physical grid.

Kwon, Kyung-bin↗
DOE OSTI2021

High-throughput bend-strengths of ultra-small polysilicon MEMS components

The strength distribution of polysilicon bend specimens, approximately 10 μm in size, is measured using a high-throughput microelectromechanical system fabrication and testing method. The distribution is predicted from reference tests on tensile specimens and finite element analysis of the bend specimen geometry incorporated into a stochastic extreme-value strength framework. Agreement between experiment and prediction suggests that the ultra-small specimens may be at the limit of extreme-value scaling and contain only one strength-controlling flaw/specimen.

Cook, Robert F. (ORCID:0000000304228881)↗
DOE OSTI2021

Error-Level-Controlled Synthetic Forecasts for Renewable Generation

Renewable energy resources, including solar and wind energy, play a significant role in sustainable energy systems. However, the inherent uncertainty and intermittency of renewable generation pose challenges to the safe and efficient operation of power systems. Recognizing the importance of short-term (hours ahead) renewable generation forecasting in power systems operation, it becomes crucial to address the potential inaccuracies in these forecasts. To systematically evaluate the performance of controllers in the presence of imperfect forecasts, we generate synthetic forecasts using actual renewable generation profiles (one from solar and one from wind). These synthetic forecasts incorporate different levels of statistical error, allowing us to control and manipulate the accuracy of the predictions. The primary objective is to employ synthetic forecasts with controlled yet realistic error levels to systematically investigate how controllers adapt to variations in forecast accuracy, providing valuable insights into their robustness and effectiveness under real-world conditions.

Array↗
DOE OSTI2020

Modeling Flexible Generator Operating Regions via Chance- constrained Stochastic Unit Commitment

Here, we introduce a novel chance-constrained stochastic unit commitment model to address uncertainty in renewables' production uncertainty in power systems operation. For most thermal generators,underlying technical constraints that are universally treated as "hard" by deterministic unit commitment models are in fact based on engineering judgments, such that system operators can periodically request operation outside these limits in non-nominal situations, e.g., to ensure reliability. We incorporate this practical consideration into a chance-constrained stochastic unit commitment model, specifically by in-frequently allowing minor deviations from the minimum and maximum thermal generator power output levels. We demonstrate that an extensive form of our model is computationally tractable for medium-sized power systems given modest numbers of scenarios for renewables' production. We show that the model is able to potentially save significant annual production costs by allowing infrequent and controlled violation of the traditionally hard bounds imposed on thermal generator production limits. Finally, we conduct a sensitivity analysis of optimal solutions to our model under two restricted regimes and observe similar qualitative results.

42 ENGINEERING↗
DOE OSTI2021

Human-in-the-loop Sensing and Control for Commercial Building Energy Efficiency and Occupant Comfort

Most of the existing heating, ventilation and air conditioning (HVAC) systems in commercial buildings operate in a conservative manner by assuming maximum occupancy in each room during pre-specified periods of the week, leading to significant energy being wasted as rooms are over-conditioned compared to the actual requirements of the occupants. Though critical, our understanding of occupancy patterns and thermal comfort needs of the occupants in commercial buildings is lacking and it is well known that both of these quantities are stochastic and time-varying, thus requiring sensing solutions to estimate them. This project had the goal of designing, implementing and evaluating a hardware and software solution to ameliorate this challenge. In particular, a depth camera (one whose pixels reveal distance from the camera as opposed to color values) placed on doorways is used to detect entrance and exit events from thermal zones in the building, and thereby estimate their occupancy levels. This information is then fed to a novel control algorithm that can, through interactions with the HVAC system, learn how to provide control inputs that maximize comfort and minimize energy waste. The resulting system represents a significant improvement over existing controllers for commercial HVAC systems and allowed us to improve our understanding of the design of future human-in-the-loop control solutions. For this solution to be feasible, the project had target metrics for its performance and cost. In particular, entrance and exit events for occupants moving about the building would need to be detected with an accuracy higher than 97%; and the resulting control inputs derived from this information would need to lead to approximately 10% energy savings compared to a schedule-based controller. Furthermore, regarding the final hardware design, the project had a target bill of materials (BOM) cost for the sensing solution of less than US$200 per unit while using less than 25W of power on average. All of these target metrics were met or exceeded by our final proposed solution. We performed evaluations by deploying the system in over 20 rooms of different types across 6 commercial buildings in Pittsburgh, PA over the course of three years, and performing targeted controlled experiments to test its performance along the different metrics. The human-in-the-loop control solutions (both hardware and software) developed through this project are expected to lead to significant improvements in the comfort and energy efficiency of HVAC systems used in commercial buildings. The insights we developed through the project pave the way to HVAC systems that can condition interior spaces according to their real-time utilization and the thermal comfort needs of the occupants, thereby reducing energy use. They also open up a new learning-based way of configuring HVAC controllers without having to manually fine-tune them for each building. These innovations can significantly increase the adoption of novel control solutions by the industry and thereby save resources and reduce costs of operation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

STOCHASTIC OPTIMAL POWER FLOW FOR REAL-TIME MANAGEMENT OF DISTRIBUTED RENEWABLE GENERATION AND DEMAND RESPONSE (Final Report)

To meet the grand challenge of a sustainable energy future, there has been a surge of interest in renewable energy. Today, the uncertainty associated with renewable resources is handled by using operating reserves. The high penetration of renewable resources, however, introduces difficult-to-control dynamics and challenges for power system operation. Decision support tools are necessary at the bulk system operational level to recognize and efficiently utilize renewable resources and distributed demand response products in concert with traditional grid resources. It is envisaged that responsive load can potentially have very significant cost advantages over either spinning or non-spinning ramping reserve. Critical decisions are made during hour(s)-ahead and real-time power system operation regarding the commitment and dispatch of generators to ensure power delivery is both reliable and economic. These decisions are typically made by a security constrained optimal flow, which determines future generator commitments, dispatches, and ensures adequate reserves are available in the event of a contingency (unexpected outage) or if future system conditions deviate from forecasts. However, security has been always based on a pre-specified subset of contingency constraints whose enforcement does not guarantee security under all possible future possibilities while also giving little or no weight to the likelihood of each contingent event or the severity of its consequences. Existing tools, which are based exclusively on deterministic optimization models, do not yield optimal operational decisions to address these new challenges, in terms of both reliability and cost-effectiveness. This project has focused on developing a stochastic optimal power flow (SOPF) framework, which integrates renewable resource uncertainty, load uncertainty, distributed storage (DS), demand response (DR) products, in a holistic manner to address the uncertainty associated with ever-increasing renewable resources, along with the inclusion of distributed demand response products in future power systems. A proof-of-concept problem was created using the Pennsylvania-Jersey-Maryland (PJM) power system network. Synthetic wind generation was added to the system to simulate 50% wind penetration. A 1-hour test of SOPF operation indicated more than 6% operational cost savings. The project continued by adding the Midwestern Independent System Operator (MISO) as a partner, with focus shifting from SOPF to Stochastic Look-Ahead Unit Commitment (SLAC). Unlike PJM, MISO is faced with significant renewable energy resources within its footprint and is challenged with substantial uncertainty in its operations. The SLAC distinguishes itself from existing tools that operators use. At best, today’s tools solve two to three cases independently, where one or two system parameters, such as forecasted load level (e.g., a low, base, and high forecast), are varied and the resulting scenarios are analyzed independently. The stochastic-based optimization of SLAC leverages statistical information from an ensemble of potential operational scenarios and their respective likelihood. The SLAC output can be translated into valuable information to the operator such as suggested commitments, optimal scheduling and dispatch of resources, reserve requirements at both locational and zonal resolutions, ramping availability and requirements, availability of demand response including operational guidance concerning the near-term and real-time coordination between distributed energy resources, and utilization of distributed storage resources. The developed SOPF/SLAC tool, a stand-alone tool compatible with existing EMSs, will provide system operators with unprecedented visibility, flexibility and predictability to these resources and operational guidance concerning the real-time coordination between DERs and DR/DS products. The game changing and practical impact of this disruptive technology will be dramatic and will usher in a new era in the electric power industry, wherein green energy concepts are fully embraced, and electric power costs are lowered throughout the nation.

42 ENGINEERING↗
DOE OSTI2021

EGR Dilution and Fuel Property Effects on High-Efficiency Spark-Ignition Flames

Modern spark ignition internal combustion engines rely on fast combustion rates and high dilution to achieve high brake thermal efficiencies. To accomplish this, new engine designs have moved towards increased tumble ratios and stroke-to-bore ratios. Increased tumble ratios correlate positively with increases in turbulent kinetic energy and improved fuel and residual gas mixing, all of which favor faster and more efficient combustion. Longer stroke-to-bore ratios allow higher geometric compression ratios and use of late intake valve closing to control peak compression pressures and temperatures. The addition of dilution to improve efficiency is limited by the resulting increase in combustion instabilities manifested by cycle-to-cycle variability. A number of effects - preferential diffusion, turbulence-combustion interactions, stochastic flow patterns, laminar-turbulent flame kernel transitions, and relative length and velocity scales between flame and turbulence - are believed to be responsible for the increase in cycle-to-cycle variations, where their contributions are likely interlinked. Several studies have shown the influence of stochastic flow characteristics on the nature of combustion instabilities, such as velocity patterns on flame kernel formation and cycle-to-cycle variations in residual gas. However, few have focused on the specific effects of fuel properties. The objective of this work is to contrast the effects of dilution on propane stoichiometric combustion against gasoline. Dilution tolerance experiments were conducted in a purpose-built high stroke-to-bore ratio single cylinder engine with both gasoline and LPG. Three-dimensional full cycle computational fluid dynamics (CFD) simulations employing a level-set combustion approach and Reynolds averaged Navier-Stokes (RANS) turbulence modeling was used to qualitatively assess the changes in length and velocity scales for turbulence and the flame. The experimental results showed that LPG can tolerate higher exhaust gas recirculation (EGR) dilution under a variety of conditions. Analysis of CFD simulations showed that propane flames are likely less sensitive to influences from the flow field due to less thickening of the flame and higher effective flame speeds.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Surrogate Hessian accelerated structural optimization for stochastic electronic structure theories

In this work, we present an efficient energy-based method for structural optimization with stochastic electronic structure theories, such as diffusion quantum Monte Carlo (DMC). This method is based on robust line-search energy minimization in reduced parameter space, exploiting approximate but accurate Hessian information from a surrogate theory, such as density functional theory. The surrogate theory is also used to characterize the potential energy surface, allowing for simple but reliable ways to maximize statistical efficiency while retaining controllable accuracy. We demonstrate the method by finding the minimum DMC energy structures of the selected flake-like aromatic molecules, such as benzene, coronene, and ovalene, represented by 2, 6, and 19 structural parameters, respectively. In each case, the energy minimum is found within two parallel line-search iterations. The method is near-optimal for a line-search technique and suitable for a broad range of applications. It is easily generalized to any electronic structure method where forces and stresses are still under active development and implementation, such as diffusion Monte Carlo, auxiliary-field Monte Carlo, and stochastic configuration interaction, as well as deterministic approaches such as the random-phase approximation. Accurate and efficient means of geometry optimization could shed light on a broad class of materials and molecules, showing high sensitivity of induced properties to structural variables.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Discrete stochastic model of point defect-dislocation interaction for simulating dislocation climb

Dislocation climb is an important high temperature process in metals plasticity, responsible for the phenomena such as creep, swelling, or hardening. Climb is defined by the ability of dislocations to leave their original glide plane by interacting with point defects. As such, dislocation climb is controlled by point defect diffusion/absorption/emission, all of which involve thermal activation. The existing thermodynamically consistent models for climb are generally formulated in a continuum framework, through the definition of effective defect fluxes and climb propensities in response to thermodynamic driving forces. However, the point-wise discrete nature of vacancies (and/or self-interstitials) confers a highly discrete nature to the climb dynamics, which is also strongly affected by elastic forces. The combination of discreteness, thermal activation, and elasticity makes this process too challenging for direct atomistic methods such as molecular dynamics. Here we develop a kinetic Monte Carlo model that captures vacancy generation and transport kinetics acting in conjuction with the evolving elastic fields provided by discrete dislocation dynamics simulations. The two models are coupled via the applied stresses and stress gradients generated by dislocation structures at vacancy locations. Our simulations reveal two surprising results. First that climb is dominated by vacancy emission even when the background vacancy concentration is much higher than the equilibrium one. And, second, that climb velocities might be much faster than otherwise believed when one uses the classical theories of climb. These effects are due to the locality of vacancy-dislocation processes, which are not captured in classical treatments that assume smooth vacancy fluxes and homogeneous concentrations. We apply the method to study elementary climb processes in body-centered cubic iron and furnish climb mobility functions to be used in parametric dislocation dynamics and/or crystal plasticity simulations. Here, we apply the technique to study non-conservative plastic bypass of spherical precipitates by edge dislocations and point out the differences between our discrete approach and existing continuum formulations.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Ab initio molecular dynamics on quantum computers

Ab initio molecular dynamics (AIMD) is a valuable technique for studying molecules and materials at finite temperatures where the nuclei evolve on potential energy surfaces obtained from accurate electronic structure calculations. In this work, we present an approach to running AIMD simulations on noisy intermediate-scale quantum (NISQ)-era quantum computers. The electronic energies are calculated on a quantum computer using the variational quantum eigensolver (VQE) method. Algorithms for computation of analytical gradients entirely on a quantum computer require quantum fault-tolerant hardware, which is beyond NISQ-era. Therefore, we compute the energy gradients numerically using finite differences, the Hellmann-Feynman theorem, and a correlated sampling technique. This method only requires additional classical calculations of electron integrals for each degree of freedom without any additional computations on a quantum computer beyond the initial VQE run. As a proof of concept, AIMD simulations are demonstrated for the H-2 molecule on IBM quantum devices. In addition, we demonstrate the validity of the method for larger molecules using full configuration interaction wave functions. As quantum hardware and noise mitigation techniques continue to improve, the method can be utilized for studying larger molecular systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗