Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Time-Sequenced Flow Field Prediction in an Optima Spark-Ignition Direct-Injection Engine Using Bidirectional Recurrent Neural Network (bi-RNN) with Long Short-Term Memory

To further improve the energy conversion efficiency of internal combustion engine, the transient and complex air flow movement inside the cylinder needs to be better understood and controlled. Although the in-cylinder flow fields are highly stochastic with strong cycle-to-cycle fluctuations, machine learning can still provide an efficient way to learn and regress the complex flow movement process inside the cylinder. In this work, a bidirectional recurrent neural network (bi-RNN) model with long short-term memory was applied to predict the in-cylinder flow fields at different time steps using training data from mull-cycle particle image velocimetry (PIV) measurements. To evaluate the agreement between the true and predicted flow fields, structure and magnitude comparison indices are calculated both globally and locally. The comparison results show that the bi-RNN model can accurately predict the bulk flow and vortex motions from early intake stroke to compression stroke. This work demonstrates that the machine learning model has the potential to predict the underlying dynamics of the interaction between in-cylinder flows and provides a reliable way to improve temporal resolution in PIV flow data to better reveal transient in-cylinder flow features.

Bi-RNN model↗

A computer vision algorithm for interpreting lacustrine carbonate textures at Searles Valley, USA

Investigations of the paleohydrologies of pluvial lake systems have often employed lake carbonate deposits called “tufa” that grow subaqueously and can be preserved long after the drying of the lake. For this reason, tufa have been used as a proxy for minimum lake level. However, they exhibit a variety of textures that hold the potential to reveal richer paleoclimatological information. With the goal of determining if tufa texture can be used as a proxy for lake environment, this study investigates the textures of tufa at Mono Lake, California in comparison to the fossil tufa in Searles Valley, California. While observations in the last century suggest that the tufa in the Mono basin grew in waters similar to the modern, the tufa at Searles formed during the last glacial period, when the Great Basin contained a system of pluvial lakes on the scale of the modern Great Lakes. The tufa at both basins have been observed to have a range of classifiable textures, and new methods of inspecting visual data could be informative about what factors control these textures. To this end, a t-Distributed Stochastic Neighbor Embedding (t-SNE) algorithm is used to project images of the tufa at Searles and Mono into a coordinate space, allowing for simple, quantitative comparisons of the visual similarity of textures. In this work, the textures of tufa at Searles are compared to each other, as well as to the tufa at Mono. This study performs a robust assessment of the feasibility of Mono Lake as a modern analogue for Searles Valley. It finds that there is a justifiable basis for the comparison of certain fossil facies at Searles to the tufa at Mono, significant progress towards the goal of using texture as a metric for the environment in which tufa formed.

58 GEOSCIENCES↗

A Non-Cooperative Game-Based Distributed Beam Scheduling Framework for 5G Millimeter-Wave Cellular Networks

Here, this paper studies the problem of distributed beam scheduling for 5G millimeter-Wave (mm-Wave) cellular networks where base stations (BSs) belonging to different operators share the same spectrum without centralized coordination among them. Our goal is to design efficient distributed scheduling algorithms to maximize the network utility, which is a function of the achieved throughput by the user equipment (UEs), subject to the average and instantaneous power consumption constraints of the BSs. We propose a Media Access Control (MAC) and a power allocation/adaptation mechanism utilizing the Lyapunov stochastic optimization framework and non-cooperative games. In particular, we first decompose the original utility maximization problem into two sub-optimization problems for each time frame, which are a convex optimization problem and a non-convex optimization problem, respectively. By formulating the distributed scheduling problem as a non-cooperative game where each BS is a player attempting to optimize its own utility, we provide a distributed solution to the non-convex sub-optimization problem via finding the Nash Equilibrium (NE) of the game whose weights are determined optimally by the Lyapunov optimization framework. Finally, we conduct simulation under various network settings to show the effectiveness of the proposed game-based beam scheduling algorithm in comparison to that of several reference schemes.

42 ENGINEERING↗

Understanding the Drivers of Atlantic Multidecadal Variability using a Stochastic Model Hierarchy

The relative importance of ocean and atmospheric dynamics in generating Atlantic Multidecadal Variability (AMV) remains an open question. Comparisons between climate models with SLAB and fully-dynamic (FULL) ocean components are often used to explore this question, but cannot reveal how individual ocean processes generate these differences. We build a hierarchy of physically interpretable stochastic models to investigate the contribution of two upper-ocean processes to AMV: the role of seasonal variation and mixed-layer entrainment. This interpretability arises from the stochastic model’s simplified representation of sea surface temperature (SST), considering only the local upper ocean response to white-noise atmospheric forcing and its impact on surface heat exchange. We focus on understanding differences between SLAB and FULL non-eddy resolving pre-industrial control simulations of the Community Earth System Model 1 (CESM), and estimate the stochastic model parameters from each respective simulation. Despite its simplicity, the stochastic model reproduces temporal characteristics of SST variability in the SPG, including reemergence, seasonal-to-interannual persistence and power spectra. Furthermore, unrealistically persistent SST of the CESM-SLAB ocean simulation is reproduced in the equivalent stochastic model configuration where the mixed-layer depth (MLD) is constant. The stochastic model also reveals that vertical entrainment primarily damps SST variability, thus explaining why SLAB exhibits larger SST variance than FULL. Here, the stochastic model driven by temporally stochastic, spatially coherent forcing patterns reproduces the canonical AMV pattern. However, the amplitude of low-frequency variability remains underestimated, suggesting a role for ocean dynamics beyond entrainment.

54 ENVIRONMENTAL SCIENCES↗

Scalable/Secure Cooperative Algorithms and Framework for Extremely-high Penetration Solar Integration (SolarExPert) (Final Technical Report)

This SolarExPert project has developed a Sustainable Grid Platform (SGP) with scalable architecture of distributed control and optimization. The SGP consists of the following major functions: 1) an advanced grid architecture with hierarchical and distributed communication and control, combined with the OpenFMB standard and implemented on the Multi-Agent OpenDSS (MA-OpenDSS) platform; 2) an online distributed stochastic optimal power flow; 3) an online distributed system state estimation algorithm; 4) the distributed Volt/VAR optimization and frequency control algorithms; 5) the distributed distribution system restoration strategy. The developed SGP together with advanced functions are tested in 1 million (1M)-node distribution system on the MA-OpenDSS platform. Furthermore, the models and algorithms are tested in 100,000-node system HiL simulation, and also in P-HiL implementation with 100 physical devices. The developed functions haven been validated and tested on the selected actual distribution feeder with the data collected from the field of Maui Meadows in Hawaii. The distributed PV hosting capacities with cooperative Volt/VAR and Volt/VAR/Watt control are estimated and compared to provide recommendations for customers and the utility company.

14 SOLAR ENERGY↗

Multi-Time Scale Coordinated Control and Scheduling of Inverter-Based TCLs With Variable Wind Generation

To address microgrid tie flow errors caused by wind generation variability, here we propose and develop a multi-time scale coordinated control and scheduling strategy for inverter-based thermostatically controlled loads (TCLs). First, in hour-time scale, inverter-based TCLs with adjusting temperature set-point are modeled as virtual generators to compensate tie flow deviations in the day-ahead plan. Next, in minute-time scale, virtual batteries representing operating behaviors of inverter-based TCLs with frequency control are scheduled determined by the control of virtual generators in hour-time scale. The virtual batteries are scheduled to smooth out tie flow errors corresponding to day-ahead plan and hour-time scale schedules. The multi-time scale control methods are coordinated to employ the response potential of inverter-based TCLs and response curve-based methods are proposed to control inverter-based TCLs considering the customer privacy. The multi-time scale stochastic schedules which are based on response curves of inverter-based TCLs are coordinated to accommodate wind generation variability. Simulation results demonstrate that the microgrid tie flow errors are effectively mitigated by the proposed multi-time scale coordinated control and scheduling of inverter-based TCLs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Hedging direct simulation Monte Carlo bets via event splitting

We propose a new scheme for simulation of collisions with multiple possible outcomes in variable-weight DSMC computations. The scheme is applied to a 0-D ionization rate coefficient computation, and 1-D electrical breakdown simulation. We show that the scheme offers a significant (up to an order of magnitude) improvement in the level of stochastic noise over the usual acceptance-rejection algorithm, even when controlling for the slight additional computational costs. Furthermore, the benefits and performance of the scheme are analyzed in detail, and possible extensions are proposed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Data-Driven Global Sensitivity Analysis of Three-Phase Distribution System with PVs

Global sensitivity analysis (GSA) of distribution system with respect to stochastic PV variations plays an important role in designing optimal voltage control schemes. This paper proposes a Kriging, i.e., Gaussian process modeling enabled data-driven GSA method. The key idea is to develop a surrogate model that captures the hidden global relationship between voltage and real and reactive power injections from the historical data. With the surrogate model, the Sobol index can be conveniently calculated to assess the global sensitivity of voltage to various power injection variations. Comparison results with other model-based GSA methods on the IEEE 37-bus feeder, such as the polynomial chaos expansion and the Monte Carlo approaches demonstrate that the proposed method can achieve accurate GSA outcomes while maintaining high computational efficiency.

distribution system analysis↗

Global stochastic optimization of stellarator coil configurations

In the construction of a stellarator, the manufacturing and assembling of the coil system is a dominant cost. These coils need to satisfy strict engineering tolerances, and if those are not met the project could be cancelled as in the case of the National Compact Stellarator Experiment (NCSX) project. Therefore, our goal is to find coil configurations that increase construction tolerances without compromising the performance of the magnetic field. In this paper, we develop a gradient-based stochastic optimization model which seeks robust stellarator coil configurations in high dimensions. In particular, we design a two-step method: first, we perform an approximate global search by a sample efficient trust-region Bayesian optimization; second, we refine the minima found in step one with a stochastic local optimizer. To this end, we introduce two stochastic local optimizers: BFGS applied to the sample average approximation; and Adam, equipped with a control variate for variance reduction. Numerical simulations performed on a W7-X-like coil configuration demonstrate that our global optimization approach finds a variety of promising local solutions at less than 0.1% of the cost of previous work, which considered solely local stochastic optimization.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Control of long-distance motion of single molecules on a surface

Spatial control over molecular movement is typically limited because motion at the atomic scale follows stochastic processes. Here, we used scanning tunneling microscopy to bring single molecules into a stable orientation of high translational mobility where they moved along precisely defined tracks. Single dibromoterfluorene molecules moved over large distances of 150 nanometers with extremely high spatial precision of 0.1 angstrom across a silver (111) surface. The electrostatic nature of the effect enabled the selective application of repulsive and attractive forces to send or receive single molecules. The high control allows us to precisely move an individual and specific molecular entity between two separate probes, opening avenues for velocity measurements and thus energy dissipation studies of single molecules in real time during diffusion and collision.

74 ATOMIC AND MOLECULAR PHYSICS↗

A low-cost and realistic noisy light system for studying photosynthesis

Unlike the light conditions commonly used to grow photosynthetic organisms in the research laboratory, the light intensity in real environments is dynamic. A simple and low-cost system is described in which a commercial dimmable LED panel is controlled to simulate a sinusoidal function representing daylight hours and overlaid with stochastic shading events. The output closely resembles light intensity measurements on Earth’s surface on partly cloudy days or in lower levels of plant canopies. Here, this tool may be useful to researchers studying photosynthetic acclimation responses.

59 BASIC BIOLOGICAL SCIENCES↗

Multistage economic MPC for systems with a cyclic steady state: A gas network case study

Multistage model predictive control (MPC) provides a robust control strategy for dynamic systems with uncertainties and a setpoint tracking objective. Moreover, extending MPC to minimize an economic cost instead of tracking a pre-calculated optimal setpoint improves controller performance. This paper presents a novel multistage economic nonlinear model predictive control (E-NMPC) framework for dynamic systems operating under uncertainty, with specific application to natural gas transmission networks. A key innovation lies in the integration of cyclic steady-state (CSS) constraints within the multistage MPC formulation, enabling the controller to manage periodic operating conditions commonly observed in energy systems. A Lyapunov-based descent condition is enforced to ensure robust stability of the controller. The multistage economic MPC framework is validated on two gas pipeline case studies, where it successfully minimizes net energy consumption, respects operational constraints under uncertain demand profiles, and guides the network to optimal cyclic operation. The Lyapunov function remains bounded in both case studies, validating the robust stability of multistage E-NMPC.

03 NATURAL GAS↗

DNN-based policies for stochastic AC OPF

We report a prominent challenge to the safe and optimal operation of the modern power grid arises due to growing uncertainties in loads and renewables. Stochastic optimal power flow (SOPF) formulations provide a mechanism to handle these uncertainties by computing dispatch decisions and control policies that maintain feasibility under uncertainty. Most SOPF formulations consider simple control policies such as affine policies that are mathematically simple and resemble many policies used in current practice. Motivated by the efficacy of machine learning (ML) algorithms and the potential benefits of general control policies for cost and constraint enforcement, we put forth a deep neural network (DNN)-based policy that predicts the generator dispatch decisions in real time in response to uncertainty. The weights of the DNN are learnt using stochastic primal–dual updates that solve the SOPF without the need for prior generation of training labels and can explicitly account for the feasibility constraints in the SOPF. The advantages of the DNN policy over simpler policies and their efficacy in enforcing safety limits and producing near optimal solutions are demonstrated in the context of a chance constrained formulation on a number of test cases.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Controlling process instability for defect lean metal additive manufacturing

The process instabilities intrinsic to the localized laser-powder bed interaction cause the formation of various defects in laser powder bed fusion (LPBF) additive manufacturing process. Particularly, the stochastic formation of large spatters leads to unpredictable defects in the as-printed parts. Here we report the elimination of large spatters through controlling laser-powder bed interaction instabilities by using nanoparticles. The elimination of large spatters results in 3D printing of defect lean sample with good consistency and enhanced properties. We reveal that two mechanisms work synergistically to eliminate all types of large spatters: (1) nanoparticle-enabled control of molten pool fluctuation eliminates the liquid breakup induced large spatters; (2) nanoparticle-enabled control of the liquid droplet coalescence eliminates liquid droplet colliding induced large spatters. The nanoparticle-enabled simultaneous stabilization of molten pool fluctuation and prevention of liquid droplet coalescence discovered here provide a potential way to achieve defect lean metal additive manufacturing.

36 MATERIALS SCIENCE↗

Understanding and Controlling Photoexcited Molecules in Complex Environments (Final Technical Report)

Predicting the outcome of a photochemical reaction is complicated by factors outside the scope of tradition theoretical chemistry. On such small scales, fluctuations of the environment render outcomes stochastic, nonadiabatic dynamics blur the separation between nuclear and electronic motion, and ultrafast relaxation renders typical assumptions of equilibrium inappropriate. This project aimed to elucidate and control nonadiabatic molecular dynamics in condensed phases. We developed accurate, efficient simulation tools to study irreversible molecular processes computational across a range of scales. We applied these methodological advances to study electron transfer under exotic conditions where spin and topology opened new pathways for reactivity. We also brought these ideas to bare on light harvesting systems, where energy and charge transport are coupled, and where long lifetimes can be deleterious to function. These advances helped to establish general principles for chemical efficiency and guide the design of nanoscale energy materials, molecular machines, and related technologies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Data-Driven Global Sensitivity Analysis Framework for Three-Phase Distribution System with PVs

Global sensitivity analysis (GSA) of distribution systems with respect to stochastic PV and load variations plays an important role in designing optimal voltage control schemes. This paper proposes a data-driven framework for GSA of distribution systems. In particular, two representative surrogate modeling-based approaches are developed, including the traditional Gaussian process-based and the analysis of variance (ANOVA) kernel ones. The key idea is to develop a surrogate model that captures the hidden global relationship between voltage and real and reactive power injections from the historical data. With the surrogate model, the Sobol indices can be conveniently calculated through either the sampling-based method or the analytical method to assess the global sensitivity of voltage to variations of PV and load power injections. The sampling-based method approximates the Sobol indices using Monte Carlo simulations while the analytical method calculates them by resorting to the ANOVA expansion framework. Comparison results with other model-based GSA methods on the unbalanced three-phase IEEE 37-bus and 123-bus distribution systems show that the proposed framework can achieve much higher computational efficiency with negligible loss of accuracy. The results on a real 240-node distribution system using actual smart meter data further validate the feasibility and scalability of the proposed framework.

14 SOLAR ENERGY↗

Design of an optical amplifier for amplified OSC in IOTA facility at Fermilab

Optical stochastic cooling (OSC) is a cutting-edge beam cooling technology to reduce, control the 3 dimensional spread and the motion of particle beams. It has recently been successfully, experimentally, demonstrated in Fermilab's IOTA storage ring, marking a major step forward in beam cooling. OSC has the potential to significantly improve both the performance and flexibility as a beam cooling system. One promising way to boost OSC performance is by adding a high-gain optical amplifier. However, this amplifier must be carefully designed to meet the specific constraints of the OSC system. A major challenge lies in the limited optical delay, which is just 6 mm for the case of IOTA, set by the beam bypass, restricts us to use a short-length gain medium. This, along with IOTA’s high repetition rate and the relatively long duration of the optical pulses, limits the peak power available for the pump laser without damaging the crystal, which is crucial for achieving strong nonlinear gain. Additionally, it's essential to preserve the phase coherence of the undulator radiation during amplification, which further complicates the amplifier design. This report details a specialized amplifier setup that addresses these challenges, includes simulations of the integrated system, and summarizes the latest experimental progress and results.

Mondal, Abhishek [Fermilab]↗

Phase-space tailoring and cooling of charged-particle beams for energy- and intensity-frontier applications

This project addressed accelerator science & technology researches relevant to the Intensity and Energy frontiers by investigating generic techniques to tailor and cool the phase-space distributions of charged-particle beams. Specifically, the project had two main research thrusts: (i) the development of phase-space tailoring techniques using externally-applied electromagnetic fields and (ii) the investigation of phase-space control using the beam’s self-field such as the optical-stochastic cooling (OSC). The work related to the development of phase-space-tailoring techniques leveraged on the research performed under our previous grant DE-SC0011831 where new temporal-shaping methods were proposed and some experimentally demonstrated. The work related to the concept of beam manipulation using self fields, and especially OSC, built on the achievements supported by grant DE-SC0013761 which focused on a OSC proof-of-principle experiment at the Fermilab’s IOTA ring.

43 PARTICLE ACCELERATORS↗