Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Assessing mechanisms for microbial taxa and community dynamics using process models

Disentangling the assembly mechanisms controlling community composition, structure, distribution, functions, and dynamics is a central issue in ecology. Although various approaches have been proposed to examine community assembly mechanisms, quantitative characterization is challenging, particularly in microbial ecology. Here, we present a novel approach for quantitatively delineating community assembly mechanisms by combining the consumer–resource model with a neutral model in stochastic differential equations. Using time-series data from anaerobic bioreactors that target microbial 16S rRNA genes, we tested the applicability of three ecological models: the consumer–resource model, the neutral model, and the combined model. Our results revealed that model performances varied substantially as a function of population abundance and/or process conditions. The combined model performed best for abundant taxa in the treatment bioreactors where process conditions were manipulated. In contrast, the neutral model showed the best performance for rare taxa. Our analysis further indicated that immigration rates decreased with taxa abundance and competitions between taxa were strongly correlated with phylogeny, but within a certain phylogenetic distance only. The determinism underlying taxa and community dynamics were quantitatively assessed, showing greater determinism in the treatment bioreactors that aligned with the subsequent abnormal system functioning. Given its mechanistic basis, the framework developed here is expected to be potentially applicable beyond microbial ecology.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

The Cascade Effectiveness of 3-Terminal Tandem Photocathode Architectures as Applied to CO 2 Reduction

Cascade catalysis for photoelectrochemical CO 2 reduction (CO 2 R) decouples the overall reaction into sequential steps occurring on separately optimized catalysts (for example, Ag and Cu) between which an intermediate species such as CO is transferred. A 3-terminal tandem (3TT) photovoltaic architecture advantageously holds two different catalytic regions at different potentials under a single illumination source, but its overall efficiency is low. Using a stochastic reaction-diffusion model, we have examined 3TT photocathode design principles, focusing on the coupling of surface chemistry and transport of CO both inside the boundary layer and outward, into the bulk electrolyte. We find that ensuring that the lateral diffusion distance within the boundary layer is short compared to the boundary layer thickness and controlling bulk flow are key, with interdigitated designs showing an overall conversion efficiency improvement by 2 orders of magnitude compared to the side-by-side case without flow. These findings can be adapted for other cascaded architectures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

New Advances in Optical Stochastic Cooling

Recently, Optical Stochastic Cooling (OSC) became the first demonstrated method for ultra-high-bandwidth stochastic cooling. The initial experiments at Fermilab’s IOTA ring explored the essential physics of the method and demonstrated cooling, heating and manipulation of beams and single particles. Having been validated in practice, with continued development, OSC carries the potential for dramatic advances in the state-of-the-art performance and flexibility for beam cooling and control. The ongoing program at Fermilab is now focused on the development of an OSC system that includes high-gain optical amplification, which promises a two-order-of-magnitude increase in the strength of the OSC force. In this talk, we briefly review the results of the initial experimental campaign, describe the status of the conceptual and hardware designs for the amplified OSC system, report initial experimental results of our high-gain amplifier development, and explore near-term operational plans and use cases.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

The Optical Stochastic Cooling Program at Fermilab

Recently, Optical Stochastic Cooling (OSC) became the first demonstrated method for ultra-high-bandwidth stochastic cooling. The initial experiments at Fermilab’s IOTA ring explored the essential physics of the method and demonstrated cooling, heating and manipulation of beams and single particles. Having been validated in practice, with continued development, OSC carries the potential for dramatic advances in the state-of-the-art performance and flexibility for beam cooling and control. The ongoing program at Fermilab is now focused on the development of an OSC system that includes high-gain optical amplification, which promises a two-order-of-magnitude increase in the strength of the OSC force. Here we review the progress and plans for the amplified OSC program. This includes detailed lattice designs and tracking simulations for the various experimental configurations, designs and status for the various hardware systems, and near-term operational plans and use cases.

Jarvis, J. [Fermilab]↗
DOE OSTI2022

Understanding the Accuracy Limitations of Quantifying Methane Emissions Using Other Test Method 33A

Researchers have utilized Other Test Method (OTM) 33A to quantify methane emissions from natural gas infrastructure. Historically, errors have been reported based on a population of measurements compared to known controlled releases of methane. These errors have been reported as 2σ errors of ±70%. However, little research has been performed on the minimum attainable uncertainty of any one measurement. We present two methods of uncertainty estimation. The first was the measurement uncertainty of the state-of-the-art equipment, which was determined to be ±3.8% of the estimate. This was determined from bootstrapped measurements compared to controlled releases. The second approach of uncertainty estimation was a modified Hollinger and Richardson (H&R) method which was developed for quantifying the uncertainty of eddy covariance measurements. Using a modified version of this method applied to OTM 33A measurements, it was determined that uncertainty of any given measurement was ±17%. Combining measurement uncertainty with that of stochasticity produced a total minimum uncertainty of 17.4%. Due to the current nature of stationary single-sensor measurements and the stochasticity of atmospheric data, such uncertainties will always be present. This is critical in understanding the transport of methane emissions and indirect measurements obtained from the natural gas industry.

Heltzel, Robert↗
DOE OSTI2021

Energy-saving potential evaluation for primary schools with occupant-centric controls

Recent studies demonstrated that there is significant energy-saving potential for primary schools, which heating, ventilation, and air-conditioning (HVAC) systems with occupant-centric control (OCC) is an excellent candidate to save energy. However, such an energy impact has yet to be evaluated for different climate zones as well as different energy code versions, but is critical for technology transfer and deployment. Therefore, this paper conducts comprehensive evaluation on the energy-saving potentials for the primary schools with two advanced OCC strategies: presence-based and counting-based. In this work, ninety-six building energy models with stochastic behavior of occupants are developed and simulated, which consist of two building energy code versions, 16 climate zones, and baseline case (without OCC) and two advanced cases (with OCC). To evaluate the energy saving potentials for OCC, primary schools in the U.S. are used as an example. The results show that there is significant energy-saving potential for primary schools by considering OCC strategies, especially the counting-based case. The energy-saving potential is up to 10.2% for presence-based OCC and 12.41% for counting-based OCC. Furthermore, both climate and code version have a significant impact on energy savings from OCC strategies. The energy-saving potentials vary from 1.79% to 12.41% for different climates and code versions. This evaluation can also contribute to quantify the nationwide energy saving potential for other countries.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Soft Actor Critic Based Volt-VAR Co-optimization in Active Distribution Grids

Modern distribution networks are undergoing several technical challenges, such as voltage fluctuations, because of high penetration of distributed energy resources (DERs). This paper proposes a deep reinforcement learning (DRL)-based Volt VAR co-optimization technique for reducing voltage fluctuations as well as power loss under high penetration of DERs. In addition, the proposed approach minimizes the operational cost of the grid. A stochastic policy optimization based soft actor critic (SAC) agent is proposed to configure the optimal set-points of the reactive power outputs of the inverters. The performance of the proposed model is verified on the modified IEEE 34- and 123-bus systems and compared with a base case scenario with no reactive supply by inverters, and a local droop control approach. The results demonstrate that the proposed framework outperforms the conventional droop control method in improving the voltage profile, minimizing the network power loss, and reducing grid operational cost.

—Distribution grids, deep reinforcement learning, ↗
DOE OSTI2020

Explaining persistent incomplete mixing in multicomponent reactive transport with Eulerian stochastic model

We present an Eulerian stochastic advection–diffusion–reaction (SADR) model and use it to explain incomplete mixing typically observed in transport experiments with bimolecular reactions. Unlike traditional advection– dispersion–reaction (ADR) models, the SADR model describes mechanical and diffusive mixing as two separate processes. In the SADR model, mechanical mixing is driven by random advective velocity whose variance is given by the coefficient of mechanical dispersion. The diffusive mixing is modeled as a Fickian diffusion process with the effective diffusion coefficient. We demonstrate that the sum of the two coefficients is equal to the dispersion coefficient, but only the effective diffusion coefficient contributes to the mixing-controlled reactions. We use experimental results of Gramling et al. * * to show that for transport and bimolecular reactions in porous media, the SADR model is significantly more accurate than the ADR model, which overestimates the concentration of the reaction product by as much as 60%. We also show that the SADR model predicts an experimentally observed bell- shaped spatial distribution of the reactive product concentration, while the ADR model results in a concentration distribution with an unphysical kink.

Bimolecular reactions, incomplete mixing, Stochast↗
DOE OSTI2024

Stochastic finite volume method for uncertainty quantification of transient flow in gas pipeline networks

We develop a weakly intrusive framework to simulate the propagation of uncertainty in solutions of generic hyperbolic partial differential equation systems on graph-connected domains with nodal coupling and boundary conditions. The method is based on the Stochastic Finite Volume (SFV) approach and can be applied for uncertainty quantification (UQ) of the dynamical state of fluid flow over actuated transport networks. The numerical scheme has specific advantages for modeling intertemporal uncertainty in time-varying boundary parameters, which cannot be characterized by strict upper and lower (interval) bounds. We describe the scheme for a single pipe, and then formulate the controlled junction Riemann problem (JRP) that enables the extension to general network structures. In conclusion, we demonstrate the method's capabilities and performance characteristics using a standard benchmark test network.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

An integrated photonic engine for programmable atomic control

Abstract Solutions for scalable, high-performance optical control are important for the development of scaled atom-based quantum technologies. Modulation of many individual optical beams is central to applying arbitrary gate and control sequences on arrays of atoms or atom-like systems. At telecom wavelengths, miniaturization of optical components via photonic integration has pushed the scale and performance of classical and quantum optics far beyond the limitations of bulk devices. However, material platforms for high-speed telecom integrated photonics lack transparency at the short wavelengths required by leading atomic systems. Here, we propose and implement a scalable and reconfigurable photonic control architecture using integrated, visible-light modulators based on thin-film lithium niobate. We combine this system with techniques in free-space optics and holography to demonstrate multi-channel, gigahertz-rate visible beamshaping. When applied to silicon-vacancy artificial atoms, our system enables the spatial and spectral addressing of a dynamically-selectable set of these stochastically-positioned point emitters.

Science & Technology - Other Topics↗
DOE OSTI2022

Riverine bacterioplankton and phytoplankton assembly along an environmental gradient induced by urbanization

In the Anthropocene, human activities are intensifying stresses on biological communities across ecosystems. Knowledge on how environmental changes influence microbial community dynamics is crucial but currently limited. Here we unraveled ecological processes generating distribution patterns of bacterioplankton and phytoplankton communities in a river draining an urbanizing watershed in southern China. In this ecosystem, longitudinal environmental heterogeneity and directional flow potentially have counteracting effects on planktonic community assembly. Using simultaneously multiple approaches, we showed that the observed compositional patterns result from an interplay of stochastic and deterministic processes, indicating that dispersal via fluvial connectivity could not override local selective pressures. Successional shifts in the relative importance of the above processes were associated with trends in climatic factors. High diversity was observed at the intermediate levels of ecological processes alongside intense inter-species interactions maintained by a few keystone taxa. Altogether, interactions between climatic conditions, landscape and hydrology control plankton community dynamics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

A Systems-Level Approach to Address Risks and Ethics in Artificial Intelligence Systems

Artificial intelligence (AI) is rapidly changing the world, from completely controlling routine or mundane tasks like text and image generation, to powering advanced algorithms that control critical systems. The recent advances in generative AI quickly overwhelmed multiple industries from education to finance as first adopters rushed (and continue to rush) to take advantage of the technology. The expanding AI ecosystem presents novel risks and ethical challenges that must be handled to ensure that technology is leveraged fairly and ethically. There are intertwined risks and ethical challenges stemming from the stochastic nature of AI (i.e., intrinsic risks), as well as from specific applications (i.e., extrinsic risks). Appropriately regulating AI requires a systems-approach to develop an integrated solution to these dependent challenges. Thus far, however, questions of risk, ethics and regulation appear to occupy separate spaces. This paper reviews the risks and ethical implications of AI and proposes a system-level approach to integrating ethics and regulation for the nascent industry.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Experimental Demonstration of a Large Transverse Emittance Ratio 11 : 1 in the Relativistic Heavy Ion Collider for the Electron-Ion Collider

The Electron-Ion Collider (EIC), to be constructed at Brookhaven National Laboratory, will collide polarized high-energy electron beams with hadron beams, achieving luminosities of up to 1.0 × 10 34 cm –2 s –1 in the center-of-mass energy range of 20–140 GeV. In order to achieve such high luminosity, the EIC will employ small and flat beams at the interaction point. In the hadron storage ring of the EIC, the ratio of horizontal to vertical emittances is approximately 11:1. In contrast, in previous or existing hadron colliders, the horizontal and vertical emittances are typically similar or closely matched. At the Relativistic Heavy Ion Collider (RHIC), we experimentally demonstrated a large transverse emittance ratio of 11:1 with gold ion beams at a particle energy of 100 GeV per nucleon, thanks to stochastic cooling and fine decoupling. Furthermore, we demonstrated collisions with flat beams, featuring a transverse beam size ratio of 3:1 for the first time at the RHIC.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

A comprehensive review of nonlinear oscillators in hydrokinetic energy harnessing using flow-induced vibrations

A comprehensive review of hydrokinetic energy converters based on alternating lift technology (ALT) is provided. Emphasis is on nonlinear oscillators based on Flow Induced Vibration (FIV) or Oscillation (FIO). Due to strong coupling in Fluid-Structure Interaction (FSI), and in order to maximize the hydrokinetic harnessed energy, design of nonlinear oscillators and analysis by model tests or computational fluid dynamics dominates this area. Research confirmed that the nonlinear oscillator can harvest energy from a stochastic excitation modeled by a generic wide spectrum, and overcome the most severe oscillator limitations: specifically, the need for continuous frequency tuning due to the narrow bandwidth response, and low efficiency outside the narrow bandwidth oscillator response. This review covers the following aspects of nonlinear oscillators in ALT converters: (1) Geometric changes in oscillator cross-section; e.g., circular, square, rectangular, or trilateral shapes. (2) Passive turbulence control of FIV/FIO. (3) Position based nonlinear stiffness. (4) Multi-cylinder synergistic FIV/FIO. (5) Mechanically linked oscillators. (6) Velocity-based, nonlinear, adaptive harnessing damping.

42 ENGINEERING↗
DOE OSTI2023

The mapping & avoidance of high order cavity modes

In this paper a technique developed in 2016 is presented for mapping the multidimensional, multi-mode high order mode landscape of a beam driven super conducting RF cavity. The initial use case for this technique was intended to allow longitudinal gradient control of a beam driven super conducting cavity while simultaneously avoiding many dangerous high order modes and excessive component stresses. This paper will focus on the stability and component stress considerations of the 56MHz superconducting cavity, located in the 4 o’clock sector interaction region of the Relativistic Heavy Ion Collider (RHIC) at Brookhaven National Laboratory. The 56MHz cavity is intended to work in conjunction with the Stochastic Cooling system to improve the longitudinal confinement in the central 197MHz RF bucket and thus increase the integrated luminosity during heavy ion beam runs at RHIC.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Optimization problems governed by systems of PDEs with uncertainties

This paper reviews current theoretical and numerical approaches to optimization problems governed by partial differential equations (PDEs) that depend on random variables or random fields. Such problems arise in many engineering, science, economics and societal decision-making tasks. This paper focuses on problems in which the governing PDEs are parametrized by the random variables/fields, and the decisions are made at the beginning and are not revised once uncertainty is revealed. Examples of such problems are presented to motivate the topic of this paper, and to illustrate the impact of different ways to model uncertainty in the formulations of the optimization problem and their impact on the solution. A linear–quadratic elliptic optimal control problem is used to provide a detailed discussion of the set-up for the risk-neutral optimization problem formulation, study the existence and characterization of its solution, and survey numerical methods for computing it. Different ways to model uncertainty in the PDE-constrained optimization problem are surveyed in an abstract setting, including risk measures, distributionally robust optimization formulations, probabilistic functions and chance constraints, and stochastic orders. Furthermore, approximation-based optimization approaches and stochastic methods for the solution of the large-scale PDE-constrained optimization problems under uncertainty are described. Some possible future research directions are outlined.

Heinkenschloss, Matthias [Rice Univ., Houston, TX ↗
DOE OSTI2022

Impacts of Suppressing Excessive Light Rain on Aerosol Radiative Effects and Health Risks

Global climate models (GCMs) have been used widely to study radiative forcing and health risks of aerosols. A recent study using two GCMs found that light rain plays a dominant role in controlling aerosol loading. However, “too much light rain and too little heavy rain” is a longstanding bias in GCMs. It is unclear how much light rain affects aerosol-cloud-radiation interactions and health risks from air pollution. Here, in this work, we show that, with the correction of the rainfall intensity spectrum in the National Center for Atmospheric Research Community Atmosphere Model version 5.3 by introducing a stochastic deep convection scheme, the reduced frequency of light rain (1–20 mm d -1 ) results in changes of aerosol direct radiative effects (DRE) of up to -0.5 ± 0.03 W/m 2 and aerosol cloud radiative effects (CRE) of up to -0.9 ± 0.03 W/m 2 . The total (CRE + DRE) radiative effects of light rain-mediated aerosol changes exceed the present-day anthropogenic forcing of aerosols relative to preindustrial levels from the Coupled Model Intercomparison Project (CMIP5&6) models. However, the correction of the rainfall intensity spectrum has little effect on anthropogenic aerosol forcing (defined as the radiative perturbation due to changes in aerosol concentrations between the industrial era and preindustrial levels). Due to increased exposure to fine particulates (PM 2.5 ), the estimated global total premature mortality is much higher than previously estimated, by 300,000 ± 60,000 deaths per year, and is more severe in populous regions such as India and China. The findings in this study highlight the need to understand uncertainties in radiative effects and health risks of aerosols due to simulation biases of precipitation in GCMs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Integrated path planning and control through proximal policy optimization for a marine current turbine

This paper presents an integrated path planning and tracking control framework for a marine current turbine (MCT), where the MCT is treated as an energy-harvesting autonomous underwater vehicle (AUV). Considering the ocean (space of action) is continuous, the proposed framework employs two modules to address path planning and path tracking enabled by the proximal policy optimization (PPO) algorithm, which is a policy gradient deep reinforcement learning (RL) method. Further, to enable fully autonomous operation in a stochastic oceanic environment, the proposed path planning seeks a primary objective of maximizing the harvested energy; then, the path tracking module is designed to minimize the tracking error and avoid collisions with static and dynamic obstacles. Using field-collected acoustic Doppler current profiler (ADCP) data, the performance of the proposed framework is evaluated. Comparative studies with baseline algorithms in three different scenarios of path planning, path tracking without an obstacle, and path tracking with collision avoidance verify the effectiveness of our proposed approach.

16 TIDAL AND WAVE POWER↗