SEARCH · Search NASA

Results for “stochastic control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

All sources NASA NTRS DOE OSTI

DOE OSTI2025

The Optical Stochastic Cooling Program at Fermilab

Recently, Optical Stochastic Cooling (OSC) became the first demonstrated method for ultra-high-bandwidth stochastic cooling. The initial experiments at Fermilab’s IOTA ring explored the essential physics of the method and demonstrated cooling, heating and manipulation of beams and single particles. Having been validated in practice, with continued development, OSC carries the potential for dramatic advances in the state-of-the-art performance and flexibility for beam cooling and control. The ongoing program at Fermilab is now focused on the development of an OSC system that includes high-gain optical amplification, which promises a two-order-of-magnitude increase in the strength of the OSC force. Here we review the progress and plans for the amplified OSC program. This includes detailed lattice designs and tracking simulations for the various experimental configurations, designs and status for the various hardware systems, and near-term operational plans and use cases.

Jarvis, J. [Fermilab]↗

DOE OSTI2022

Understanding the Accuracy Limitations of Quantifying Methane Emissions Using Other Test Method 33A

Researchers have utilized Other Test Method (OTM) 33A to quantify methane emissions from natural gas infrastructure. Historically, errors have been reported based on a population of measurements compared to known controlled releases of methane. These errors have been reported as 2σ errors of ±70%. However, little research has been performed on the minimum attainable uncertainty of any one measurement. We present two methods of uncertainty estimation. The first was the measurement uncertainty of the state-of-the-art equipment, which was determined to be ±3.8% of the estimate. This was determined from bootstrapped measurements compared to controlled releases. The second approach of uncertainty estimation was a modified Hollinger and Richardson (H&R) method which was developed for quantifying the uncertainty of eddy covariance measurements. Using a modified version of this method applied to OTM 33A measurements, it was determined that uncertainty of any given measurement was ±17%. Combining measurement uncertainty with that of stochasticity produced a total minimum uncertainty of 17.4%. Due to the current nature of stationary single-sensor measurements and the stochasticity of atmospheric data, such uncertainties will always be present. This is critical in understanding the transport of methane emissions and indirect measurements obtained from the natural gas industry.

Heltzel, Robert↗

DOE OSTI2021

Energy-saving potential evaluation for primary schools with occupant-centric controls

Recent studies demonstrated that there is significant energy-saving potential for primary schools, which heating, ventilation, and air-conditioning (HVAC) systems with occupant-centric control (OCC) is an excellent candidate to save energy. However, such an energy impact has yet to be evaluated for different climate zones as well as different energy code versions, but is critical for technology transfer and deployment. Therefore, this paper conducts comprehensive evaluation on the energy-saving potentials for the primary schools with two advanced OCC strategies: presence-based and counting-based. In this work, ninety-six building energy models with stochastic behavior of occupants are developed and simulated, which consist of two building energy code versions, 16 climate zones, and baseline case (without OCC) and two advanced cases (with OCC). To evaluate the energy saving potentials for OCC, primary schools in the U.S. are used as an example. The results show that there is significant energy-saving potential for primary schools by considering OCC strategies, especially the counting-based case. The energy-saving potential is up to 10.2% for presence-based OCC and 12.41% for counting-based OCC. Furthermore, both climate and code version have a significant impact on energy savings from OCC strategies. The energy-saving potentials vary from 1.79% to 12.41% for different climates and code versions. This evaluation can also contribute to quantify the nationwide energy saving potential for other countries.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

NASA NTRS1981

Exceedance statistics of accelerations resulting from thruster firings on the Apollo-Soyuz mission

Spacecraft acceleration resulting from firings of vernier control system thrusters is an important consideration in the design, planning, execution and post-flight analysis of laboratory experiments in space. In particular, scientists and technologists involved with the development of experiments to be performed in space in many instances required statistical information on the magnitude and rate of occurrence of spacecraft accelerations. Typically, these accelerations are stochastic in nature, so that it is useful to characterize these accelerations in statistical terms. Statistics of spacecraft accelerations are summarized.

Fichtl, G. H.↗

NASA NTRS1983

Exceedance statistics of accelerations resulting from thruster firings on the Apollo-Soyuz mission

Fichtl, G. H.↗

DOE OSTI2022

Soft Actor Critic Based Volt-VAR Co-optimization in Active Distribution Grids

Modern distribution networks are undergoing several technical challenges, such as voltage fluctuations, because of high penetration of distributed energy resources (DERs). This paper proposes a deep reinforcement learning (DRL)-based Volt VAR co-optimization technique for reducing voltage fluctuations as well as power loss under high penetration of DERs. In addition, the proposed approach minimizes the operational cost of the grid. A stochastic policy optimization based soft actor critic (SAC) agent is proposed to configure the optimal set-points of the reactive power outputs of the inverters. The performance of the proposed model is verified on the modified IEEE 34- and 123-bus systems and compared with a base case scenario with no reactive supply by inverters, and a local droop control approach. The results demonstrate that the proposed framework outperforms the conventional droop control method in improving the voltage profile, minimizing the network power loss, and reducing grid operational cost.

—Distribution grids, deep reinforcement learning, ↗

DOE OSTI2020

Explaining persistent incomplete mixing in multicomponent reactive transport with Eulerian stochastic model

We present an Eulerian stochastic advection–diffusion–reaction (SADR) model and use it to explain incomplete mixing typically observed in transport experiments with bimolecular reactions. Unlike traditional advection– dispersion–reaction (ADR) models, the SADR model describes mechanical and diffusive mixing as two separate processes. In the SADR model, mechanical mixing is driven by random advective velocity whose variance is given by the coefficient of mechanical dispersion. The diffusive mixing is modeled as a Fickian diffusion process with the effective diffusion coefficient. We demonstrate that the sum of the two coefficients is equal to the dispersion coefficient, but only the effective diffusion coefficient contributes to the mixing-controlled reactions. We use experimental results of Gramling et al. * * to show that for transport and bimolecular reactions in porous media, the SADR model is significantly more accurate than the ADR model, which overestimates the concentration of the reaction product by as much as 60%. We also show that the SADR model predicts an experimentally observed bell- shaped spatial distribution of the reactive product concentration, while the ADR model results in a concentration distribution with an unphysical kink.

Bimolecular reactions, incomplete mixing, Stochast↗

DOE OSTI2024

Stochastic finite volume method for uncertainty quantification of transient flow in gas pipeline networks

We develop a weakly intrusive framework to simulate the propagation of uncertainty in solutions of generic hyperbolic partial differential equation systems on graph-connected domains with nodal coupling and boundary conditions. The method is based on the Stochastic Finite Volume (SFV) approach and can be applied for uncertainty quantification (UQ) of the dynamical state of fluid flow over actuated transport networks. The numerical scheme has specific advantages for modeling intertemporal uncertainty in time-varying boundary parameters, which cannot be characterized by strict upper and lower (interval) bounds. We describe the scheme for a single pipe, and then formulate the controlled junction Riemann problem (JRP) that enables the extension to general network structures. In conclusion, we demonstrate the method's capabilities and performance characteristics using a standard benchmark test network.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

An integrated photonic engine for programmable atomic control

Abstract Solutions for scalable, high-performance optical control are important for the development of scaled atom-based quantum technologies. Modulation of many individual optical beams is central to applying arbitrary gate and control sequences on arrays of atoms or atom-like systems. At telecom wavelengths, miniaturization of optical components via photonic integration has pushed the scale and performance of classical and quantum optics far beyond the limitations of bulk devices. However, material platforms for high-speed telecom integrated photonics lack transparency at the short wavelengths required by leading atomic systems. Here, we propose and implement a scalable and reconfigurable photonic control architecture using integrated, visible-light modulators based on thin-film lithium niobate. We combine this system with techniques in free-space optics and holography to demonstrate multi-channel, gigahertz-rate visible beamshaping. When applied to silicon-vacancy artificial atoms, our system enables the spatial and spectral addressing of a dynamically-selectable set of these stochastically-positioned point emitters.

Science & Technology - Other Topics↗

NASA NTRS2004

Computation Molecular Kinetics Model of HZE Induced Cell Cycle Arrest

Cell culture models play an important role in understanding the biological effectiveness of space radiation. High energy and charge (HZE) ions produce prolonged cell cycle arrests at the G1/S and G2/M transition points in the cell cycle. A detailed description of these phenomena is needed to integrate knowledge of the expression of DNA damage in surviving cells, including the determination of relative effectiveness factors between different types of radiation that produce differential types of DNA damage and arrest durations. We have developed a hierarchical kinetics model that tracks the distribution of cells in various cell phase compartments (early G1, late G1, S, G2, and M), however with transition rates that are controlled by rate-limiting steps in the kinetics of cyclin-cdk's interactions with their families of transcription factors and inhibitor molecules. The coupling of damaged DNA molecules to the downstream cyclin-cdk inhibitors is achieved through a description of the DNA-PK and ATM signaling pathways. For HZE irradiations we describe preliminary results, which introduce simulation of the stochastic nature of the number of direct particle traversals per cell in the modulation of cyclin-cdk and cell cycle population kinetics. Comparison of the model to data for fibroblast cells irradiated photons or HZE ions are described.

Cucinotta, Francis A.↗

DOE OSTI2022

Riverine bacterioplankton and phytoplankton assembly along an environmental gradient induced by urbanization

In the Anthropocene, human activities are intensifying stresses on biological communities across ecosystems. Knowledge on how environmental changes influence microbial community dynamics is crucial but currently limited. Here we unraveled ecological processes generating distribution patterns of bacterioplankton and phytoplankton communities in a river draining an urbanizing watershed in southern China. In this ecosystem, longitudinal environmental heterogeneity and directional flow potentially have counteracting effects on planktonic community assembly. Using simultaneously multiple approaches, we showed that the observed compositional patterns result from an interplay of stochastic and deterministic processes, indicating that dispersal via fluvial connectivity could not override local selective pressures. Successional shifts in the relative importance of the above processes were associated with trends in climatic factors. High diversity was observed at the intermediate levels of ecological processes alongside intense inter-species interactions maintained by a few keystone taxa. Altogether, interactions between climatic conditions, landscape and hydrology control plankton community dynamics.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

A Systems-Level Approach to Address Risks and Ethics in Artificial Intelligence Systems

Artificial intelligence (AI) is rapidly changing the world, from completely controlling routine or mundane tasks like text and image generation, to powering advanced algorithms that control critical systems. The recent advances in generative AI quickly overwhelmed multiple industries from education to finance as first adopters rushed (and continue to rush) to take advantage of the technology. The expanding AI ecosystem presents novel risks and ethical challenges that must be handled to ensure that technology is leveraged fairly and ethically. There are intertwined risks and ethical challenges stemming from the stochastic nature of AI (i.e., intrinsic risks), as well as from specific applications (i.e., extrinsic risks). Appropriately regulating AI requires a systems-approach to develop an integrated solution to these dependent challenges. Thus far, however, questions of risk, ethics and regulation appear to occupy separate spaces. This paper reviews the risks and ethical implications of AI and proposes a system-level approach to integrating ethics and regulation for the nascent industry.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2024

Experimental Demonstration of a Large Transverse Emittance Ratio 11 : 1 in the Relativistic Heavy Ion Collider for the Electron-Ion Collider

The Electron-Ion Collider (EIC), to be constructed at Brookhaven National Laboratory, will collide polarized high-energy electron beams with hadron beams, achieving luminosities of up to 1.0 × 10 34 cm –2 s –1 in the center-of-mass energy range of 20–140 GeV. In order to achieve such high luminosity, the EIC will employ small and flat beams at the interaction point. In the hadron storage ring of the EIC, the ratio of horizontal to vertical emittances is approximately 11:1. In contrast, in previous or existing hadron colliders, the horizontal and vertical emittances are typically similar or closely matched. At the Relativistic Heavy Ion Collider (RHIC), we experimentally demonstrated a large transverse emittance ratio of 11:1 with gold ion beams at a particle energy of 100 GeV per nucleon, thanks to stochastic cooling and fine decoupling. Furthermore, we demonstrated collisions with flat beams, featuring a transverse beam size ratio of 3:1 for the first time at the RHIC.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2021

A comprehensive review of nonlinear oscillators in hydrokinetic energy harnessing using flow-induced vibrations

A comprehensive review of hydrokinetic energy converters based on alternating lift technology (ALT) is provided. Emphasis is on nonlinear oscillators based on Flow Induced Vibration (FIV) or Oscillation (FIO). Due to strong coupling in Fluid-Structure Interaction (FSI), and in order to maximize the hydrokinetic harnessed energy, design of nonlinear oscillators and analysis by model tests or computational fluid dynamics dominates this area. Research confirmed that the nonlinear oscillator can harvest energy from a stochastic excitation modeled by a generic wide spectrum, and overcome the most severe oscillator limitations: specifically, the need for continuous frequency tuning due to the narrow bandwidth response, and low efficiency outside the narrow bandwidth oscillator response. This review covers the following aspects of nonlinear oscillators in ALT converters: (1) Geometric changes in oscillator cross-section; e.g., circular, square, rectangular, or trilateral shapes. (2) Passive turbulence control of FIV/FIO. (3) Position based nonlinear stiffness. (4) Multi-cylinder synergistic FIV/FIO. (5) Mechanically linked oscillators. (6) Velocity-based, nonlinear, adaptive harnessing damping.

42 ENGINEERING↗

DOE OSTI2023

The mapping & avoidance of high order cavity modes

In this paper a technique developed in 2016 is presented for mapping the multidimensional, multi-mode high order mode landscape of a beam driven super conducting RF cavity. The initial use case for this technique was intended to allow longitudinal gradient control of a beam driven super conducting cavity while simultaneously avoiding many dangerous high order modes and excessive component stresses. This paper will focus on the stability and component stress considerations of the 56MHz superconducting cavity, located in the 4 o’clock sector interaction region of the Relativistic Heavy Ion Collider (RHIC) at Brookhaven National Laboratory. The 56MHz cavity is intended to work in conjunction with the Stochastic Cooling system to improve the longitudinal confinement in the central 197MHz RF bucket and thus increase the integrated luminosity during heavy ion beam runs at RHIC.

43 PARTICLE ACCELERATORS↗

DOE OSTI2025

Optimization problems governed by systems of PDEs with uncertainties

This paper reviews current theoretical and numerical approaches to optimization problems governed by partial differential equations (PDEs) that depend on random variables or random fields. Such problems arise in many engineering, science, economics and societal decision-making tasks. This paper focuses on problems in which the governing PDEs are parametrized by the random variables/fields, and the decisions are made at the beginning and are not revised once uncertainty is revealed. Examples of such problems are presented to motivate the topic of this paper, and to illustrate the impact of different ways to model uncertainty in the formulations of the optimization problem and their impact on the solution. A linear–quadratic elliptic optimal control problem is used to provide a detailed discussion of the set-up for the risk-neutral optimization problem formulation, study the existence and characterization of its solution, and survey numerical methods for computing it. Different ways to model uncertainty in the PDE-constrained optimization problem are surveyed in an abstract setting, including risk measures, distributionally robust optimization formulations, probabilistic functions and chance constraints, and stochastic orders. Furthermore, approximation-based optimization approaches and stochastic methods for the solution of the large-scale PDE-constrained optimization problems under uncertainty are described. Some possible future research directions are outlined.

Heinkenschloss, Matthias [Rice Univ., Houston, TX ↗

DOE OSTI2022

Impacts of Suppressing Excessive Light Rain on Aerosol Radiative Effects and Health Risks

Global climate models (GCMs) have been used widely to study radiative forcing and health risks of aerosols. A recent study using two GCMs found that light rain plays a dominant role in controlling aerosol loading. However, “too much light rain and too little heavy rain” is a longstanding bias in GCMs. It is unclear how much light rain affects aerosol-cloud-radiation interactions and health risks from air pollution. Here, in this work, we show that, with the correction of the rainfall intensity spectrum in the National Center for Atmospheric Research Community Atmosphere Model version 5.3 by introducing a stochastic deep convection scheme, the reduced frequency of light rain (1–20 mm d -1 ) results in changes of aerosol direct radiative effects (DRE) of up to -0.5 ± 0.03 W/m 2 and aerosol cloud radiative effects (CRE) of up to -0.9 ± 0.03 W/m 2 . The total (CRE + DRE) radiative effects of light rain-mediated aerosol changes exceed the present-day anthropogenic forcing of aerosols relative to preindustrial levels from the Coupled Model Intercomparison Project (CMIP5&6) models. However, the correction of the rainfall intensity spectrum has little effect on anthropogenic aerosol forcing (defined as the radiative perturbation due to changes in aerosol concentrations between the industrial era and preindustrial levels). Due to increased exposure to fine particulates (PM 2.5 ), the estimated global total premature mortality is much higher than previously estimated, by 300,000 ± 60,000 deaths per year, and is more severe in populous regions such as India and China. The findings in this study highlight the need to understand uncertainties in radiative effects and health risks of aerosols due to simulation biases of precipitation in GCMs.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Integrated path planning and control through proximal policy optimization for a marine current turbine

This paper presents an integrated path planning and tracking control framework for a marine current turbine (MCT), where the MCT is treated as an energy-harvesting autonomous underwater vehicle (AUV). Considering the ocean (space of action) is continuous, the proposed framework employs two modules to address path planning and path tracking enabled by the proximal policy optimization (PPO) algorithm, which is a policy gradient deep reinforcement learning (RL) method. Further, to enable fully autonomous operation in a stochastic oceanic environment, the proposed path planning seeks a primary objective of maximizing the harvested energy; then, the path tracking module is designed to minimize the tracking error and avoid collisions with static and dynamic obstacles. Using field-collected acoustic Doppler current profiler (ADCP) data, the performance of the proposed framework is evaluated. Comparative studies with baseline algorithms in three different scenarios of path planning, path tracking without an obstacle, and path tracking with collision avoidance verify the effectiveness of our proposed approach.

16 TIDAL AND WAVE POWER↗