SEARCH · Search NASA

Results for “stochastic control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

All sources NASA NTRS DOE OSTI

NASA NTRS1981

Data acquisition and analysis of range-finding systems for spacing construction

For space missions of future, completely autonomous robotic machines will be required to free astronauts from routine chores of equipment maintenance, servicing of faulty systems, etc. and to extend human capabilities in hazardous environments full of cosmic and other harmful radiations. In places of high radiation and uncontrollable ambient illuminations, T.V. camera based vision systems cannot work effectively. However, a vision system utilizing directly measured range information with a time of flight laser rangefinder, can successfully operate under these environments. Such a system will be independent of proper illumination conditions and the interfering effects of intense radiation of all kinds will be eliminated by the tuned input of the laser instrument. Processing the range data according to certain decision, stochastic estimation and heuristic schemes, the laser based vision system will recognize known objects and thus provide sufficient information to the robot's control system which can develop strategies for various objectives.

Shen, C. N.↗

NASA NTRS2012

Improving Balance Function Using Low Levels of Electrical Stimulation of the Balance Organs

Crewmembers returning from long-duration space flight face significant challenges due to the microgravity-induced inappropriate adaptations in balance/sensorimotor function. The Neuroscience Laboratory at JSC is developing a method based on stochastic resonance to enhance the brain's ability to detect signals from the balance organs of the inner ear and use them for rapid improvement in balance skill, especially when combined with balance training exercises. This method involves a stimulus delivery system that is wearable/portable and provides imperceptible electrical stimulation to the balance organs of the human body. Stochastic resonance (SR) is a phenomenon whereby the response of a nonlinear system to a weak periodic input signal is optimized by the presence of a particular non-zero level of noise. This phenomenon of SR is based on the concept of maximizing the flow of information through a system by a non-zero level of noise. Application of imperceptible SR noise coupled with sensory input in humans has been shown to improve motor, cardiovascular, visual, hearing, and balance functions. SR increases contrast sensitivity and luminance detection; lowers the absolute threshold for tone detection in normal hearing individuals; improves homeostatic function in the human blood pressure regulatory system; improves noise-enhanced muscle spindle function; and improves detection of weak tactile stimuli using mechanical or electrical stimulation. SR noise has been shown to improve postural control when applied as mechanical noise to the soles of the feet, or when applied as electrical noise at the knee and to the back muscles. SR using imperceptible stochastic electrical stimulation of the vestibular system (stochastic vestibular stimulation, SVS) applied to normal subjects has shown to improve the degree of association between the weak input periodic signals introduced via venous blood pressure receptors and the heart-rate responses. Also, application of SVS over 24 hours improves the long-term heart-rate dynamics and motor responsiveness as indicated by daytime trunk activity measurements in patients with multi-system atrophy, Parkinson s disease, or both, including patients who were unresponsive to standard therapy for Parkinson s disease. Recent studies conducted at the NASA JSC Neurosciences Laboratories showed that imperceptible SVS, when applied to normal young healthy subjects, leads to significantly improved balance performance during postural disturbances on unstable compliant surfaces. These studies have shown the benefit of SR noise characteristic optimization with imperceptible SVS in the frequency range of 0-30 Hz, and amplitudes of stimulation have ranged from 100 to 400 microamperes.

Bloomberg, Jacob↗

DOE OSTI2023

Simple Monomers for Precise Polymer Functionalization During Ring-Opening Metathesis Polymerization

Controlling the monomer sequence of synthetic polymers is a grand challenge in polymer science. Conventional sequence control has been achieved in dispersed polymers by exploiting the kinetic tendencies of monomers and their order of addition. While the sequence of blocks in multiblock copolymers can be readily tuned using sequential addition of monomers (SAM), control over the sequence distribution is eroded as the targeted block size approaches a single monomer unit (i.e., X n ~ 1) due to the stochastic nature of chain-growth reactions. Thus, unique monomers are needed to ensure precise single additions. Herein, we investigate common classes of cyclic olefin monomers for ring-opening metathesis polymerization (ROMP) to identify monomers for single unit addition during sequential monomer addition synthesis. Through careful analysis of polymerization kinetics, we find that easily synthesized oxanorbornene imide monomers are suitable for single-addition reactions. With the identified monomers, we demonstrate the synthesis of multiblock copolymers containing up to three precise functionalization sites and singly cross-linked four-armed star copolymers. In conclusion, we envision that expanded kinetic analyses of monomer reactivities in ROMP reactions will enable novel polymer synthesis capabilities such as the autonomous synthesis of sequence-defined polymers or one-shot multiblock copolymer syntheses.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2020

Grid-based diffusion Monte Carlo for fermions without the fixed-node approximation

A diffusion Monte Carlo algorithm is introduced that can determine the correct nodal structure of the wave function of a few-fermion system and its ground-state energy without an uncontrolled bias. This is achieved by confining signed random walkers to the points of a uniform infinite spatial grid, allowing them to meet and annihilate one another to establish the nodal structure without the fixed-node approximation. An imaginary-time propagator is derived rigorously from a discretized Hamiltonian, governing a non-Gaussian, sign-flipping, branching, and mutually annihilating random walk of particles. The accuracy of the resulting stochastic representations of a fermion wave function is limited only by the grid and imaginary-time resolutions and can be improved in a controlled manner. Here, the method is tested for a series of model problems including fermions in a harmonic trap as well as the He atom in its singlet or triplet ground state. For the latter case, the energies approach from above with increasing grid resolution and converge within 0.015 E h of the exact basis-set-limit value for the grid spacing of 0.08 a.u. with a statistical uncertainty of 10 –5 E h without an importance sampling or Jastrow factor.

74 ATOMIC AND MOLECULAR PHYSICS↗

DOE OSTI2024

Optimal Zeno Dragging for Quantum Control: A Shortcut to Zeno with Action-Based Scheduling Optimization

The quantum Zeno effect asserts that quantum measurements inhibit simultaneous unitary dynamics when the “collapse” events are sufficiently strong and frequent. This applies in the limit of strong continuous measurement or dissipation. It is possible to implement a dissipative control that is known as “Zeno dragging” by dynamically varying the monitored observable, and hence also the eigenstates, which are attractors under Zeno dynamics. This is similar to adiabatic processes, in that the Zeno-dragging fidelity is highest when the rate of eigenstate change is slow compared to the measurement rate. We demonstrate here two theoretical methods for using such dynamics to achieve control of quantum systems. The first, which we shall refer to as “shortcut to Zeno,” is analogous to the shortcuts to adiabaticity (counterdiabatic driving) that are frequently used to accelerate unitary adiabatic evolution. In the second approach, we apply the Chantasri-Dressel-Jordan stochastic action [PRA 88, 042110 (2013)], and demonstrate that the extremal-probability readout paths derived from this are well suited to setting up a Pontryagin-style optimization of the Zeno-dragging schedule. A fundamental contribution of the latter approach is to show that an action suitable for measurement-driven control optimization can be derived quite generally from statistical arguments. Implementing these methods on the Zeno dragging of a qubit, we find that both approaches yield the same solution, namely, that the optimal control is a unitary that matches the motion of the Zeno-monitored eigenstate. We then show that such a solution can be more robust than a unitary-only operation and we comment on solvable generalizations of our qubit example embedded in larger systems. These methods open up new pathways toward systematically developing dynamic control of Zeno subspaces to realize dissipatively stabilized quantum operations. Published by the American Physical Society 2024

Physics↗

NASA NTRSDate not supplied

Path Planning: Differential Dynamic Programming and Model Predictive Path Integral Control on VTOL Aircraft

This paper explores two optimal control approaches, widely used in robotics, to establish their viability as real-time trajectory planners for vehicle configurations envisioned for the emerging aviation sector of Urban Air Mobility (UAM). Differential Dynamic Programming (DDP) enables planning over highly nonlinear dynamics using second-order approximations along a nominal trajectory, and displays quadratic convergence to a local solution. Model Predictive Path Integral (MPPI) is a stochastic sampling-based algorithm that can optimize for general cost criteria, including potentially highly nonlinear formulations, and supports parallel computation through the use of modern GPU hardware. In this work, DDP and MPPI were implemented using model predictive control (MPC), and the results indicate they are able to successfully transition the aircraft over different flight envelopes and generate trajectories unique to UAM vehicles.

Differential Dynamic Programming↗

DOE OSTI2024

Multistage Stochastic optimization for mid-term integrated generation and maintenance scheduling of cascaded hydroelectric system with renewable energy uncertainty

The uncertainties resulting from the escalating penetration of renewable energy resources pose severe challenges to the efficient operation of modern power systems. Hydroelectricity is characterized by its flexibility, controllability, and reliability, and thus becomes one of the most ideal energy resources to hedge against such uncertainties. This paper studies the mid-term integrated generation and maintenance scheduling of a cascaded hydroelectric system (CHS) consisting of multiple cascaded reservoirs and hydroelectric units. To precisely describe the mid-term water regulation policies, the hydraulic coupling relationship and water-energy nexus of CHS are incorporated into the proposed optimization model. The uncertainties of natural water inflow and the power outputs of wind/solar energy generation are taken into consideration and captured via a stochastic process modeled by a scenario tree. A multistage stochastic optimization (MSO) approach is developed to coordinate the complementary operations of multiple energy resources, by optimizing the mid-term water resource management, generation scheduling, and maintenance scheduling of CHS. The proposed MSO model is formulated as a large-scale mixed-integer linear program that presents significant computational intractability. To address this issue, a tailored Benders decomposition algorithm is developed. Two real-world case studies are conducted to demonstrate the capability and characteristics of the proposed model and algorithm. The computational results show that the proposed MSO model can exploit the flexibility of hydroelectricity to efficiently respond to variable wind and solar power, and reserve water resources for the generation in peak months to reduce the consumption of fossil fuel. Furthermore, the proposed solution approach also exhibits promising computational efficiency when handling large-scale models.

13 HYDRO ENERGY↗

DOE OSTI2023

Nucleation-mediated reshaping of facetted metallic nanocrystals: Breakdown of the classical free energy picture

Shape stability is key to avoiding degradation of performance for metallic nanocrystals synthesized with facetted non-equilibrium shapes to optimize properties for catalysis, plasmonics, and so on. Reshaping of facetted nanocrystals is controlled by the surface diffusion-mediated nucleation and growth of new outer layers of atoms. Here, Kinetic Monte Carlo (KMC) simulation of a realistic stochastic atomistic-level model is applied to precisely track the reshaping of Pd octahedra and nanocubes. Unexpectedly, separate constrained equilibrium Monte Carlo analysis of the free energy profile during reshaping reveals a fundamental failure of the classical nucleation theory (CNT) prediction for the reshaping barrier and rate. Why? Nucleation barriers can be relatively low for these processes, so the system is not locally equilibrated before crossing the barrier, as assumed in CNT. This claim is supported by an analysis of a first-passage problem for reshaping within a master equation framework for the model that reasonably captures the behavior in KMC simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

Network Reconfiguration for Enhanced Operational Resilience Using Reinforcement Learning

This paper proposes a reinforcement learning-based approach for distribution network reconfiguration(DNR) to enhance the resilience of the electric power supply. Resilience enhancements usually require solving large-scale stochastic optimization problems that are computationally expensive and sometimes infeasible. The exceptional performance of reinforcement learning techniques has encouraged their adoption in various power system control studies, specifically resilience-based real-time applications. In this paper, a single agent framework is developed using an Actor-Critic algorithm (ACA) to determine statuses of tie-switches in a distribution feeder impacted by an extreme weather event. The proposed approach provides a fast-acting control algorithm that reconfigures the feeder topology to reduce or even avoid load shedding. The problem is formulated as a discrete Markov decision process in such a way that a system state captures the system topology and its operational characteristics. An action is made to open or close a specific set of tie-switches after which a reward is calculated to evaluate the practicality and advantage of that action. The iterative Markov process is used to train the proposed ACA under diverse failure scenarios and is demonstrated on the 33-node distribution feeder system. Results show the capability of the proposed ACA to determine proper switching action of tie-switches with accuracy exceeding 93%.

actor critic↗

NASA NTRS1994

Particle acceleration mechanisms

High-energy particle acceleration is observed to proceed in a diverse variety of astrophysical sites ranging from the terrestrial aurorae to the most distant quasars. Particle acceleration is a fairly common channel for the release of large-scale kinetic, rotational, and magnetic energy. Physical mechanisms include electrostatic acceleration, stochastic processes, and diffusive shock energization. Cosmic-ray energy spectra have shapes which reflect escape, collisional, and radiative losses. The overall acceleration efficiency is controlled by the low-energy particle injection which may, in turn, feed back into the energization. Recent observational developments, which illustrate these general principles and raise fresh questions, are briefly summarized.

Blandford, R. D.↗

NASA NTRS2014

Tuning Monotonic Basin Hopping: Improving the Efficiency of Stochastic Search as Applied to Low-Thrust Trajectory Optimization

Trajectory optimization methods using monotonic basin hopping (MBH) have become well developed during the past decade [1, 2, 3, 4, 5, 6]. An essential component of MBH is a controlled random search through the multi-dimensional space of possible solutions. Historically, the randomness has been generated by drawing random variable (RV)s from a uniform probability distribution. Here, we investigate the generating the randomness by drawing the RVs from Cauchy and Pareto distributions, chosen because of their characteristic long tails. We demonstrate that using Cauchy distributions (as first suggested by J. Englander [3, 6]) significantly improves monotonic basin hopping (MBH) performance, and that Pareto distributions provide even greater improvements. Improved performance is defined in terms of efficiency and robustness. Efficiency is finding better solutions in less time. Robustness is efficiency that is undiminished by (a) the boundary conditions and internal constraints of the optimization problem being solved, and (b) by variations in the parameters of the probability distribution. Robustness is important for achieving performance improvements that are not problem specific. In this work we show that the performance improvements are the result of how these long-tailed distributions enable MBH to search the solution space faster and more thoroughly. In developing this explanation, we use the concepts of sub-diffusive, normally-diffusive, and super-diffusive random walks (RWs) originally developed in the field of statistical physics.

autonomous↗

DOE OSTI2025

Realizing Steady-State Microbunching with Optical Stochastic Crystallization

Optical Stochastic Cooling (OSC) is a state-of-the-art beam cooling technology first demonstrated in 2021 at the IOTA storage ring at Fermilab's FAST facility. A second phase of the research program is planned to run in 2026 and will incorporate an optical amplifier to enable significantly increased cooling rates and greater operational flexibility. In addition to beam cooling, an OSC system can be configured to enable advanced control over the phase space of the beam. An example operational mode could enable crystallization, where the particles in a bunch are locked into a self-reinforcing, regular microstructure at the OSC fundamental wavelength; we refer to this as Optical Stochastic Crystallization (OSX). OSX represents a new path toward Steady-State Microbunching (SSMB), which may enable light sources combining the high brightness of a free-electron laser with the high repetition rate of a storage ring. Such a source has applications from the terahertz to the extreme ultraviolet (EUV), including high-power EUV generation for semiconductor lithography. This contribution will discuss the integration of OSX development as part of the OSC program at IOTA. The design of an accelerator lattice to enable the mechanism and associated high fidelity simulations will be shown, and a path to realizing an experimental demonstration will be discussed.

Wallbank, Michael James [Fermilab]↗

DOE OSTI2025

Steady-State Microbunching using Optical Stochastic Cooling

Optical Stochastic Cooling (OSC) is a state-of-the-art beam cooling technology first demonstrated in 2021 at the IOTA storage ring at Fermilab's FAST facility. A second phase of the research program is planned to run in 2026 and will incorporate an optical amplifier to enable significantly increased cooling rates and greater operational flexibility. In addition to beam cooling, an OSC system can be configured to enable advanced control over the phase space of the beam. An example operational mode could enable crystallization, where the particles in a bunch are locked into a self-reinforcing, regular microstructure at the OSC fundamental wavelength; we refer to this as Optical Stochastic Crystallization (OSX). OSX represents a new path toward Steady-State Microbunching (SSMB), which may enable light sources combining the high brightness of a free-electron laser with the high repetition rate of a storage ring. Such a source has applications from the terahertz to the extreme ultraviolet (EUV), including high-power EUV generation for semiconductor lithography. This contribution will discuss the integration of OSX development as part of the OSC program at IOTA. The design of an accelerator lattice to enable the mechanism and associated high fidelity simulations demonstrating the beam dynamics will be shown, and a path to realizing an experimental demonstration will be discussed.

Wallbank, Michael James [Fermilab]↗

DOE OSTI2024

Realizing Steady-State Microbunching with Optical Stochastic Crystallization

Optical Stochastic Cooling (OSC) is a state-of-the-art beam cooling technology first demonstrated in 2021 at the IOTA storage ring at Fermilab's FAST facility. A second phase of the research program is planned to run in early 2025 and will incorporate an optical amplifier to enable significantly increased cooling rates and greater operational flexibility. In addition to beam cooling, an OSC system can be configured to enable advanced control over the phase space of the beam. An example operational mode could enable crystallization, where the particles in a bunch are locked into a self-reinforcing, regular microstructure at the OSC fundamental wavelength; we refer to this as Optical Stochastic Crystallization (OSX). OSX represents a new path toward Steady-State Microbunching (SSMB), which may enable light sources combining the high brightness of a free-electron laser with the high repetition rate of a storage ring. Such a source has applications from the terahertz to the extreme ultraviolet (EUV), including high-power EUV generation for semiconductor lithography. This contribution will discuss the status of the OSC experimental program and its potential to achieve the first demonstration of SSMB during the upcoming experimental run.

Wallbank, M.↗

DOE OSTI2024

Realizing Steady-State Microbunching with Optical Stochastic Crystallization

Optical Stochastic Cooling (OSC) is a state-of-the-art beam cooling technology first demonstrated in 2021 at the IOTA storage ring at Fermilab's FAST facility. A second phase of the research program is planned to run in early 2025 and will incorporate an optical amplifier to enable significantly increased cooling rates and greater operational flexibility. In addition to beam cooling, an OSC system can be configured to enable advanced control over the phase space of the beam. An example operational mode could enable crystallization, where the particles in a bunch are locked into a self-reinforcing, regular microstructure at the OSC fundamental wavelength; we refer to this as Optical Stochastic Crystallization (OSX). OSX represents a new path toward Steady-State Microbunching (SSMB), which may enable light sources combining the high brightness of a free-electron laser with the high repetition rate of a storage ring. Such a source has applications from the terahertz to the extreme ultraviolet (EUV), including high-power EUV generation for semiconductor lithography. This contribution will discuss the status of the OSC experimental program and its potential to achieve the first demonstration of SSMB during the upcoming experimental run.

43 PARTICLE ACCELERATORS↗

DOE OSTI2025

Evaluating the feasibility of using downwind methods to quantify point source oil and gas emissions using continuously monitoring fence-line sensors

The dependable reporting of methane (CH 4 ) emissions from point sources, such as fugitive leaks from oil and gas infrastructure, is important for profit maximization (retaining more hydrocarbons), evaluating climate impacts, assessing CH 4 fees for regulatory programs, and validating CH 4 intensity in differentiated gas programs. Currently, there are disagreements between emissions reported by different quantification techniques for the same sources. It has been suggested that downwind CH 4 quantification methods using CH 4 measurements on the fence line of production facilities could be used to generate emission estimates from oil and gas operations at the site level, but it is currently unclear how accurate the quantified emissions are. To investigate the accuracy of downwind methods, this study uses fence-line simulated data collected during controlled-release experiments as input for a non-standard closed-path eddy covariance (EC), the Gaussian plume inverse model (GPIM), and the backward Lagrangian stochastic (bLs) model in a range of atmospheric conditions. This study's EC attempt was unsuccessful due to data collection and instrumentation issues, resulting in invalid results characterized by underestimated emissions, large negative fluxes, and cospectra/ogives that deviated from their ideal shapes. Consequently, the EC results could not be compared with the GPIM and bLS model. The bLs model demonstrated the highest accuracy for single-release single-point emissions, though it exhibited greater uncertainty than GPIM under multi-release conditions. Across the GPIM and bLs model, the most reliable quantification was achieved with 15 min averaging and a narrow 5° wind sector range. Although EC was limited in this context, future studies should consider employing a standard EC system and further optimizing GPIM and bLs approaches – particularly for complex multi-source scenarios – to enhance quantification accuracy and reduce uncertainty.

03 NATURAL GAS↗

NASA NTRS1993

Synthesis of robust controllers

At the 1990 American Controls Conference a benchmark problem was issued as a challenge for designing robust compensators. Many compensators were presented in response to the problem. In previous work Stochastic Robustness Analysis (SRA) was used to compare these compensators. In this work SRA metrics are used as guides to synthesize robust compensators, using the benchmark problem as an example.

Marrison, Chris↗

NASA NTRS1990

Random search optimization based on genetic algorithm and discriminant function

The general problem of optimization with arbitrary merit and constraint functions, which could be convex, concave, monotonic, or non-monotonic, is treated using stochastic methods. To improve the efficiency of the random search methods, a genetic algorithm for the search phase and a discriminant function for the constraint-control phase were utilized. The validity of the technique is demonstrated by comparing the results to published test problem results. Numerical experimentation indicated that for cases where a quick near optimum solution is desired, a general, user-friendly optimization code can be developed without serious penalties in both total computer time and accuracy.

Kiciman, M. O.↗