Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40
All sourcesNASA NTRSDOE OSTI
NASA NTRS1979

Optimization and simulation of flight control laws under parameter uncertainty and external disturbances

Several tasks pertinent to flight control in parameter uncertainty and wind-gust loading were successfully completed. Identification algorithms for extracting stability and control derivatives from flight data taking gust loading into account were developed. They were verified by simulation and evaluated throughly on actual flight data taken on a Lockheed Jet Star flying in turbulence. In particular the need for automatically generated dither-like inputs was studied. Criteria for performance evaluation using stochastic models were developed for gust alleviation as well as handling quantities. Algorithms for assessing degradation in performance due to parameter uncertainty were developed and evaluated using flight test data.

Source record↗
NASA NTRS2006

Modeling and Classifying Six-Dimensional Trajectories for Teleoperation Under a Time Delay

Within the context of teleoperating the JSC Robonaut humanoid robot under 2-10 second time delays, this paper explores the technical problem of modeling and classifying human motions represented as six-dimensional (position and orientation) trajectories. A dual path research agenda is reviewed which explored both deterministic approaches and stochastic approaches using Hidden Markov Models. Finally, recent results are shown from a new model which represents the fusion of these two research paths. Questions are also raised about the possibility of automatically generating autonomous actions by reusing the same predictive models of human behavior to be the source of autonomous control. This approach changes the role of teleoperation from being a stand-in for autonomy into the first data collection step for developing generative models capable of autonomous control of the robot.

SunSpiral, Vytas↗
NASA NTRS2007

Stochastic Effects in Computational Biology of Space Radiation Cancer Risk

Estimating risk from space radiation poses important questions on the radiobiology of protons and heavy ions. We are considering systems biology models to study radiation induced repair foci (RIRF) at low doses, in which less than one-track on average transverses the cell, and the subsequent DNA damage processing and signal transduction events. Computational approaches for describing protein regulatory networks coupled to DNA and oxidative damage sites include systems of differential equations, stochastic equations, and Monte-Carlo simulations. We review recent developments in the mathematical description of protein regulatory networks and possible approaches to radiation effects simulation. These include robustness, which states that regulatory networks maintain their functions against external and internal perturbations due to compensating properties of redundancy and molecular feedback controls, and modularity, which leads to general theorems for considering molecules that interact through a regulatory mechanism without exchange of matter leading to a block diagonal reduction of the connecting pathways. Identifying rate-limiting steps, robustness, and modularity in pathways perturbed by radiation damage are shown to be valid techniques for reducing large molecular systems to realistic computer simulations. Other techniques studied are the use of steady-state analysis, and the introduction of composite molecules or rate-constants to represent small collections of reactants. Applications of these techniques to describe spatial and temporal distributions of RIRF and cell populations following low dose irradiation are described.

Cucinotta, Francis A.↗
NASA NTRS2014

Improving Sensorimotor Adaptation Following Long Duration Space Flight by Enhancing Vestibular Information Transfer

Crewmember adapted to the microgravity state may need to egress the vehicle within a few minutes for safety and operational reasons after gravitational transitions. The transition from one sensorimotor state to another consists of two main mechanisms: strategic and plastic-adaptive and have been demonstrated in astronauts returning after long duration space flight. Strategic modifications represent "early adaptation" - immediate and transitory changes in control that are employed to deal with short-term changes in the environment. If these modifications are prolonged then plastic-adaptive changes are evoked that modify central nervous system function, automating new behavioral responses. More importantly, this longer term adaptive recovery mechanism was significantly associated with their strategic ability to recover on the first day after return to Earth G. We are developing a method based on stochastic resonance to enhance information transfer by improving the brain's ability to detect vestibular signals (Vestibular Stochastic Resonance, VSR) especially when combined with balance training exercises such as sensorimotor adaptability (SA) training for rapid improvement in functional skill, for standing and mobility. This countermeasure to improve detection of vestibular signals is a stimulus delivery system that is wearable/portable providing low imperceptible levels of white noise based binaural bipolar electrical stimulation of the vestibular system (stochastic vestibular stimulation). To determine efficacy of vestibular stimulation on physiological and perceptual responses during otolith-canal conflicts and dynamic perturbations we have conducted a series of studies: We have shown that imperceptible binaural bipolar electrical stimulation of the vestibular system across the mastoids enhances balance performance in the mediolateral (ML) plane while standing on an unstable surface. We have followed up on the previous study showing VSR stimulation improved balance performance in both ML and anteroposterior planes while stimulating in the ML axis only. We have shown the efficacy of VSR stimulations on enhancing physiological and perceptual responses of whole-body orientation during low frequency perturbations (0.1 Hz) on the ocular motor system using a variable radius centrifuge on both physiological (using eye movements) and perceptual responses (using a joystick) to track imposed oscillations. The variable radius centrifuge provides a selective tilting sensation that is detectable only by the otolith organs providing conflicting information from the canal organs of the vestibular system (intra-vestibular conflict). These results indicate that VSR can improve performance in sensory conflict scenarios like that experienced during space flight. We have showed the efficacy of VSR stimulation to improve balance and locomotor control on subjects exposed to continuous, sinusoidal lateral motion of the support surface while walking on a treadmill while viewing perceptually matched linear optic flow. We have shown the safety of short term continuous use of up to 4 hours of VSR stimulation and its efficacy in improving balance and locomotor function in Parkinson's Disease patients. This technique for improving vestibular signal detection may thus provide additional information to improve strategic abilities. We hypothesize that VSR stimulation will act synergistically with SA training to improve adaptability by increased utilization of vestibular information and therefore serve to optimize and personalize the SA countermeasure prescription. This forms the basis of its usefulness both as a training modality and further help in significantly reducing the number of days required to recover functional performance to preflight levels after long duration space flight.

Mulavara, A. P.↗
DOE OSTI2025

High-energy ion beams generated with high efficiency using laser-driven 3D microstructures

Laser-driven ion acceleration in plasma is being proposed as a source of ion beams with a high peak current that can be useful in many fields of science and medicine. Using this method, high proton energies have been achieved by increasing the laser power and by using ultrathin (≤ 200 nm) foils. However, this approach is limited by survivability of the nanotargets to laser prepulses and by difficulty in controlling the plasma acceleration properties. Here, we introduce a new target platform using two-photon polymerization, 3D laser-printed “clone” microstructures with average densities lower than solid that are relatively insensitive to the laser prepulse. Two types of microstructured targets consisting of either a multilayered log-pile or a stochastic arrangement of one micron diameter wires are used. Both demonstrate a higher energy and higher yield proton acceleration compared to thin solid-density foil targets by the robust target normal sheath acceleration (TNSA) mechanism. We find that when such 10–20 μm thick structures are irradiated with a petawatt laser, protons with energies up to 110 MeV and a laser-to-proton conversion efficiency of ~ 10% are obtained. Our work suggests that such microstructures optimized for 60–200 MeV compact proton accelerators are promising for future radiotherapy and other applications.

Physics - Plasma physics↗
DOE OSTI2020

NREL CITIES Support (CRADA CRD-14-00558 Final Report)

The Technical University of Denmark has received a Grant from the Danish Council for Strategic Research for the project "CITIES - Centre for IT-Intelligent Energy Systems in Cities", a strategic research centre, which involves industrial partners and universities. The Alliance for Sustainable Energy, LLC will participate with DTU as an industrial partner in "CITIES" under this Cooperative Research and Development Agreement (CRADA). The Centre for IT based Intelligent Energy Systems in Cities (CITIES) Project is a Danish national research center focused on work in building short-term operational integrated energy system models that feed longer term plam1ing models, considering the spatio-temporal variations, interactions, dynamics and stochastics in the energy system, from production to consumption. CITIES will harness the extensive expertise and experience of its industrial and academic partners to conduct meaningful research with tangible outputs, including a roadmap to a fossil free future. Decision support tools will be developed to inform stakeholders of the impact of investment, control and policy measures and to identify further opportunities for energy system efficiency. Dissemination and transferring knowledge is a key value to this CRADA, and the use of results by Danish policymakers, industry and society is vital. All participants in the Centre for IT based Intelligent Energy Systems in Cities (CITIES) Project are therefore encouraged to use all means to communicate their findings to society. Wherever possible, and compatible with applicable intellectual property regulations, publications should be produced and disseminated under Open Science, Data, Source and Access principles.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Intrabeam scattering studies with large-emittance-ratio ion beams in the Relativistic Heavy Ion Collider, and implications for the Electron-Ion Collider

The Electron-Ion Collider (EIC), to be constructed at Brookhaven National Laboratory, will collide polarized, high-energy electron beams with hadron beams, achieving peak luminosities of up to 1.0 x 10 34 cm -2 s -1 . To reach such high luminosity, the EIC will employ flat-beam collisions at the interaction point. The design transverse emittance ratio will be about 10:1 in the Hadron Storage Ring (HSR). Thanks to stochastic cooling and precise decoupling, we successfully generated and accelerated gold ion beams with a large emittance ratio of 11:1 in the Relativistic Heavy Ion Collider (RHIC). In this article, we present results of intrabeam scattering (IBS) measurements and modeling for large-emittance gold ion beams, both without and with controlled betatron coupling. To model the IBS growth, we use the formulas developed by Lebedev and Nagaitsev.

43 PARTICLE ACCELERATORS↗
DOE OSTI2020

Robust Learning with Implicit Residual Networks

In this effort, we propose a new deep architecture utilizing residual blocks inspired by implicit discretization schemes. As opposed to the standard feed-forward networks, the outputs of the proposed implicit residual blocks are defined as the fixed points of the appropriately chosen nonlinear transformations. We show that this choice leads to the improved stability of both forward and backward propagations, has a favorable impact on the generalization power, and allows for control the robustness of the network with only a few hyperparameters. In addition, the proposed reformulation of ResNet does not introduce new parameters and can potentially lead to a reduction in the number of required layers due to improved forward stability. Finally, we derive the memory-efficient training algorithm, propose a stochastic regularization technique, and provide numerical results in support of our findings.

Reshniak, Viktor↗
DOE OSTI2022

MAGIS-100 environmental characterization and noise analysis

We investigate and analyze site specific systematics for the MAGIS-100 atomic interferometry experiment at Fermi National Accelerator Laboratory. As atom interferometers move out of the laboratory environment passive and active mitigation for noise sources must be implemented. To inform the research and development of the experiment design, we measure ambient temperature, humidity, and vibrations of the installation site. We find that temperature fluctuations will necessitate enclosures for critical subsystems and a temperature controlled laser room for the laser system. We also measure and analyze the vibration spectrum above and below ground for the installation site. The seismic vibration effect of gravity gradient noise is also modeled using input from a low-noise seismometer at multiple locations and a mitigation scheme is studied using a stochastic simulation and characterized by a suppression factor.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Deep Reinforcement Learning for Distribution System Restoration Using Distributed Energy Resources and Tie-Switches

Distributed energy resources (DERs), such as solar PVs and energy storage, can be used to restore distribution system critical loads after the extreme weather events to increase grid resilience. However, coordinating multiple DERs together with tie-switches for multi-step restoration process under renewable uncertainty is challenging. This paper proposes a deep reinforcement learning to control discrete actions of switching on/off tie switches and DERs for critical load restoration. The restoration problem is first cast into the Markov decision process suitable for DRL. Then, the original soft actor critic (SAC) method for continuous actions has been extended to handle discrete and continuous actions. Numerical comparison results with other stochastic optimization-based approaches on the modified IEEE 33-bus system show that the proposed method can achieve fast critical load restoration in the presence of substation power outage while maintaining system voltage limit throughout the restoration process.

active distribution systems↗
DOE OSTI2020

Power System Resilience Enhancement in Typhoons Using a Three-Stage Day-Ahead Unit Commitment

In this work, we propose a three-stage resilient unit commitment model which considers uncertain typhoon paths and line outages to improve the power system resilience against typhoon events. The proposed solution coordinates resources in response to the worst-case scenario for each possible typhoon path. The optimal decision is based on the characterization of the power system schedule into three stages of preventive control, emergency control, and restoration. Preventive control is performed before the typhoon occurs by quickly adjusting the three-stage resilient unit commitment schedule; emergency control is conducted during the typhoon by shedding local loads to meet the power balance, while other control strategies are assumed to be unavailable due to possible interruptions in the communication system; restoration is realized after the typhoon, when resources are optimally dispatched to repair the outages of critical devices and recover the normal operation state of the power system quickly. Considering the typhoon path uncertainty, we have introduced a stochastic model for possible typhoon paths where all possible affected lines along each typhoon path are assumed to be on outage during the typhoon. Accordingly, we explore the strategy for co-optimizing the three stages in unit commitment. The proposed model is tested on the IEEE 118-bus system and the real-world provincial system to verify its effectiveness.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Physics Basis, Optimization, and Control for Integrated 3D Edge Long-pulse Tokamak Scenarios

The aim of this project with international collaborations (PI: J.-K. Park of Princeton Plasma Physics Laboratory) is to develop a unified physics basis and predictive capability for the control of edge-localized modes (ELMs) with optimized non-axisymmetric (3D) fields, by leveraging the unique research capabilities of international KSTAR tokamak in Korea. At the University of California, Irvine, we use a fusion simulation code GTC to study the effects of the 3D magnetic fields (including both magnetic islands and stochastic magnetic field lines) on microturbulence. We focus on the effects of 3D equilibrium on turbulent and neoclassical transport that leads to ELM suppression. During the project period, the UCI team of this collaboration has made significant progress in understanding turbulent transport in 3D geometry including both tokamaks with RMP and stellarators. Four UCI postdoctoral researchers, Drs. Javier Nicolau, Gyungjin Choi, Pengfei Liu, and Xishuo Wei were partially supported by this project and collaborating with the entire project team. We have published 4 journal papers and gave several invited talks. This project advance physics understand of 3D effects on microturbulence, specially effects of magnetic islands. It will contribute to the DOE SciDAC ISEP project in the area of GTC development for general 3D geometry capability, rigorous verification and validation, and readiness for the emerging exascale computing. Through collaborations with computational scientists, the project helps to advance high performance computing in the area of GPU acceleration, linear solver, and data management.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS2008

Robust Path Planning and Feedback Design Under Stochastic Uncertainty

Autonomous vehicles require optimal path planning algorithms to achieve mission goals while avoiding obstacles and being robust to uncertainties. The uncertainties arise from exogenous disturbances, modeling errors, and sensor noise, which can be characterized via stochastic models. Previous work defined a notion of robustness in a stochastic setting by using the concept of chance constraints. This requires that mission constraint violation can occur with a probability less than a prescribed value.In this paper we describe a novel method for optimal chance constrained path planning with feedback design. The approach optimizes both the reference trajectory to be followed and the feedback controller used to reject uncertainty. Our method extends recent results in constrained control synthesis based on convex optimization to solve control problems with nonconvex constraints. This extension is essential for path planning problems, which inherently have nonconvex obstacle avoidance constraints. Unlike previous approaches to chance constrained path planning, the new approach optimizes the feedback gain as wellas the reference trajectory.The key idea is to couple a fast, nonconvex solver that does not take into account uncertainty, with existing robust approaches that apply only to convex feasible regions. By alternating between robust and nonrobust solutions, the new algorithm guarantees convergence to a global optimum. We apply the new method to an unmanned aircraft and show simulation results that demonstrate the efficacy of the approach.

autonomuys vehicles↗
NASA NTRS1981

Optimal interpolation and the Kalman filter

The estimation theory of stochastic-dynamic systems is described and used in a numerical study of optimal interpolation. The general form of data assimilation methods is reviewed. The Kalman-Bucy, KB filter, and optimal interpolation (OI) filters are examined for effectiveness in performance as gain matrices using a one-dimensional form of the shallow-water equations. Control runs in the numerical analyses were performed for a ten-day forecast in concert with the OI method. The effects of optimality, initialization, and assimilation were studied. It was found that correct initialization is necessary in order to localize errors, especially near boundary points. Also, the use of small forecast error growth rates over data-sparse areas was determined to offset inaccurate modeling of correlation functions near boundaries.

Cohn, S.↗
DOE OSTI2023

Assessing mechanisms for microbial taxa and community dynamics using process models

Disentangling the assembly mechanisms controlling community composition, structure, distribution, functions, and dynamics is a central issue in ecology. Although various approaches have been proposed to examine community assembly mechanisms, quantitative characterization is challenging, particularly in microbial ecology. Here, we present a novel approach for quantitatively delineating community assembly mechanisms by combining the consumer–resource model with a neutral model in stochastic differential equations. Using time-series data from anaerobic bioreactors that target microbial 16S rRNA genes, we tested the applicability of three ecological models: the consumer–resource model, the neutral model, and the combined model. Our results revealed that model performances varied substantially as a function of population abundance and/or process conditions. The combined model performed best for abundant taxa in the treatment bioreactors where process conditions were manipulated. In contrast, the neutral model showed the best performance for rare taxa. Our analysis further indicated that immigration rates decreased with taxa abundance and competitions between taxa were strongly correlated with phylogeny, but within a certain phylogenetic distance only. The determinism underlying taxa and community dynamics were quantitatively assessed, showing greater determinism in the treatment bioreactors that aligned with the subsequent abnormal system functioning. Given its mechanistic basis, the framework developed here is expected to be potentially applicable beyond microbial ecology.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

The Cascade Effectiveness of 3-Terminal Tandem Photocathode Architectures as Applied to CO 2 Reduction

Cascade catalysis for photoelectrochemical CO 2 reduction (CO 2 R) decouples the overall reaction into sequential steps occurring on separately optimized catalysts (for example, Ag and Cu) between which an intermediate species such as CO is transferred. A 3-terminal tandem (3TT) photovoltaic architecture advantageously holds two different catalytic regions at different potentials under a single illumination source, but its overall efficiency is low. Using a stochastic reaction-diffusion model, we have examined 3TT photocathode design principles, focusing on the coupling of surface chemistry and transport of CO both inside the boundary layer and outward, into the bulk electrolyte. We find that ensuring that the lateral diffusion distance within the boundary layer is short compared to the boundary layer thickness and controlling bulk flow are key, with interdigitated designs showing an overall conversion efficiency improvement by 2 orders of magnitude compared to the side-by-side case without flow. These findings can be adapted for other cascaded architectures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1972

Bounded state space

This investigation is divided functionally into three different areas: (1) study of bounded state space, (2) nonlinear smoothing theory, and (3) system identification. (1) Study of bounded state space: necessary and sufficient conditions for an optimal control are obtained for a bounded state space optimal control problem. The difficulty of determining the so-called jump conditions is eliminated; however, the problem of determining the points where the response either enters or leaves the boundary still remains unsolved. (2) Nonlinear smoothing theory: nonlinear fixed-interval, fixed-point and fixed-lag smoothing of a random signal generated by a stochastic differential equation are investigated. Results on the asymptotic stability of a linear constant-parameter fixed-interval smoothing filter are obtained. (3) System identification: a particular stochastic modelling problem is solved. An Ito stochastic integral equation is used to mathematically model a black box having multiple inputs and multiple outputs. A new method for identifying system parameters is presented.

Eyman, E. D.↗
DOE OSTI2024

New Advances in Optical Stochastic Cooling

Recently, Optical Stochastic Cooling (OSC) became the first demonstrated method for ultra-high-bandwidth stochastic cooling. The initial experiments at Fermilab’s IOTA ring explored the essential physics of the method and demonstrated cooling, heating and manipulation of beams and single particles. Having been validated in practice, with continued development, OSC carries the potential for dramatic advances in the state-of-the-art performance and flexibility for beam cooling and control. The ongoing program at Fermilab is now focused on the development of an OSC system that includes high-gain optical amplification, which promises a two-order-of-magnitude increase in the strength of the OSC force. In this talk, we briefly review the results of the initial experimental campaign, describe the status of the conceptual and hardware designs for the amplified OSC system, report initial experimental results of our high-gain amplifier development, and explore near-term operational plans and use cases.

43 PARTICLE ACCELERATORS↗