Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
NASA NTRS2003

Development of Probabilistic Life Prediction Methodologies and Testing Strategies for MEMS

This effort is to investigate probabilistic life prediction methodologies for MicroElectroMechanical Systems (MEMS) and to analyze designs that determine stochastic properties of MEMS. This includes completion of a literature survey regarding Weibull size effect in MEMS and strength testing techniques. Also of interest is the design of a proper test for the Weibull size effect in tensile specimens. The Weibull size effect is a consequence of a stochastic strength response predicted from the Weibull distribution. Confirming that MEMS strength is controlled by the Weibull distribution will enable the development of a probabilistic design methodology for MEMS - similar to the GRC developed CARES/Life program for bulk ceramics. Another potential item of interest is analysis and modeling of material interfaces for strength as well as developing a strategy to handle stress singularities at sharp corners, filets, and material interfaces. The ultimate objective of this effort is to further develop and verify the ability of the Ceramics Analysis and Reliability Evaluation of Structuredlife (CARES/Life) code to predict the time-dependent reliability of MEMS structures subjected to multiple transient loads. Along these lines work may also be performed on transient fatigue life prediction methodologies.

Jadaan, Osama M.↗
NASA NTRS2003

Development of Testing Methodologies for the Mechanical Properties of MEMS

This effort is to investigate and design testing strategies to determine the mechanical properties of MicroElectroMechanical Systems (MEMS) as well as investigate the development of a MEMS Probabilistic Design Methodology (PDM). One item of potential interest is the design of a test for the Weibull size effect in pressure membranes. The Weibull size effect is a consequence of a stochastic strength response predicted from the Weibull distribution. Confirming that MEMS strength is controlled by the Weibull distribution will enable the development of a probabilistic design methodology for MEMS - similar to the GRC developed CARES/Life program for bulk ceramics. However, the primary area of investigation will most likely be analysis and modeling of material interfaces for strength as well as developing a strategy to handle stress singularities at sharp corners, filets, and material interfaces. This will be a continuation of the previous years work. The ultimate objective of this effort is to further develop and verify the ability of the Ceramics Analysis and Reliability Evaluation of Structures Life (CARES/Life) code to predict the time-dependent reliability of MEMS structures subjected to multiple transient loads.

Ekwaro-Osire, Stephen↗
NASA NTRS2003

Development of Probabilistic Life Prediction Methodologies and Testing Strategies for MEMS and CMC's

This effort is to investigate probabilistic life prediction methodologies for ceramic matrix composites and MicroElectroMechanical Systems (MEMS) and to analyze designs that determine stochastic properties of MEMS. For CMC's this includes a brief literature survey regarding lifing methodologies. Also of interest for MEMS is the design of a proper test for the Weibull size effect in thin film (bulge test) specimens. The Weibull size effect is a consequence of a stochastic strength response predicted from the Weibull distribution. Confirming that MEMS strength is controlled by the Weibull distribution will enable the development of a probabilistic design methodology for MEMS - similar to the GRC developed CARES/Life program for bulk ceramics. A main objective of this effort is to further develop and verify the ability of the Ceramics Analysis and Reliability Evaluation of Structures/Life (CARES/Life) code to predict the time-dependent reliability of MEMS structures subjected to multiple transient loads. A second set of objectives is to determine the applicability/suitability of the CARES/Life methodology for CMC analysis, what changes would be needed to the methodology and software, and if feasible, run a demonstration problem. Also important is an evaluation of CARES/Life coupled to the ANSYS Probabilistic Design System (PDS) and the potential of coupling transient reliability analysis to the ANSYS PDS.

Jadaan, Osama↗
NASA NTRS2010

Feasibility of Exoplanet Coronagraphy with the Hubble Space Telescope

Herein we report on a preliminary study to assess the use of the Hubble Space Telescope (HST) for the direct detection and spectroscopic characterization of exoplanets and debris disks - an application for which HST was not originally designed. Coronagraphic advances may enable the design of a science instrument that could achieve limiting contrasts approx.10deg beyond 275 milli-arcseconds (4 lambda/D at 800 nm) inner working angle, thereby enabling detection and characterization of several known jovian planets and imaging of debris disks. Advantages of using HST are that it already exists in orbit, it's primary mirror is thermally stable and it is the most characterized space telescope yet flown. However there is drift of the HST telescope, likely due to thermal effects crossing the terminator. The drift, however, is well characterized and consists of a larger deterministic components and a smaller stochastic component. It is the effect of this drift versus the sensing and control bandwidth of the instrument that would likely limit HST coronagraphic performance. Herein we discuss the science case, quantifY the limiting factors and assess the feasibility of using HST for exoplanet discovery using a hypothetical new instrument. Keywords: Hubble Space Telescope, coronagraphy, exoplanets, telescopes

Lyon, Richard G.↗
NASA NTRS2012

Image Mapping and Visual Attention on the Sensory Ego-Sphere

The Sensory Ego-Sphere (SES) is a short-term memory for a robot in the form of an egocentric, tessellated, spherical, sensory-motor map of the robot s locale. Visual attention enables fast alignment of overlapping images without warping or position optimization, since an attentional point (AP) on the composite typically corresponds to one on each of the collocated regions in the images. Such alignment speeds analysis of the multiple images of the area. Compositing and attention were performed two ways and compared: (1) APs were computed directly on the composite and not on the full-resolution images until the time of retrieval; and (2) the attentional operator was applied to all incoming imagery. It was found that although the second method was slower, it produced consistent and, thereby, more useful APs. The SES is an integral part of a control system that will enable a robot to learn new behaviors based on its previous experiences, and that will enable it to recombine its known behaviors in such a way as to solve related, but novel, task problems with apparent creativity. The approach is to combine sensory-motor data association and dimensionality reduction to learn navigation and manipulation tasks as sequences of basic behaviors that can be implemented with a small set of closed-loop controllers. Over time, the aggregate of behaviors and their transition probabilities form a stochastic network. Then given a task, the robot finds a path in the network that leads from its current state to the goal. The SES provides a short-term memory for the cognitive functions of the robot, association of sensory and motor data via spatio-temporal coincidence, direction of the attention of the robot, navigation through spatial localization with respect to known or discovered landmarks, and structured data sharing between the robot and human team members, the individuals in multi-robot teams, or with a C3 center.

Fleming, Katherine Achim↗
DOE OSTI2020

Data-Driven Preemptive Voltage Monitoring and Control Using Probabilistic Voltage Sensitivities

Increased penetration levels of distributed variable renewable generation can cause random voltage fluctuations and violations at multiple nodes. Traditional methods of voltage control typically involve reactionary responses of capacitor banks, tap changers, and recently even smart inverters. But because of the lack of foresight in voltage violations, these controls are ineffective to completely mitigate the issue. Therefore, new methods of predicting voltage violations subject to random power injection changes in the distribution network are needed, which can be used to guide optimal and dynamic methods of voltage control. This work lays the foundation for such preemptive voltage monitoring and control by proposing an analytical and sensor data-driven voltage sensitivity analysis method. Driven by stochastic data and forecasts, the method can be used to develop probabilistic voltage sensitivities and consequently to predict system nodes with high likelihood of voltage limit violations. The effectiveness of this method is tested on IEEE 69-node distribution system integrated with distributed solar. The results demonstrate the proposed method's ability to successfully predict nodes with high probability of voltage violations for a specific time-series simulation. The results also demonstrate the ability to guide timely power injection control actions to mitigate future voltage violations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2010

Postflight Quiet Stance Stability of Astronauts Following Recovery From a Simulated Fall

INTRODUCTION: Astronauts returning from space flight universally present with postural ataxia. Throughout the Space Shuttle Program, measurement of ataxia has concentrated on sway in the anterior-posterior plane. Implementation of an interdisciplinary pre- and postflight study (Functional Task Test, FTT) designed to evaluate both astronaut postflight functional performance and related physiological changes has allowed the investigation of postural instability by characterizing dynamic stabilographic sway patterns. METHODS: Six astronauts from short-duration (Shuttle) and three from long-duration (ISS) flights were required to recover from a simulated fall. Subjects with eyes open, wearing running shoes lay prone on the floor for 2 minutes and then quickly stood up, maintained a quiet stance for 3 minutes, arms relaxed along the side of the body, and feet comfortably placed on the force plate. Crewmembers were tested twice before flight, on landing day (Shuttle only), and 1, 6, and 30 days after flight. Anterior-posterior (AP) and medial-lateral (ML) center-of-pressure (COP) coordinates were calculated from the ground reaction forces collected at 500 Hz. The 3-minute quiet stance trial was broken into three 1-minute segments for stabilogram diffusion analysis. A mean sway speed (rate of change of COP displacement) was also calculated as an additional postural stability parameter. RESULTS/CONCLUSION: While there was considerable variation, most of crewmembers tested exhibited increased stochastic activity evidenced by larger short-term COP diffusion coefficients postflight in both the AP and ML planes, suggesting significant changes in postural control mechanisms, particularly control of lower limb muscle function. As expected, postural instability of ISS astronauts on the first day postflight was similar to that of Shuttle crewmembers on landing day. Recoveries of stochastic activity and mean sway speed to baseline levels were typically observed by the 30th day postflight for both long-duration and short-duration crewmembers. Dynamic postural stability characteristics obtained in this low-impact study complement the data measured with computerized dynamic posturography.

Reschke, M. F.↗
NASA NTRS2011

A Simple Postflight Measure of Postural Atania in Astronauts

Astronauts returning from space flight universally present with postural ataxia. Throughout the Space Shuttle Program, measurement of ataxia has concentrated on sway in the anterior-posterior (AP) plane. The current investigation, as a part of a larger functional study, concentrated on characterizing postural instability using dynamic stabilographic sway patterns in both the AP and medial-lateral (ML) planes. To accomplish this goal, six astronauts from short-duration (Shuttle) and three from long-duration (ISS) flights were required to recover from a simulated fall. Subjects with eyes open, wearing running shoes lay prone on the floor for 2 minutes and then quickly stood up, maintained a quiet stance for 3 minutes, arms relaxed along the side of the body, and feet comfortably placed on the force plate. Crewmembers were tested twice before flight, on landing day (Shuttle only), and 1, 6, and 30 days after flight. Anterior-posterior and ML center-of-pressure (COP) coordinates were calculated from the ground reaction forces collected at 500 Hz. The 3-minute quiet stance trial was broken into three 1-minute segments for stabilogram diffusion analysis. A mean sway speed (rate of change of COP displacement) was also calculated as an additional postural stability parameter. While there was considerable variation, most of crewmembers tested exhibited increased stochastic activity evidenced by larger short-term COP diffusion coefficients postflight in both the AP and ML planes, suggesting significant changes in postural control mechanisms, particularly control of lower limb muscle function. As expected, postural instability of ISS astronauts on the first day postflight was similar to that of Shuttle crewmembers on landing day. Recoveries of stochastic activity and mean sway speed to baseline levels were typically observed by the 30th day postflight for both long-duration and short-duration crewmembers. Dynamic postural stability characteristics obtained in this low-impact study complement the data measured with computerized dynamic posturography.

Reschke, M. F.↗
DOE OSTI2025

Flexible Resource Scheduler for FAST-DERMS (FRS-FASTDERMS) v0.9

The Flexible Resource Scheduler is a hierarchical controller that manages the distributed energy resources in a distribution substation or distribution feeder to provide a firm commitment of power flow at the substation or feeder head to be scheduled in transmission-level markets as an aggregated demand resource. It is the reference controller for the FAST-DERMS Architecture, developed in tandem with the architecture under the DOE FAST-DERMS project. It is comprised of a day-ahead stochastic optimization, which schedules substation power flow and reserves, a intra-hour MPC, which generates dispatch base points for DER, and a real-time PID controller maintaining that dispatches DER to maintain the substation power around the base points. The repository also includes a representative aggregator controller, and all of the necessary components to run a simulation using PNNL's GridAPPS-D software with the controller.

MacDonald, Jason [Lawrence Berkeley National Labor↗
DOE OSTI2021

Occupant Preference-Aware Load Scheduling for Resilient Communities

The load scheduling of resilient communities in the islanded mode is subject to many uncertainties such as weather forecast errors and occupant behavior stochasticity. To date, it remains unclear how occupant preferences affect the effectiveness of the load scheduling of resilient communities. This paper proposes an occupant thermal preference-aware load scheduler for resilient communities operating in the islanded mode. First, key resilience indicators are selected to quantify its impacts on the load scheduling of a resilient community. A deterministic model predictive control-based load scheduling framework is adopted as the baseline. Then, a chance-constrained controller is proposed to address the occupant-induced uncertainty in room temperature setpoints. Finally, the chance-constrained controller is compared with the deterministic controller on a virtual community testbed based on a real-world net-zero energy community in Florida, U.S. Results have shown that the proposed chance-constrained controller performs better in terms of serving occupants’ thermal preference and the required battery sizes compared to the deterministic controller with the presence of the assumed stochastic occupant behavior. This work indicates that it is necessary to consider the stochasticity of the occupant behavior when designing optimal load schedulers for resilient communities.

Wang, Jing↗
DOE OSTI2021

A Stochastic Multi-Criteria Decision-Making Algorithm for Dynamic Load Prioritization in Grid-Interactive Efficient Buildings

Increasing deployment of advanced sensing, controls, and communication infrastructure enables buildings to provide services to the power grid, leading to the concept of grid-interactive efficient buildings. Since occupant activities and preferences primarily drive the availability and operational flexibility of building devices, there is a critical need to develop occupant-centric approaches that prioritize devices for providing grid services, while maintaining the desired end-use quality of service. In this paper, we present a decision-making framework that facilitates a building owner/operator to effectively prioritize loads for curtailment service under uncertainties, while minimizing any adverse impact on the occupants. The proposed framework uses a stochastic (Markov) model to represent the probabilistic behavior of device usage from power consumption data, and a load prioritization algorithm that dynamically ranks building loads using a stochastic multi-criteria decision-making algorithm. The proposed load prioritization framework is illustrated via numerical simulations in a residential building use-case, including plug-loads, air-conditioners, and plug-in electric vehicle chargers, in the context of load curtailment as a grid service. Suitable metrics are proposed to evaluate the closed-loop performance of the proposed prioritization algorithm under various scenarios and design choices. Scalability of the proposed algorithm is established via computational analysis, while time-series plots are used for intuitive explanation of the ranking choices.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Identification of hot water end-use process of electric water heaters from energy measurements

This paper presents an algorithm for the identification of parameters for a stochastic hot water end-use process that drives a homogeneous population of thermostatically controlled electric water heaters (EWH). Usually, only metered interval consumption data (kWh) is collected and the hot water end-use process is unobservable to utility and aggregators. However, the availability of EWHs for demand response (DR) is closely coupled with the hot water end-use process. In this context, the hot water end-use process is modeled as a two-state Markov chain (Use / No use), which causes the thermostatic ON-OFF switching process to behave as a Markov renewal process (MRP). A set of first passage-time problems is developed to obtain the moments of the transition probability densities of the MRP. These problems are addressed by establishing a system of coupled partial differential equations characterizing the temperature evolution of the EWH population. A key quantity in the methodology for estimating the parameters is the total time an EWH is ON within a period of interest. It is referred to as the total busy time. Total busy time in this approach is a random variable for which analytical expressions of the moments are developed as a function of the metered window length. The latter expressions become the basis of a hot water demand model identification algorithm which is validated using agent-based simulations of EWHs.

42 ENGINEERING↗
DOE OSTI2024

Efficient prediction of attosecond two-colour pulses from an X-ray free-electron laser with machine learning

Abstract X-ray free-electron lasers are sources of coherent, high-intensity X-rays with numerous applications in ultra-fast measurements and dynamic structural imaging. Due to the stochastic nature of the self-amplified spontaneous emission process and the difficulty in controlling injection of electrons, output pulses exhibit significant noise and limited temporal coherence. Standard measurement techniques used for characterizing two-coloured X-ray pulses are challenging, as they are either invasive or diagnostically expensive. In this work, we employ machine learning methods such as neural networks and decision trees to predict the central photon energies of pairs of attosecond fundamental and second harmonic pulses using parameters that are easily recorded at the high-repetition rate of a single shot. Using real experimental data, we apply a detailed feature analysis on the input parameters while optimizing the training time of the machine learning methods. Our predictive models are able to make predictions of central photon energy for one of the pulses without measuring the other pulse, thereby leveraging the use of the spectrometer without having to extend its detection window. We anticipate applications in X-ray spectroscopy using XFELs, such as in time-resolved X-ray absorption and photoemission spectroscopy, where improved measurement of input spectra will lead to better experimental outcomes.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Computational Modeling, Simulation, and Potential Applications of Optical Stochastic Cooling

With the rising demand for intense particles beams, much research is being conducted in the area of particle beam cooling. One of these methods, called Stochastic Cooling (SC) (developed at CERN in the 1970's), delivered a feedback method to improve the quality and lifetime of circulating proton beams by reducing their 6D phase-space and has been widely implemented in a number of hadron machines. However, traditional stochastic cooling schemes are limited by the bandwidth of microwave frequency systems. Optical Stochastic Cooling (OSC) is a promising extension of the stochastic cooling beam cooling technique. OSC instead uses optical wavelengths which allows for improved control and increased cooling but creates its own technical challenges. This lays out work conducted toward the experimental demonstration of OSC at Fermilab's Integrable Optics Test Accelerator (IOTA) storage ring. This includes the design and characterization of parts of the optical delay system, the development and validation of a high-fidelity computational model of the OSC process, and the investigations into possible applications of the OSC mechanism to advanced beam manipulations.

43 PARTICLE ACCELERATORS↗
DOE OSTI2026

Reshaping the Quantum Arrow of Time

While the microscopic laws of physics are often symmetric under time reversal, most natural processes that we observe are not. The emergent asymmetry between typical and time-reversed processes is referred to as the arrow of time. In quantum physics, an arrow of time emerges when a sequence of measurements is performed on a system. We introduce quantum control tools that can yield dynamics more consistent with time flowing backward than forward. The control tools are based on the explicit construction of a Hamiltonian that can replicate the stochastic trajectories of a monitored quantum system. Such a Hamiltonian can reverse the effect of monitoring and, via a feedback process, generate trajectories consistent with a reversed arrow of time. It can also be used to simulate the backward-in-time dynamics of an open quantum system. Finally, we design a feedback-driven continuous measurement engine powered by the energy pumped into the system by the monitoring process. We show that the engine can operate under experimentally realizable conditions with feedback delay and finite-efficiency measurements.

Entropy production↗
DOE OSTI2019

Quasi-Stochastic Approximation and Off-Policy Reinforcement Learning: Preprint

The Robbins-Monro stochastic approximation algorithm is a foundation of many algorithmic frameworks for reinforcement learning and often an efficient approach to solving (or approximating the solution to) complex optimal control problems. In many cases, however, practitioners are unable to apply these techniques because of an inherent high variance. This paper aims to provide a general foundation for 'quasi-stochastic approximation,' in which all of the processes under consideration are deterministic, much like quasi-Monte Carlo for variance reduction in simulation. The variance reduction can be substantial, subject to tuning of pertinent parameters in the algorithm. This paper introduces a new coupling argument to establish the optimal rate of convergence provided the gain is sufficiently large. These results are established for linear models and tested also in nonideal settings. A major application of these general results is a new class of reinforcement learning algorithms for deterministic state space models. In this setting, the main contribution is a class of algorithms for approximating the value function for a given policy, using a different policy designed to introduce exploration.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Polynomial Chaos Surrogate Construction for Random Fields with Parametric Uncertainty

Engineering and applied science rely on computational experiments to rigorously study physical systems. The mathematical models used to probe these systems are highly complex, and sampling-intensive studies often require prohibitively many simulations for acceptable accuracy. Surrogate models provide a means of circumventing the high computational expense of sampling such complex models. In particular, polynomial chaos expansions (PCEs) have been successfully used for uncertainty quantification studies of deterministic models where the dominant source of uncertainty is parametric. We discuss an extension to conventional PCE surrogate modeling to enable surrogate construction for stochastic computational models that have intrinsic noise in addition to parametric uncertainty. We develop a PCE surrogate on a joint space of intrinsic and parametric uncertainty, enabled by Rosenblatt transformations, which are evaluated via kernel density estimation of the associated conditional cumulative distributions. Furthermore, we extend the construction to random field data via the Karhunen–Loève expansion. We then take advantage of closed-form solutions for computing PCE Sobol indices to perform a global sensitivity analysis of the model which quantifies the intrinsic noise contribution to the overall model output variance. Additionally, the resulting joint PCE is generative in the sense that it allows generating random realizations at any input parameter setting that are statistically approximately equivalent to realizations from the underlying stochastic model. The method is demonstrated on a chemical catalysis example model and a synthetic example controlled by a parameter that enables a switch from unimodal to bimodal response distributions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Coupled Thermo-Hydro-Mechanical Processes in Fractured Rocks: Some Past Scientific Highlights and Future Research Directions

Abstract Coupled thermo-hydro-mechanical (THM) processes in fractured rocks have been a topic of intense scientific research for more than 30 years. The present paper takes a look into the past and highlights some scientific advances which are of an unusual “out-of-the-box” nature, and then looks forward and discusses possible directions of future research in this interesting field of study. Concerning future research directions, we see a trend from a focus on coupled THM processes in single fractures or a few interacting fractures, to the study of coupled THM behavior in complex fracture network systems where the fractures act collectively giving rise to local stress concentration points and points of large pressure gradients. Three examples of future research directions are presented. First is an effort towards identifying characterizing parameters of a fracture network that play a direct controlling role in major coupled THM phenomena (such as induced seismicity and flow channeling), rather than parameters of stochastic distributions of fractures in the network. The second example of research direction is accounting for the heterogeneity and hierarchy of fractures in a fault or fracture zone which has been associated with major THM events in a number of geo-energy projects. The third example is at the opposite end of the first; here it is recognized that in some cases, the coupled THM processes in fractured rocks may be controlled dominantly by only a few key bridges. Identification, characterization, and evaluation of these key bridges should be one of the important research directions in the coming days.

58 GEOSCIENCES↗