Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Stochastic disks that roll

We study a model of rolling particles subject to stochastic fluctuations, which may be relevant in systems of nano- or microscale particles where rolling is an approximation for strong static friction. We consider the simplest possible nontrivial system: a linear polymer of three disks constrained to remain in contact and immersed in an equilibrium heat bath so the internal angle of the polymer changes due to stochastic fluctuations. We compare two cases: one where the disks can slide relative to each other and the other where they are constrained to roll, like gears. Starting from the Langevin equations with arbitrary linear velocity constraints, we use formal homogenization theory to derive the overdamped equations that describe the process in configuration space only. The resulting dynamics have the formal structure of a Brownian motion on a Riemannian or sub-Riemannian manifold, depending on if the velocity constraints are holonomic or nonholonomic. We use this to compute the trimer's equilibrium distribution with and without the rolling constraints. Surprisingly, the two distributions are different. We suggest two possible interpretations of this result: either (i) dry friction (or other dissipative, nonequilibrium forces) changes basic thermodynamic quantities like the free energy of a system, a statement that could be tested experimentally, or (ii) as a lesson in modeling rolling or friction more generally as a velocity constraint when stochastic fluctuations are present. In the latter case, we speculate there could be a “roughness” entropy whose inclusion as an effective force could compensate the constraint and preserve classical Boltzmann statistics. Regardless of the interpretation, our calculation shows the word “rolling” must be used with care when stochastic fluctuations are present.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Numerical analysis of a time discretized method for nonlinear filtering problem with Lévy process observations

Abstract In this paper, we consider a nonlinear filtering model with observations driven by correlated Wiener processes and point processes. We first derive a Zakai equation whose solution is an unnormalized probability density function of the filter solution. Then, we apply a splitting-up technique to decompose the Zakai equation into three stochastic differential equations, based on which we construct a splitting-up approximate solution and prove its half-order convergence. Furthermore, we apply a finite difference method to construct a time semi-discrete approximate solution to the splitting-up system and prove its half-order convergence to the exact solution of the Zakai equation. Finally, we present some numerical experiments to demonstrate the theoretical analysis.

Mathematics↗

Continuous joint measurement and entanglement of qubits in remote cavities

We present a first-principles theoretical analysis of the entanglement of two superconducting qubits in spatially separated microwave cavities by a sequential (cascaded) probe of the two cavities with a coherent mode, that provides a full characterization of both the continuous measurement induced dynamics and the entanglement generation. We use the SLH formalism to derive the full quantum master equation for the coupled qubits and cavities system, within the rotating wave and dispersive approximations, and conditioned equations for the cavity fields. We then develop effective stochastic master equations for the dynamics of the qubit system in both a polaronic reference frame and a reduced representation within the laboratory frame. We compare simulations with and analyze tradeoffs between these two representations, including the onset of a non-Markovian regime for simulations in the reduced representation. We provide conditions for ensuring persistence of entanglement and show that using shaped pulses enables these conditions to be met at all times under general experimental conditions. The resulting entanglement is shown to be robust with respect to measurement imperfections and loss channels. Here, we also study the effects of qubit driving and relaxation dynamics during a weak measurement, as a prelude to modeling measurement-based feedback control in this cascaded system.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

maestro

MÆSTRO stands for Multi-fidelity Adaptive Ensemble Stochastic Trust Region Optimization and it is a plug n play derivate fee stochastic optimization solver. The problem being considered in MÆSTRO involves fitting Monte Carlo simulations that describe complex phenomena to experiments. This is done by finding parameters of the resource intensive and noisy simulation that yield the least squares objective function value to the noisy experimental data. This problem is solved using a stochastic trust-region optimization algorithm where in each iteration, a local approximation of the simulation signal and of the simulation noise is constructed over data, which is obtained by running the simulation at strategically placed design points within the trust-region around the current iterate. Then the simulation components of the objective are replaced by their approximations and this analytical and closed-form optimization problem is solved to find the next iterate within the trust-region. Then the trust region is moved and the iterations continue until a satisfactory convergence criteria is met.

KRISHNAMOORTHY, MOHAN↗

A Eulerian-Lagrangian Model to Simulate Two-Phase/Particulate Flows

Figure 1 shows a snapshot of liquid fuel spray coming out of an injector nozzle in a realistic gas-turbine combustor. Here the spray atomization was simulated using a stochastic secondary breakup model (Apte et al. 2003a) with point-particle approximation for the droplets. Very close to the injector, it is observed that the spray density is large and the droplets cannot be treated as point-particles. The volume displaced by the liquid in this region is significant and can alter the gas-phase ow and spray evolution. In order to address this issue, one can compute the dense spray regime by an Eulerian-Lagrangian technique using advanced interface tracking/level-set methods (Sussman et al. 1994; Tryggvason et al. 2001; Herrmann 2003). This, however, is computationally intensive and may not be viable in realistic complex configurations. We therefore plan to develop a methodology based on Eulerian-Lagrangian technique which will allow us to capture the essential features of primary atomization using models to capture interactions between the fluid and droplets and which can be directly applied to the standard atomization models used in practice. The numerical scheme for unstructured grids developed by Mahesh et al. (2003) for incompressible flows is modified to take into account the droplet volume fraction. The numerical framework is directly applicable to realistic combustor geometries. Our main objectives in this work are: Develop a numerical formulation based on Eulerian-Lagrangian techniques with models for interaction terms between the fluid and particles to capture the Kelvin- Helmholtz type instabilities observed during primary atomization. Validate this technique for various two-phase and particulate flows. Assess its applicability to capture primary atomization of liquid jets in conjunction with secondary atomization models.

Apte, S. V.↗

VERA neutronics high-fidelity benchmark for a modern PWR core design

Nearly 20 years since the origin of the infamous 'Kord Smith Challenge', and after 10 years and hundreds of millions of dollars invested by the US Department of Energy into the development of the Virtual Environment for Reactor Applications (VERA), the capability to accurately simulate a modern pressurized water reactor (PWR) fuel cycle at the fuel rod level with high-fidelity Monte Carlo (MC) stochastic transport methods still evades us. The deterministic methods in VERA make approximations that allow it to be successfully benchmarked against measured data from hundreds of PWR fuel cycles, but none of these benchmarks provided information at the local fuel rod level or allowed quantification of these approximations' impact for modern PWR reload designs. Using MPACT to establish the estimated isotopic distributions and thermal hydraulic conditions in a recent and challenging reactor design, a 2D quarter-core benchmark problem was established and solved consistently with both MPACT, the 51-energy group deterministic transport solver in VERA, and Shift, the continuous-energy MC transport solver in VERA. Impacts of energy groups, ray spacing, and scattering treatment were evaluated. Though MPACT has been previously shown to perform well compared to MC methods for initial Cycle 1 cores with only fresh fuel, this is the first benchmark of MPACT for a challenging modern reload core with depleted fuel and burnable absorbers. This work establishes additional credibility for the methods in MPACT and highlights the efficiency of these methods relative to those in use by MC-based tools. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Measurement and feedback-driven adaptive dynamics in the classical and quantum kicked top

In classical dynamical systems, stochastic feedback can stabilize otherwise unstable periodic orbits, giving rise to distinct controlled and uncontrolled phases as the rate of control application is varied. In this work, we apply these control protocols in classical, semiclassical, and quantum regimes to the kicked top, a paradigmatic model of quantum chaos. The quantum kicked top, modeled as the dynamics of a spin-S object, naturally interpolates between these regimes with the spin size S acting as an effective Planck constant. We show that the dynamics of the kicked top in classical, semiclassical, and fully quantum limits can all be controlled using stochastic feedback protocols. Comparing the full quantum dynamics to a truncated Wigner approximation that captures quantum noise but neglects interference beyond the Ehrenfest time, we find that low-moment observables are largely accounted for semiclassically, while the remaining discrepancy in higher moments is consistent with contributions from interference and possibly nonlinearities in rare trajectories that explore the compact phase space. We also find rapid purification in the numerics studied for all rates of control considered, suggesting that control quenches the top's ability to encode a qubit of quantum information even in the uncontrolled phase.

Prasad, Mahaveer [Tata Inst.; Singapore U. Tech. D↗

Deep Learning Approaches to Surrogates for Solving the Diffusion Equation for Mechanistic Real-World Simulations

In many mechanistic medical, biological, physical, and engineered spatiotemporal dynamic models the numerical solution of partial differential equations (PDEs), especially for diffusion, fluid flow and mechanical relaxation, can make simulations impractically slow. Biological models of tissues and organs often require the simultaneous calculation of the spatial variation of concentration of dozens of diffusing chemical species. One clinical example where rapid calculation of a diffusing field is of use is the estimation of oxygen gradients in the retina, based on imaging of the retinal vasculature, to guide surgical interventions in diabetic retinopathy. Furthermore, the ability to predict blood perfusion and oxygenation may one day guide clinical interventions in diverse settings, i.e., from stent placement in treating heart disease to BOLD fMRI interpretation in evaluating cognitive function (Xie et al., 2019; Lee et al., 2020). Since the quasi-steady-state solutions required for fast-diffusing chemical species like oxygen are particularly computationally costly, we consider the use of a neural network to provide an approximate solution to the steady-state diffusion equation. Machine learning surrogates, neural networks trained to provide approximate solutions to such complicated numerical problems, can often provide speed-ups of several orders of magnitude compared to direct calculation. Surrogates of PDEs could enable use of larger and more detailed models than are possible with direct calculation and can make including such simulations in real-time or near-real time workflows practical. Creating a surrogate requires running the direct calculation tens of thousands of times to generate training data and then training the neural network, both of which are computationally expensive. Often the practical applications of such models require thousands to millions of replica simulations, for example for parameter identification and uncertainty quantification, each of which gains speed from surrogate use and rapidly recovers the up-front costs of surrogate generation. We use a Convolutional Neural Network to approximate the stationary solution to the diffusion equation in the case of two equal-diameter, circular, constant-value sources located at random positions in a two-dimensional square domain with absorbing boundary conditions. Such a configuration caricatures the chemical concentration field of a fast-diffusing species like oxygen in a tissue with two parallel blood vessels in a cross section perpendicular to the two blood vessels. To improve convergence during training, we apply a training approach that uses roll-back to reject stochastic changes to the network that increase the loss function. The trained neural network approximation is about 1000 times faster than the direct calculation for individual replicas. Because different applications will have different criteria for acceptable approximation accuracy, we discuss a variety of loss functions and accuracy estimators that can help select the best network for a particular application. We briefly discuss some of the issues we encountered with overfitting, mismapping of the field values and the geometrical conditions that lead to large absolute and relative errors in the approximate solution.

60 APPLIED LIFE SCIENCES↗

Solving the master equation without kinetic Monte Carlo: Tensor train approximations for a CO oxidation model

In multiscale modeling of heterogeneous catalytic processes, one crucial point is the solution of a Markovian master equation describing the stochastic reaction kinetics. Usually, this is too high-dimensional to be solved with standard numerical techniques and one has to rely on sampling approaches based on the kinetic Monte Carlo method. In this study we break the curse of dimensionality for the direct solution of the Markovian master equation by exploiting the Tensor Train Format for this purpose. The performance of the approach is demonstrated on a first principles based, reduced model for the CO oxidation on the RuO{sub 2}(110) surface. We investigate the complexity for increasing system size and for various reaction conditions. The advantage over the stochastic simulation approach is illustrated by a problem with increased stiffness.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Quantum theory of open systems based on stochastic differential equations of generalized Langevin (non-Wiener) type

It is shown that the effective Hamiltonian representation, as it is formulated in author's papers, serves as a basis for distinguishing, in a broadband environment of an open quantum system, independent noise sources that determine, in terms of the stationary quantum Wiener and Poisson processes in the Markov approximation, the effective Hamiltonian and the equation for the evolution operator of the open system and its environment. General stochastic differential equations of generalized Langevin (non-Wiener) type for the evolution operator and the kinetic equation for the density matrix of an open system are obtained, which allow one to analyze the dynamics of a wide class of localized open systems in the Markov approximation. The main distinctive features of the dynamics of open quantum systems described in this way are the stabilization of excited states with respect to collective processes and an additional frequency shift of the spectrum of the open system. As an illustration of the general approach developed, the photon dynamics in a single-mode cavity without losses on the mirrors is considered, which contains identical intracavity atoms coupled to the external vacuum electromagnetic field. For some atomic densities, the photons of the cavity mode are 'locked' inside the cavity, thus exhibiting a new phenomenon of radiation trapping and non-Wiener dynamics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Linearly Adjustable International Portfolios

We present an approach to multi-stage international portfolio optimization based on the imposition of a linear structure on the recourse decisions. Multiperiod decision problems are traditionally formulated as stochastic programs. Scenario tree based solutions however can become intractable as the number of stages increases. By restricting the space of decision policies to linear rules, we obtain a conservative tractable approximation to the original problem. Local asset prices and foreign exchange rates are modelled separately, which allows for a direct measure of their impact on the final portfolio value.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Stochastic tunneling for strongly non-Gaussian inflationary theories

We reconsider the dynamics of stochastic or thermal tunneling in theories like Dirac-Born-Infeld inflation that have non-minimal kinetic terms and, as a result, strongly non-Gaussian perturbations. We first describe a local description of the tunneling process which gives results consistent with the standard Hawking-Moss tunneling. This result is under perturbative control as long as the fluctuation determinant is well approximated by a one-loop integral. We then move to a global description, using the methodology of stochastic inflation and the in-in path integral formalism. This approach shows clearly that the tunneling process becomes strongly coupled whenever the sound speed of the tunneling trajectory departs sufficiently from unity. We argue that these two very different perspectives are nevertheless consistent, and may imply the existence of a simple resummation of the strongly coupled interactions of the field.

79 ASTRONOMY AND ASTROPHYSICS↗

A uniform history for galaxy evolution

Recent observations indicate a remarkable similarity in the properties of evolving galaxies at fixed mass and redshift, prompting us to consider the possibility that most galaxies may evolve with a common history encompassing star formation, quasar accretion, and eventual quiescence. We quantify this by defining a synchronization timescale for galaxies as a function of mass and redshift that characterizes the extent to which different galaxies of a common mass are evolving in the same manner at various cosmic epochs. We measure this synchronization timescale using nine different star-forming galaxy observations from the literature and Sloan Digital Sky Survey quasar observations spanning 0 < z ≲ 6. Surprisingly, this synchronization timescale is a constant, approximately 1.5 Gyr for all combinations of mass and time. We also find that the ratio between the stellar mass of galaxies turning off star formation and black hole mass of turnoff quasars is approximately 30:1, much lower than the 500:1 for quiescent galaxies at low redshift. As a result, we propose a model in which the star-forming 'main sequence', analogous quasar behavior, and other observations form a galactic evolution 'main sequence', in which star formation occurs earliest, followed by supermassive black hole accretion, and feedback between the two are dominated by deterministic rather than stochastic processes.

79 ASTRONOMY AND ASTROPHYSICS↗

ADP-Based Home Energy Management System: A Case Study Using Dynamo: Preprint

This paper explores Home Energy Management System (HEMS) algorithms to minimize household cost while maintaining comfort when faced with uncertain weather, and demand. Specifically, we consider a HEMS that optimizes forward looking schedules for a home's heating, ventilation, and air conditioning (HVAC); water heater (WH); and electric vehicle (EV) charging while considering uncertainty in outside temperature, hot water usage, and non-controllable load (NCL). We adopt a Dynamic Programming (DP) formulation and utilize the Dynamic programming for Adaptive Modeling and Optimization (DYNAMO) toolkit to implement DP and approximate dynamic programming (ADP) algorithms. Simulation results under a single tariff plan compare the quality of the solution generated by ADP to that of DP, and show significant improvement in computation time while maintaining acceptable solution accuracy.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A solution algorithm for the fluid dynamic equations based on a stochastic model for molecular motion

In this paper, a stochastic model is presented to simulate the flow of gases, which are not in thermodynamic equilibrium, like in rarefied or micro situations. For the interaction of a particle with others, statistical moments of the local ensemble have to be evaluated, but unlike in molecular dynamics simulations or DSMC, no collisions between computational particles are considered. In addition, a novel integration technique allows for time steps independent of the stochastic time scale. The stochastic model represents a Fokker-Planck equation in the kinetic description, which can be viewed as an approximation to the Boltzmann equation. This allows for a rigorous investigation of the relation between the new model and classical fluid and kinetic equations. The fluid dynamic equations of Navier-Stokes and Fourier are fully recovered for small relaxation times, while for larger values the new model extents into the kinetic regime. Numerical studies demonstrate that the stochastic model is consistent with Navier-Stokes in that limit, but also that the results become significantly different, if the conditions for equilibrium are invalid. The application to the Knudsen paradox demonstrates the correctness and relevance of this development, and comparisons with existing kinetic equations and standard solution algorithms reveal its advantages. Moreover, results of a test case with geometrically complex boundaries are presented.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Towards sub-optimal stochastic control of partially observable stochastic systems

A class of multidimensional stochastic control problems with noisy data and bounded controls encountered in aerospace design is examined. The emphasis is on suboptimal design, the optimality being taken in quadratic mean sense. To that effect the problem is viewed as a stochastic version of the Lurie problem known from nonlinear control theory. The main result is a separation theorem (involving a nonlinear Kalman-like filter) suitable for Lurie-type approximations. The theorem allows for discontinuous characteristics. As a byproduct the existence of strong solutions to a class of non-Lipschitzian stochastic differential equations in dimensions is proven.

Ruzicka, G. J.↗

Towards sub-optimal stochastic control of partially observable stochastic systems

The paper deals with a class of multidimensional stochastic control problems with noisy data and bounded controls encountered in aerospace design. The emphasis is on suboptimal design, the optimality being taken in quadratic mean sense. To that effect the problem is viewed as a stochastic version of the Lurie problem known from nonlinear control theory. The main result is a separation theorem (involving a nonlinear Kalman-like filter) suitable for Lurie-type approximations. The theorem allows for discontinuous characteristics. As a byproduct the existence of strong solutions to a class of non-Lipschitzian stochastic differential equations in n dimensions is proved.

Ruzicka, G. J.↗

Optimization under uncertainty of a hybrid waste tire and natural gas feedstock flexible polygeneration system using a decomposition algorithm

Market uncertainties motivate the development of flexible polygeneration systems that are able to adjust operating conditions to favor production of the most profitable product portfolio. However, this operational flexibility comes at the cost of higher capital expenditure. A scenario-based two-stage stochastic nonconvex Mixed-Integer Nonlinear Programming (MINLP) approach lends itself naturally to optimizing these trade-offs. This work studies the optimal design and operation under uncertainty of a hybrid feedstock flexible polygeneration system producing electricity, methanol, dimethyl ether, olefins or liquefied (synthetic) natural gas. A recently developed C++ based software framework (named GOSSIP) is used for modeling the optimization problem as well as its efficient solution using the Nonconvex Generalized Benders Decomposition (NGBD) algorithm. Two different cases are studied: The first uses estimates of the means and variances of the uncertain parameters from historical data, whereas the second assesses the impact of increased uncertain parameter volatility. The value of implementing flexible designs characterized by the value of the stochastic solution (VSS) is in the range of 260–405 M$ for a scale of approximately 893 MW of thermal input. Increased price volatility around the same mean results in higher expected net present value and VSS as operational flexibility allows for asymmetric exploitation of price peaks.

42 ENGINEERING↗