Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Data-Driven Selection of Tessellation Models Describing Polycrystalline Microstructures

Tessellation models have proven to be useful for the geometric description of grain microstructures in polycrystalline materials. With the use of a suitable tessellation model, the complex morphology of grains can be represented by a small number of parameters assigned to each grain, which not only entails a significant reduction in complexity, but also facilitates the investigation of certain geometric features of the microstructure. However, for a given set of microstructural data, the choice of a particular geometric model is traditionally based on researcher intuition. The model should provide a sufficiently good approximation to the data, while keeping the number of parameters small. In this paper, we discuss general aspects of the process of model selection and suggest several criteria for selecting an appropriate candidate from a certain set of tessellation models. The choice of candidate represents a trade-off between accuracy and complexity of the model. Here, the selected model is used solely to approximate given data samples, but it also provides guidance for developing stochastic tessellation models and generating virtual microstructures. Model fitting is carried out by simulated annealing, applied in a consistent manner to twelve different tessellation models.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Multistart algorithm for identifying all optima of nonconvex stochastic functions

Here, we propose a multistart algorithm to identify all local minima of a constrained, nonconvex stochastic optimization problem. The algorithm uniformly samples points in the domain and then starts a local stochastic optimization run from any point that is the "probabilistically best" point in its neighborhood. Under certain conditions, our algorithm is shown to asymptotically identify all local optima with high probability; this holds even though our algorithm is shown to almost surely start only finitely many local stochastic optimization runs. We demonstrate the performance of an implementation of our algorithm on nonconvex stochastic optimization problems, including identifying optimal variational parameters for the quantum approximate optimization algorithm.

97 MATHEMATICS AND COMPUTING↗

Statistics of avalanches in the self-organized criticality state of a Josephson junction

Magnetic flux avalanches in Josephson junctions that include superconductor-insulator-superconductor (SIS) tunnel junctions and are magnetized at temperatures lower than approximately 5 K have been studied in detail. Avalanches are of stochastic character and appear when the magnetic field penetration depth {lambda} into a junction becomes equal to the length a of the Josephson junction with a decrease in the temperature. The statistical properties of such avalanches are presented. The size distribution of the avalanches is a power law with a negative noninteger exponent about unity, indicating the self-organized criticality state. The self-organized criticality state is not observed in Josephson junctions with a superconductor-normal metal-superconductor (SNS) junction.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Tensor Network Quantum Virtual Machine for Simulating Quantum Circuits at Exascale

The numerical simulation of quantum circuits is an indispensable tool for development, verification, and validation of hybrid quantum-classical algorithms intended for near-term quantum co-processors. The emergence of exascale high-performance computing (HPC) platforms presents new opportunities for pushing the boundaries of quantum circuit simulation. Here, we present a modernized version of the Tensor Network Quantum Virtual Machine (TNQVM) that serves as the quantum circuit simulation backend in the eXtreme-scale ACCelerator (XACC) framework. The new version is based on the scalable tensor network processing library ExaTN (Exascale Tensor Networks). It provides multiple configurable quantum circuit simulators that perform either an exact quantum circuit simulation via the full tensor network contraction or an approximate simulation via a suitably chosen tensor factorization scheme. Upon necessity, stochastic noise modeling from real quantum processors is incorporated into the simulations by modeling quantum channels with Kraus tensors. By combining the portable XACC quantum programming frontend and the scalable ExaTN numerical processing backend, we introduce an end-to-end virtual quantum development environment that can scale from laptops to future exascale platforms. We report initial benchmarks of our framework, which include a demonstration of the distributed execution, incorporation of quantum decoherence models, and simulation of the random quantum circuits used for the certification of quantum supremacy on Google’s Sycamore superconducting architecture.

Nguyen, Thien↗

Hybrid stochastic simulation of reaction-diffusion systems with slow and fast dynamics

In this paper, we present a novel hybrid method to simulate discrete stochastic reaction-diffusion models arising in biochemical signaling pathways. We study moderately stiff systems, for which we can partition each reaction or diffusion channel into either a slow or fast subset, based on its propensity. Numerical approaches missing this distinction are often limited with respect to computational run time or approximation quality. We design an approximate scheme that remedies these pitfalls by using a new blending strategy of the well-established inhomogeneous stochastic simulation algorithm and the tau-leaping simulation method. The advantages of our hybrid simulation algorithm are demonstrated on three benchmarking systems, with special focus on approximation accuracy and efficiency.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Variance-Reduced Accelerated First-Order Methods: Central Limit Theorems and Confidence Statements

In this paper, we consider a strongly convex stochastic optimization problem and propose three classes of variable sample-size stochastic first-order methods: (i) the standard stochastic gradient descent method, (ii) its accelerated variant, and (iii) the stochastic heavy-ball method. In each scheme, the exact gradients are approximated by averaging across an increasing batch size of sampled gradients. We prove that when the sample size increases at a geometric rate, the generated estimates converge in mean to the optimal solution at an analogous geometric rate for schemes (i)–(iii). Based on this result, we provide central limit statements, whereby it is shown that the rescaled estimation errors converge in distribution to a normal distribution with the associated covariance matrix dependent on the Hessian matrix, the covariance of the gradient noise, and the step length. If the sample size increases at a polynomial rate, we show that the estimation errors decay at a corresponding polynomial rate and establish the associated central limit theorems (CLTs). Under certain conditions, we discuss how both the algorithms and the associated limit theorems may be extended to constrained and nonsmooth regimes. As a result, we provide an avenue to construct confidence regions for the optimal solution based on the established CLTs and test the theoretical findings on a stochastic parameter estimation problem.

Lei, Jinlong↗

Suppression of phase mixing in drift-kinetic plasma turbulence

Transfer of free energy from large to small velocity-space scales by phase mixing leads to Landau damping in a linear plasma. In a turbulent drift-kinetic plasma, this transfer is statistically nearly canceled by an inverse transfer from small to large velocity-space scales due to “anti-phase-mixing” modes excited by a stochastic form of plasma echo. Fluid moments (density, velocity, and temperature) are thus approximately energetically isolated from the higher moments of the distribution function, so phase mixing is ineffective as a dissipation mechanism when the plasma collisionality is small.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Robustness of Quadratic Hedging Strategies in Finance via Backward Stochastic Differential Equations with Jumps

We consider a backward stochastic differential equation with jumps (BSDEJ) which is driven by a Brownian motion and a Poisson random measure. We present two candidate-approximations to this BSDEJ and we prove that the solution of each candidate-approximation converges to the solution of the original BSDEJ in a space which we specify. We use this result to investigate in further detail the consequences of the choice of the model to (partial) hedging in incomplete markets in finance. As an application, we consider models in which the small variations in the price dynamics are modeled with a Poisson random measure with infinite activity and models in which these small variations are modeled with a Brownian motion or are cut off. Using the convergence results on BSDEJs, we show that quadratic hedging strategies are robust towards the approximation of the market prices and we derive an estimation of the model risk.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A GENERALIZED STOCHASTIC COLLOCATION APPROACH TO CONSTRAINED OPTIMIZATION FOR RANDOM DATA IDENTIFICATION PROBLEMS

We present a scalable, parallel mechanism for stochastic identification/control for problems constrained by partial differential equations with random input data. Several identification objectives will be discussed that either minimize the expectation of a tracking cost functional or minimize the difference of desired statistical quantities in the appropriate $L^p$ norm, and the distributed parameters/control can both deterministic or stochastic. Given an objective we prove the existence of an optimal solution, establish the validity of the Lagrange multiplier rule and obtain a stochastic optimality system of equations. The modeling process may describe the solution in terms of high dimensional spaces, particularly in the case when the input data (coefficients, forcing terms, boundary conditions, geometry, etc) are affected by a large amount of uncertainty. For higher accuracy, the computer simulation must increase the number of random variables (dimensions), and expend more effort approximating the quantity of interest in each individual dimension. Hence, we introduce a novel stochastic parameter identification algorithm that integrates an adjoint-based deterministic algorithm with the sparse grid stochastic collocation FEM approach. This allows for decoupled, moderately high dimensional, parameterized computations of the stochastic optimality system, where at each collocation point, deterministic analysis and techniques can be utilized. The advantage of our approach is that it allows for the optimal identification of statistical moments (mean value, variance, covariance, etc.) or even the whole probability distribution of the input random fields, given the probability distribution of some responses of the system (quantities of physical interest). Our rigorously derived error estimates, for the fully discrete problems, will be described and used to compare the efficiency of the method with several other techniques. Numerical examples illustrate the theoretical results and demonstrate the distinctions between the various stochastic identification objectives.

Webster, Clayton G↗

Bias-Variance Trade-Off in Physics-Informed Neural Networks with Randomized Smoothing for High-Dimensional PDEs

Physics-Informed Neural Networks (PINNs) have triggered a paradigm shift in scientific computing, leveraging mesh-free properties and robust approximation capabilities. While proving effective for low-dimensional partial differential equations (PDEs), the computational cost of PINNs remains a hurdle in high-dimensional scenarios. This is particularly pronounced when computing high-order and high-dimensional derivatives in the physics-informed loss. Randomized Smoothing PINN (RS-PINN) introduces Gaussian noise for stochastic smoothing of the original neural net model, enabling the use of Monte Carlo methods for derivative approximation, which eliminates the need for costly automatic differentiation. Despite its computational efficiency, especially in the approximation of high-dimensional derivatives, RS-PINN introduces biases in both loss and gradients, negatively impacting convergence, especially when coupled with stochastic gradient descent (SGD) algorithms. We present a comprehensive analysis of biases in RS-PINN, attributing them to the nonlinearity of the Mean Squared Error (MSE) loss as well as the intrinsic nonlinearity of the PDE itself. We propose tailored bias correction techniques, delineating their application based on the order of PDE nonlinearity. The derivation of an unbiased RS-PINN allows for a detailed examination of its advantages and disadvantages compared to the biased version. Specifically, the biased version has a lower variance and runs faster than the unbiased version, but it is less accurate due to the bias. To optimize the bias-variance trade-off, we combine the two approaches in a hybrid method that balances the rapid convergence of the biased version with the high accuracy of the unbiased version. In addition to methodological contributions, we present an enhanced implementation of RS-PINN. Extensive experiments on diverse high-dimensional PDEs, including Fokker-Planck, Hamilton-Jacobi-Bellman (HJB), viscous Burgers’, Allen-Cahn, and Sine-Gordon equations, illustrate the bias-variance trade-off and highlight the effectiveness of the hybrid RS-PINN. Empirical guidelines are provided for selecting biased, unbiased, or hybrid versions, depending on the dimensionality and nonlinearity of the specific PDE problem.

97 MATHEMATICS AND COMPUTING↗

Comprehensive uncertainty quantification (UQ) for full engineering models by solving probability density function (PDF) equation

This report details a new method for propagating parameter uncertainty (forward uncertainty quantification) in partial differential equations (PDE) based computational mechanics applications. The method provides full-field quantities of interest by solving for the joint probability density function (PDF) equations which are implied by the PDEs with uncertain parameters. Full-field uncertainty quantification enables the design of complex systems where quantities of interest, such as failure points, are not known apriori. The method, motivated by the well-known probability density function (PDF) propagation method of turbulence modeling, uses an ensemble of solutions to provide the joint PDF of desired quantities at every point in the domain. A small subset of the ensemble is computed exactly, and the remainder of the samples are computed with approximation of the driving (dynamics) term of the PDEs based on those exact solutions. Although the proposed method has commonalities with traditional interpolatory stochastic collocation methods applied directly to quantities of interest, it is distinct and exploits the parameter dependence and smoothness of the dynamics term of the governing PDEs. The efficacy of the method is demonstrated by applying it to two target problems: solid mechanics explicit dynamics with uncertain material model parameters, and reacting hypersonic fluid mechanics with uncertain chemical kinetic rate parameters. A minimally invasive implementation of the method for representative codes SPARC (reacting hypersonics) and NimbleSM (finite- element solid mechanics) and associated software details are described. For solid mechanics demonstration problems the method shows order of magnitudes improvement in accuracy over traditional stochastic collocation. For the reacting hypersonics problem, the method is implemented as a streamline integration and results show very good accuracy for the approximate sample solutions of re-entry flow past the Apollo capsule geometry at Mach 30.

42 ENGINEERING↗

Test particle study of ion transport in drift type turbulence

Ion transport regimes in drift type turbulence are determined in the frame of a realistic model for the turbulence spectrum based on numerical simulations. The model includes the drift of the potential with the effective diamagnetic velocity, turbulence anisotropy, and dominant waves. The effects of the zonal flow modes are also analyzed. A semi-analytical method that is able to describe trajectory stochastic trapping or eddying is used for obtaining the transport coefficients as function of the parameters of the turbulence. Analytical approximations of the transport coefficients are derived from the results. They show the transition from Bohm to gyro-Bohm scaling as plasma size increases in very good agreement with the numerical simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Multi-scenario modelling of uncertainty in stochastic chemical systems

Uncertainty analysis has not been well studied at the molecular scale, despite extensive knowledge of uncertainty in macroscale systems. The ability to predict the effect of uncertainty allows for robust control of small scale systems such as nanoreactors, surface reactions, and gene toggle switches. However, it is difficult to model uncertainty in such chemical systems as they are stochastic in nature, and require a large computational cost. To address this issue, a new model of uncertainty propagation in stochastic chemical systems, based on the Chemical Master Equation, is proposed in the present study. The uncertain solution is approximated by a composite state comprised of the averaged effect of samples from the uncertain parameter distributions. This model is then used to study the effect of uncertainty on an isomerization system and a two gene regulation network called a repressilator. The results of this model show that uncertainty in stochastic systems is dependent on both the uncertain distribution, and the system under investigation. -- Highlights: •A method to model uncertainty on stochastic systems was developed. •The method is based on the Chemical Master Equation. •Uncertainty in an isomerization reaction and a gene regulation network was modelled. •Effects were significant and dependent on the uncertain input and reaction system. •The model was computationally more efficient than Kinetic Monte Carlo.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

EFFECTS OF NON-ISOTROPIC SCATTERING, MAGNETIC HELICITY, AND ADIABATIC FOCUSING ON DIFFUSIVE TRANSPORT OF SOLAR ENERGETIC PARTICLES

Transport of solar energetic particles in interplanetary space is analyzed. A new systematic derivation of the diffusion approximation is given, which incorporates the effects of non-isotropic scattering, magnetic helicity, and adiabatic focusing in a non-uniform large-scale magnetic field. The derivation is based on a system of stochastic differential equations, equivalent to the Fokker-Planck equation, and the new method is a generalization of the Smoluchowski approximation in the theory of the Brownian motion. Simple, physically transparent expressions for the transport coefficients are derived. Different results of earlier treatments of the problem are related to the assumptions regarding the evolving particle distribution.

79 ASTRONOMY AND ASTROPHYSICS↗

Exact and approximate unitary 2-designs and their application to fidelity estimation

We develop the concept of a unitary t-design as a means of expressing operationally useful subsets of the stochastic properties of the uniform (Haar) measure on the unitary group U(2{sup n}) on n qubits. In particular, sets of unitaries forming 2-designs have wide applicability to quantum information protocols. We devise an O(n)-size in-place circuit construction for an approximate unitary 2-design. We then show that this can be used to construct an efficient protocol for experimentally characterizing the fidelity of a quantum process on n qubits with quantum circuits of size O(n) without requiring any ancilla qubits, thereby improving upon previous approaches.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A model and variance reduction method for computing statistical outputs of stochastic elliptic partial differential equations

We present a model and variance reduction method for the fast and reliable computation of statistical outputs of stochastic elliptic partial differential equations. Our method consists of three main ingredients: (1) the hybridizable discontinuous Galerkin (HDG) discretization of elliptic partial differential equations (PDEs), which allows us to obtain high-order accurate solutions of the governing PDE; (2) the reduced basis method for a new HDG discretization of the underlying PDE to enable real-time solution of the parameterized PDE in the presence of stochastic parameters; and (3) a multilevel variance reduction method that exploits the statistical correlation among the different reduced basis approximations and the high-fidelity HDG discretization to accelerate the convergence of the Monte Carlo simulations. The multilevel variance reduction method provides efficient computation of the statistical outputs by shifting most of the computational burden from the high-fidelity HDG approximation to the reduced basis approximations. Furthermore, we develop a posteriori error estimates for our approximations of the statistical outputs. Based on these error estimates, we propose an algorithm for optimally choosing both the dimensions of the reduced basis approximations and the sizes of Monte Carlo samples to achieve a given error tolerance. We provide numerical examples to demonstrate the performance of the proposed method.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

COMPUTATIONAL MODELING OF IGNITION AND PREMIXED FLAME PROPAGATION INITIATED BY A PRE-CHAMBER TURBULENT JET

Addressing the pressing need for reduced carbon emissions, Turbulent Jet Ignition (TJI) emerges as a promising technology for ultra-lean combustion, offering enhanced thermal efficiencies and minimized cyclic variability in spark-ignited engines. To facilitate rapid testing and integration of this technology, a robust computational modeling framework is crucial. This study delves into the predictive capabilities of computational models for main-chamber ignition and premixed flame propagation using a single-cycle TJI rig measured by Biswas et al. (Applied Thermal Engineering, vol 106, 2016). Employing an open-source compressible flow simulation solver with Large Eddy Simulation (LES) for turbulence modeling, the investigation integrates the conventional Laminar Finite Rate Chemistry (LFRC) model alongside the transported Probability Density Method (PDF) for turbulence-chemistry interaction. A fully-consistent Eulerian Monte-Carlo Fields (EMCF) method is utilized to approximate the transported PDF, while Interaction by Exchange with Mean is employed to close micro-mixing terms in stochastic differential equations. A reduced chemical reaction mechanism with 21 species and 84 reactions (DRM-19) is used for solving chemical kinetics, and a double Gaussian energy deposition model is used to approximate the spark ignition in the pre-chamber. An unstructured O-grid mesh with 0.3 million cells in the prechamber and 1 million cells in the main chamber is employed. Results are divided into two phases: pre-chamber initialization and full TJI simulations. Validation of the predicted pre-chamber flame propagation and the lean ignition in the main-chamber is carried out by using available experimental data. Under quiescent conditions, both the LFRC and transported PDF methods largely underestimate the flame speed and subsequent pressure growth in the pre-chamber. A linear momentum forcing technique is applied to investigate the impact of initial turbulence in the pre-chamber, demonstrating a notable influence on flame propagation. Fine-tuning of the forcing coefficient reproduces the sudden pressure growth observed in the experiment. The experimentally validated pre-chamber simulation serves as the initial condition for the full TJI simulations. It is found that the LFRC model fails to predict lean-ignition in the main-chamber, resulting in a misfiring event. Incorporation of turbulence-chemistry interaction using the transported PDF method substantially improves the prediction of the ignition event in the main-chamber, achieving fair qualitative agreement and quantitative validation of combustion parameters within ±10% of the reported experimental data. The rich simulation results consisting of a full set of statistical description of the thermo-chemical states enable us to gain deep insights into the ignition mechanisms in the main chamber, which is limited when done experimentally. A novel dual ignition phenomenon is revealed in the TJI rig for the first time. Initially, a primary ignition kernel is formed at a downstream location which eventually detaches from the main jet. As the jet momentum decreases, a secondary ignition event follows, this time at a more upstream location which eventually combines with the primary ignition kernel to form a single connected flame front. Investigation of these ignition sequences in chemical composition space reveal distinct differences between the two. The primary ignition event in the main-chamber is followed by a large concentration of active radicals from the pre-chamber jet, accelerating the chain-branching steps, characterizing what has been referred to as flame ignition. In contrast, the secondary ignition occurs in the absence of active radicals in the pre-chamber jet, hence characterized as jet ignition. Further analysis of the effect of pre-chamber jet characteristics on lean ignition in the main-chamber is conducted by setting up cases with different initial pressure ratios (por) between the two chambers, a non-dimensional parameter, ranging from 1.2 to 3.2. As the initial pressure ratio increases, jet momentum increases, with dual ignition observed in cases above por= 2.2. Case with por= 3.2 lead to misfiring. The effect of ignition sequence on global combustion characteristics of TJI is analyzed. Dual ignition events lead to non-monotonicity in combustion characteristics such as global reaction progress variable, flame penetration, and global heat release rate. In dual ignition events, although the rate of fuel consumption and global heat release rate is initially lower, the secondary ignition leads to a sudden increase in flame surface area, resulting in a sudden jump and promoting the overall performance of the TJI system.

42 ENGINEERING↗