SEARCH · Search NASA

Results for “Stochastic Numerical Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

All sources NASA NTRS DOE OSTI

DOE OSTI2016

Variational Bayesian strategies for high-dimensional, stochastic design problems

This paper is concerned with a lesser-studied problem in the context of model-based, uncertainty quantification (UQ), that of optimization/design/control under uncertainty. The solution of such problems is hindered not only by the usual difficulties encountered in UQ tasks (e.g. the high computational cost of each forward simulation, the large number of random variables) but also by the need to solve a nonlinear optimization problem involving large numbers of design variables and potentially constraints. We propose a framework that is suitable for a class of such problems and is based on the idea of recasting them as probabilistic inference tasks. To that end, we propose a Variational Bayesian (VB) formulation and an iterative VB–Expectation-Maximization scheme that is capable of identifying a local maximum as well as a low-dimensional set of directions in the design space, along which, the objective exhibits the largest sensitivity. We demonstrate the validity of the proposed approach in the context of two numerical examples involving thousands of random and design variables. In all cases considered the cost of the computations in terms of calls to the forward model was of the order of 100 or less. The accuracy of the approximations provided is assessed by information-theoretic metrics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2021

Correspondence between neuroevolution and gradient descent

Abstract We show analytically that training a neural network by conditioned stochastic mutation or neuroevolution of its weights is equivalent, in the limit of small mutations, to gradient descent on the loss function in the presence of Gaussian white noise. Averaged over independent realizations of the learning process, neuroevolution is equivalent to gradient descent on the loss function. We use numerical simulation to show that this correspondence can be observed for finite mutations, for shallow and deep neural networks. Our results provide a connection between two families of neural-network training methods that are usually considered to be fundamentally different.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2016

An Improved Stochastic Unit Commitment Formulation to Accommodate Wind Uncertainty

The United States targets to supply 20% of its electricity generation using wind energy by 2030. The expansion of renewable resources, especially weather-based resources such as wind, creates more uncertainty and variability in the operation of the power grid. New methods and approaches in electricity market operations are needed to efficiently manage the continuing increase in variability and uncertainty caused by expanding intermittent wind. This paper proposes an improved stochastic programming approach for incorporating wind uncertainty into energy markets. The proposed formulation improves the two-stage stochastic unit commitment problem by introducing a dynamic decision making approach similar to a multi-stage formulation in the presence of wind power scenarios which are not well represented by a scenario tree. The numerical results present up to 1%-2% decrease in operational costs compared to the two-stage stochastic unit commitment formulation.

Electricity markets↗

DOE OSTI2022

Multi-Fidelity Stochastic Economic Dispatch for Operating Low Carbon Power Grids

Grid operators can address the inherently stochastic nature of renewables by solving a two-stage stochastic programming model that minimizes the cost of dispatch decisions while accounting for the complex grid dynamics. It is common to use a sample average approximation to estimate the expectation of the second stage costs in this model. However, the large sample count needed for numerical accuracy makes effective modeling large-scale electric grids computationally intractable. We introduce a control variate multi-fidelity estimator for the second-stage recourse that enables high quality dispatch decisions in real-time with a reduced computational burden. We obtain a hierarchy of model fidelities by linearizing the AC power flow system representation to DC power flow, and by relaxing transmission and voltage network constraints. We evaluate the performance of our proposed method on a synthetic grid with 73 buses against a deterministic baseline with persistence forecast and a high-fidelity reference. Our analysis shows a computational speed-up of 7.62x with a minimal loss in accuracy. The multi-fidelity method is well suited to fidelity combinations that use a simplified network topology in their lower fidelity model and is an attractive option for applications where accurate grid modeling needed on a limited computational budget.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2015

Initiation of fission chains during delayed criticality accidents - 14366

We present the simulation of the waiting time probability distribution before a prescribed reaction rate in a delayed supercritical system. The Kolmogorov backward equations for the count number probability distribution taking into account the delayed neutron precursors are solved within the time dependent point model framework. The initiation of fission chains is also studied using analog Monte-Carlo simulations of the prompt neutrons and delayed neutron precursors population. The fission rate is calculated for comparison with deterministic simulations. Numerical results are presented using both deterministic and Monte-Carlo calculations to study the effect of the source strength and reactivity level. (authors)

42 ENGINEERING↗

DOE OSTI2018

Fluctuating hydrodynamics of reactive liquid mixtures

Fluctuating hydrodynamics (FHD) provides a framework for modeling microscopic fluctuations in a manner consistent with statistical mechanics and nonequilibrium thermodynamics. This paper presents an FHD formulation for isothermal reactive incompressible liquid mixtures with stochastic chemistry. Fluctuating multispecies mass diffusion is formulated using a Maxwell-Stefan description without assuming a dilute solution, and momentum dynamics is described by a stochastic Navier-Stokes equation for the fluid velocity. We consider a thermodynamically consistent generalization for the law of mass action for non-dilute mixtures and use it in the chemical master equation (CME) to model reactions as a Poisson process. The FHD approach provides remarkable computational efficiency over traditional reaction-diffusion master equation methods when the number of reactive molecules is large, while also retaining accuracy even when there are as few as ten reactive molecules per hydrodynamic cell. We present a numerical algorithm to solve the coupled FHD and CME equations and validate it on both equilibrium and nonequilibrium problems. We simulate a diffusively driven gravitational instability in the presence of an acid-base neutralization reaction, starting from a perfectly flat interface. We demonstrate that the coupling between velocity and concentration fluctuations dominates the initial growth of the instability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

Simulating Open Quantum Systems Using Hamiltonian Simulations

We present a novel method to simulate the Lindblad equation, drawing on the relationship between Lindblad dynamics, stochastic differential equations, and Hamiltonian simulations. We derive a sequence of unitary dynamics in an enlarged Hilbert space that can approximate the Lindblad dynamics up to an arbitrarily high order. This unitary representation can then be simulated using a quantum circuit that involves only Hamiltonian simulation and tracing out the ancilla qubits. There is no need for additional postselection in measurement outcomes, ensuring a success probability of one at each stage. Our method can be directly generalized to the time-dependent setting. We provide numerical examples that simulate both time-independent and time-dependent Lindbladian dynamics with accuracy up to the third order. Published by the American Physical Society 2024

Ding, Zhiyan (ORCID:000000018863403X)↗

DOE OSTI2014

Two critical issues in Langevin simulation of gas flows

A stochastic algorithm based on the Langevin equation has been recently proposed to simulate rarefied gas flows. Compared with the direct simulation Monte Carlo (DSMC) method, the Langevin method is more efficient in simulating small Knudsen number flows. While it is well-known that the cell sizes and time steps should be smaller than the mean free path and the mean collision time, respectively, in DSMC simulations, the Langevin equation uses a drift term and a diffusion term to describe molecule movements, so no direct molecular collisions have to be modeled. This enables the Langevin simulation to proceed with a much larger time step than that in the DSMC method. Two critical issues in Langevin simulation are addressed in this paper. The first issue is how to reproduce the transport properties as that described by kinetic theory. Transport coefficients predicted by Langevin equation are obtained by using Green-Kubo formulae. The second issue is numerical scheme with boundary conditions. We present two schemes corresponding to small time step and large time step, respectively. For small time step, the scheme is similar to DSMC method as the update of positions and velocities are uncoupled; for large time step, we present an analytical solution of the hitting time, which is the crucial factor for accurate simulation. Velocity-Couette flow, thermal-Couette flow, Rayleigh-Bénard flow and wall-confined problem are simulated by using these two schemes. Our study shows that Langevin simulation is a promising tool to investigate small Knudsen number flows.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2023

On unifying randomized methods for inverse problems

This work unifies the analysis of various randomized methods for solving linear and nonlinear inverse problems with Gaussian priors by framing the problem in a stochastic optimization setting. By doing so, we show that many randomized methods are variants of a sample average approximation (SAA). More importantly, we are able to prove a single theoretical result that guarantees the asymptotic convergence for a variety of randomized methods. Additionally, viewing randomized methods as an SAA enables us to prove, for the first time, a single non-asymptotic error result that holds for randomized methods under consideration. Another important consequence of our unified framework is that it allows us to discover new randomization methods. Here, we present various numerical results for linear, nonlinear, algebraic, and PDE-constrained inverse problems that verify the theoretical convergence results and provide a discussion on the apparently different convergence rates and the behavior for various randomized methods.

42 ENGINEERING↗

DOE OSTI2023

Recent Hydrodynamic Modeling Enhancements in OpenFAST

To improve the hydrodynamic modeling capabilities of the offshore wind design and modeling tool OpenFAST, a restructuring of the HydroDyn hydrodynamics module was undertaken with several new features implemented. The generation of the wave field is now separated from HydroDyn into a new module called SeaState. Unlike previous versions of HydroDyn, which precomputed the wave kinematics at the undisplaced positions of the hydrodynamic nodes, the new SeaState module computes the complete time history of the wave field at the vertices of a user-defined wave grid. During the simulation, the wave kinematics at any point within the grid can be efficiently interpolated, allowing the strip-theory wave loads to be evaluated based on the wave kinematics at the displaced structure position. A phase correction was also implemented for the potential-flow wave-exciting loads to account for large structure displacements. Several wave-stretching methods were implemented for the strip-theory solution along with a wave-load redistribution method that ensures smooth variation of the nodal loads as the nodes of a discrete hydrodynamic mesh enter and exit the water. The load smoothing is included to avoid the excitation of unphysical high-frequency structural vibration during hydroelastic simulations. The MacCamy-Fuchs diffraction correction for the strip-theory solution and the capability to insert a constrained NewWave into extreme stochastic sea states with directional spreading were also added. The present article documents the formulations of the new improvements to HydroDyn with example applications and numerical results.

constrained wave↗

DOE OSTI2022

Recent Hydrodynamic Modeling Enhancements in OpenFAST: Preprint

constrained wave↗

DOE OSTI2019

Data-Consistent Solutions to Stochastic Inverse Problems Using a Probabilistic Multi-Fidelity Method Based on Conditional Densities

In this work, we build upon a recently developed approach for solving stochastic inverse problems based on a combination of measure-theoretic principles and Bayes' rule. We propose a multi-fidelity method to reduce the computational burden of performing uncertainty quantification using high-fidelity models. This approach is based on a Monte Carlo framework for uncertainty quantification that combines information from solvers of various fidelities to obtain statistics on the quantities of interest of the problem. In particular, our goal is to generate samples from a high-fidelity push-forward density at a fraction of the costs of standard Monte Carlo methods, while maintaining flexibility in the number of random model input parameters. Key to this methodology is the construction of a regression model to represent the stochastic mapping between the low- and high-fidelity models, such that most of the computations can be leveraged to the low-fidelity model. To that end, we employ Gaussian process regression and present extensions to multi-level-type hierarchies as well as to the case of multiple quantities of interest. Finally, we demonstrate the feasibility of the framework in several numerical examples.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Process-oriented stochastic perturbations applied to the parametrization of turbulence and shallow convection for ensemble prediction

Weather forecasting nowadays often requires some estimation of uncertainties associated with the output of meteorological models, in order to better inform decision making, especially in the context of intense weather events. Ensemble prediction systems provide such information through sets of possible scenarios which are designed to represent various uncertainty sources, including model uncertainties. A wide variety of methods have been proposed to estimate model uncertainties, among which perturbation methods targeting uncertain processes are a promising research field. Here, we focus on the representation of small-scale variability by process-oriented perturbation schemes applied to two key physical processes, namely turbulence and shallow convection. The perturbations are applied to a single-column version of the convection-permitting AROME model, in three idealized boundary-layer cases. Large-eddy simulations (LESs) of the same cases serve as a reference for the subgrid variability that has to be represented, and the results are also compared to those given by the Stochastically Perturbed Parametrization Tendencies (SPPT) method, which is a method commonly used by weather forecast centres to represent model uncertainty. The spread produced by our process-oriented perturbations of turbulence and shallow convection does not represent all the small-scale variability implied by the LESs for temperature and humidity. However, it is of a similar order of magnitude for the wind, thanks to perturbations generated by the stochastic turbulence scheme. The dispersion is structurally different from what is obtained with SPPT. It is non-negligible in the lower levels, where SPPT perturbations are usually suppressed because of numerical instabilities, indicating a possible complementarity between the schemes.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2014

An ensemble Kalman filter for statistical estimation of physics constrained nonlinear regression models

A central issue in contemporary science is the development of nonlinear data driven statistical–dynamical models for time series of noisy partial observations from nature or a complex model. It has been established recently that ad-hoc quadratic multi-level regression models can have finite-time blow-up of statistical solutions and/or pathological behavior of their invariant measure. Recently, a new class of physics constrained nonlinear regression models were developed to ameliorate this pathological behavior. Here a new finite ensemble Kalman filtering algorithm is developed for estimating the state, the linear and nonlinear model coefficients, the model and the observation noise covariances from available partial noisy observations of the state. Several stringent tests and applications of the method are developed here. In the most complex application, the perfect model has 57 degrees of freedom involving a zonal (east–west) jet, two topographic Rossby waves, and 54 nonlinearly interacting Rossby waves; the perfect model has significant non-Gaussian statistics in the zonal jet with blocked and unblocked regimes and a non-Gaussian skewed distribution due to interaction with the other 56 modes. We only observe the zonal jet contaminated by noise and apply the ensemble filter algorithm for estimation. Numerically, we find that a three dimensional nonlinear stochastic model with one level of memory mimics the statistical effect of the other 56 modes on the zonal jet in an accurate fashion, including the skew non-Gaussian distribution and autocorrelation decay. On the other hand, a similar stochastic model with zero memory levels fails to capture the crucial non-Gaussian behavior of the zonal jet from the perfect 57-mode model.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

An Efficient Numerical Algorithm for Solving Data Driven Feedback Control Problems

The goal of this paper is to solve a class of stochastic optimal control problems numerically, in which the state process is governed by an Itô type stochastic differential equation with control process entering both in the drift and the diffusion, and is observed partially. The optimal control of feedback form is determined based on the available observational data. In this work, we call this type of control problems the data driven feedback control. The computational framework that we introduce to solve such type of problems aims to find the best estimate for the optimal control as a conditional expectation given the observational information. To make our method feasible in providing timely feedback to the controlled system from data, we develop an efficient stochastic optimization algorithm to implement our computational framework.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2014

A flexible method to calculate the distributions of discretization errors in operator-split codes with stochastic noise in problem data

This report investigates a technique to calculate the distributions of discretization errors for a model of advection-diffusion-reaction with stochastic noise in problem data. The focus is on operator-split discretization methods. The error is decomposed into components due to the splitting and due to the discretization within each component. We present a method to estimate the distributions of the total discretization error for a quantity of interest as well as the aforementioned error components. These computations require information about the propagation of uncertainty within and between code modules, for which purpose we use a flexible code framework for uncertainty quantification. Computational examples illustrate that in certain cases the distribution of numerical error can have a significant impact on the code output. Using information about the components of the numerical error, decisions can be made regarding discretization parameters to efficiently reduce the impact of numerical error on the distribution of model outputs.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Stochastic modeling of x-ray superfluorescence

An approach to modeling the dynamics of x-ray amplified spontaneous emission and superfluorescence, the phenomenon of collective x-ray emission initiated by intense pulses of x-ray free-electron lasers, is developed based on stochastic partial differential equations. The equations are derived from first principles, and the relevant approximations, derivation steps, and extensions specific to stimulated x-ray emission are presented. The resulting equations take the form of three-dimensional generalized Maxwell-Bloch equations augmented with noise terms for both field and atomic variables. The derived noise terms possess specific correlation properties that enable the correct reconstruction of spontaneous emission. Consequently, the developed theoretical formalism is universally suitable for describing all stages of stimulated x-ray emission: spontaneous emission, amplified spontaneous emission, and superfluorescence. Here, we present numerical examples that illustrate various properties of the emitted field, including spatiotemporal coherence and spectral-angular and polarization characteristics. We anticipate that the proposed theoretical framework will establish a robust foundation for interpreting measurements in stimulated x-ray emission spectroscopy, modeling x-ray laser oscillators, and describing other experiments leveraging x-ray superfluorescence.

74 ATOMIC AND MOLECULAR PHYSICS↗

DOE OSTI2015

Stochastic Optical Reconstruction Microscopy Imaging of Microtubule Arrays in Intact Arabidopsis thaliana Seedling Roots

Super-resolution fluorescence microscopy has generated tremendous success in revealing detailed subcellular structures in animal cells. However, its application to plant cell biology remains extremely limited due to numerous technical challenges, including the generally high fluorescence background of plant cells and the presence of the cell wall. In the current study, stochastic optical reconstruction microscopy (STORM) imaging of intact Arabidopsis thaliana seedling roots with a spatial resolution of 20–40nm was demonstrated. Using the super-resolution images, the spatial organization of cortical microtubules in different parts of a whole Arabidopsis root tip was analyzed quantitatively, and the results show the dramatic differences in the density and spatial organization of cortical microtubules in cells of different differentiation stages or types. The method developed can be applied to plant cell biological processes, including imaging of additional elements of the cytoskeleton, organelle substructure, and membrane domains.

54 ENVIRONMENTAL SCIENCES↗