Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic approaches”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Deep Neural Network Algorithm for CMC Microstructure Characterization and Variability Quantification

Microstructure characterization and variability quantification are crucial for understanding ceramic matrix composites (CMCs) mechanical behavior and deformation mechanisms across length scales. Traditionally, analyses of the micrographs obtained from microscopy are labor-intensive. However, with the vast improvement in computer vision (CV) and deep learning (DL), an automated algorithm can be designed to extract essential microstructure variability from micrographs which can then be used to construct a statistically representative volume element (SRVE). The DL-based algorithm spans the taxonomy of microstructure analyses, including semantic segmentation of microstructure constituents, secondary phases, matrix/fiber interface, and defects, and quantifying the microstructure variability in terms of probability distributions. In this work, C/SiNC and SiC/SiNC CMCs microstructures are semantically segmented through a deep convolutional neural network, followed by variability quantification through the implementation of a fully connected regression layer, hence forming a deep regression network. The deep regression network operates in a feedforward regime, in which the neuron output signal traverses through the network in a unidirectional manner. The weight tensor associated with each layer is updated through a backpropagation stochastic gradient descent approach. The input gray-scale image obtained through in-house scanning electron microscope and confocal microscope micrographs is augmented through affine transformations to increase the training set size, which is then processed through four strided convolutional layers. This compresses the image resolution by half at each layer while increasing the image depth by applying different filters (image encoding). The class activation maps (CAMs) corresponding to the applied filters highlight the key architectural features and assist with the semantic segmentation of the microstructure.

Hamza, Mohamed H.↗
DOE OSTI2021

Surrogate Modeling For Efficiently Accurately and Conservatively Estimating Measures of Risk

We present a surrogate modeling framework for conservatively estimating measures of risk from limited realizations of an expensive physical experiment or computational simulation. We adopt a probabilistic description of risk that assigns probabilities to consequences associated with an event and use risk measures, which combine objective evidence with the subjective values of decision makers, to quantify anticipated outcomes. Given a set of samples, we construct a surrogate model that produces estimates of risk measures that are always greater than their empirical estimates obtained from the training data. These surrogate models not only limit over-confidence in reliability and safety assessments, but produce estimates of risk measures that converge much faster to the true value than purely sample-based estimates. We first detail the construction of conservative surrogate models that can be tailored to the specific risk preferences of the stakeholder and then present an approach, based upon stochastic orders, for constructing surrogate models that are conservative with respect to families of risk measures. The surrogate models introduce a bias that allows them to conservatively estimate the target risk measures. We provide theoretical results that show that this bias decays at the same rate as the L 2 error in the surrogate model. Our numerical examples confirm that risk-aware surrogate models do indeed over-estimate the target risk measures while converging at the expected rate.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Stochastic hydrodynamics and hydro-kinetics: Similarities and differences

The hydro-kinetic formalism has been used as a complementary approach to solving the Stochastic Differential Equations (SDE) corresponding to noisy hydrodynamics. The hydro-kinetic formalism consists of a deterministic set of relaxation type equations that tracks the evolution of 2-point correlation functions of stochastic hydrodynamic quantities. Hence they are comparatively easier to solve than the SDEs, which are computationally intensive and need to deal with arbitrarily large gradients. This work compares the two approaches for the propagation and diffusion of conserved charge fluctuations in the Bjorken hydrodynamic model. For white noise, the two approaches agree. For colored Catteneo noise, which is causal, the two approaches diverge. This is because white noise only induces two-point correlations, while Catteneo noise also induces higher-order correlations. Furthermore, this difference is quantified from the effects of causal evolution and influence from higher-order correlations induced by the Catteneo noise.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Stochastic parametric skeletal dosimetry model for humans: General approach and application to active marrow exposure from bone-seeking beta-particle emitters

The objective of this study is to develop a skeleton model for assessing active marrow dose from bone-seeking beta-emitting radionuclides. This article explains the modeling methodology which accounts for individual variability of the macro- and microstructure of bone tissue. Bone sites with active hematopoiesis are assessed by dividing them into small segments described by simple geometric shapes. Spongiosa, which fills the segments, is modeled as an isotropic three-dimensional grid (framework) of rod-like trabeculae that “run through” the bone marrow. Randomized multiple framework deformations are simulated by changing the positions of the grid nodes and the thickness of the rods. Model grid parameters are selected in accordance with the parameters of spongiosa microstructures taken from the published papers. Stochastic modeling of radiation transport in heterogeneous media simulating the distribution of bone tissue and marrow in each of the segments is performed by Monte Carlo methods. Model output for the human femur at different ages is provided as an example. The uncertainty of dosimetric characteristics associated with individual variability of bone structure was evaluated. An advantage of this methodology for the calculation of doses absorbed in the marrow from bone-seeking radionuclides is that it does not require additional studies of autopsy material. The biokinetic model results will be used in the future to calculate individual doses to members of a cohort exposed to 89,90 Sr from liquid radioactive waste discharged to the Techa River by the Mayak Production Association in 1949–1956. Further study of these unique cohorts provides an opportunity to gain more in-depth knowledge about the effects of chronic radiation on the hematopoietic system. In addition, the proposed model can be used to assess the doses to active marrow under any other scenarios of 90 Sr and 89 Sr intake to humans.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Stochastic and mixed density functional theory within the projector augmented wave formalism for simulation of warm dense matter

Stochastic density functional theory (DFT) and mixed stochastic-deterministic DFT are burgeoning approaches for the calculation of the equation of state and transport properties in materials under extreme conditions. In the intermediate warm dense matter regime, a state between correlated condensed matter and kinetic plasma, electrons can range from being highly localized around nuclei to delocalized over the whole simulation cell. The plane-wave basis pseudopotential approach is thus the typical tool of choice for modeling such systems at the DFT level. Unfortunately, stochastic DFT methods scale as the square of the maximum plane-wave energy in this basis. To reduce the effect of this scaling and improve the overall description of the electrons within the pseudopotential approximation, we present stochastic and mixed DFT approaches developed and implemented within the projector augmented wave formalism. In conclusion, we compare results between the different DFT approaches for both single-point and molecular dynamics trajectories and present calculations of self-diffusion coefficients of solid density carbon from 1 to 50 eV.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Developing and Testing a Novel Stochastic Ice Microphysics Parameterization for Cloud and Climate Models Using ARM Field Campaign Data (Final Progress Report)

The major goals of this project were: 1) to use field campaign measurements from DOE’s Atmospheric Radiation Measurement (ARM) program to characterize variability of important parameters describing properties of ice particles in the atmosphere; 2) based on this observational analysis, to develop a parameterization scheme for weather and climate models that stochastically varies these parameters, and implement the new scheme into a weather model called the Weather Research and Forecasting model (WRF); 3) to use WRF coupled with the new stochastic scheme to simulate ARM field campaign thunderstorm cases and analyze how accounting for this parameter variability affects the model simulations. This work was performed jointly between the National Center for Atmospheric Research, University of Oklahoma, and University of Utah. To accomplish these goals, we extended an approach previously developed to characterize the variability in the size distribution of ice particles to parameters that are explicitly represented in models (i.e., relationships between ice particle mass and size, and between particle fall velocity and size). Our project was, to our knowledge, the first to apply observationally-constrained estimates of this parameter variability describing mass-size and fall velocity-size in a modeling framework. Our results showed efficacy of the approach, evaluated using ARM observations. Similarly, to our knowledge, work in this project was the first to propose and evaluate in detail a stochastic approach for unresolved turbulent mixing in high-resolution model simulations against detailed, benchmark large eddy simulations and ARM observations. Results showed some promising behavior, particularly with increased mixing and dilution of air in thunderstorm cores with surrounding environmental air, bringing the stochastic simulations closer to the benchmark large eddy simulations; however, results were somewhat degraded using stochastic mixing compared to observations from the AMIE/DYNAMO field campaign. This project also further refined and applied a modeling methodology called “piggybacking” that can robustly separate dynamical and thermodynamic impacts of model changes, and comparison studies of different models based on cases developed from ARM observations. Finally, this project directly supported three graduate students who completed their PhDs as well as a postdoctoral research fellow.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

An Online Approach to Solve the Dynamic Vehicle Routing Problem with Stochastic Trip Requests for Paratransit Services

Many transit agencies operating paratransit and microtransit services have to respond to trip requests that arrive in real-time, which entails solving hard combinatorial and sequential decision-making problems under uncertainty. To avoid decisions that lead to significant inefficiency in the long term, vehicles should be allocated to requests by optimizing a non-myopic utility function or by batching requests together and optimizing a myopic utility function. While the former approach is typically offline, the latter can be performed online. We point out two major issues with such approaches when applied to paratransit services in practice. First, it is difficult to batch paratransit requests together as they are temporally sparse. Second, the environment in which transit agencies operate changes dynamically (e.g., traffic conditions can change over time), causing the estimates that are learned offline to become stale. To address these challenges, we propose a fully online approach to solve the dynamic vehicle routing problem (DVRP) with time windows and stochastic trip requests that is robust to changing environmental dynamics by construction. We focus on scenarios where requests are relatively sparse—our problem is motivated by applications to paratransit services. We formulate DVRP as a Markov decision process and use Monte Carlo tree search to evaluate actions for any given state. Accounting for stochastic requests while optimizing a non-myopic utility function is computationally challenging; indeed, the action space for such a problem is intractably large in practice. To tackle the large action space, we leverage the structure of the problem to design heuristics that can sample promising actions for the tree search. Our experiments using real-world data from our partner agency show that the proposed approach outperforms existing state-of-the-art approaches both in terms of performance and robustness.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Robust verification of stochastic simulation codes

We introduce a robust verification tool for computational codes, which we call Stochastic Robust Extrapolation based Error Quantification (StREEQ). Unlike the prevalent Grid Convergence Index (GCI) [1] method, our approach is suitable for both stochastic and deterministic computational codes and is generalizable to any number of discretization variables. Building on ideas introduced in the Robust Verification [2] approach, we estimate the converged solution and orders of convergence with uncertainty using multiple fits of a discretization error model. In contrast to Robust Verification, we perform these fits to many bootstrap samples yielding a larger set of predictions with smoother statistics. Here, bootstrap resampling is performed on the lack-of-fit errors for deterministic code responses, and directly on the noisy data set for stochastic responses. This approach lends a degree of robustness to the overall results, capable of yielding precise verification results for sufficiently resolved data sets, and appropriately expanding the uncertainty when the data set does not support a precise result. For stochastic responses, a credibility assessment is also performed to give the analyst an indication of the trustworthiness of the results. Furthermore, this approach is suitable for both code and solution verification, and is particularly useful for solution verification of high-consequence simulations..

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Simulating Atmospheric Processes in Earth System Models and Quantifying Uncertainties With Deep Learning Multi‐Member and Stochastic Parameterizations

Abstract Deep learning is a powerful tool to represent subgrid processes in climate models, but many application cases have so far used idealized settings and deterministic approaches. Here, we develop stochastic parameterizations with calibrated uncertainty quantification to learn subgrid convective and turbulent processes and surface radiative fluxes of a superparameterization embedded in an Earth System Model (ESM). We explore three methods to construct stochastic parameterizations: (a) a single Deep Neural Network (DNN) with Monte Carlo Dropout; (b) a multi‐member parameterization; and (c) a Variational Encoder Decoder with latent space perturbation. We show that the multi‐member parameterization improves the representation of convective processes, especially in the planetary boundary layer, compared to individual DNNs. The respective uncertainty quantification illustrates that methods (b) and (c) are advantageous compared to a dropout‐based DNN parameterization regarding the spread of convective processes. Hybrid simulations with our best‐performing multi‐member parameterizations remained challenging and crash within the first days. Therefore, we develop a pragmatic partial coupling strategy relying on the superparameterization for condensate emulation. Partial coupling reduces the computational efficiency of hybrid Earth‐like simulations but enables model stability over 5 months with our multi‐member parameterizations. However, our hybrid simulations exhibit biases in thermodynamic fields and differences in precipitation patterns. Despite this, the multi‐member parameterizations enable improvements in reproducing tropical extreme precipitation compared to a traditional convection parameterization. Despite these challenges, our results indicate the potential of a new generation of multi‐member machine learning parameterizations leveraging uncertainty quantification to improve the representation of stochasticity of subgrid effects.

Behrens, Gunnar [Deutsches Zentrum für Luft‐ und R↗
DOE OSTI2022

Harnessing structural stochasticity in the computational discovery and design of microstructures

This paper presents a deep generative model-based design methodology for tailoring the structural stochasticity of microstructures. Although numerous methods have been established for designing deterministic (periodic) or stochastic microstructures, a systematic design approach that allows the unified treatment of both deterministic and stochastic microstructure design domains has yet to be created. The proposed methodology resolves this issue by learning a unified feature space that embodies diverse structural patterns with continuously varying stochasticity levels. A highly diverse microstructure database is established to incorporate various types of deterministic and stochastic microstructure patterns. A property-aware deep generative model is proposed to learn a unified feature space of the structural characteristics, as well as the relationship between structure features and properties of interest. Autoencoder (AE), Variational Autoencoder (VAE), and Adversarial Autoencoder (AAE) are compared to understand their relative merits in the property-aware learning of the unified feature space. Microstructural designs with tailorable stochasticity and properties are obtained by searching the unified feature space. Multiple design cases are presented to demonstrate the capability of designing microstructures for structural stochasticity and properties. Furthermore, the proposed method is employed to create stochastically graded structures, which manipulate the mechanical behaviors by varying the local stochasticity of the structure.

36 MATERIALS SCIENCE↗
DOE OSTI2021

A Data-Driven Multi-Period Importance Sampling Strategy for Stochastic Economic Dispatch

Power systems with high penetrations of renewable energy (e.g., wind power) require sophisticated approaches to optimize system performance due to uncertainty in short-term system generation capacity. In this paper, we combine a data-driven analog scenario selection method with importance sampling to create a novel scenario construction approach for two-stage stochastic economic dispatch problems with a large number of wind farms on a network. The proposed method produces scenarios with realistic physics by finding high-fidelity analogs that can describe future states of the system. We show how to extend this method to multi-period operations and demonstrate the effectiveness of this technique by simulating economic dispatch operations on a synthetic test system over the course of a week.

data-driven forecasting↗
DOE OSTI2020

Merging of transport theory with the time-dependent Hartree-Fock approach: Multinucleon transfer in U + U collisions

Multinucleon transfer mechanism in the collision of 238 U + 238 U system is investigated at E c.m. = 833 MeV in the framework of the quantal diffusion description based on the stochastic mean-field approach. Double cross sections σ (N, Z ) as a function of the neutron and proton numbers, the cross sections σ (Z ) and σ (A) as a function of the atomic numbers and the mass numbers are calculated for production of the primary fragments. The calculation indicates the 238 U + 238 U system may be located at an unstable equilibrium state at the potential energy surface with a slightly negative curvature along the β stability line on the (N, Z ) plane. Here, this behavior may lead to rather large diffusion along the β stability direction.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

An improved framework for the dynamic likelihood filtering approach to data assimilation

Here, we propose improvements to the Dynamic Likelihood Filter (DLF), a Bayesian data assimilation filtering approach, specifically tailored to wave problems. The DLF approach was developed to address the common challenge in the application of data assimilation to hyperbolic problems in the geosciences and in engineering, where observation systems are sparse in space and time. When these observations have low uncertainties, as compared to model uncertainties, the DLF exploits the inherent nature of information and uncertainties to propagate along characteristics to produce estimates that are phase aware as well as amplitude aware, as would be the case in the traditional data assimilation approach. Along characteristics, the stochastic partial differential equations underlying the linear or nonlinear stochastic dynamics are differential equations. This study focuses on developing the explicit challenges of relating dynamics and uncertainties in the Eulerian and Lagrangian frames via dynamic Gaussian processes. It also implements the approach using the ensemble Kalman filter (EnKF) and compares the DLF approach to the conventional one with respect to wave amplitude and phase estimates in linear and nonlinear wave problems. Numerical comparisons show that the DLF/EnKF outperforms the EnKF estimates, when applied to linear and nonlinear wave problems. This advantage is particularly noticeable when sparse, low uncertainty observations are used.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Multi-element flow-driven spectral chaos (ME-FSC) method for uncertainty quantification of dynamical systems

The flow-driven spectral chaos (FSC) is a recently developed method for tracking and quantifying uncertainties in the long-time response of stochastic dynamical systems using the spectral approach. The method uses a novel concept called enriched stochastic flow maps as a means to construct an evolving finite-dimensional random function space that is both accurate and computationally efficient in time. In this paper, we present a multi-element version of the FSC method (the ME-FSC method for short) to tackle (mainly) those dynamical systems that are inherently discontinuous over the probability space. In ME-FSC, the random domain is partitioned into several elements, and then the problem is solved separately on each random element using the FSC method. Subsequently, results are aggregated to compute the probability moments of interest using the law of total probability. To demonstrate the effectiveness of the ME-FSC method in dealing with discontinuities and long-time integration of stochastic dynamical systems, four representative numerical examples are presented in this paper, including the Van-der-Pol oscillator problem and the Kraichnan-Orszag three-mode problem. Results show that the ME-FSC method is capable of solving problems that have strong nonlinear dependencies over the probability space, both reliably and at low computational cost.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Machine learning–aided real-time detection of keyhole pore generation in laser powder bed fusion

Porosity defects are currently a major factor that hinders the widespread adoption of laser-based metal additive manufacturing technologies. One common porosity occurs when an unstable vapor depression zone (keyhole) forms because of excess laser energy input. With simultaneous high-speed synchrotron x-ray imaging and thermal imaging, coupled with multiphysics simulations, we discovered two types of keyhole oscillation in laser powder bed fusion of Ti-6Al-4V. Amplifying this understanding with machine learning, we developed an approach for detecting the stochastic keyhole porosity generation events with submillisecond temporal resolution and near-perfect prediction rate. Finally, the highly accurate data labeling enabled by operando x-ray imaging allowed us to demonstrate a facile and practical way to adopt our approach in commercial systems.

42 ENGINEERING↗
DOE OSTI2025

Optimization problems governed by systems of PDEs with uncertainties

This paper reviews current theoretical and numerical approaches to optimization problems governed by partial differential equations (PDEs) that depend on random variables or random fields. Such problems arise in many engineering, science, economics and societal decision-making tasks. This paper focuses on problems in which the governing PDEs are parametrized by the random variables/fields, and the decisions are made at the beginning and are not revised once uncertainty is revealed. Examples of such problems are presented to motivate the topic of this paper, and to illustrate the impact of different ways to model uncertainty in the formulations of the optimization problem and their impact on the solution. A linear–quadratic elliptic optimal control problem is used to provide a detailed discussion of the set-up for the risk-neutral optimization problem formulation, study the existence and characterization of its solution, and survey numerical methods for computing it. Different ways to model uncertainty in the PDE-constrained optimization problem are surveyed in an abstract setting, including risk measures, distributionally robust optimization formulations, probabilistic functions and chance constraints, and stochastic orders. Furthermore, approximation-based optimization approaches and stochastic methods for the solution of the large-scale PDE-constrained optimization problems under uncertainty are described. Some possible future research directions are outlined.

Heinkenschloss, Matthias [Rice Univ., Houston, TX ↗
DOE OSTI2024

Determining the N -Representability of a Reduced Density Matrix via Unitary Evolution and Stochastic Sampling

The N-representability problem consists in determining whether, for a given p-body matrix, there exists at least one N-body density matrix from which the p-body matrix can be obtained by contraction, that is, if the given matrix is a p-body reduced density matrix (p-RDM). The knowledge of all necessary and sufficient conditions for a p-body matrix to be N-representable allows the constrained minimization of a many-body Hamiltonian expectation value with respect to the p-body density matrix and, thus, the determination of its exact ground state. However, the number of constraints that complete the N-representability conditions grows exponentially with system size, and hence, the procedure quickly becomes intractable for practical applications. This work introduces a hybrid quantum-stochastic algorithm to effectively replace the N-representability conditions. The algorithm consists of applying to an initial N-body density matrix a sequence of unitary evolution operators constructed from a stochastic process that successively approaches the reduced state of the density matrix on a p-body subsystem, represented by a p-RDM, to a target p-body matrix, potentially a p-RDM. The generators of the evolution operators follow the well-known adaptive derivative-assembled pseudo-Trotter method (ADAPT), while the stochastic component is implemented by using a simulated annealing process. The resulting algorithm is independent of any underlying Hamiltonian, and it can be used to decide whether a given p-body matrix is N-representable, establishing a criterion to determine its quality and correcting it. We apply the proposed hybrid ADAPT algorithm to alleged reduced density matrices from a quantum chemistry electronic Hamiltonian, from the reduced Bardeen–Cooper–Schrieffer model with constant pairing, and from the Heisenberg XXZ spin model. In all cases, the proposed method behaves as expected for 1-RDMs and 2-RDMs, evolving the initial matrices toward different targets.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

A modular methodology for time-domain stochastic seismic wave propagation

Presented here is a modular methodology for time-domain stochastic seismic wave propagation analysis. Presented methodology is designed to analyse uncertain seismic motions as an input, propagating through uncertain material. Traditional approach for uncertain wave propagation relies on models that include deep bedrock, local soil site, and their random process and random field information. Such models can become quite large and computationally intractable. The modular approach proposed herein features two step approach that allows separate consideration of the deep bedrock and local site along with corresponding random field information. In this work, the first step considers an auxiliary stochastic motions problem in the bedrock. Stochastic local site response can then be simulated in a reduced domain within certain depth from the surface. Application of uncertain seismic motions at depth, for local uncertain site response is done using stochastic effective forces developed through the Domain Reduction Method. By using Hermite polynomial chaos expansion to represent the non-Gaussian random field of material parameters and non-stationary random process of seismic motion, the proposed modular methodology is formulated using intrusive stochastic Galerkin approach, as seen in the Stochastic Elastic–Plastic Finite Element Method (SEPFEM). Developed modular methodology is illustrated using a 1-D stochastic seismic wave propagation analysis with three cases, and simulation results are also verified with results from conventional approach.

58 GEOSCIENCES↗