Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Mapping Stochastic Devices to Probabilistic Algorithms

Probabilistic and Bayesian neural networks have long been proposed as a method to incorporate uncertainty about the world (both in training data and operation) into artificial intelligence applications. One approach to making a neural network probabilistic is to leverage a Monte Carlo sampling approach that samples a trained network while incorporating noise. Such sampling approaches for neural networks have not been extensively studied due to the prohibitive requirement of many computationally expensive samples. While the development of future microelectronics platforms that make this sampling more efficient is an attractive option, it has not been immediately clear how to sample a neural network and what the quality of random number generation should be. This research aimed to start addressing these two fundamental questions by examining basic “off the shelf” neural networks can be sampled through a few different mechanisms (including synapse “dropout” and neuron “dropout”) and examine how these sampling approaches can be evaluated both in terms of evaluating algorithm effectiveness and the required quality of random numbers.

97 MATHEMATICS AND COMPUTING↗

Ultrasonic Attenuation Due to Grain Boundary Scattering in Pure Niobium

Experimental confirmation of various grain scattering theories exist but there are still outstanding questions concerning the characterization of microstructure using ultrasound. In this study, high purity niobium serves as a model material devoid of extrinsic scattering centers (e.g., voids, precipitates, second phase particles etc.) A range of microstructures were obtained by annealing in ultrahigh vacuum at different temperatures (600–800°C) after routine cold-rolling and recrystallization heat treatment. Ultrasonic attenuation is measured as a function of a frequency for each sample. For the samples with an intermediate grain size (typically ∼50 μm), attenuation follows a power law dependence on frequency with an exponent of n∼1.6, which is close to the prediction, n=2, of classical Stochastic scattering theory. However, quantitative comparison shows that the observed attenuation is higher than predicted by the classical theory. The Stanke-Kino unified grain scattering theory may provide an explanation for the lower frequency dependence than traditional theories predict, though it still under predicts the magnitude of the attenuation. In any event, the resulting empirical relations provide a useful approach for practical grain size measurement with an acceptable level of uncertainty. The effect of a layered microstructure typical of some sheets/plates is discussed.

36 MATERIALS SCIENCE↗

Machine-learning error models for approximate solutions to parameterized systems of nonlinear equations

Here, this work proposes a machine-learning framework for constructing statistical models of errors incurred by approximate solutions to parameterized systems of nonlinear equations. These approximate solutions may arise from early termination of an iterative method, a lower-fidelity model, or a projection-based reduced-order model, for example. The proposed statistical model comprises the sum of a deterministic regression-function model and a stochastic noise model. The method constructs the regression-function model by applying regression techniques from machine learning (e.g., support vector regression, artificial neural networks) to map features (i.e., error indicators such as sampled elements of the residual) to a prediction of the approximate-solution error. The method constructs the noise model as a mean-zero Gaussian random variable whose variance is computed as the sample variance of the approximate-solution error on a test set; this variance can be interpreted as the epistemic uncertainty introduced by the approximate solution. This work considers a wide range of feature-engineering methods, data-set-construction techniques, and regression techniques that aim to ensure that (1) the features are cheaply computable, (2) the noise model exhibits low variance (i.e., low epistemic uncertainty introduced), and (3) the regression model generalizes to independent test data. Finally, numerical experiments performed on several computational-mechanics problems and types of approximate solutions demonstrate the ability of the method to generate statistical models of the error that satisfy these criteria and significantly outperform more commonly adopted approaches for error modeling.

97 MATHEMATICS AND COMPUTING↗

Fatigue behavior analysis and multi-scale modelling of chopped carbon fiber chip-reinforced composites under tension-tension loading condition

Here, the fatigue damage behavior of chopped carbon fiber chip-reinforced composite has been experimentally and numerically investigated. A large scatter is exhibited in the S-N diagram due to the random distribution of carbon fiber chips, and therefore a new analysis procedure is proposed to link the local microstructure to the fatigue behavior of the bulk material. Interrupted fatigue tests are also performed so that microstructure characterization can be conducted on the tested samples to analyze the crack initiation and propagation. Inspired from the experimental findings, a multi-scale progressive damage fatigue model is proposed to predict the fatigue behavior. The model incorporates a new stochastic chip-packing algorithm for microstructure reconstruction along with continuum damage models into the representative volume element (RVE) model in ABAQUS/Explicit. Finally, the simulation results based on the proposed model are in good agreement with the experimental data in terms of cracking modes and predicted life.

36 MATERIALS SCIENCE↗

Nuclear data uncertainty propagation and modeling uncertainty impact evaluation in neutronics core simulation

Uncertainty analysis is a critical requirement in reactor simulation as it is used to quantify the reliability of best-estimate calculation. A comprehensive uncertainty analysis should characterize all sources of uncertainties in a computationally-feasible and scientifically-defendable manner. Here we employ a well-established reduced order modeling (ROM) based uncertainty quantification methodology to propagate uncertainties throughout neutronic calculations. ROM relies on recent advances in randomized data mining techniques applied to large data streams. In our proposed implementation, the nuclear data uncertainties are first propagated from multi-group level through lattice physics calculation to generate few-group parameter uncertainties, described using a vector of mean values and a covariance matrix. Employing an ROM-based compression of the covariance matrix, the few-group uncertainties are then propagated through downstream core simulation in a computationally efficient manner. This straightforward approach, albeit efficient as compared to brute force forward and/or adjoint-based methods, often employs a number of assumptions that have been unquestioned in the literature of neutronic uncertainty analysis. This manuscript argues that these assumptions could introduce another source of uncertainty referred to as modeling uncertainties, whose magnitude needs to be quantified in tandem with nuclear data uncertainties. Thus, our primary goal is to explore the interactions between these two uncertainty sources in order to assess whether modeling uncertainties have an impact on parameter uncertainties. To explore this endeavor, the impact of a number of modeling assumptions on core attributes uncertainties is quantified. The study employs a CANDU reactor model, with Serpent and NEWT as lattice physics solvers and NESTLE-C as core simulator. The modeling assumptions investigated include those related with the uncertainty propagation method employed, e.g., deterministic vs. stochastic, the few-group energy structure employed to represent the cross-sections, the resonance treatment in lattice physics calculation, the reference values for the cross-section, and the number of samples employed to render ROM compression. Results indicate that some of the modeling assumptions could have a non-negligible impact on the core responses propagated uncertainties, highlighting the need for a more comprehensive approach to combine parameter and modeling uncertainties.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Free energy landscape and molecular pathways of gas hydrate nucleation

Despite the significance of gas hydrates in diverse areas, a quantitative knowledge of hydrate formation at a molecular level is missing. The impediment to acquiring this understanding is primarily attributed to the stochastic nature and ultra-fine scales of nucleation events, posing a great challenge for both experiment and simulation to explore hydrate nucleation. Here we employ advanced molecular simulation methods, including forward flux sampling (FFS), p{sub B} histogram analysis, and backward flux sampling, to overcome the limit of direct molecular simulation for exploring both the free energy landscape and molecular pathways of hydrate nucleation. First we test the half-cage order parameter (H-COP) which we developed for driving FFS, through conducting the p{sub B} histogram analysis. Our results indeed show that H-COP describes well the reaction coordinates of hydrate nucleation. Through the verified order parameter, we then directly compute the free energy landscape for hydrate nucleation by combining both forward and backward flux sampling. The calculated stationary distribution density, which is obtained independently of nucleation theory, is found to fit well against the classical nucleation theory (CNT). Subsequent analysis of the obtained large ensemble of hydrate nucleation trajectories show that although on average, hydrate formation is facilitated by a two-step like mechanism involving a gradual transition from an amorphous to a crystalline structure, there also exist nucleation pathways where hydrate crystallizes directly, without going through the amorphous stage. The CNT-like free energy profile and the structural diversity suggest the existence of multiple active transition pathways for hydrate nucleation, and possibly also imply the near degeneracy in their free energy profiles among different pathways. Our results thus bring a new perspective to the long standing question of how hydrates crystallize.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Strongly intermittent far scrape-off layer fluctuations in Alcator C-Mod plasmas close to the empirical discharge density limit

Abstract Intermittent plasma fluctuations in the boundary region of the Alcator C-Mod device were comprehensively investigated using data time-series from gas puff imaging and mirror Langmuir probe diagnostics. Fluctuations were sampled during stationary plasma conditions in ohmically heated, lower single null diverted configurations with scans in both line-averaged density and plasma current, with Greenwald density fractions up to 0.85. Utilizing a stochastic model, we describe the plasma fluctuations as a super-position of uncorrelated pulses, with large-amplitude events corresponding to blob-like filaments moving through the scrape-off layer (SOL). A deconvolution method is used to estimate the pulse arrival times and amplitudes. The analysis reveals a significant increase of pulse amplitudes and waiting times as the line-averaged density approaches the empirical discharge density limit. Broadened and flattened average radial profiles are thus accompanied by strongly intermittent and large-amplitude fluctuations. Although these filaments are arriving less frequently at high line-averaged densities, we show that there are significant increases in radial far-SOL particle and heat fluxes which will further enhance plasma–wall interactions. The stochastic model has been used as a framework for study of the scalings in the intermittency parameter, flux and mean amplitude and waiting times, and is being used to inform predictive capability for the effects of filamentary transport as a function of Greenwald fraction.

Physics↗

Multivariate analysis of x-ray scattering using a stochastic source

The normalization of scattered intensity by incident flux is a crucial step in analyzing data from stochastic x-ray free electron laser sources and is complicated by non-linearities traditionally attributed to detector saturation. Here we show that such non-linearities can also arise when the sample spectra are non-uniform within the monochromator bandwidth. A method for modeling and removing this non-linearity using multivariate regression with shot-by-shot x-ray photon energy as an independent variable is presented. In conclusion, this approach demonstrates the benefit of event building and will allow for a reconsideration of data which has proven challenging to normalize.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Logical error rates for the surface code under a mixed coherent and stochastic circuit-level noise model inspired by trapped ions

With fault-tolerant quantum computing (FTQC) on the horizon, it is critical to understand sources of logical errors in plausible hardware implementations of quantum error-correcting codes. Detailed error modeling of computational instructions on particular FTQC architectures will enable the better prediction of error propagation in FT-encoded quantum circuits while revealing where greater attention is needed in hardware design. In this work, we consider logical error rates for the surface code implemented on a hypothetical grid-based trapped-ion quantum charge-coupled device architecture. Specifically, we construct logical channels for the idling surface code and examine its diamond error under a mixed coherent and stochastic circuit-level noise model inspired by trapped ions. We include the coherent dephasing noise that is known to accumulate during physical qubit idling and transport in these systems, determining idling and transport durations using the time-resolved output of an open-source trapped-ion surface code compiler. To estimate expectation values of logical Pauli observables following hardware circuits containing non-Clifford sources of noise, we utilize a Monte Carlo technique to sample from an underlying quasiprobability distribution of Clifford circuits that we independently simulate in a phase-sensitive fashion. We verify error suppression up to code distance 𝑑 = 11 at coherent dephasing rates near and below those of current-generation trapped-ion quantum computers and find that logical error rates align with those of analogous fully stochastic simulations in this regime. Exploring higher dephasing rates at 𝑑 = 3−5, we find evidence for growing coherent rotations about all three logical Pauli axes, increased diagonal logical error process matrix elements relative to those of stochastic simulations, and a reduced dephasing rate threshold. Overall, our work paves a way toward realistic hardware emulation of small fault-tolerant quantum processes, e.g., members of an FTQC instruction set.

Quantum benchmarking↗

Stochastic joint inversion of hydrogeophysical data for salt tracer test monitoring and hydraulic conductivity imaging

The assessment of hydraulic conductivity of heterogeneous aquifers is a difficult task using traditional hydrogeological methods (e.g., steady state or transient pumping tests) due to their low spatial resolution. Geophysical measurements performed at the ground surface and in boreholes provide additional information for increasing the resolution and accuracy of the inverted hydraulic conductivity field. We used a stochastic joint inversion of Direct Current (DC) resistivity and Self-Potential (SP) data plus in situ measurement of the salinity in a downstream well during a synthetic salt tracer experiment to reconstruct the hydraulic conductivity field between two wells. The pilot point parameterization was used to avoid over-parameterization of the inverse problem. Bounds on the model parameters were used to promote a consistent Markov chain Monte Carlo sampling of the model parameters. To evaluate the effectiveness of the joint inversion process, we compared 8 cases in which the geophysical data are coupled or not to the in situ sampling of the salinity to map the hydraulic conductivity. We first tested the effectiveness of the inversion of each type of data alone (concentration sampling, self-potential, and DC resistivity), and then we combined the data two by two. We finally combined all the data together to show the value of each type of geophysical data in the joint inversion process because of their different sensitivity map. We also investigated a case in which the data were contaminated with noise and the variogram unknown and inverted stochastically. The results of the inversion revealed that incorporating the self-potential data improves the estimate of hydraulic conductivity field especially when the self-potential data were combined to the salt concentration measurement in the second well or to the time-lapse cross-well electrical resistivity data. Various tests were also performed to quantify the uncertainty in the inverted hydraulic conductivity field.

54 ENVIRONMENTAL SCIENCES↗

Variability of K d Values in Cementitious Materials and Sediments

Measured distribution coefficients (K d values) for environmental contaminants provide input data for performance assessments (PA) that evaluate physical and chemical phenomena for release of radionuclides from wasteforms, degradation of engineered components and subsequent transport of radionuclides through environmental media. Research efforts at SRNL to study the effects of formulation and curing variability on the physiochemical properties of the saltstone wasteform produced at the Saltstone Disposal Facility (SDF) are ongoing and provide information for the PA and Saltstone Operations. Furthermore, the range and distribution of plutonium K d values in soils is not known. Knowledge of these parameters is needed to provide guidance for stochastic modeling in the PA. Under the current SRS liquid waste processing system, supernate from F & H Tank Farm tanks is processed to remove actinides and fission products, resulting in a low-curie Decontaminated Salt Solution (DSS). At the Saltstone Production Facility (SPF), DSS is mixed with premix, comprised of blast furnace slag (BFS), Class F fly ash (FA), and portland cement (OPC) to form a grout mixture. The fresh grout is subsequently placed in SDF vaults where it cures through hydration reactions to produce saltstone, a hardened monolithic waste form. Variation in saltstone composition and cure conditions of grout can affect the saltstone's physiochemical properties. Variations in properties may originate from variables in DSS, premix, and water to premix ratio, grout mixing, placing, and curing conditions including time and temperature (Harbour et al. 2007; Harbour et al. 2009). There are no previous studies reported in the literature regarding the range and distribution of K d values in cementitious materials. Presently, the Savannah River Site (SRS) estimate ranges and distributions of K d values based on measurements of K d values made in sandy SRS sediments (Kaplan 2010). The actual cementitious material K d values and solubility values differ from the sandy sediments. The K d value range and distribution currently used in the PA are estimated to range between 0.25*K d and 1.75*K d , where the minimum and maximum values of the ranges reflect the 95% confidence level for the mean K d value (Kaplan 2010). The objective of the research with cementitious materials was to measure the range and distribution of a monovalent (Cs) and I - (anion), divalent (Sr), and trivalent (Eu) ions for a variety of laboratory-prepared saltstone surrogate samples to establish a K d range other than that which is presently used in the PA. It has been observed in laboratory samples that cure temperature profiles can affect properties such as heat of hydration, permeability, porosity, compressive strength, and set time (Harbour et al. 2009). The intent was to identify a range and distribution that could be used by stochastic modelers for the PA. Furthermore, the intent was to replace the arbitrarily selected distributions based on geological sandy sediments and to base it on actual cementitious materials. The scope of this study did not include understanding saltstone sorption mechanisms responsible for increasing or decreasing sorption. Similar to the work with cementitious materials, the purpose of the Pu sediment K d dataset was not to attempt to understand through statistics how to better understand Pu sorption to sediments or to lower Pu K d variance. The sediment Pu K d data is included in this study because it is a key risk driver for the PAs on the SRS, and there is presently no direct studies of Pu variability in SRS soils. Instead the distribution of Pu sediment K d values was assumed to be similar to other cations, as presented by Kaplan (2010).

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Data-Driven Compositional Optimization in Misspecified Regimes

With a manifold growth in the scale and intricacy of systems, the challenges of parametric misspecification become pronounced. These concerns are further exacerbated in compositional settings, which emerge in problems complicated by modeling risk and robustness. In “Data-Driven Compositional Optimization in Misspecified Regimes,” the authors consider the resolution of compositional stochastic optimization problems, plagued by parametric misspecification. In considering settings where such misspecification may be resolved via a parallel learning process, the authors develop schemes that can contend with diverse forms of risk, dynamics, and nonconvexity. They provide asymptotic and rate guarantees for unaccelerated and accelerated schemes for convex, strongly convex, and nonconvex problems in a two-level regime with extensions to the multilevel setting. Surprisingly, the nonasymptotic rate guarantees show no degradation from the rate statements obtained in a correctly specified regime and the schemes achieve optimal (or near-optimal) sample complexities for general T-level strongly convex and nonconvex compositional problems.

Business & Economics↗

A generative modeling approach to reconstructing 21 cm tomographic data

Abstract Analyses of the cosmic 21 cm signal are hampered by astrophysical foregrounds that are far stronger than the signal itself. These foregrounds, typically confined to a wedge-shaped region in Fourier space, often necessitate the removal of a vast majority of modes, thereby degrading the quality of the data anisotropically. To address this challenge, we introduce a novel deep generative model based on stochastic interpolants to reconstruct the 21 cm data lost to wedge filtering. Our method leverages the non-Gaussian nature of the 21 cm signal to effectively map wedge-filtered 3D lightcones to samples from the conditional distribution of wedge-recovered lightcones. We demonstrate how our method is able to restore spatial information effectively, considering both varying cosmological initial conditions and astrophysics. Furthermore, we discuss a number of future avenues where this approach could be applied in analyses of the 21 cm signal, potentially offering new opportunities to improve our understanding of the Universe during the epochs of cosmic dawn and reionization. Code, pre-trained models, and scripts for making plots in this paper can be found here .

Sabti, Nashwan (ORCID:000000027924546X)↗

Realistic simulations of spin squeezing and cooperative coupling effects in large ensembles of interacting two-level systems

We describe an efficient numerical method for simulating the dynamics of interacting spin ensembles in the presence of dephasing and decay. The method builds on the discrete truncated Wigner approximation for isolated systems, which combines the mean-field dynamics of a spin ensemble with a Monte Carlo sampling of discrete initial spin values to account for quantum correlations. Here we show how this approach can be generalized for dissipative spin systems by replacing the deterministic mean-field evolution by a stochastic process, which describes the decay of coherences and populations while preserving the length of each spin. We demonstrate the application of this technique for simulating nonclassical spin-squeezing effects or the dynamics and steady states of cavity QED models with 10 5 interacting two-level systems. This opens up the possibility to perform accurate real-scale simulations of a diverse range of experiments in quantum optics or with solid-state spin ensembles under realistic laboratory conditions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Emergency Asset Positioning for Resilient Transmission Grid Operation

In this paper we study a problem of hurricane emergency preparedness via placement of emergency storage assets prior to its strike. We present a two-stage stochastic model for choosing locations and quantities of emergency storage to help support the power grid through a hurricane event. The expectation of losses in our two-stage model is estimated using the sample average approximation. We construct damage scenarios for sample average approximation using WIND Toolkit meteorological data and fragility curves of various electric grid components. We demonstrate the efficacy of our two-stage planning model by simulating operations during Hurricane Dolly on the 2000-bus transmission test system. Our model, coupled with our scenario selection strategy, is effective at mitigating loss of load when compared to a model without emergency storage assets placed prior to an extreme event.

emergency preparedness↗

Randomized Federated Learning Methods for Nonsmooth, Nonconvex, and Hierarchical Optimization (Final Technical Report)

This final technical report summarizes the outcomes of a DOE-funded project on federated scientific machine learning (FL) under nonsmooth, nonconvex, and hierarchical optimization settings. The project develops new mathematical models, algorithms, and theoretical guarantees for decentralized stochastic, bilevel, and minimax optimization problems arising in DOE mission-relevant applications. A unified framework of randomized and zeroth-order federated optimization methods is introduced, providing provable convergence, communication efficiency, and sample-complexity guarantees. The report documents algorithmic design, theoretical analysis, and empirical validation of the proposed federated learning methods. The project also contributes to workforce development through graduate training and dissemination of results via publications and seminars.

97 MATHEMATICS AND COMPUTING↗

A model for simulating random atmospheres as a function of latitude, season, and time

An empirical stochastic computer model was developed with the capability of generating random thermodynamic profiles of the atmosphere below an altitude of 99 km which are characteristic of any given season, latitude, and time of day. Samples of temperature, density, and pressure profiles generated by the model are statistically similar to measured profiles in a data base of over 6000 rocket and high-altitude atmospheric soundings; that is, means and standard deviations of modeled profiles and their vertical gradients are in close agreement with data. Model-generated samples can be used for Monte Carlo simulations of aircraft or spacecraft trajectories to predict or account for the effects on a vehicle's performance of atmospheric variability. Other potential uses for the model are in simulating pollutant dispersion patterns, variations in sound propagation, and other phenomena which are dependent on atmospheric properties, and in developing data-reduction software for satellite monitoring systems.

Campbell, J. W.↗

Measurements and predictions for nonevaporating sprays in a quiescent environment

Yule et al. (1982) have conducted a study of vaporizing sprays with the aid of laser techniques. The present investigation has the objective to supplement the measurements performed by Yule et al., by considering the limiting case of a spray in a stagnant environment. Mean and fluctuating velocities of the continuous phase are measured by means of laser Doppler anemometry (LDA) techniques, while Fraunhofer diffraction and slide impaction methods are employed to determine drop sizes. Liquid fluxes in the spray are found by making use of an isokinetic sampling probe. The obtained data are used as a basis for the evaluation of three models of the process, including a locally homogeneous flow (LHF) model, a deterministic separated flow (DSF) model, and a stochastic separated flow (SSF) model. It is found that the LHF and DSF models do not provide very satisfactory predictions for the test sprays, while the SSF model does provide reasonably good predictions of the observed structure.

Solomon, A. S. P.↗