Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical emulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

A Bayesian approach for parameter estimation and prediction using a computationally intensive model

Bayesian methods have been successful in quantifying uncertainty in physics-based problems in parameter estimation and prediction. In these cases, physical measurements y are modeled as the best fit of a physics-based model eta(theta), where theta denotes the uncertain, best input setting. Hence the statistical model is of the form y = eta(theta) + c, where epsilon accounts for measurement, and possibly other, error sources. When nonlinearity is present in eta(center dot), the resulting posterior distribution for the unknown parameters in the Bayesian formulation is typically complex and nonstandard, requiring computationally demanding computational approaches such as Markov chain Monte Carlo (MCMC) to produce multivariate draws from the posterior. Although generally applicable, MCMC requires thousands (or even millions) of evaluations of the physics model eta(center dot). This requirement is problematic if the model takes hours or days to evaluate. To overcome this computational bottleneck, we present an approach adapted from Bayesian model calibration. This approach combines output from an ensemble of computational model runs with physical measurements, within a statistical formulation, to carry out inference. A key component of this approach is a statistical response surface, or emulator, estimated from the ensemble of model runs. We demonstrate this approach with a case study in estimating parameters for a density functional theory model, using experimental mass/binding energy measurements from a collection of atomic nuclei. We also demonstrate how this approach produces uncertainties in predictions for recent mass measurements obtained at Argonne National Laboratory.

Higdon, Dave↗

Comparing emulation methods for a high‐resolution storm surge model

Abstract Realistic simulations of complex systems are fundamental for climate and environmental studies. Large computer systems are often not sufficient to run sophisticated computational models for large numbers of different input settings. Statistical surrogate models, or emulators, are key tools enabling fast exploration of the simulator input space. Gaussian processes have become standard for computer simulator emulation. However, they require careful implementation to scale appropriately, motivating alternative methods more recently introduced. We present a comparison study of surrogates of the Sea, Lake, and Overland Surges from Hurricanes (SLOSH) simulator—the simulator of choice for government agencies—using four emulation approaches: BASS; BART; SEPIA; and RobustGaSP. SEPIA and RobustGaSP use Gaussian processes, BASS implements adaptive splines, and BART is based on ensembles of regression trees. We describe the four models and compare them in terms of computation time and predictive metrics. These surrogates use proven and distinct methodologies, are available through accessible software, and quantify prediction uncertainty. Our data cover millions of response values. We find that SEPIA and RobustGaSP provide exceptional predictive power, but cannot scale to emulate experiments as large as the one considered in this paper as effectively as BASS and BART.

Hutchings, Grant↗

THE MIRA–TITAN UNIVERSE: PRECISION PREDICTIONS FOR DARK ENERGY SURVEYS

Large-scale simulations of cosmic structure formation play an important role in interpreting cosmological observations at high precision. The simulations must cover a parameter range beyond the standard six cosmological parameters and need to be run at high mass and force resolution. A key simulation-based task is the generation of accurate theoretical predictions for observables using a finite number of simulation runs, via the method of emulation. Using a new sampling technique, we explore an eight-dimensional parameter space including massive neutrinos and a variable equation of state of dark energy. We construct trial emulators using two surrogate models (the linear power spectrum and an approximate halo mass function). The new sampling method allows us to build precision emulators from just 26 cosmological models and to systematically increase the emulator accuracy by adding new sets of simulations in a prescribed way. Emulator fidelity can now be continuously improved as new observational data sets become available and higher accuracy is required. Finally, using one ΛCDM cosmology as an example, we study the demands imposed on a simulation campaign to achieve the required statistics and accuracy when building emulators for investigations of dark energy.

79 ASTRONOMY AND ASTROPHYSICS↗

Incorporating Snow Albedo Feedback into Downscaled Temperature and Snow Cover Projections for California’s Sierra Nevada

California’s Sierra Nevada is a high-elevation mountain range with significant seasonal snow cover. Under anthropogenic climate change, amplification of the warming is expected to occur at elevations near snow margins due to snow albedo feedback. However, climate change projections for the Sierra Nevada made by global climate models (GCMs) and statistical downscaling methods miss this key process. Dynamical downscaling simulates the additional warming due to snow albedo feedback. Ideally, dynamical downscaling would be applied to a large ensemble of 30 or more GCMs to project ensemble-mean outcomes and intermodel spread, but this is far too computationally expensive. To approximate the results that would occur if the entire GCM ensemble were dynamically downscaled, a hybrid dynamical–statistical downscaling approach is used. First, dynamical downscaling is used to reconstruct the historical climate of the 1981–2000 period and then to project the future climate of the 2081–2100 period based on climate changes from five GCMs. Next, a statistical model is built to emulate the dynamically downscaled warming and snow cover changes for any GCM. This statistical model is used to produce warming and snow cover loss projections for all available CMIP5 GCMs. These projections incorporate snow albedo feedback, so they capture the local warming enhancement (up to 3°C) from snow cover loss that other statistical methods miss. Capturing these details may be important for accurately projecting impacts on surface hydrology, water resources, and ecosystems

54 ENVIRONMENTAL SCIENCES↗

Emulating ab initio computations of infinite nucleonic matter

We construct efficient emulators for the computation of the infinite nuclear matter equation of state. These emulators are based on the subspace-projected coupled-cluster method for which we here develop a new algorithm called small-batch voting to eliminate spurious states that might appear when emulating quantum many-body methods based on a non-Hermitian Hamiltonian. The efficiency and accuracy of these emulators facilitate a rigorous statistical analysis within which we explore nuclear matter predictions for > 10 6 different parametrizations of a chiral interaction model with explicit Δ -isobars at next-to-next-to leading order. Constrained by nucleon-nucleon scattering phase shifts and bound-state observables of light nuclei up to He 4 , we use history matching to identify nonimplausible domains for the low-energy coupling constants of the chiral interaction. Within these domains we perform a Bayesian analysis using sampling and importance resampling with different likelihood calibrations and study correlations between interaction parameters, calibration observables in light nuclei, and nuclear matter saturation properties. Published by the American Physical Society 2024

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Modeling Redshift-space Clustering with Abundance Matching

Abstract We explore the degrees of freedom required to jointly fit projected and redshift-space clustering of galaxies selected in three bins of stellar mass from the Sloan Digital Sky Survey Main Galaxy Sample (SDSS MGS) using a subhalo abundance matching (SHAM) model. We employ emulators for relevant clustering statistics in order to facilitate our analysis, leading to large speed gains with minimal loss of accuracy. We are able to simultaneously fit the projected and redshift-space clustering of the two most massive galaxy samples that we consider with just two free parameters: scatter in stellar mass at fixed SHAM proxy, and the dependence of the SHAM proxy on dark matter halo concentration. We find some evidence for models that include velocity bias, but including orphan galaxies improves our fits to the lower-mass samples significantly. We also model the clustering signals of specific star formation rate (sSFR) selected samples using conditional abundance matching (CAM). We obtain acceptable fits to projected and redshift-space clustering as a function of sSFR and stellar mass using two CAM variants, although the fits are worse than for stellar-mass-selected samples alone. By incorporating nonunity correlations between the CAM proxy and sSFR, we are able to resolve previously identified discrepancies between CAM predictions and SDSS observations of the environmental dependence of quenching for isolated central galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗

Design of Experiments, Model Calibration and Data Assimilation

This presentation provides an overview of emulation, calibration and experiment design for computer experiments. Emulation refers to building a statistical surrogate from a carefully selected and limited set of model runs to predict unsampled outputs. The standard kriging approach to emulation of complex computer models is presented. Calibration refers to the process of probabilistically constraining uncertain physics/engineering model inputs to be consistent with observed experimental data. An initial probability distribution for these parameters is updated using the experimental information. Markov chain Monte Carlo (MCMC) algorithms are often used to sample the calibrated parameter distribution. Several MCMC algorithms commonly employed in practice are presented, along with a popular diagnostic for evaluating chain behavior. Space-filling approaches to experiment design for selecting model runs to build effective emulators are discussed, including Latin Hypercube Design and extensions based on orthogonal array skeleton designs and imposed symmetry requirements. Optimization criteria that further enforce space-filling, possibly in projections of the input space, are mentioned. Designs to screen for important input variations are summarized and used for variable selection in a nuclear fuels performance application. This is followed by illustration of sequential experiment design strategies for optimization, global prediction, and rare event inference.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The Mira-Titan Universe. III. Emulation of the Halo Mass Function

We construct an emulator for the halo mass function over group and cluster mass scales for a range of cosmologies, including the effects of dynamical dark energy and massive neutrinos. The emulator is based on the recently completed Mira-Titan Universe suite of cosmological N-body simulations. The main set of simulations spans 111 cosmological models with 2.1 Gpc boxes. We extract halo catalogs in the redshift range z = [0.0, 2.0] and for masses M-200c >= 10(13)M(circle dot)/h. The emulator covers an eight-dimensional hypercube spanned by {Omega(m)h(2), Omega(b)h(2), Omega(nu)h(2), sigma(8), h, n(s), w(0), w(a)}; spatial flatness is assumed. We obtain smooth halo mass functions by fitting piecewise second-order polynomials to the halo catalogs and employ Gaussian process regression to construct the emulator while keeping track of the statistical noise in the input halo catalogs and uncertainties in the regression process. For redshifts z less than or similar to 1, the typical emulator precision is better than 2% for 10(13)-10(14)M(circle dot)/h and <10<^> M similar or equal to 101(circle dot)(54)/h. For comparison, fitting functions using the traditional universal form for the halo mass function can be biased at up to 30% at M similar or equal to 10(144)M(circle dot)/h for z = 0. Our emulator is publicly available at https://github.com/SebastianBocquet/MiraTitanHMFemulator.

cosmology: theory↗

Simulation and Emulation of X-Ray Diffraction from Dynamic Compression Experiments

Many important aspects of the dynamic thermo-mechanical response of materials occur at the mesoscale, i.e. a physical scale of interactions smaller than what can be adequately described by homogenous behaviors, yet larger than the scale of the atomic lattice. Concurrent advancements in computational power, continuum theory, and experimental diagnostics are enabling unprecedented understanding of such interactions. However, we cannot develop a sufficient level of confidence in such mesoscale capability until the constitutive description of the underlying constituents is reliably representative of their actual physical behavior. Therefore, there is a strong need to combine experimental, modeling, and data-science techniques to validate models of the thermomechanical response of individual single crystals. One experimental diagnostic with high potential impact to shock physics and materials science is in-situ x-ray diffraction. This paper is primarily focused on simulation of x-ray diffraction in shock physics, but with an aim toward quantifying parametric uncertainty of simulation models. Here, we develop and demonstrate a data-science and model-driven approach to constrain the parameterization of continuum models of crystal lattice deformation associated with the shock response of crystalline materials. The framework is built around the connection between continuum hydrodynamic simulations of lattice deformation and a new Bragg diffraction simulation code, BarberShop. The dynamic deformation of a crystal lattice is modeled using the DiscoFlux model within an arbitrary Lagrangian-Eulerian hydrodynamic code, FLAG. These detailed continuum simulations of lattice deformation can be computationally slow, thus a statistical model is used to emulate the evolution of lattice deformation fields in time and across the considered model parameter space. Emulated lattice deformation fields can then be generated rapidly for any combination of physics model parameters. In turn, these fields can be fed into BarberShop to realize a rapid prediction of Bragg diffraction patterns associated with particular values of physics model parameters. The framework enables parameterization of the single crystal model to obtain Bragg diffraction patterns that most closely resemble a corresponding measurement. Furthermore, the framework naturally provides sensitivities of the lattice deformation to the physics parameters. We highlight the utility of this framework through the application to a synthetic closed-loop inverse problem leading to the parameterization of a single crystal material model. As a model problem, we consider the dynamic response of the energetic molecular crystal, cyclotrimethylenetrinitramine (or RDX), under dynamic compression induced by simulated flyer plate impact experiments.

36 MATERIALS SCIENCE↗

Discussion on “Saving Storage in Climate Ensembles: A Model-Based Stochastic Approach”

Abstract We thank the authors for this interesting paper that highlights important ideas and concepts for the future of climate model ensembles and their storage, as well as future uses of stochastic emulators. Stochastic emulators are particularly relevant because of the statistical nature of climate model ensembles, as discussed in previous work of the authors (Castruccio et al. in J Clim 32:8511–8522, 2019; Hu and Castruccio in J Clim 34:8409–8418, 2021). We thank the authors for sharing of some of their data with us in order to illustrate this discussion. In the following, in Sect. 1 we discuss alternative techniques currently used and studied, namely lossy compression and ideas emerging from the climate modeling community, that could feed the discussion on ensemble and storage. In that section, we also present numerical results of compression performed on the data shared by the authors. In Sect. 2, we discuss the current statistical model proposed by the authors and its context. We discuss other potential uses of stochastic emulators in climate and Earth modeling.

97 MATHEMATICS AND COMPUTING↗

CHARACTERIZING THE FORMATION HISTORY OF MILKY WAY LIKE STELLAR HALOS WITH MODEL EMULATORS

We use the semi-analytic model ChemTreeN, coupled to cosmological N-body simulations, to explore how different galaxy formation histories can affect observational properties of Milky Way like galaxies' stellar halos and their satellite populations. Gaussian processes are used to generate model emulators that allow one to statistically estimate a desired set of model outputs at any location of a p-dimensional input parameter space. This enables one to explore the full input parameter space orders of magnitude faster than could be done otherwise. Using mock observational data sets generated by ChemTreeN itself, we show that it is possible to successfully recover the input parameter vectors used to generate the mock observables if the merger history of the host halo is known. However, our results indicate that for a given observational data set, the determination of 'best-fit' parameters is highly susceptible to the particular merger history of the host. Very different halo merger histories can reproduce the same observational data set, if the 'best-fit' parameters are allowed to vary from history to history. Thus, attempts to characterize the formation history of the Milky Way using these kind of techniques must be performed statistically, analyzing large samples of high-resolution N-body simulations.

79 ASTRONOMY AND ASTROPHYSICS↗

Emulation of the calculations of final r -process abundance patterns with a neural network

This work explores the construction of a fast emulator for the calculation of the final pattern of nucleosynthesis in the rapid neutron capture process (the r-process). An emulator is built using a feed-forward artificial neural network (ANN). We train the ANN with nuclear data and relative abundance patterns. We take as input the β-decay half-lives and the one-neutron separation energy of the nuclei in the rare-earth region. The output is the final isotopic abundance pattern. In this work, we focus on the nuclear data and abundance patterns in the rare-earth region to reduce the dimension of the input and output space. We show that the ANN can capture the effect of the changes in the nuclear physics inputs on the final r-process abundance pattern in the adopted astrophysical conditions. We employ the deep ensemble method to quantify the prediction uncertainty of the neural network emulator. The emulator achieves a speed-up by a factor of about 20 000 in obtaining a final abundance pattern in the rare-earth region. The emulator may be utilized in statistical analyses such as uncertainty quantification, inverse problems, and sensitivity analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

The Aemulus Project. V. Cosmological Constraint from Small-scale Clustering of BOSS Galaxies

We analyze clustering measurements of BOSS galaxies using a simulation-based emulator of two-point statistics. We focus on the monopole and quadrupole of the redshift-space correlation function, and the projected correlation function, at scales of 0.1 ~ 60 h -1 Mpc. Although our simulations are based on wCDM with general relativity (GR), we include a scaling parameter of the halo velocity field, γ f , defined as the amplitude of the halo velocity field relative to the GR prediction. We divide the BOSS data into three redshift bins. After marginalizing over other cosmological parameters, galaxy bias parameters, and the velocity scaling parameter, we find fσ 8 (z = 0.25) = 0.413 ± 0.031, fσ 8 (z = 0.4) = 0.470 ± 0.026, and fσ 8 (z = 0.55) = 0.396 ± 0.022. Compared with Planck observations using a flat Lambda cold dark matter model, our results are lower by 1.9σ, 0.3σ, and 3.4σ, respectively. These results are consistent with other recent simulation-based results at nonlinear scales, including weak lensing measurements of BOSS LOWZ galaxies, two-point clustering of eBOSS LRGs, and an independent clustering analysis of BOSS LOWZ. All these results are generally consistent with a combination of ${\gamma }_{f}^{1/2}{\sigma }_{8}\approx 0.75$. We note, however, that the BOSS data is well fit assuming GR, i.e., γf = 1. We cannot rule out an unknown systematic error in the galaxy bias model at nonlinear scales, but near-future data and modeling will enhance our understanding of the galaxy–halo connection, and provide a strong test of new physics beyond the standard model.

79 ASTRONOMY AND ASTROPHYSICS↗

Fast & accurate emulation of two-body scattering observables without wave functions

We combine Newton's variational method with ideas from eigenvector continuation to construct a fast & accurate emulator for two-body scattering observables. The emulator will facilitate the application of rigorous statistical methods for interactions that depend smoothly on a set of free parameters. Our approach begins with a trial K or T matrix constructed from a small number of exact solutions to the Lippmann–Schwinger equation. Subsequent emulation only requires operations on small matrices. We provide several applications to short-range potentials with and without the Coulomb interaction and partial-wave coupling. It is shown that the emulator can accurately extrapolate far from the support of the training data. When used to emulate the neutron-proton cross section with a modern chiral interaction as a function of 26 free parameters, it reproduces the exact calculation with negligible error and provides an over 300x improvement in CPU time.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Uncertainty quantification for nuclear density functional theory and information content of new measurements

Statistical tools of uncertainty quantification can be used to assess the information content of measured observables with respect to present-day theoretical models, to estimate model errors and thereby improve predictive capability, to extrapolate beyond the regions reached by experiment, and to provide meaningful input to applications and planned measurements. To showcase new opportunities offered by such tools, we make a rigorous analysis of theoretical statistical uncertainties in nuclear density functional theory using Bayesian inference methods. By considering the recent mass measurements from the Canadian Penning Trap at Argonne National Laboratory, we demonstrate how the Bayesian analysis and a direct least-squares optimization, combined with high-performance computing, can be used to assess the information content of the new data with respect to a model based on the Skyrme energy density functional approach. Employing the posterior probability distribution computed with a Gaussian process emulator, we apply the Bayesian framework to propagate theoretical statistical uncertainties in predictions of nuclear masses, two-neutron dripline, and fission barriers. Overall, we find that the new mass measurements do not impose a constraint that is strong enough to lead to significant changes in the model parameters. In addition, the example discussed in this study sets the stage for quantifying and maximizing the impact of new measurements with respect to current modeling and guiding future experimental efforts, thus enhancing the experiment-theory cycle in the scientific method.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Bayesian projection pursuit regression

In projection pursuit regression (PPR), a univariate response variable is approximated by the sum of $M$ “ridge functions,” which are flexible functions of one-dimensional projections of a multivariate input variable. Traditionally, optimization routines are used to choose the projection directions and ridge functions via a sequential algorithm, and $M$ is typically chosen via cross-validation. Here, we introduce a novel Bayesian version of PPR, which has the benefit of accurate uncertainty quantification. To infer appropriate projection directions and ridge functions, we apply novel adaptations of methods used for the single ridge function case ($M$=1), called the Bayesian Single Index Model; and use a Reversible Jump Markov chain Monte Carlo algorithm to infer the number of ridge functions $M$. We evaluate the predictive ability of our model in 20 simulated scenarios and for 23 real datasets, in a bake-off against an array of state-of-the-art regression methods. Finally, we generalize this methodology and demonstrate the ability to accurately model multivariate response variables. Its effective performance indicates that Bayesian Projection Pursuit Regression is a valuable addition to the existing regression toolbox.

97 MATHEMATICS AND COMPUTING↗

Bayesian inference of in-medium baryon-baryon scattering cross sections from HADES proton flow data

Within a Bayesian statistical framework using a Gaussian Process emulator for an isospin-dependent Boltzmann-Uehling-Uhlenbeck (IBUU) transport model simulator of heavy-ion reactions at intermediate energies, we infer from the HADES proton flow data the posterior probability distribution functions of in-medium baryon-baryon scattering cross section modification factor X with respect to free-space and the corresponding incompressibility K of nuclear matter as well as their correlation function. In conclusion, the mean value of X is found to be $X$ = $1.32_ {+0.28} ^ {-0.40} $ at 68% confidence level assuming the nuclear incompressibility K will not exceed 400 MeV, providing circumstantial evidence for enhanced baryon-braryon scattering cross sections in hot and dense nuclear matter.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Ground state energy and magnetization curve of a frustrated magnetic system from real-time evolution on a digital quantum processor

Models of interacting many-body quantum systems that may realize new exotic phases of matter, notably quantum spin liquids, are challenging to study using even state-of-the-art classical methods such as tensor network simulations. Quantum computing provides a promising route for overcoming these difficulties to find ground states, dynamics, and more. In this paper, we argue that recently developed hybrid quantum-classical algorithms based on real-time evolution are promising methods for solving a particularly important model in the search for spin liquids, the antiferromagnetic Heisenberg model on the two-dimensional kagome lattice. We show how to construct efficient quantum circuits to implement time evolution for the model and to evaluate key observables on the quantum computer, and we argue that the method has favorable scaling with increasing system size. We then restrict to a 12-spin star plaquette from the kagome lattice and a related 8-spin system, and we give an empirical demonstration on these small systems that the hybrid algorithms can efficiently find the ground state energy and the magnetization curve. For these demonstrations, we use four levels of approximation: exact state vectors, exact state vectors with statistical noise from sampling, noisy classical emulators, and (for the 8-spin system only) real quantum hardware, specifically the Quantinuum H1-1 processor; for the noisy simulations and hardware demonstration, we also employ error mitigation strategies based on the symmetries of the Hamiltonian. Our results strongly suggest that these hybrid algorithms present a promising direction for studying quantum spin liquids and more generally for resolving important unsolved problems in condensed matter theory and beyond.

97 MATHEMATICS AND COMPUTING↗