Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical emulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

On estimating cosmology-dependent covariance matrices

We describe a statistical model to estimate the covariance matrix of matter tracer two-point correlation functions with cosmological simulations. Assuming a fixed number of cosmological simulation runs, we describe how to build a 'statistical emulator' of the two-point function covariance over a specified range of input cosmological parameters. Because the simulation runs with different cosmological models help to constrain the form of the covariance, we predict that the cosmology-dependent covariance may be estimated with a comparable number of simulations as would be needed to estimate the covariance for fixed cosmology. Our framework is a necessary first step in planning a simulations campaign for analyzing the next generation of cosmological surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Megadrought: A Series of Unfortunate La Niña Events?

Megadroughts are multidecadal periods of aridity more persistent than most droughts during the instrumental period. Paleoclimate evidence suggests that megadroughts occur in many parts of the world, including North America, Central America, western Europe, eastern Asia, and northern Africa. It remains unclear to what extent such megadroughts require external forcing or whether they can arise from internal climate variability alone. A novel statistical–dynamical approach is used to evaluate the possibility that such events arise solely as a function of interannual tropical sea surface temperature (SST) variations. A statistical emulator of tropical SST variations is constructed by using an empirical moving-blocks bootstrap approach that randomly samples multiyear sequences of the observational SST record. This approach preserves the power spectrum, seasonal cycle, and spatial pattern of El Niño-Southern Oscillation (ENSO) but removes longer timescale fluctuations embedded in the observational record. These resampled SST anomalies are then used to force an atmospheric model (the Community Atmosphere Model Version 5). As megadroughts emerge in this run, they should, therefore, be solely a consequence of La Niña sequences combined with internal atmospheric variability and persistence driven by soil moisture storage and other land-surface processes. We indeed find that megadroughts in this simulation have an amplitude-duration rate that is generally indistinguishable from the rate documented in paleoclimate records of the western United States. Our findings support the idea that megadroughts may occur randomly when the unforced climate system evolves freely over a sufficiently long period of time, implying that an unforced unusual but statistically plausible series of La Niña events may be sufficient to generate megadrought.

54 ENVIRONMENTAL SCIENCES↗

Global Sensitivity of Simulated Water Balance Indicators Under Future Climate Change in the Colorado Basin

The Colorado River basin is a fundamentally important river for society, ecology and energy in the United States. Streamflow estimates are often provided using modeling tools which rely on uncertain parameters; sensitivity analysis can help determine which parameters impact model results. Despite the fact that simulated flows respond to changing climate and vegetation in the basin, parameter sensitivity of the simulations under climate change has rarely been considered. In this study, we conduct a global sensitivity analysis to relate changes in runoff, evapotranspiration, snow water equivalent and soil moisture to model parameters in the Variable Infiltration Capacity (VIC) hydrologic model. Here, we combine global sensitivity analysis with a space-filling Latin Hypercube sampling of the model parameter space and statistical emulation of the VIC model to examine sensitivities to uncertainties in 46 model parameters following a variance-based approach.

54 ENVIRONMENTAL SCIENCES↗

Optimizing human activity patterns using global sensitivity analysis

Implementing realistic activity patterns for a population is crucial for modeling, for example, disease spread, supply and demand, and disaster response. Using the dynamic activity simulation engine, DASim, we generate schedules for a population that capture regular (e.g., working, eating, and sleeping) and irregular activities (e.g., shopping or going to the doctor). We use the sample entropy (SampEn) statistic to quantify a schedule’s regularity for a population. We show how to tune an activity’s regularity by adjusting SampEn, thereby making it possible to realistically design activities when creating a schedule. The tuning process sets up a computationally intractable high-dimensional optimization problem. To reduce the computational demand, we use Bayesian Gaussian process regression to compute global sensitivity indices and identify the parameters that have the greatest effect on the variance of SampEn. Here we use the harmony search (HS) global optimization algorithm to locate global optima. Our results show that HS combined with global sensitivity analysis can efficiently tune the SampEn statistic with few search iterations. We demonstrate how global sensitivity analysis can guide statistical emulation and global optimization algorithms to efficiently tune activities and generate realistic activity patterns. Finally, though our tuning methods are applied to dynamic activity schedule generation, they are general and represent a significant step in the direction of automated tuning and optimization of high-dimensional computer simulations.

97 MATHEMATICS AND COMPUTING↗

Computer Model Calibration Based on Image Warping Metrics: An Application for Sea Ice Deformation

Arctic sea ice plays an important role in the global climate. Sea ice models governed by physical equations have been used to simulate the state of the ice including characteristics such as ice thickness, concentration, and motion. More recent models also attempt to capture features such as fractures or leads in the ice. These simulated features can be partially misaligned or misshapen when compared to observational data, whether due to numerical approximation or incomplete physics. In order to make realistic forecasts and improve understanding of the underlying processes, it is necessary to calibrate the numerical model to field data. Traditional calibration methods based on generalized least-square metrics are flawed for linear features such as sea ice cracks. We develop a statistical emulation and calibration framework that accounts for feature misalignment and misshapenness, which involves optimally aligning model output with observed features using cutting-edge image registration techniques. Here, this work can also have application to other physical models which produce coherent structures.

54 ENVIRONMENTAL SCIENCES↗

A Framework for Parametric and Predictive Uncertainty Quantification in the E3SM Land Model: Assessing Site and Observable Generalizability

Quantifying parametric uncertainty using observations from individual sites provides a critical foundation for Earth system modeling, serving as a necessary first step before scaling up to regional or global applications. This study introduces a novel computational framework designed to enhance model predictability by reducing parametric uncertainty and assessing site and observable generalizability using various observational constraints. The framework integrates five components: Model Simulation, Statistical Emulation, Global Sensitivity Analysis (GSA), Model Calibration, and Model Prediction. Using the E3SM land model, we simulated site-level land-atmosphere carbon and energy fluxes from 2003 to 2007 across five evergreen needleleaf FLUXNET sites, perturbing 26 vegetation-related model parameters. Gaussian process emulators were employed to expedite GSA and model calibration. Four critical parameters that strongly influence selected land-atmosphere fluxes were identified by GSA. Bayesian approaches were used to infer parameter probability distributions leveraging synthetic data and FLUXNET observations. The results reveal that posterior parameter distributions vary significantly across different sites and observables within the same plant functional type. Probabilistic predictions indicate that parameters calibrated at one site can enhance predictive accuracy at other sites, although site heterogeneity may sometimes outweigh parametric uncertainty. Additionally, the probabilistic predictions demonstrate that calibration for one variable can also improve predictability for other variables, thereby maximizing predictive capabilities with limited observations. This framework provides a powerful approach for reducing parametric uncertainty in Earth system models and deepening our understanding of carbon dynamics and energy cycles. Its adaptability makes it a valuable tool for broader applications in Earth system modeling.

54 ENVIRONMENTAL SCIENCES↗

Projected land ice contributions to twenty-first-century sea level rise

The land ice contribution to global mean sea level rise has not yet been predicted using ice sheet and glacier models for the latest set of socio-economic scenarios, nor using coordinated exploration of uncertainties arising from the various computer models involved. Two recent international projects generated a large suite of projections using multiple models, but primarily used previous-generation scenarios and climate models, and could not fully explore known uncertainties. Here we estimate probability distributions for these projections under the new scenarios using statistical emulation of the ice sheet and glacier models. In this work, we find that limiting global warming to 1.5 degrees Celsius would halve the land ice contribution to twenty-first-century sea level rise, relative to current emissions pledges. The median decreases from 25 to 13 centimetres sea level equivalent (SLE) by 2100, with glaciers responsible for half the sea level contribution. The projected Antarctic contribution does not show a clear response to the emissions scenario, owing to uncertainties in the competing processes of increasing ice loss and snowfall accumulation in a warming climate. However, under risk-averse (pessimistic) assumptions, Antarctic ice loss could be five times higher, increasing the median land ice contribution to 42 centimetres SLE under current policies and pledges, with the 95th percentile projection exceeding half a metre even under 1.5 degrees Celsius warming. This would severely limit the possibility of mitigating future coastal flooding. Given this large range (between 13 centimetres SLE using the main projections under 1.5 degrees Celsius warming and 42 centimetres SLE using risk-averse projections under current pledges), adaptation planning for twenty-first-century sea level rise must account for a factor-of-three uncertainty in the land ice contribution until climate policies and the Antarctic response are further constrained.

54 ENVIRONMENTAL SCIENCES↗

Calibration of energy density functionals with deformed nuclei

Nuclear density functional theory is the prevalent theoretical framework for accurately describing nuclear properties at the scale of the entire chart of nuclides. Given an energy functional and a many-body scheme (e.g., single- or multireference level), the predictive power of the theory depends strongly on how the parameters of the energy functionals have been calibrated with experimental data. Expanded algorithms and computing power have enabled recent optimization protocols to include data in deformed nuclei in order to optimize the coupling constants of the energy functional. The primary motivation of this work is to test the robustness of such protocols with respect to some of the technical and numerical details of the underlying calculations, especially when the calibration explores a large parameter space. To this end, we quantify the effect of these uncertainties on both the optimization and statistical emulation of composite objective functions. We also emphasize that Bayesian calibration can provide better estimates of the theoretical errors used to define objective functions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Quantifying Uncertainties In Neutron-Alpha Scattering With Chiral Nucleon-Nucleon And Three-Nucleon Forces

We report that modern ab initio theory combined with high-quality nucleon-nucleon (NN) and three-nucleon (3N) interactions from chiral effective field theory (EFT) can provide a predictive description of low-energy light-nuclei reactions relevant for astrophysics and fusion-energy applications. However, the high cost of computations has so far impeded a complete analysis of the uncertainty budget of such calculations. Starting from NN potentials up to fifth order (N 4 LO) combined with leading-order 3N forces, we study how the order-by-order convergence of the chiral expansion and confidence intervals for the 3N contact and contact-plus-one-pion-exchange low-energy constants (c E and c D ) contribute to the overall uncertainty budget of many-body calculations of neutron- 4 He (n-α) elastic scattering. We compute structure and reaction observables for three-, four-, and five-nucleon systems within the ab initio frameworks of the no-core shell model and no-core shell model with continuum. Using a small set of design runs, we construct a Gaussian process model (GPM) that acts as a statistical emulator for the theory. With this, we gain insight into how uncertainties in the 3N low-energy constants propagate throughout the calculation and determine the Bayesian posterior distribution of these parameters with Markov-Chain Monte Carlo. We find rapidly converging n-α phase shifts with respect to the chiral order. With the adopted leading-order 3N force, calculations based on the NN interaction at N 4 LO of Entem, Machleidt, and Nosyk are unable to reproduce the experimental phase shifts in the 3/2 - channel within the estimated chiral truncation errors. Closer agreement with empirical data is found when using an older parametrization of the NN interaction at order N 3 LO, and the position and width of the P-wave resonances can be used to reduce the uncertainty of the 3N low-energy constants. The present results point to a lack of spin-orbit strength when the newer parametrization of the chiral NN force up to fifth order is combined with the leading-order 3N force. The inclusion of higher-order 3N-force terms may be required to recover the missing strength. GPMs can act as fast and accurate emulators of ab initio many-body calculations of low-energy scattering and reactions of light nuclei, opening the way to a robust quantification of theoretical uncertainties grounded in the description of the underlying chiral Hamiltonian.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Analysis of Filesystem Utilization by the ?Ensemble of Models? Approach (U)

In order to execute Uncertainty Quantification (UQ) studies, the number of reads placed on the filesystem will increase. This document works through the file I/O for a climatology UQ study. The utilization of the filesystem for the above discussed will be similar for ICF and Stockpile Stewardship applications. The current state of the art for the quantification of uncertainty of a multi-physics simulation code is the utilization of an ensemble of models approach. As an overview of the ensemble of models approach, a set of uncertain input parameters is identified along with an identified set of observational and output parameters. The model is computed n number of times with each ensemble simulation using a unique set of parametric combinations of input parameters thereby creating an ensemble of simulations. Response surface models (also known as statistical emulator models, surrogate models, or meta models) are trained using the ensemble results. The response models are then convolved with observational data to further constrain input parameters and to create uncertainty bounds on the model outputs. Using the Community Climate System Model (CCSM) specifically the atmospheric component of CCSM, the Community Atmospheric Model (CAM), as the model of interest, this document provides a rough model of the demands on a filesystem that is needed to execute a UQ study on CAM. Each ensemble simulation consists of 12 simulation years and uses 384 processors on the Atlas machine. The LLNL UQ Pipeline is LLNL's standard tool to execute UQ studies. The UQ Pipeline possesses the capability to execute the ensemble simulations on LLNL's diverse set of HPC environments, produce response models, generate uncertainty bounds, and analyze the results. The process executing the LLNL UQ Pipeline is run on a different compute node from the set of concurrent, executing ensemble simulations.

99 GENERAL AND MISCELLANEOUS↗

Projected land ice contributions to twenty-first-century sea level rise

The land ice contribution to global mean sea level rise has not yet been predicted1 using ice sheet and glacier models for the latest set of socio-economic scenarios, nor using coordinated exploration of uncertainties arising from the various computer models involved. Two recent international projects generated a large suite of projections using multiple models2,3,4,5,6,7,8, but primarily used previous-generation scenarios9 and climate models10, and could not fully explore known uncertainties. Here we estimate probability distributions for these projections under the new scenarios11,12 using statistical emulation of the ice sheet and glacier models. We find that limiting global warming to 1.5 degrees Celsius would halve the land ice contribution to twenty-first-century sea level rise, relative to current emissions pledges. The median decreases from 25 to 13 centimetres sea level equivalent (SLE) by 2100, with glaciers responsible for half the sea level contribution. The projected Antarctic contribution does not show a clear response to the emissions scenario, owing to uncertainties in the competing processes of increasing ice loss and snowfall accumulation in a warming climate. However, under risk-averse (pessimistic) assumptions, Antarctic ice loss could be five times higher, increasing the median land ice contribution to 42 centimetres SLE under current policies and pledges, with the 95th percentile projection exceeding half a metre even under 1.5 degrees Celsius warming. This would severely limit the possibility of mitigating future coastal flooding. Given this large range (between 13 centimetres SLE using the main projections under 1.5 degrees Celsius warming and 42 centimetres SLE using risk-averse projections under current pledges), adaptation planning for twenty-first-century sea level rise must account for a factor-of-three uncertainty in the land ice contribution until climate policies and the Antarctic response are further constrained.

Tamsin L. Edwards↗

Uniformly Ordered Binary Decision Algorithm for Benchmark Experiment Correlations in Whisper Validation

When performing a validation exercise for determining the upper subcritical limit of a nuclear criticality safety application, an analyst should select and perform a statistical analysis on a population of benchmark experiments that are neutronically similar to the application. The size of this population should be sufficiently large such that the statistical analysis has a high degree of confidence that the bias plus bias uncertainty (calculational margin) has been accurately quantified. A complication arises because many benchmark experiments share common components, leading to correlations in their measured effective multiplication factors. Correlations between benchmark experiments within the population reduces its predictive power. This motivates the need for methods that consider benchmark experiment correlations and ensure adequate statistical significance of results. The Whisper code is a statistical analysis pack- age that incorporates nuclear data sensitivity coefficients from MCNP to assess benchmark experiment similarity and then performs an extreme-value analysis to estimate the bias plus bias uncertainty. The original methodology in Whisper does not consider the effect of benchmark experiment correlations when making this estimation, and this summary proposes the uniformly ordered binary decision algorithm to address this shortcoming. The original methodology in Whisper computes similarity coefficients ck for an application compared to all benchmark experiments in its library and develops weighting factors for a selected population proportional to the ck values. The methodology can be interpreted as statistically emulating a validation exercise for a particular application where the weighting factors may be viewed as the likelihood that an analyst would include a particular benchmark experiment within the population. The effective sample size of the population is the expected or mean number of benchmark experiments in the population. The uniformly ordered binary decision algorithm identifies clusters of correlated benchmark experiments within the population and then computes adjusted weighting factors based on the magnitude of the correlation coefficients within the cluster to compute a reduced effective sample size accounting for the lower information content because of correlations. Benchmark experiments within the cluster are ordered randomly with equal probability and probabilistic decisions are made as to whether a benchmark. experiment within the cluster should treated as redundant with a previous one; if two redundant benchmark experiments are included, then the conservative worst case bias plus bias uncertainty is used and the pair is counted as a single benchmark experiment in the population. Results are provided for HEU solutions in a research version of the Whisper software using benchmark experiment correlations provided by DICE, the Database for the International Criticality Safety Benchmark Evaluation Project (ICSBEP). These show that there can be a significant increase in the bias plus bias uncertainty because the effective sample size is reduced, and therefore the algorithm, needing to meet sample size requirements, expands the benchmark experiment population by accepting less similar benchmark experiments that would have otherwise not been included.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Parameter-masked Mock Data Challenge for Beyond-two-point Galaxy Clustering Statistics

The past few years have seen the emergence of a wide array of novel techniques for analyzing high-precision data from upcoming galaxy surveys, which aim to extend the statistical analysis of galaxy clustering data beyond the linear regime and the canonical two-point (2pt) statistics. We test and benchmark some of these new techniques in a community data challenge named “Beyond-2pt,” initiated during the Aspen 2022 Summer Program “Large-Scale Structure Cosmology beyond 2-Point Statistics,” whose first round of results we present here. The challenge data set consists of high-precision mock galaxy catalogs for clustering in real space, in redshift space, and on a light cone. Participants in the challenge have developed end-to-end pipelines to analyze mock catalogs and extract unknown (“masked”) cosmological parameters of the underlying ΛCDM models with their methods. The methods represented are density-split clustering, nearest neighbor statistics, BACCO power spectrum emulator, void statistics, LEFTfield field-level inference using effective field theory (EFT), and joint power spectrum and bispectrum analyses using both EFT and simulation-based inference. In this work, we review the results of the challenge, focusing on problems solved, lessons learned, and future research needed to perfect the emerging beyond-2pt approaches. The unbiased parameter recovery demonstrated in this challenge by multiple statistics and the associated modeling and inference frameworks supports the credibility of cosmology constraints from these methods. The challenge data set is publicly available, and we welcome future submissions from methods that are not yet represented.

Krause, Elisabeth [Univ. of Arizona, Tucson, AZ (U↗

Inferring Atmospheric Release Characteristics in a Large Computer Experiment using Bayesian Adaptive Splines

An atmospheric release of hazardous material, whether accidental or intentional, can be catastrophic for those in the path of the plume. Predicting the path of a plume based on characteristics of the release (location, amount and duration) and meteorological conditions is an active research area highly relevant for emergency and long-term response to these releases. As a result, researchers have developed particle dispersion simulators to provide plume path predictions that incorporate release characteristics and meteorological conditions. However, since release characteristics and meteorological conditions are often unknown, the inverse problem is of great interest, that is, based on all the observations of the plume so far, what can be inferred about the release characteristics? This is the question we seek to answer using plume observations from a controlled release at the Diablo Canyon Nuclear Power Plant in Central California. With access to a large number of evaluations of a computationally expensive particle dispersion simulator that includes continuous and categorical inputs and spatio-temporal output, building a fast statistical surrogate model (or emulator) presents many statistical challenges, but is an essential tool for inverse modeling and sensitivity analysis. We achieve accurate emulation using Bayesian adaptive splines to model weights on empirical orthogonal functions. Here, we use this emulator as well as appropriately identifiable simulator discrepancy and observational error models to calibrate the simulator, thus finding a posterior distribution of characteristics of the release. Since the release was controlled, these characteristics are known, making it possible to compare our findings to the truth.

54 ENVIRONMENTAL SCIENCES↗

The Aemulus Project. VI. Emulation of Beyond-standard Galaxy Clustering Statistics to Improve Cosmological Constraints

Abstract There is untapped cosmological information in galaxy redshift surveys in the nonlinear regime. In this work, we use the Aemulus suite of cosmological N -body simulations to construct Gaussian process emulators of galaxy clustering statistics at small scales (0.1–50 h −1 Mpc) in order to constrain cosmological and galaxy bias parameters. In addition to standard statistics—the projected correlation function w p ( r p ), the redshift-space monopole of the correlation function ξ 0 ( s ), and the quadrupole ξ 2 ( s )—we emulate statistics that include information about the local environment, namely the underdensity probability function P U ( s ) and the density-marked correlation function M ( s ). This extends the model of Aemulus III for redshift-space distortions by including new statistics sensitive to galaxy assembly bias. In recovery tests, we find that the beyond-standard statistics significantly increase the constraining power on cosmological parameters of interest: including P U ( s ) and M ( s ) improves the precision of our constraints on Ω m by 27%, σ 8 by 19%, and the growth of structure parameter, f σ 8 , by 12% compared to standard statistics. We additionally find that scales below ∼6 h −1 Mpc contain as much information as larger scales. The density-sensitive statistics also contribute to constraining halo occupation distribution parameters and a flexible environment-dependent assembly bias model, which is important for extracting the small-scale cosmological information as well as understanding the galaxy–halo connection. This analysis demonstrates the potential of emulating beyond-standard clustering statistics at small scales to constrain the growth of structure as a test of cosmic acceleration.

79 ASTRONOMY AND ASTROPHYSICS↗

Emulator Generation Gadget

This software automates the production of standalone emulators for complex computer models. The end result of running the software is a piece of code called an emulator, a statistical approximation which predicts the output of complex computer simulation, but at a much faster speed. The emulator is built using a training set of inputs and outputs from the simulations. The input-output pairs are used in a Bayesian scheme to estimate the parameters of a Gaussian process based regression model that learns the input-output relationship. The estimated parameters are combined with a generic C skeleton to produce a compile-able instantiation of the emulator.

Sweeney, Christine↗

Sensitivity Analysis and Emulation for Functional Data using Bayesian Adaptive Splines

When a computer code is used to simulate a complex system, one of the fundamental tasks is to assess the sensitivity of the simulator to the different input parameters. In the case of computationally expensive simulators, this is often accomplished via a surrogate statistical model, a statistical output emulator. An effective emulator is one that provides good approximations to the computer code output for wide ranges of input values. In addition, an emulator should be able to handle large dimensional simulation output for a relevant number of inputs; it should flexibly capture heterogeneities in the variability of the response surface; it should be fast to evaluate for arbitrary combinations of input parameters, and it should provide an accurate quantification of the emulation uncertainty. In this paper we discuss the Bayesian approach to multivariate adaptive regression splines (BMARS) as an emulator for a computer model that outputs curves. We introduce modifications to traditional BMARS approaches that allow for fitting large amounts of data and allow for more efficient MCMC sampling. We emphasize the ease with which sensitivity analysis can be performed in this situation. We present a sensitivity analysis of a computer model of the deformation of a protective plate used in pressure-driven experiments. Our example serves as an illustration of the ability of BMARS emulators to fulfill all the necessities of computability, flexibility and reliable calculation on relevant measures of sensitivity.

97 MATHEMATICS AND COMPUTING↗

Fast strength model characterization using Bayesian statistics

A variety of flow stress models exist with new models constantly being developed. These models aim to approximate the strength of materials in a variety of regimes from quasistatic loading through shock scenarios. All models contain an array of parameters which need to be tuned to the material under study. Some models perform well under limited conditions, requiring adjustment of the parameters when venturing outside of those predefined ranges. Other models perform well over a wide range of conditions with a set of parameters, but may be outperformed by other models optimized on a tighter range of conditions. Recent research by Los Alamos demonstrated the ability to optimize the Johnson Cook (JC) model using a set of 3 plate-impact experiments on Aluminum. They utilized Bayesian statistics and emulation to determine optimal parameters for the model with a quantification of parameter uncertainty. We present an extension of this capability to incorporate velocimetry from plate-impact tests, stress-strain data from split Hopkinson pressure bar and quasistatic compression tests, plus profiles from Taylor cylinders in a unified fashion. Statistically robust comparisons of the performance and uncertainty of different realizations of the JC flow stress model were carried out based on calibration to several possible combinations of these three different experiment types.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗