SEARCH · Search NASA

Results for “Statistical Emulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

NASA NTRS2023

The Statistical Emulators of GGCMI Phase 2: Responses of Year-to-Year Variation of Crop Yield to CO 2 , Temperature, Water and Nitrogen Perturbations

Understanding the impact of climate change on year-to-year variation of crop yield is critical to global food stability and security. While crop model emulators are believed to be lightweight tools to replace the models, few emulators have been developed to capture such interannual variation of crop yield in response to climate variability. In this study, we developed a statistical emulator with a machine learning algorithm to reproduce the response of year-to-year variation of four crop yields to CO 2 (C), temperature (T), water (W), and nitrogen (N) perturbations defined in the Global Gridded Crop Model Intercomparison Project (GGCMI) phase 2. The emulators were able to explain more than 52 % of the variance of simulated yield and performed well in capturing the year-to-year variation of global average and gridded crop yield over current croplands in the baseline. With the changes in CO 2 –temperature–water–nitrogen (CTWN) perturbations, the emulators could reproduce the year-to-year variation of crop yield well over most current cropland. The variation of R and the mean absolute error was small under the single CTWN perturbations and dual-factor perturbations. These emulators thus provide statistical response surfaces of yield, including both its mean and interannual variability, to climate factors. They could facilitate spatiotemporal downscaling of crop model simulation, projecting the changes in crop yield variability in the future and serving as a lightweight tool for multi-model ensemble simulation. The emulators enhanced the flexibility of crop yield estimates and expanded the application of large-ensemble simulations of crop yield under climate change.

Climate change↗

NASA NTRS2016

Statistical Emulator for Expensive Classification Simulators

Expensive simulators prevent any kind of meaningful analysis to be performed on the phenomena they model. To get around this problem the concept of using a statistical emulator as a surrogate representation of the simulator was introduced in the 1980's. Presently, simulators have become more and more complex and as a result running a single example on these simulators is very expensive and can take days to weeks or even months. Many new techniques have been introduced, termed criteria, which sequentially select the next best (most informative to the emulator) point that should be run on the simulator. These criteria methods allow for the creation of an emulator with only a small number of simulator runs. We follow and extend this framework to expensive classification simulators.

Ross, Jerret↗

DOE OSTI2021

Statistical emulation of a perturbed basal melt ensemble of an ice sheet model to better quantify Antarctic sea level rise uncertainties

Abstract. Antarctic ice shelves are vulnerable to warming ocean temperatures, and some have already begun thinning in response to increased basal melt rates. Sea level is therefore expected to rise due to Antarctic contributions, but uncertainties in its amount and timing remain largely unquantified. In particular, there is substantial uncertainty in future basal melt rates arising from multi-model differences in thermal forcing and how melt rates depend on that thermal forcing. To facilitate uncertainty quantification in sea level rise projections, we build, validate, and demonstrate projections from a computationally efficient statistical emulator of a high-resolution (4 km) Antarctic ice sheet model, the Community Ice Sheet Model version 2.1. The emulator is trained to a large (500-member) ensemble of 200-year-long 4 km resolution transient ice sheet simulations, whereby regional basal melt rates are perturbed by idealized (yet physically informed) trajectories. The main advantage of our emulation approach is that by sampling a wide range of possible basal melt trajectories, the emulator can be used to (1) produce probabilistic sea level rise projections over much larger Monte Carlo ensembles than are possible by direct numerical simulation alone, thereby providing better statistical characterization of uncertainties, and (2) predict the simulated ice sheet response under differing assumptions about basal melt characteristics as new oceanographic studies are published, without having to run additional numerical ice sheet simulations. As a proof of concept, we propagate uncertainties about future basal melt rate trajectories, derived from regional ocean models, to generate probabilistic sea level rise estimates for 100 and 200 years into the future.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2012

Towards Validation of an Adaptive Flight Control Simulation Using Statistical Emulation

Traditional validation of flight control systems is based primarily upon empirical testing. Empirical testing is sufficient for simple systems in which a.) the behavior is approximately linear and b.) humans are in-the-loop and responsible for off-nominal flight regimes. A different possible concept of operation is to use adaptive flight control systems with online learning neural networks (OLNNs) in combination with a human pilot for off-nominal flight behavior (such as when a plane has been damaged). Validating these systems is difficult because the controller is changing during the flight in a nonlinear way, and because the pilot and the control system have the potential to co-adapt in adverse ways traditional empirical methods are unlikely to provide any guarantees in this case. Additionally, the time it takes to find unsafe regions within the flight envelope using empirical testing means that the time between adaptive controller design iterations is large. This paper describes a new concept for validating adaptive control systems using methods based on Bayesian statistics. This validation framework allows the analyst to build nonlinear models with modal behavior, and to have an uncertainty estimate for the difference between the behaviors of the model and system under test.

He, Yuning↗

DOE OSTI2020

Quantifying Uncertainties of Microscopic Nuclear Theories

The goal of this project was to produce modernized nuclear data libraries of light ion fusion reactions and actinide fission product yields. Such libraries are essential input in both stockpile science but also fundamental science (nucleosynthesis, superheavy nuclei). When such libraries are used to model complex processes involving exotic, very short-lived nuclei that have not been measured experimentally, the underlying nuclear data come from theoretical models, the predictive power of which needs to be quantified, together with its uncertainties. By teaming up nuclear theorists and statisticians, we built comprehensive theoretical frameworks based on the most fundamental theories of fusion and fission that we coupled for the first time with a Bayesian framework with machine learning techniques for uncertainty quantification. Our results include: (1) statistical emulators for neutron-alpha scattering, and the fission product mass yields of neutron-induced fission of 239 Pu, which will enable developers to generate random realizations of the corresponding data for uncertainty quantification (UQ) in applications; (2) the first complete and most accurate ab initio prediction of the S-factor for proton capture on 7 Be, which – combined with UQ – may become the recommended value at solar energies in the next review of solar fusion cross sections; (3) statistical emulators for fission mass yields in the neutron-induced fission of 239 Pu; (4) the first quantification of how uncertainties in nuclear forces impact fission properties that are relevant in nucleosynthesis simulations to explain how heavy elements are formed in the Cosmos.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2024

Cosmological parameters from the joint analysis of density split and second order statistics: An emulator based on the halo occupation distribution

Not Available

Burger, Pierre A. (ORCID:0000000186376305)↗

NASA NTRS2020

The GGCMI Phase 2 emulators: global gridded crop model responses to changes in CO2, temperature, water, and nitrogen (version 1.0)

Statistical emulation allows combining advantageous features of statistical and process-based crop models for understanding the effects of future climate changes on crop yields. We describe here the development of emulators for nine process-based crop models and five crops using output from the Global Gridded Model Intercomparison Project (GGCMI) Phase 2. The GGCMI Phase 2 experiment is designed with the explicit goal of producing a structured training dataset for emulator development that samples across four dimensions relevant to crop yields: atmospheric carbon dioxide (CO2) concentrations, temperature, water supply, and nitrogen inputs (CTWN). Simulations are run under two different adaptation assumptions: that growing seasons shorten in warmer climates, and that cultivar choice allows growing seasons to remain fixed. The dataset allows emulating the climatological-mean yield response of all models with a simple polynomial in mean growing-season values. Climatological-mean yields are a central metric in climate change impact analysis; we show here that they can be captured without relying on interannual variations. In general, emulation errors are negligible relative to differences across crop models or even across climate model scenarios; errors become significant only in some marginal lands where crops are not currently grown. We demonstrate that the resulting GGCMI emulators can reproduce yields under realistic future climate simulations, even though the GGCMI Phase 2 dataset is constructed with uniform CTWN offsets, suggesting that the effects of changes in temperature and precipitation distributions are small relative to those of changing means. The resulting emulators therefore capture relevant crop model responses in a lightweight, computationally tractable form, providing a tool that can facilitate model comparison, diagnosis of interacting factors affecting yields, and integrated assessment of climate impacts.

James A Franke↗

DOE OSTI2020

The GGCMI Phase 2 emulators: global gridded crop model responses to changes in CO 2 , temperature, water, and nitrogen (version 1.0)

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Gaussian Process Emulators for Volcanic Ash Dispersion Model Tephra2

It is necessary to predict volcanic ash deposition since falling ash is harmful to human activities. Because simulators built for this purpose are computationally expensive, it is popular to use statistical emulators for geophysical hazard analyses, where a large number of simulations are required. Gaussian stochastic process emulators are able to approximate expensive simulations in an accurate and efficient way. Using a relatively small number of simulation runs, a well-trained emulator can accurately predict simulation outputs at massive new input points in a few seconds. Under different explosive eruption conditions, we constructed Gaussian stochastic process emulators for Tephra2, a simulation tool for estimating the accumulation of volcanic ash over a region. Historical wind records are used as input wind data, without assuming a Gaussian wind speed profile or common wind direction among elevations. While there are several inputs for Tephra2, we use no more than three physically motivated variables as emulator inputs to reduce the computational cost of emulations. The emulator outputs predict the mass of tephra per unit area at 50281 grid points around a predetermined vent location.

58 GEOSCIENCES↗

NASA NTRS2014

Carbon-Temperature-Water Change Analysis for Peanut Production Under Climate Change: A Prototype for the AgMIP Coordinated Climate-Crop Modeling Project (C3MP)

Climate change is projected to push the limits of cropping systems and has the potential to disrupt the agricultural sector from local to global scales. This article introduces the Coordinated Climate-Crop Modeling Project (C3MP), an initiative of the Agricultural Model Intercomparison and Improvement Project (AgMIP) to engage a global network of crop modelers to explore the impacts of climate change via an investigation of crop responses to changes in carbon dioxide concentration ([CO2]), temperature, and water. As a demonstration of the C3MP protocols and enabled analyses, we apply the Decision Support System for Agrotechnology Transfer (DSSAT) CROPGRO-Peanut crop model for Henry County, Alabama, to evaluate responses to the range of plausible [CO2], temperature changes, and precipitation changes projected by climate models out to the end of the 21st century. These sensitivity tests are used to derive crop model emulators that estimate changes in mean yield and the coefficient of variation for seasonal yields across a broad range of climate conditions, reproducing mean yields from sensitivity test simulations with deviations of ca. 2% for rain-fed conditions. We apply these statistical emulators to investigate how peanuts respond to projections from various global climate models, time periods, and emissions scenarios, finding a robust projection of modest (<10%) median yield losses in the middle of the 21st century accelerating to more severe (>20%) losses and larger uncertainty at the end of the century under the more severe representative concentration pathway (RCP8.5). This projection is not substantially altered by the selection of the AgMERRA global gridded climate dataset rather than the local historical observations, differences between the Third and Fifth Coupled Model Intercomparison Project (CMIP3 and CMIP5), or the use of the delta method of climate impacts analysis rather than the C3MP impacts response surface and emulator approach.

climate change↗

DOE OSTI2024

Probabilistic projections of the Amery Ice Shelf catchment, Antarctica, under conditions of high ice-shelf basal melt

Abstract. Antarctica's Lambert Glacier drains about one-sixth of the ice from the East Antarctic Ice Sheet and is considered stable due to the strong buttressing provided by the Amery Ice Shelf. While previous projections of the sea-level contribution from this sector of the ice sheet have predicted significant mass loss only with near-complete removal of the ice shelf, the ocean warming necessary for this was deemed unlikely. Recent climate projections through 2300 indicate that sufficient ocean warming is a distinct possibility after 2100. This work explores the impact of parametric uncertainty on projections of the response of the Lambert–Amery system (hereafter “the Amery sector”) to abrupt ocean warming through Bayesian calibration of a perturbed-parameter ice-sheet model ensemble. We address the computational cost of uncertainty quantification for ice-sheet model projections via statistical emulation, which employs surrogate models for fast and inexpensive parameter space exploration while retaining critical features of the high-fidelity simulations. To this end, we build Gaussian process (GP) emulators from simulations of the Amery sector at a medium resolution (4–20 km mesh) using the Model for Prediction Across Scales (MPAS)-Albany Land Ice (MALI) model. We consider six input parameters that control basal friction, ice stiffness, calving, and ice-shelf basal melting. From these, we generate 200 perturbed input parameter initializations using space filling Sobol sampling. For our end-to-end probabilistic modeling workflow, we first train emulators on the simulation ensemble and then calibrate the input parameters using observations of the mass balance, grounding line movement, and calving front movement with priors assigned via expert knowledge. Next, we use MALI to project a subset of simulations to 2300 using ocean and atmosphere forcings from a climate model for both low- and high-greenhouse-gas-emission scenarios. From these simulation outputs, we build multivariate emulators by combining GP regression with principal component dimension reduction to emulate multivariate sea-level contribution time series data from the MALI simulations. We then use these emulators to propagate uncertainty from model input parameters to predictions of glacier mass loss through 2300, demonstrating that the calibrated posterior distributions have both greater mass loss and reduced variance compared to the uncalibrated prior distributions. Parametric uncertainty is large enough through about 2130 that the two projections under different emission scenarios are indistinguishable from one another. However, after rapid ocean warming in the first half of the 22nd century, the projections become statistically distinct within decades. Overall, this study demonstrates an efficient Bayesian calibration and uncertainty propagation workflow for ice-sheet model projections and identifies the potential for large sea-level rise contributions from the Amery sector of the Antarctic Ice Sheet after 2100 under high-greenhouse-gas-emission scenarios.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Beyond the proton drip line: Bayesian analysis of proton-emitting nuclei

The limits of the nuclear landscape are determined by nuclear binding energies. Beyond the proton drip lines, where the separation energy becomes negative, there is not enough binding energy to prevent protons from escaping the nucleus. Predicting properties of unstable nuclear states in the vast territory of proton emitters poses an appreciable challenge for nuclear theory as it often involves far extrapolations. In addition, significant discrepancies between nuclear models in the proton-rich territory call for quantified predictions. With the help of Bayesian methodology, we mix a family of nuclear mass models corrected with statistical emulators trained on the experimental mass measurements, in the proton-rich region of the nuclear chart. Separation energies were computed within nuclear density functional theory using several Skyrme and Gogny energy density functionals. We also considered mass predictions based on two models used in astrophysical studies. Quantified predictions were obtained for each model using Bayesian Gaussian processes trained on separation-energy residuals and combined via Bayesian model averaging. Here, we obtained a good agreement between averaged predictions of statistically corrected models and experiment. In particular, we quantified model results for one- and two-proton separation energies and derived probabilities of proton emission. This information enabled us to produce a quantified landscape of proton-rich nuclei. The most promising candidates for two-proton decay studies have been identified. Finally, the methodology used in this work has broad applications to model-based extrapolations of various nuclear observables. It also provides a reliable uncertainty quantification of theoretical predictions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

Megadrought: A Series of Unfortunate La Niña Events?

Megadroughts are multidecadal periods of aridity more persistent than most droughts during the instrumental period. Paleoclimate evidence suggests that megadroughts occur in many parts of the world, including North America, Central America, western Europe, eastern Asia, and northern Africa. It remains unclear to what extent such megadroughts require external forcing or whether they can arise from internal climate variability alone. A novel statistical–dynamical approach is used to evaluate the possibility that such events arise solely as a function of interannual tropical sea surface temperature (SST) variations. A statistical emulator of tropical SST variations is constructed by using an empirical moving-blocks bootstrap approach that randomly samples multiyear sequences of the observational SST record. This approach preserves the power spectrum, seasonal cycle, and spatial pattern of El Niño-Southern Oscillation (ENSO) but removes longer timescale fluctuations embedded in the observational record. These resampled SST anomalies are then used to force an atmospheric model (the Community Atmosphere Model Version 5). As megadroughts emerge in this run, they should, therefore, be solely a consequence of La Niña sequences combined with internal atmospheric variability and persistence driven by soil moisture storage and other land-surface processes. We indeed find that megadroughts in this simulation have an amplitude-duration rate that is generally indistinguishable from the rate documented in paleoclimate records of the western United States. Our findings support the idea that megadroughts may occur randomly when the unforced climate system evolves freely over a sufficiently long period of time, implying that an unforced unusual but statistically plausible series of La Niña events may be sufficient to generate megadrought.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

A Framework for Parametric and Predictive Uncertainty Quantification in the E3SM Land Model: Assessing Site and Observable Generalizability

Quantifying parametric uncertainty using observations from individual sites provides a critical foundation for Earth system modeling, serving as a necessary first step before scaling up to regional or global applications. This study introduces a novel computational framework designed to enhance model predictability by reducing parametric uncertainty and assessing site and observable generalizability using various observational constraints. The framework integrates five components: Model Simulation, Statistical Emulation, Global Sensitivity Analysis (GSA), Model Calibration, and Model Prediction. Using the E3SM land model, we simulated site-level land-atmosphere carbon and energy fluxes from 2003 to 2007 across five evergreen needleleaf FLUXNET sites, perturbing 26 vegetation-related model parameters. Gaussian process emulators were employed to expedite GSA and model calibration. Four critical parameters that strongly influence selected land-atmosphere fluxes were identified by GSA. Bayesian approaches were used to infer parameter probability distributions leveraging synthetic data and FLUXNET observations. The results reveal that posterior parameter distributions vary significantly across different sites and observables within the same plant functional type. Probabilistic predictions indicate that parameters calibrated at one site can enhance predictive accuracy at other sites, although site heterogeneity may sometimes outweigh parametric uncertainty. Additionally, the probabilistic predictions demonstrate that calibration for one variable can also improve predictability for other variables, thereby maximizing predictive capabilities with limited observations. This framework provides a powerful approach for reducing parametric uncertainty in Earth system models and deepening our understanding of carbon dynamics and energy cycles. Its adaptability makes it a valuable tool for broader applications in Earth system modeling.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Projected land ice contributions to twenty-first-century sea level rise

The land ice contribution to global mean sea level rise has not yet been predicted using ice sheet and glacier models for the latest set of socio-economic scenarios, nor using coordinated exploration of uncertainties arising from the various computer models involved. Two recent international projects generated a large suite of projections using multiple models, but primarily used previous-generation scenarios and climate models, and could not fully explore known uncertainties. Here we estimate probability distributions for these projections under the new scenarios using statistical emulation of the ice sheet and glacier models. In this work, we find that limiting global warming to 1.5 degrees Celsius would halve the land ice contribution to twenty-first-century sea level rise, relative to current emissions pledges. The median decreases from 25 to 13 centimetres sea level equivalent (SLE) by 2100, with glaciers responsible for half the sea level contribution. The projected Antarctic contribution does not show a clear response to the emissions scenario, owing to uncertainties in the competing processes of increasing ice loss and snowfall accumulation in a warming climate. However, under risk-averse (pessimistic) assumptions, Antarctic ice loss could be five times higher, increasing the median land ice contribution to 42 centimetres SLE under current policies and pledges, with the 95th percentile projection exceeding half a metre even under 1.5 degrees Celsius warming. This would severely limit the possibility of mitigating future coastal flooding. Given this large range (between 13 centimetres SLE using the main projections under 1.5 degrees Celsius warming and 42 centimetres SLE using risk-averse projections under current pledges), adaptation planning for twenty-first-century sea level rise must account for a factor-of-three uncertainty in the land ice contribution until climate policies and the Antarctic response are further constrained.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Calibration of energy density functionals with deformed nuclei

Nuclear density functional theory is the prevalent theoretical framework for accurately describing nuclear properties at the scale of the entire chart of nuclides. Given an energy functional and a many-body scheme (e.g., single- or multireference level), the predictive power of the theory depends strongly on how the parameters of the energy functionals have been calibrated with experimental data. Expanded algorithms and computing power have enabled recent optimization protocols to include data in deformed nuclei in order to optimize the coupling constants of the energy functional. The primary motivation of this work is to test the robustness of such protocols with respect to some of the technical and numerical details of the underlying calculations, especially when the calibration explores a large parameter space. To this end, we quantify the effect of these uncertainties on both the optimization and statistical emulation of composite objective functions. We also emphasize that Bayesian calibration can provide better estimates of the theoretical errors used to define objective functions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2020

Quantifying Uncertainties In Neutron-Alpha Scattering With Chiral Nucleon-Nucleon And Three-Nucleon Forces

We report that modern ab initio theory combined with high-quality nucleon-nucleon (NN) and three-nucleon (3N) interactions from chiral effective field theory (EFT) can provide a predictive description of low-energy light-nuclei reactions relevant for astrophysics and fusion-energy applications. However, the high cost of computations has so far impeded a complete analysis of the uncertainty budget of such calculations. Starting from NN potentials up to fifth order (N 4 LO) combined with leading-order 3N forces, we study how the order-by-order convergence of the chiral expansion and confidence intervals for the 3N contact and contact-plus-one-pion-exchange low-energy constants (c E and c D ) contribute to the overall uncertainty budget of many-body calculations of neutron- 4 He (n-α) elastic scattering. We compute structure and reaction observables for three-, four-, and five-nucleon systems within the ab initio frameworks of the no-core shell model and no-core shell model with continuum. Using a small set of design runs, we construct a Gaussian process model (GPM) that acts as a statistical emulator for the theory. With this, we gain insight into how uncertainties in the 3N low-energy constants propagate throughout the calculation and determine the Bayesian posterior distribution of these parameters with Markov-Chain Monte Carlo. We find rapidly converging n-α phase shifts with respect to the chiral order. With the adopted leading-order 3N force, calculations based on the NN interaction at N 4 LO of Entem, Machleidt, and Nosyk are unable to reproduce the experimental phase shifts in the 3/2 - channel within the estimated chiral truncation errors. Closer agreement with empirical data is found when using an older parametrization of the NN interaction at order N 3 LO, and the position and width of the P-wave resonances can be used to reduce the uncertainty of the 3N low-energy constants. The present results point to a lack of spin-orbit strength when the newer parametrization of the chiral NN force up to fifth order is combined with the leading-order 3N force. The inclusion of higher-order 3N-force terms may be required to recover the missing strength. GPMs can act as fast and accurate emulators of ab initio many-body calculations of low-energy scattering and reactions of light nuclei, opening the way to a robust quantification of theoretical uncertainties grounded in the description of the underlying chiral Hamiltonian.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

NASA NTRS2021

Projected land ice contributions to twenty-first-century sea level rise

The land ice contribution to global mean sea level rise has not yet been predicted1 using ice sheet and glacier models for the latest set of socio-economic scenarios, nor using coordinated exploration of uncertainties arising from the various computer models involved. Two recent international projects generated a large suite of projections using multiple models2,3,4,5,6,7,8, but primarily used previous-generation scenarios9 and climate models10, and could not fully explore known uncertainties. Here we estimate probability distributions for these projections under the new scenarios11,12 using statistical emulation of the ice sheet and glacier models. We find that limiting global warming to 1.5 degrees Celsius would halve the land ice contribution to twenty-first-century sea level rise, relative to current emissions pledges. The median decreases from 25 to 13 centimetres sea level equivalent (SLE) by 2100, with glaciers responsible for half the sea level contribution. The projected Antarctic contribution does not show a clear response to the emissions scenario, owing to uncertainties in the competing processes of increasing ice loss and snowfall accumulation in a warming climate. However, under risk-averse (pessimistic) assumptions, Antarctic ice loss could be five times higher, increasing the median land ice contribution to 42 centimetres SLE under current policies and pledges, with the 95th percentile projection exceeding half a metre even under 1.5 degrees Celsius warming. This would severely limit the possibility of mitigating future coastal flooding. Given this large range (between 13 centimetres SLE using the main projections under 1.5 degrees Celsius warming and 42 centimetres SLE using risk-averse projections under current pledges), adaptation planning for twenty-first-century sea level rise must account for a factor-of-three uncertainty in the land ice contribution until climate policies and the Antarctic response are further constrained.

Tamsin L. Edwards↗