Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical emulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Cosmological constraints using Minkowski functionals from the first year data of the Hyper Suprime-Cam

We use Minkowski functionals to analyse weak lensing convergence maps from the first-year data release of the Subaru Hyper Suprime-Cam (HSC-Y1) survey. Minkowski functionals provide a description of the morphological properties of a field, capturing the non-Gaussian features of the Universe matter-density distribution. Using simulated catalogues that reproduce survey conditions and encode cosmological information, we emulate Minkowski functionals predictions across a range of cosmological parameters to derive the best-fit from the data. By applying multiple scales cuts, we rigorously mitigate systematic effects, including baryonic feedback and intrinsic alignments. From the analysis, combining constraints of the angular power spectrum and Minkowski functionals, we obtain S8≡σ8Ωm/0.3=0.808−0.046+0.033 and Ωm=0.293−0.043+0.157⁠. These results represent a 40 per cent improvement on the S8 constraints compared to using power spectrum only. Minkowski functionals results are consistent with other two-point, and higher order statistics constraints using the same data, being in agreement with CMB results from the Planck S8 measurements. Our study demonstrates the power of Minkowski functionals beyond two-point statistics to constrain and break the degeneracy between Ωm and σ8⁠.

79 ASTRONOMY AND ASTROPHYSICS↗

Maximum a posteriori Ly α estimator (MAPLE): band power and covariance estimation of the 3D Ly α forest power spectrum

We present a novel maximum a posteriori estimator to jointly estimate band powers and the covariance of the three-dimensional power spectrum (P3D) of Ly $\alpha$ forest flux fluctuations, called MAPLE. Our Wiener-filter based algorithm reconstructs a window-deconvolved P3D in the presence of complex survey geometries typical for Ly $\alpha$ surveys that are sparsely sampled transverse to and densely sampled along the line of sight. We demonstrate our method on idealized Gaussian random fields with two selection functions: (i) a sparse sampling of 30 background sources per square degree designed to emulate the current Dark Energy Spectroscopic Instrument; (ii) a dense sampling of 900 background sources per square degree emulating the upcoming Prime Focus Spectrograph Galaxy Evolution Survey. Our proof-of-principle shows promise, especially since the algorithm can be extended to marginalize jointly over nuisance parameters and contaminants, i.e. offsets introduced by continuum fitting. Our code is implemented in JAX and is publicly available on GitHub.

79 ASTRONOMY AND ASTROPHYSICS↗

Sequential data assimilation for single-molecule FRET photon-counting data

Data assimilation is a statistical method designed to improve the quality of numerical simulations in combination with real observations. Here, we develop a sequential data assimilation method that incorporates one-dimensional time-series data of smFRET (single-molecule Förster resonance energy transfer) photon-counting into conformational ensembles of biomolecules derived from “replicated” molecular dynamics (MD) simulations. A particle filter using a large number of “replicated” MD simulations with a likelihood function for smFRET photon-counting data is employed to screen the conformational ensembles that match the experimental data. We examine the performance of the method using emulated smFRET data and coarse-grained (CG) MD simulations of a dye-labeled polyproline-20. The method estimates the dynamics of the end-to-end distance from smFRET data as well as revealing that of latent conformational variables. The particle filter is also able to correct model parameter dependence in CG MD simulations. We discuss the applicability of the method to real experimental data for conformational dynamics of biomolecules.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deep learning-based predictive models for laser direct drive at the Omega Laser Facility

The rich and complex physics of inertial confinement fusion provides a unique and challenging space for high-fidelity first-principles modeling. Consequently, simulation codes that are used to design experiments are computationally expensive and lack the predictive capability required for extensive parameter exploration in search of a high-performing design for laser direct drive. In this article, we present two deep-learning-based predictive models intended to address these difficulties. The first model (TL DNN) acts as a fast emulator of simulations as well as experiments at the Omega Laser Facility. This model is trained on a simulation database and subsequently calibrated on experimental data using transfer learning. To facilitate the development of this model, an autoencoder is developed to reduce the dimensionality of the input space by compressing the laser pulse input. The model predicts key experimental scalar observables of Omega experiments with high accuracy and minimal computational cost. This deep neural net enables rapid exploration of a high-dimensional input parameter space for an optimal implosion design. The second model (DNN SM+) aims to extend the statistical modeling work of Lees et al. [Phys. Rev. Lett. 127, 105001 (2021)], by increasing the complexity of the model space and allowing for coupling between degradation terms. Since the model capacity of DNN SM+ is higher than the model of Lees et al., DNN SM+ can potentially provide an improvement in predictive capability, and we use this model to provide insight into complicated degradation dependencies.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A Hybrid Reduced-Order Model of Fine-Resolution Hydrologic Simulations at a Polygonal Tundra Site

High-resolution predictions of land surface hydrological dynamics are desirable for improved investigations of regional- and watershed-scale processes. Direct deterministic simulations of fine-resolution land surface variables present many challenges, including high computational cost. We therefore propose the use of reduced-order modeling techniques to facilitate emulation of fine-resolution simulations. We use an emulator, Gaussian process regression, to approximate fine-resolution four-dimensional soil moisture fields predicted using a three-dimensional surface-subsurface hydrological simulator (PFLOTRAN). A dimension-reduction technique known as “proper orthogonal decomposition” is further used to improve the efficiency of the resulting reduced-order model (ROM). The ROM reduces simulation computational demand to negligible levels compared to the underlying fine-resolution model. In addition, the ROM that we constructed is equipped with an uncertainty estimate, allowing modelers to construct a ROM consistent with uncertainty in the measured data. The ROM is also capable of constructing statistically equivalent analogs that can be used in uncertainty and sensitivity analyses. We apply the technique to four polygonal tundra sites near Barrow, Alaska that are part of the Department of Energy’s Next-Generation Ecosystem Experiments (NGEE)-Arctic project. The ROM is trained for each site using simulated soil moisture from 1998-2000 and validated using the simulated data for 2002 and 2006. The average relative RMSEs of the ROMs are under 1%.

58 GEOSCIENCES↗

Fldgen v1.0: an emulator with internal variability and space–time correlation for Earth system models

Earth system models (ESMs) are the gold standard for producing future projections of climate change, but running them is difficult and costly, and thus researchers are generally limited to a small selection of scenarios. This paper presents a technique for detailed emulation of the Earth system model (ESM) temperature output, based on the construction of a deterministic model for the mean response to global temperature. The residuals between the mean response and the ESM output temperature fields are used to construct variability fields that are added to the mean response to produce the final product. The method produces grid-level output with spatially and temporally coherent variability. Output fields include random components, so the system may be run as many times as necessary to produce large ensembles of fields for applications that require them. We introduce the method, show example outputs, and present statistical verification that it reproduces the ESM properties it is intended to capture. This method, available as an open-source R package, should be useful in the study of climate variability and its contribution to uncertainties in the interactions between human and Earth systems.

58 GEOSCIENCES↗

What Is the Best Way to Contour Lung Tumors on PET Scans? Multiobserver Validation of a Gradient-Based Method Using a NSCLC Digital PET Phantom

Purpose: To evaluate the accuracy and consistency of a gradient-based positron emission tomography (PET) segmentation method, GRADIENT, compared with manual (MANUAL) and constant threshold (THRESHOLD) methods. Methods and Materials: Contouring accuracy was evaluated with sphere phantoms and clinically realistic Monte Carlo PET phantoms of the thorax. The sphere phantoms were 10-37 mm in diameter and were acquired at five institutions emulating clinical conditions. One institution also acquired a sphere phantom with multiple source-to-background ratios of 2:1, 5:1, 10:1, 20:1, and 70:1. One observer segmented (contoured) each sphere with GRADIENT and THRESHOLD from 25% to 50% at 5% increments. Subsequently, seven physicians segmented 31 lesions (7-264 mL) from 25 digital thorax phantoms using GRADIENT, THRESHOLD, and MANUAL. Results: For spheres <20 mm in diameter, GRADIENT was the most accurate with a mean absolute % error in diameter of 8.15% (10.2% SD) compared with 49.2% (51.1% SD) for 45% THRESHOLD (p < 0.005). For larger spheres, the methods were statistically equivalent. For varying source-to-background ratios, GRADIENT was the most accurate for spheres >20 mm (p < 0.065) and <20 mm (p < 0.015). For digital thorax phantoms, GRADIENT was the most accurate (p < 0.01), with a mean absolute % error in volume of 10.99% (11.9% SD), followed by 25% THRESHOLD at 17.5% (29.4% SD), and MANUAL at 19.5% (17.2% SD). GRADIENT had the least systematic bias, with a mean % error in volume of -0.05% (16.2% SD) compared with 25% THRESHOLD at -2.1% (34.2% SD) and MANUAL at -16.3% (20.2% SD; p value <0.01). Interobserver variability was reduced using GRADIENT compared with both 25% THRESHOLD and MANUAL (p value <0.01, Levene's test). Conclusion: GRADIENT was the most accurate and consistent technique for target volume contouring. GRADIENT was also the most robust for varying imaging conditions. GRADIENT has the potential to play an important role for tumor delineation in radiation therapy planning and response assessment.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

An Efficient Bayesian Approach to Learning Droplet Collision Kernels: Proof of Concept Using “Cloudy,” a New n -Moment Bulk Microphysics Scheme

The small-scale microphysical processes governing the formation of precipitation particles cannot be resolved explicitly by cloud resolving and climate models. Instead, they are represented by microphysics schemes that are based on a combination of theoretical knowledge, statistical assumptions, and fitting to data (“tuning”). Historically, tuning was done in an ad hoc fashion, leading to parameter choices that are not explainable or repeatable. Recent work has treated it as an inverse problem that can be solved by Bayesian inference. The posterior distribution of the parameters given the data—the solution of Bayesian inference—is found through computationally expensive sampling methods, which require over $\mathcal{O}$(10 5 ) evaluations of the forward model; this is prohibitive for many models. We present a proof of concept of Bayesian learning applied to a new bulk microphysics scheme named “Cloudy,” using the recently developed Calibrate-Emulate-Sample (CES) algorithm. Cloudy models collision-coalescence and collisional breakup of cloud droplets with an adjustable number of prognostic moments and with easily modifiable assumptions for the cloud droplet mass distribution and the collision kernel. The CES algorithm uses machine learning tools to accelerate Bayesian inference by reducing the number of forward evaluations needed to $\mathcal{O}$(10 2 ). It also exhibits a smoothing effect when forward evaluations are polluted by noise. In a suite of perfect-model experiments, we show that CES enables computationally efficient Bayesian inference of parameters in Cloudy from noisy observations of moments of the droplet mass distribution. In an additional imperfect-model experiment, a collision kernel parameter is successfully learned from output generated by a Lagrangian particle-based microphysics model.

54 ENVIRONMENTAL SCIENCES↗

Rigorous constraints on three-nucleon forces in chiral effective field theory from fast and accurate calculations of few-body observables

We explore the constraints on the three-nucleon force (3NF) of chiral effective field theory (χ EFT) that are provided by bound-state observables in the A = 3 and A = 4 sectors. Our statistically rigorous analysis incorporates experimental error, computational method uncertainty, and the uncertainty due to truncation of the χ EFT expansion at next-to-next-to-leading order. A consistent solution for the 3 H binding energy, the 4 He binding energy and radius, and the 3 H β-decay rate can only be obtained if χ EFT truncation errors are included in the analysis. Here, the β-decay rate is the only one of these that yields a nondegenerate constraint on the 3NF low-energy constants, which makes it crucial for the parameter estimation. We use eigenvector continuation for fast and accurate emulation of no-core shell model calculations of the few-nucleon observables. This facilitates sampling of the posterior probability distribution, allowing us to also determine the distributions of the parameters that quantify the truncation error. We find a χ EFT expansion parameter of Q = 0.33 ± 0.06 for these observables.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Novel Statistical Method for Measuring the Temperature–Density Relation in the IGM Using the b – N Hi Distribution of Absorbers in the Ly α Forest

We propose a new method for determining the thermal state of the intergalactic medium based on Voigt profile decomposition of the Lyα forest. The distribution of Doppler parameter and column density (b–N H i distribution) is sensitive to the temperature–density relation T = T 0 (ρ/ρ 0 ) γ-1 , and previous work has inferred T 0 and γ by fitting its low-b cutoff. This approach discards the majority of available data and is susceptible to systematics related to cutoff determination. We introduce an approach that exploits all information encoded in the b – N H i distribution by modeling its entire shape. We apply kernel density estimation to discrete absorption lines to generate model probability density functions, and then we use principal component decomposition to create an emulator that can be evaluated anywhere in thermal parameter space. We introduce a Bayesian likelihood based on these models enabling parameter inference via Markov Chain Monte Carlo. The method's robustness is tested by applying it to a large grid of thermal history simulations. By conducting 160 mock measurements, we establish that our approach delivers unbiased estimates and valid uncertainties for a 2D ( T 0 , γ) measurement. Furthermore, we conduct a pilot study applying this methodology to real observational data at z = 2. Using 200 absorbers, equivalent in path length to a single Lya forest spectrum, we measure $\mathrm{log}{T}_{0}={4.092}_{-0.055}^{+0.050}$ and $\gamma ={1.49}_{-0.074}^{+0.073}$ in excellent agreement with cutoff fitting determinations using the same data. Our method is far more sensitive than cutoff fitting, enabling measurements of log T 0 and γ with precision on $\mathrm{log}{T}_{0}$ (γ) nearly two (three) times higher for current data set sizes.

79 ASTRONOMY AND ASTROPHYSICS↗

Pangeo-Enabled ESM Pattern Scaling (PEEPS): A customizable dataset of emulated Earth System Model output

Emulation through pattern scaling is a well-established method of rapidly producing climate fields (like temperature or precipitation) from existing Earth System Model (ESM) output that, while inaccurate, is often useful for a variety of downstream purposes. Conducting pattern scaling has historically been a laborious process, in large part due to the increasing volume of ESM output data that has often required downloading and storing locally to train on. Here we describe the Pangeo-Enabled ESM Pattern Scaling (PEEPS) dataset, a repository of trained annual and monthly patterns from CMIP6 outputs. This manuscript describes and validates these updated patterns so that users can save effort calculating and reporting error statistics in manuscripts focused on the use of patterns. The trained patterns are available as NetCDF files on Zenodo for ease of use in the impact community, and are reproducible with the code provided via GitHub in both Jupyter notebook and Python script formats. Because all training data for the PEEPS data set is cloud-based, users do not need to download and house the ESM output data to reproduce the patterns in the zenodo archive, should that be more efficient. Validating the PEEPS data set on the CMIP6 archive for annual and monthly temperature, precipitation, and near-surface relative humidity, pattern scaling performs well over a variety of future scenarios except for regions in which there are strong, potentially nonlinear climate feedbacks. Although pattern scaling is normally conducted on annual mean ESM output data, it works equally well on monthly mean ESM output data. We identify several downstream applications of the PEEPS data set, including impacts assessment and evaluating certain types of Earth system uncertainties.

54 ENVIRONMENTAL SCIENCES↗

Probabalistic Modeling of Minibangs and Megabands (Final Report)

This project was original proposed as a fundamental advance in the treatment of probabilistic modeling as it applies to nuclear fission calculations of nuclear database inputs and produced particle distributions in heavy-ion collisions. However, funding decisions made within LLNL and the DOE Office of Science led to the project proceeding through three distinct stages. The first two, probabilistic calculations of the fission and jet energy loss relate follow directly from the proposed research. The fission task led to the development of a proof-of-principle Gaussian Process Emulator for time-dependent generator coordinate method (TDGCM) calculation for the fission of Pu-240. To study energy loss in heavy-ion collisions with a probabilistic model, we generated a training data set using the Pythia event generator superimposed on a heavy-ion background with a single quench-factor parameter. We then used kernel density estimation (KDE) to recover the distribution of quench-factors for a calibration data set. In the third stage, we proceeded to work through collaborations, collecting new data within the ATLAS experiment at the Large Hadron Collider (LHC), and further developing bayesian methodology within the Jet Energy-loss Tomography with a Statistically and Computationally Advanced Program Envelope (JETSCAPE) Collaboration.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Greedy emulators for nuclear two-body scattering

Applications of reduced basis method emulators are increasing in low-energy nuclear physics because they enable fast and accurate sampling of high-fidelity calculations, enabling robust uncertainty quantification. Here, in this paper, we develop, implement, and test two model-driven emulators based on the (Petrov-)Galerkin projection using the prototypical test case of two-body scattering with the Minnesota potential and a more realistic local chiral potential. The high-fidelity scattering equations are solved with the matrix Numerov method, a reformulation of the popular Numerov recurrence relation for solving special second-order differential equations as a linear system of coupled equations. A novel error estimator based on reduced-space residuals is applied to an active learning approach (a greedy algorithm) to choosing training samples (“snapshots”) for the emulator and contrasted with a proper orthogonal decomposition (POD) approach. Both approaches allow for computationally efficient offline-online decompositions, but the greedy approach requires many fewer snapshot calculations. These developments set the groundwork for emulating scattering observables based on chiral nucleon-nucleon and three-nucleon interactions and optical models, where computational speed-ups are necessary for Bayesian uncertainty quantification. Our emulators and error estimators are widely applicable to linear systems.

Bayesian methods↗

Modeling stratified flames with and without shear using multiple mapping conditioning

A stochastic sparse particle approach is coupled with an artificial thickening flame (ATF) model for large eddy simulations (LES) to predict a series of turbulent premixed-stratified flames with and without shear and stratification. The thickened reaction progress variable serves as reference variable for the multiple mapping conditioning (MMC) mixing model which emulates turbulent mixing of the stochastic particles. The key feature of MMC is to enforce localness in this reference space when particle pairs are mixed and prevents unphysical mixing of burnt and unburnt fluid across the flame front. We apply MMC-ATF to three flames of a series of turbulent stratified flames and validate the method by comparison with experimental data. The new measurements feature increased accuracy in comparison to previously published data of the same flames due to a better signal-to-noise ratio and a setup which is less prone to beam steering. All flame locations are well predicted by the LES-ATF approach and an analysis of the MMC particle statistics demonstrates that MMC preserves the flamelet-like behaviour in regions where the experiments show low scatter around the flamelet solution. Predicted (local) deviations from the flamelet-solution are comparable to deviations observed in the measurements and variations in the flame structure due to differences in stratification and shear are reasonably well captured by the method.

47 OTHER INSTRUMENTATION↗

Estimation of sensor measurement errors in reactor coolant systems using multi-sensor fusion

A nuclear power plant is typically instrumented with a variety of sensors to continually monitor its variables, and their sensor’s measurements may be used to assess the plant state and initiate safety actions, if needed. Errors in sensor measurements, due to factors such as calibration drifts, critically affect such state assessments. Here, we address a problem of estimating sensor errors using physics-informed machine learning methods that use measurements collected under known plant conditions. For a given sensor, we propose an information fusion method that uses measurements from other sensors to estimate its output assuming it is error-free and provides its difference from an actual measurement as an error estimate. We present the ensemble of trees and support vector machine fusers, and evaluate their performance using measurements collected over an emulated test loop of a pressurized water reactor. The plant variables are related to each other through the underlying physical laws under inertial constraints that place bounds on their derivatives, which analytically justify the applicability of machine learning methods for computing these fusers. Under twenty scenarios, we assess their sensor error estimates for pressure sensors of the heat exchanger of a reactor’s primary coolant system. Multiple types of errors are captured by both fusers under externally induced calibration drifts, blockages, minor leaks and air gaps in sensing lines, and electromagnetic interference; the root mean square error of the estimation of error is under 2.2% percent of the maximum measurement. We present generalization equations, in the framework of statistical learning theory, for these methods that characterize the confidence probability that the estimation error is bounded by a specified parameter in future test scenarios.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Galaxy blending effects in deep imaging cosmic shear probes of cosmology

ABSTRACT Upcoming deep imaging surveys such as the Vera C. Rubin Observatory Legacy Survey of Space and Time will be confronted with challenges that come with increased depth. One of the leading systematic errors in deep surveys is the blending of objects due to higher surface density in the more crowded images; a considerable fraction of the galaxies which we hope to use for cosmology analyses will overlap each other on the observed sky. In order to investigate these challenges, we emulate blending in a mock catalogue consisting of galaxies at a depth equivalent to 1.3 yr of the full 10-yr Rubin Observatory that includes effects due to weak lensing, ground-based seeing, and the uncertainties due to extraction of catalogues from imaging data. The emulated catalogue indicates that approximately 12 per cent of the observed galaxies are ‘unrecognized’ blends that contain two or more objects but are detected as one. Using the positions and shears of half a billion distant galaxies, we compute shear–shear correlation functions after selecting tomographic samples in terms of both spectroscopic and photometric redshift bins. We examine the sensitivity of the cosmological parameter estimation to unrecognized blending employing both jackknife and analytical Gaussian covariance estimators. An ∼0.025 decrease in the derived structure growth parameter S8 = σ8(Ωm/0.3)0.5 is seen due to unrecognized blending in both tomographies with a slight additional bias for the photo-z-based tomography. This bias is greater than the 2σ statistical error in measuring S8.

79 ASTRONOMY AND ASTROPHYSICS↗

Exploring Randomly Wired Neural Networks for Climate Model Emulation

Exploring the climate impacts of various anthropogenic emissions scenarios is key to making informed decisions for climate change mitigation and adaptation. State-of-the-art Earth system models can provide detailed insight into these impacts but have a large associated computational cost on a per-scenario basis. This large computational burden has driven recent interest in developing cheap machine learning models for the task of climate model emulation. In this paper, we explore the efficacy of randomly wired neural networks for this task. We describe how they can be constructed and compare them with their standard feedforward counterparts using the ClimateBench dataset. Specifically, we replace the serially connected dense layers in multilayer perceptrons, convolutional neural networks, and convolutional long short-term memory networks with randomly wired dense layers and assess the impact on model performance for models with 1 million and 10 million parameters. We find that models with less-complex architectures see the greatest performance improvement with the addition of random wiring (up to 30.4% for multilayer perceptrons). Furthermore, of 24 different model architecture, parameter count, and prediction task combinations, only one had a statistically significant performance deficit in randomly wired networks relative to their standard counterparts, with 14 cases showing statistically significant improvement. We also find no significant difference in prediction speed between networks with standard feedforward dense layers and those with randomly wired layers. These findings indicate that randomly wired neural networks may be suitable direct replacements for traditional dense layers in many standard models.

54 ENVIRONMENTAL SCIENCES↗

Climate policy implications of nonlinear decline of Arctic land permafrost and other cryosphere elements

Arctic feedbacks accelerate climate change through carbon releases from thawing permafrost and higher solar absorption from reductions in the surface albedo, following loss of sea ice and land snow. Here, we include dynamic emulators of complex physical models in the integrated assessment model PAGE-ICE to explore nonlinear transitions in the Arctic feedbacks and their subsequent impacts on the global climate and economy under the Paris Agreement scenarios. The permafrost feedback is increasingly positive in warmer climates, while the albedo feedback weakens as the ice and snow melt. Combined, these two factors lead to significant increases in the mean discounted economic effect of climate change: +4.0% (24.8 trillion) under the 1.5 °C scenario, +5.5% ($33.8 trillion) under the 2 °C scenario, and +4.8% (66.9 trillion) under mitigation levels consistent with the current national pledges. Considering the nonlinear Arctic feedbacks makes the 1.5 °C target marginally more economically attractive than the 2 °C target, although both are statistically equivalent.

54 ENVIRONMENTAL SCIENCES↗