Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian Model Calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Quantifying heavy quark transport coefficients with an improved transport model

We report that the heavy-flavor transport coefficients contain important information on the strong interaction at finite temperatures. The extraction of these numbers from experimental data requires dynamical modeling of heavy-flavor transport that is coupled to realistic medium evolution. Furthermore, meaningful extractions necessitate both a faithful implementation of the physical inputs to be tested and the quantification of model uncertainty. For these purposes, we have developed a partonic transport model LIDO. It has an improved treatment of in-medium parton bremsstrahlung, which has been calibrated to theoretical calculations in a simple medium to reduce modeling uncertainty. Regarding the interaction between heavy quark and the medium, few-body perturbative scatterings are applied to large-momentum transfer (q) processes, while a diffusion equation models the dynamics of small-q processes. Such a separation restricts the explicit use of medium quasi-particles to large-q processes only. Another advantage is that deviations from the leading-order probe-medium coupling can be parametrized as an additional contribution to the diffusion constant. The heavy quark transport coefficients are then extracted with uncertainty estimation from a Bayesian analysis including both the RHIC and the LHC data. The results are found to be consistent with earlier extraction of the light-quark transport coefficients at high momentum and be comparable with lattice calculations of the heavy-flavor diffusion constant in the static limit at low momentum.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Robustness of cosmic birefringence measurement against Galactic foreground emission and instrumental systematics

The polarization of the cosmic microwave background (CMB) can be used to search for parity-violating processes like that predicted by a Chern-Simons coupling to a light pseudoscalar field. Such an interaction rotates E modes into E modes in the observed CMB signal through an effect known as cosmic birefringence. Even though isotropic birefringence can be confused with the rotation produced by a miscalibration of the detectors' polarization angles, the degeneracy between both effects is broken when Galactic foreground emission is used as a calibrator. Here, in this work, we use realistic simulations of the High-Frequency Instrument of the Planck mission to test the impact that Galactic foreground emission and instrumental systematics have on the recent birefringence measurements obtained through this technique. Our results demonstrate the robustness of the methodology against the miscalibration of polarization angles and other systematic effects, like intensity-to-polarization leakage, beam leakage, or cross-polarization effects. However, our estimator is sensitive to the EB correlation of polarized foreground emission. Here we propose to correct the bias induced by dust EB by modeling the foreground signal with templates produced in Bayesian component-separation analyses that fit parametric models to CMB data. Acknowledging the limitations of currently available dust templates like that of the Commander sky model, high-precision CMB data and a characterization of dust beyond the modified blackbody paradigm are needed to obtain a definitive measurement of cosmic birefringence in the future.

79 ASTRONOMY AND ASTROPHYSICS↗

Universal reduced basis for the calibration of covariant energy density functionals

The reduced basis method is used to construct a “universal” basis of Dirac orbitals that may be applicable throughout the nuclear chart to calibrate covariant energy density functionals. Relative to the successful development of a reduced basis emulator for the nonrelativistic Schrödinger equation, the Dirac equation adds an extra layer of complexity due to the existence of negative energy states, which complicates building an efficient reduced basis. However, once this problem is mitigated, the resulting reduced basis is able to accurately and efficiently reproduce the high-fidelity model at a fraction of the computational cost. We are confident that the resulting reduced basis will serve as a foundational element in developing rapid and accurate emulators. In turn, these emulators will play a critical role in the Bayesian optimization of covariant energy density functionals.

Bayesian methods↗

Nuclear Data Adjustment for Nonlinear Applications in the OECD/NEA WPNCS SG14 Benchmark—A Bayesian Inverse UQ-Based Approach for Data Assimilation

The Organisation for Economic Co-operation and Development Working Party on Nuclear Criticality Safety has proposed a benchmark exercise to assess the performance of current nuclear data adjustment techniques applied to nonlinear applications and experiments with low correlation to applications. This work introduces Bayesian inverse uncertainty quantification (IUQ) employing scientific machine learning surrogate models as a method for nuclear data adjustments in this benchmark, and compares IUQ to the more traditional methods of generalized linear least squares (GLLS) and Monte Carlo Bayes (MOCABA). Posterior predictions from IUQ showed agreement with GLLS and MOCABA for linear applications. Here, when comparing GLLS, MOCABA, and IUQ posterior predictions to computed model responses using adjusted parameters, we observe that the GLLS predictions failed to replicate the computed response distributions for nonlinear applications, while MOCABA showed near agreement, and IUQ used the computed model responses directly. We also discuss observations on why experiments with low correlation to applications can be informative to nuclear data adjustments and identify some properties useful in selecting experiments for inclusion in nuclear data adjustment. Performance in this benchmark indicates potential for Bayesian IUQ in nuclear data adjustments.

Bayesian calibration↗

Continuity of A Global, Satellite-Based Terrestrial Primary Productivity Dataset in the VIIRS Era Achieved With Model-Data Fusion

The NASA Terra and Aqua satellites have been successfully operating for over two decades and have far exceeded their original 5‐year design life. However, the era of NASA’s Earth Observing System (EOS) may be coming to a close as early as 2023. We conducted a comprehensive calibration and validation of the MODIS MOD17 product [1,2] and the potential for continuity of multi‐decadal ecosystem gross primary productivity (GPP) and annual net primary productivity (NPP), using data from the Visible Infrared Imaging Radiometer Suite (VIIRS) sensors aboard Suomi NPP and NOAA‐20. We combined an 18‐year record of eddy covariance flux tower measurements with hundreds of field measurements of NPP from the Oak Ridge National Laboratories Multi‐Biome collection to benchmark MODIS MOD17 Collection 6.1 (C61) and to develop the first terrestrial productivity estimates from VIIRS. Plant traits from the literature and the global TRY database [3,4] provide strong priors for identifying model parameters in a Bayesian model‐data fusion. As MODIS‐like observations are still needed for global environmental applications, the new VIIRS VNP17 product has the potential to extend these continuous estimates of global, terrestrial primary productivity beyond 2030.

K. Arthur Endsley↗

The Impala's horn applied to posterior samples of Ti-6Al-4V strength model parameters

We have generated strength model parameters for the Preston-Tonks-Wallace (PTW) model of plastic deformation based on a collection of Ti-6Al-4V alloy data and a Bayesian framework. This data collected from the literature includes different chemistries and processes. The experiments include quasistatic compression, Split Hopkinson Pressure Bar (SHPB) compression, and Taylor cylinders. Here we use posterior parameter distributions applied to a hypothetical impact referred to as the Impala's horn. The Impala's horn is like a Taylor cylinder, but modified to have a conical pro le that is truncated before coming to a point. The smaller diameter at the impact end results in higher calculated strain rates and strains than the same velocity impact with the traditional Taylor profile. The modified geometry exercises the behavior of the strength model outside the range of conditions found in the calibration data. Here we sort posterior strength models based on their flow stress at characteristic values for this hypothetical deformation. Then we compare the performance of these posterior models based on two simple observable final state properties of the Impala's horn.

36 MATERIALS SCIENCE↗

Effects of Dose Error and Sample Size on Sonic Boom Dose-Response Curves

NASA will soon be collecting noise-annoyance community survey data as the X-59 aircraft flies supersonically over several communities in the USA. Sparse measurements of the X-59 sonic thumps will be used together with physics-based simulations to estimate noise doses at survey participant locations. These dose estimates have associated error that affects the accuracy of modeled dose-response curves, which can result in misestimation of annoyance. The precision in dose-response curves is also a consideration in selecting the number of survey participants. To enable pretest studies of dose error and precision, simulated dose-response data were generated based on NASA’s Quiet Supersonic Flights 2018 test. The data included various degrees of dose error and sample size. Frequentist multilevel logistic regression models were fit to the true and perturbed dose-response data. Simple proportional relationships were identified between the model parameters and the perturbation standard deviation. The summary dose-response curves illustrate the impact on accuracy if dose error is not accounted for in the model. The precision in the dose-response curves is also shown as the number of participants and degree of participation is varied. Finally, sampling variability is illustrated by showing the dose-response curves for several replicates with random draws of participants and errors.

X-59↗

Commissioning the DIRC Detector and Searching for Axion-like Particles at GlueX

This thesis centers around problems in the study of the strong nuclear force. The GlueX DIRC, a Cherenkov radiation-based detector, was proposed to upgrade the particle identification capability of the GlueX experiment, which aims to perform quantitative tests of Quantum Chromodynamics in the nonperturbative regime by searching for and studying hybrid mesons. This thesis describes the construction, commissioning, reconstruction, and calibration of the GlueX DIRC detector. Originally proposed to solve the strong CP problem, axions and axion-like particles are hypothetical pseudoscalar particles found in many proposed extensions to the Standard Model of particle physics. This thesis presents a search for photoproduction of axion-like particles using data in photon-proton interactions collected by the GlueX experiment at Jefferson Laboratory in the $\gamma\gamma$ and $\pi^+\pi^-\pi^0$ final states of the axion-like particles. In addition, the Monte Carlo modeling of the strong interaction at low energies leads to challenges known as the event generator tuning problem. This thesis presents a novel approach to the Monte Carlo event generator tuning problem using Bayesian optimization.

Yang, Yunjie↗

A NICER View of the Massive Pulsar PSR J0740+6620 Informed by Radio Timing and XMM-Newton Spectroscopy

We report on Bayesian estimation of the radius, mass, and hot surface regions of the massive millisecond pulsar PSR J0740+6620, conditional on pulse-profile modeling of Neutron Star Interior Composition Explorer X-ray Timing Instrument event data. We condition on informative pulsar mass, distance, and orbital inclination priors derived from the joint North American Nanohertz Observatory for Gravitational Waves and Canadian Hydrogen Intensity Mapping Experiment/Pulsar wideband radio timing measurements of Fonseca et al. We use XMM-Newton European Photon Imaging Camera spectroscopic event data to inform our X-ray likelihood function. The prior support of the pulsar radius is truncated at 16 km to ensure coverage of current dense matter models. We assume conservative priors on instrument calibration uncertainty. We constrain the equatorial radius and mass of PSR J0740+6620 to be ${12.39}_{-0.98}^{+1.30}$ km and ${2.072}_{-0.066}^{+0.067}$ M ⊙ respectively, each reported as the posterior credible interval bounded by the 16% and 84% quantiles, conditional on surface hot regions that are non-overlapping spherical caps of fully ionized hydrogen atmosphere with uniform effective temperature; a posteriori, the temperature is ${\mathrm{log}}_{10}(T\,[{\rm{K}}])={5.99}_{-0.06}^{+0.05}$ for each hot region. All software for the X-ray modeling framework is open-source and all data, model, and sample information is publicly available, including analysis notebooks and model modules in the Python language. Furthermore, our marginal likelihood function of mass and equatorial radius is proportional to the marginal joint posterior density of those parameters (within the prior support) and can thus be computed from the posterior samples.

79 ASTRONOMY AND ASTROPHYSICS↗

A NICER View of the Massive Pulsar PSR J0740+6620 Informed by Radio Timing and XMM-Newton Spectroscopy

We report on Bayesian estimation of the radius, mass, and hot surface regions of the massive millisecond pulsar PSR J0740+6620, conditional on pulse-profile modeling of Neutron Star Interior Composition Explorer X-ray Timing Instrument event data. We condition on informative pulsar mass, distance, and orbital inclination priors derived from the joint North American Nanohertz Observatory for Gravitational Waves and Canadian Hydrogen Intensity Mapping Experiment/Pulsar wideband radio timing measurements of Fonseca et al. We use XMM-Newton European Photon Imaging Camera spectroscopic event data to inform our X-ray likelihood function. The prior support of the pulsar radius is truncated at 16 km to ensure coverage of current dense matter models. We assume conservative priors on instrument calibration uncertainty. We constrain the equatorial radius and mass of PSR J0740+6620 to be-+12.390.981.30km and-+2.0720.0660.067Me respectively, each reported as the posterior credible interval bounded by the 16% and 84% quantiles, conditional on surface hot regions that are non-overlapping spherical caps of fully ionized hydrogen atmosphere with uniform effective temperature; a posteriori, the temperature is=-+TlogK5.99100.060.05([])for each hot region. All software for the X-ray modeling framework is open-source and all data, model, and sample information is publicly available, including analysis notebooks and model modules in the Python language. Our marginal likelihood function of mass and equatorial radius is proportional to the marginal joint posterior density of those parameters(within the prior support)and can thus be computed from the posterior samples.

Millisecond pulsars↗

Conformal Hierarchical Simulation-Based Inference with Local Validity

Trustworthy and interpretable uncertainty quantification is a long-standing challenge in artificial intelligence. Simulation-based inference (SBI) comprises a broad swath of approaches for estimating latent parameters with uncertainties. Although flexible neural density estimators in SBI can be remark- ably expressive capturing highly structured, high-dimensional posteriors their credible regions can be badly mis-calibrated and are often only accompanied by heuristic coverage checks. We present the first SBI framework that delivers finite-sample local valid coverage guarantees that hold in the neighborhood of each observation. Our framework can couple any off-the-shelf hierarchical SBI engine with a confor- mal Bayesian post-processing step that operates on the posterior predictive density. A kernel-weighted conformity score adapts the conformal quantile to the local geometry of the data, yielding prediction sets that are simultaneously (i) marginally calibrated, (ii) locally valid, and (iii) hierarchical, handling global and observation-specific parameters in a single pass. Through experiments on synthetic data and benchmarks from neuroscience and physics, we show that our approach attains 1 − α coverage, where prior SBI methods under- or over-cover. Our approach also maintains a competitive, credible set size with minimal computational overhead. Finally, our approach can be used to make predictions on real data and give valid credible regions modulo weight-initialization-based model mis-specification.

Trivedi, Shubhendu [Fermilab]↗

From BEYONDPLANCK to COSMOGLOBE: Preliminary WMAP Q -band analysis

We present the first application of the COSMOGLOBE analysis framework by analyzing nine-year WMAP time-ordered observations that uses similar machinery to that of BEYONDPLANCK for the Planck Low Frequency Instrument (LFI). We analyzed only the Q-band (41 GHz) data and report on the low-level analysis process based on uncalibrated time-ordered data to calibrated maps. Most of the existing BEYONDPLANCK pipeline may be reused for WMAP analysis with minimal changes to the existing codebase. The main modification is the implementation of the same preconditioned biconjugate gradient mapmaker used by the WMAP team. Producing a single WMAP Q1-band sample requires 22 CPU-hrs, which is slightly more than the cost of a Planck 44 GHz sample of 17 CPU-hrs; this demonstrates that a full end-to-end Bayesian processing of the WMAP data is computationally feasible. In general, our recovered maps are very similar to the maps released by the WMAP team, although with two notable differences. In terms of temperature, we find a ~2 μK quadrupole difference that most likely is caused by different gain modeling, while in polarization we find a distinct 2.5 μK signal that has been previously referred to as poorly measured modes by the WMAP team. In the COSMOGLOBE processing, this pattern arises from temperature-to-polarization leakage from the coupling between the CMB Solar dipole, transmission imbalance, and sidelobes. No traces of this pattern are found in either the frequency map or TOD residual map, suggesting that the current processing has succeeded in modeling these poorly measured modes within the assumed parametric model by using Planck information to break the sky-synchronous degeneracies inherent in the WMAP scanning strategy.

79 ASTRONOMY AND ASTROPHYSICS↗

Interpreting internal consistency of DES measurements

ABSTRACT Bayesian evidence ratios are widely used to quantify the statistical consistency between different experiments. However, since the evidence ratio is prior dependent, the precise translation between its value and the degree of concordance/discordance requires additional information. The most commonly adopted metric, the Jeffreys scale, can falsely suggest agreement between data sets when priors are chosen to be sufficiently wide. This work examines evidence ratios in a DES-Y1 simulated analysis, focusing on the internal consistency between weak lensing and galaxy clustering. We study two scenarios using simulated data in controlled experiments. First, we calibrate the expected evidence ratio distribution given noise realizations around the best-fitting DES-Y1 ΛCDM cosmology. Secondly, we show the behaviour of evidence ratios for noiseless fiducial data vectors simulated using a modified gravity model, which generates internal tension in the LCDM analysis. We find that the evidence ratio of noise realizations generated at all confidence levels was biased towards agreement and show, with a modified gravity model, that the choice of prior could conceal the discrepancies between weak lensing and galaxy clustering induced by prior effects in unlike cosmological models, concluding that the evidence ratio in a DES-Y1 study is, indeed, biased towards agreement. Boundary effects can also influence conclusions about the inconsistency induced by modified gravity, even in a noiseless data vector simulation.

79 ASTRONOMY AND ASTROPHYSICS↗

Effects of Dose Error and Sample Size on Sonic Boom Dose-response Curves

NASA will soon be collecting noise-annoyance community survey data as the X-59 aircraft flies supersonically over several communities in the USA. Sparse measurements of the X-59 sonic thumps will be used together with physics-based simulations to estimate noise doses at survey participant locations. These dose estimates have associated error that affects the accuracy of modeled dose-response curves, which can result in misestimation of annoyance. The precision in dose-response curves is also a consideration in selecting the number of survey participants. To enable pretest studies of dose error and precision, simulated dose-response data were generated based on NASA’s Quiet Supersonic Flights 2018 test. The data included various degrees of dose error and sample size. Frequentist multilevel logistic regression models were fit to the true and perturbed dose-response data. Simple proportional relationships were identified between the model parameters and the perturbation standard deviation. The summary dose-response curves illustrate the impact on accuracy if dose error is not accounted for in the model. The precision in the dose-response curves is also shown as the number of participants and degree of participation is varied. Finally, sampling variability is illustrated by showing the dose-response curves for several replicates with random draws of participants and errors.

X-59↗

Characterization of Partially Observed Epidemics - Application to COVID-19

This report documents a statistical method for the "real-time" characterization of partially observed epidemics. Observations consist of daily counts of symptomatic patients, diagnosed with the disease. Characterization, in this context, refers to estimation of epidemiological parameters that can be used to provide short-term forecasts of the ongoing epidemic, as well as to provide gross information for the time-dependent infection rate. The characterization problem is formulated as a Bayesian inverse problem, and is predicated on a model for the distribution of the incubation period. The model parameters are estimated as distributions using a Markov Chain Monte Carlo (MCMC) method, thus quantifying the uncertainty in the estimates. The method is applied to the COVID-19 pandemic of 2020, using data at the country, provincial (e.g., states) and regional (e.g. county) levels. The epidemiological model includes a stochastic component due to uncertainties in the incubation period. This model-form uncertainty is accommodated by a pseudo-marginal Metropolis-Hastings MCMC sampler, which produces posterior distributions that reflect this uncertainty. We approximate the discrepancy between the data and the epidemiological model using Gaussian and negative binomial error models; the latter was motivated by the over-dispersed count data. For small daily counts we find the performance of the calibrated models to be similar for the two error models. For large daily counts the negative-binomial approximation is numerically unstable unlike the Gaussian error model. Application of the model at the country level (for the United States, Germany, Italy, etc.) generally provided accurate forecasts, as the data consisted of large counts which suppressed the day-to-day variations in the observations. Further, the bulk of the data is sourced over the duration before the relaxation of the curbs on population mixing, and is not confounded by any discernible country-wide second wave of infections. At the state-level, where reporting was poor or which evinced few infections (e.g., New Mexico), the variance in the data posed some, though not insurmountable, difficulties, and forecasts were able to capture the data with large uncertainty bounds. The method was found to be sufficiently sensitive to discern the flattening of the infection and epidemic curve due to shelter-in-place orders after around 90% quantile for the incubation distribution (about 10 days for COVID-19). The proposed model was also used at a regional level to compare the forecasts for the central and north-west regions of New Mexico. Modeling the data for these regions illustrated different disease spread dynamics captured by the model. While in the central region the daily counts peaked in the late April, in the north-west region the ramp-up continued for approximately three more weeks.

59 BASIC BIOLOGICAL SCIENCES↗

Cholesky-based experimental design for Gaussian process and kernel-based emulation and calibration.

Gaussian processes and other kernel-based methods are used extensively to construct approximations of multivariate data sets. The accuracy of these approximations is dependent on the data used. This paper presents a computationally efficient algorithm to greedily select training samples that minimize the weighted L p error of kernel-based approximations for a given number of data. The method successively generates nested samples, with the goal of minimizing the error in high probability regions of densities specified by users. The algorithm presented is extremely simple and can be implemented using existing pivoted Cholesky factorization methods. Training samples are generated in batches which allows training data to be evaluated (labeled) in parallel. For smooth kernels, the algorithm performs comparably with the greedy integrated variance design but has significantly lower complexity. Numerical experiments demonstrate the efficacy of the approach for bounded, unbounded, multi-modal and non-tensor product densities. We also show how to use the proposed algorithm to efficiently generate surrogates for inferring unknown model parameters from data using Bayesian inference.

97 MATHEMATICS AND COMPUTING↗

Uncertainty quantification for high explosive reactant and product equations of state

Equations of state (EOSs) are typically represented as physics-informed models with tunable parameters that are adjusted to replicate calibration data as closely as possible. Uncertainty quantification (UQ) allows for the development of an ensemble of EOS parameters that are consistent with the calibration data instead of a single EOS. In this work, we perform UQ for the reactant and product EOSs for a variety of high explosives (HEs). In doing so, we demonstrate a strategy for dealing with heterogeneous (both experimental and calculated) data. We also use a statistical distance metric to quantify the differences between the various HEs using the UQ results.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The DESI-Lensing Mock Challenge: large-scale cosmological analysis of 3x2-pt statistics

The current generation of large galaxy surveys will test the cosmological model by combining multiple types of observational probes. Realising the statistical promise of these new datasets requires rigorous attention to all aspects of analysis including cosmological measurements, modelling, covariance and parameter likelihood. In this paper we present the results of an end-to-end simulation study designed to test the analysis pipeline for the combination of the Dark Energy Spectroscopic Instrument (DESI) Year 1 galaxy redshift dataset and separate weak gravitational lensing information from the Kilo-Degree Survey, Dark Energy Survey and Hyper-Suprime-Cam Survey. Our analysis employs the 3x2-pt correlation functions including cosmic shear and galaxy-galaxy lensing, together with the projected correlation function of the spectroscopic DESI lenses. We build realistic simulations of these datasets including galaxy halo occupation distributions, photometric redshift errors, weights, multiplicative shear calibration biases and magnification. We calculate the analytical covariance of these correlation functions including the Gaussian, noise and super-sample contributions, and show that our covariance determination agrees with estimates based on the ensemble of simulations. We use a Bayesian inference platform to demonstrate that we can recover the fiducial cosmological parameters of the simulation within the statistical error margin of the experiment, investigating the sensitivity to scale cuts. This study is the first in a sequence of papers in which we present and validate the large-scale 3x2-pt cosmological analysis of DESI-Y1.

79 ASTRONOMY AND ASTROPHYSICS↗