Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian statistical modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Open World Dempster-Shafer Theory/The Transferable Belief Model with Intervals: A Practitioner's Guide to DST and TBM

Dempster-Shafer theory (DST) is a mathematical framework that allows for uncertainty or ignorance to be quantified and included when making predictions from evidence. This is in contrast to Bayesian theory, which does not allow for any quantification of ignorance. The framework is described in great detail in [7]. DST is particularly useful for problems where the inclusion of additional evidence (for example, data from another sensor) could lead to a different conclusion. Thus, it is a useful data fusion method, especially in applications not suited to maximum likelihood or maximum a posteriori estimations due to limited samples or incomplete prior knowledge.

97 MATHEMATICS AND COMPUTING↗

Exploration of lattice Hamiltonians for functional and structural discovery via Gaussian process-based exploration–exploitation

Statistical physics models ranging from simple lattice to complex quantum Hamiltonians are one of the mainstays of modern physics that have allowed both decades of scientific discovery and provided a universal framework to understand a broad range of phenomena from alloying to frustrated and phase separated materials to quantum systems. Traditionally, exploration of the phase diagrams corresponding to multidimensional parameter spaces of Hamiltonians was performed using a combination of basic physical principles, analytical approximations, and extensive numerical modeling. However, exploration of complex multidimensional parameter spaces is subject to the classic dimensionality problem, and the behaviors of interest concentrated on low dimensional manifolds remain undiscovered. Here, we demonstrate that a combination of exploration and exploration–exploitation with Gaussian process modeling and Bayesian optimization allows effective exploration of the parameter space for lattice Hamiltonians and effectively maps the regions at which specific macroscopic functionalities or local structures are maximized. We argue that this approach is general and can be further extended well beyond the lattice Hamiltonians to effectively explore the parameter space of more complex off-lattice and dynamic models.

42 ENGINEERING↗

Efficient Stochastic Inversion Using Adjoint Models and Kernel-PCA

Performing stochastic inversion on a computationally expensive forward simulation model with a high-dimensional uncertain parameter space (e.g. a spatial random field) is computationally prohibitive even with gradient information provided. Moreover, the ‘nonlinear’ mapping from parameters to observables generally gives rise to non-Gaussian posteriors even with Gaussian priors, thus hampering the use of efficient inversion algorithms designed for models with Gaussian assumptions. In this work, we propose a novel Bayesian stochastic inversion methodology, characterized by a tight coupling between a gradient-based Langevin Markov Chain Monte Carlo (LMCMC) method and a kernel principal component analysis (KPCA). This approach addresses the ‘curse-of-dimensionality’ via KPCA to identify a low-dimensional feature space within the high-dimensional and nonlinearly correlated spatial random field. Moreover, non-Gaussian full posterior probability distribution functions are estimated via an efficient LMCMC method on both the projected low-dimensional feature space and the recovered high-dimensional parameter space. We demonstrate this computational framework by integrating and adapting recent developments such as data-driven statistics-on-manifolds constructions and reduction-through-projection techniques to solve inverse problems in linear elasticity.

97 MATHEMATICS AND COMPUTING↗

Distribution Development for Residual Inventory at the New York West Valley Site - 20400

The New York State Energy Research and Development Authority (NYSERDA) is the owner of the Western New York Nuclear Service Center (WNYNSC), a 1,351 ha site located approximately 48 km south of Buffalo, New York. In 1962, Nuclear Fuel Services, Inc. (NFS) entered into Agreements with the Atomic Energy Commission and New York State to construct the first commercial reprocessing plant of nuclear fuel in the United States. NFS, a private company, built and operated the spent fuel reprocessing plant and waste disposal facilities, processing 640 Mg of spent nuclear fuel from 1966 to 1972 under an Atomic Energy Commission license. Nuclear fuel reprocessing operations ended in 1972 and never reopened, leaving behind radioactive and chemical wastes. Operations led to contamination in a number of facilities and locations. Some of that contamination has migrated from waste disposal zones to other layers, formations, and features on and off the WNYNSC. Phase I decommissioning activities are ongoing and involve the removal of a number of areas and structures that have been associated with contamination. The purpose of this work is to outline the approach for characterizing contamination not associated with disposed wastes, contaminated structures, or specific releases. In this work, the term, residual radiological activity, is used to describe environmental contamination that exists subsequent to the completion of Phase I decommissioning activities, that is not associated with disposed wastes, contaminated structures, or specific releases. Contamination from the Site was quantified relative to data that characterize the concentrations of radionuclides that exist in background. Background concentrations are those present in the area but having no influence from Site related activities. The existence of residual radiological activity that is elevated relative to background has the potential to contribute to future risks to human health and the environment. As a consequence, the residual inventory information is used to inform the West Valley Probabilistic Performance Assessment (PPA) model to characterize potential future risks to human health and the environment. The centralized West Valley Data Management System (DMS) was the source of information for the data assembled in this analysis. The DMS is a fairly large compilation consisting of thousands of records from investigation studies, with sample dates ranging from 1990 to present. Samples from monitoring wells, boreholes, geoprobe studies, surface water, surface soils, storm water outfalls, ventilation stack filters, plant and animal tissues, and more are included in the DMS. Results are typically reported in units of activity per unit volume. For the purpose of the analyses presented here, all results were converted into consistent units of pCi per unit volume. Since 1990, data have been collected from various locations across the WNYNSC at different times with varying frequency over the course of several decades. As a consequence, a number of potential issues can arise with respect to the assembly of a dataset that is deemed adequate for the characterization of residual radiological activity. These issues were assessed and resolved to the extent possible through careful consideration of the properties of the distributions. The intent was to use data which characterize the current state of the Site. Radionuclides can be designated to one of several groups depending on their origin. In this work the groups considered were 1) Naturally Occurring Radioactive Material (NORM), 2) fallout, and 3) Other (including power plant, medical research, etc). This grouping is a useful construct with respect to the interpretation of fixed laboratory results. For example, NORM radionuclides that exist within a decay chain should have approximately equivalent distributions of concentrations if they are representative of background conditions. Insights such as these can be used as a check to identify sample results that need to be further investigated or omitted due to issues associated with reported results from fixed laboratory analyses. This type of analysis provided a foundation for the assessment of the adequacy of sample results for use in subsequent components of an assessment. The general process for the assessment of residual radiological contamination at the Site consists of a sequence of several steps. First, for each analyte, several statistical tests were performed to assess the weight of evidence against the null hypothesis that the mean of the distribution of concentrations was equal to zero. If the mean of the distribution of concentrations for a given radionuclide was not found to be greater than zero, then it was removed from consideration as a component of the residual radiological contamination. If there was significant evidence to reject the hypothesis of the mean being equal to zero, the second step was to compare the distribution of the data from the Site to that of the corresponding background. A suite of tests was used to compare the distributions of the site and background data. The results of these tests were collectively used to determine if site data are elevated relative to background. The third step was to develop distributions using a Bayesian framework to characterize the distribution of mean of the increment present above background for each of the radionuclides. The Bayesian model implemented allowed for the comparison of site-specific records to background concentrations to better approximate contamination attributed to the Site. A final screening step was employed for radionuclides that exceed background. This screening step compared 95% upper confidence limits (UCLs) from the increment distribution developed in the previous step to the risk screening levels. This approach yields a list of analytes that were determined to be elevated relative to background.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

On Bayes Equality and Related Issues

To make calculations in the Bayesian analysis, the formalism of which is based on the layering of a probability measure defined on the product of measurable spaces, it is useful to have a summary of the properties of this layering. In this paper we formulate and prove those of them that are used in calculations more often than others. Particularly, we prove Hoeffding-type inequalities using direct elementary techniques.

97 MATHEMATICS AND COMPUTING↗

Compound estimation procedures in reliability

At NASA, components and subsystems of components in the Space Shuttle and Space Station generally go through a number of redesign stages. While data on failures for various design stages are sometimes available, the classical procedures for evaluating reliability only utilize the failure data on the present design stage of the component or subsystem. Often, few or no failures have been recorded on the present design stage. Previously, Bayesian estimators for the reliability of a single component, conditioned on the failure data for the present design, were developed. These new estimators permit NASA to evaluate the reliability, even when few or no failures have been recorded. Point estimates for the latter evaluation were not possible with the classical procedures. Since different design stages of a component (or subsystem) generally have a good deal in common, the development of new statistical procedures for evaluating the reliability, which consider the entire failure record for all design stages, has great intuitive appeal. A typical subsystem consists of a number of different components and each component has evolved through a number of redesign stages. The present investigations considered compound estimation procedures and related models. Such models permit the statistical consideration of all design stages of each component and thus incorporate all the available failure data to obtain estimates for the reliability of the present version of the component (or subsystem). A number of models were considered to estimate the reliability of a component conditioned on its total failure history from two design stages. It was determined that reliability estimators for the present design stage, conditioned on the complete failure history for two design stages have lower risk than the corresponding estimators conditioned only on the most recent design failure data. Several models were explored and preliminary models involving bivariate Poisson distribution and the Consael Process (a bivariate Poisson process) were developed. Possible short comings of the models are noted. An example is given to illustrate the procedures. These investigations are ongoing with the aim of developing estimators that extend to components (and subsystems) with three or more design stages.

Barnes, Ron↗

A Bayesian Approach for Characterizing and Mitigating Gate and Measurement Errors

Various noise models have been developed in quantum computing study to describe the propagation and effect of the noise that is caused by imperfect implementation of hardware. Identifying parameters such as gate and readout error rates is critical to these models. We use a Bayesian inference approach to identify posterior distributions of these parameters such that they can be characterized more elaborately. By characterizing the device errors in this way, we can further improve the accuracy of quantum error mitigation. Experiments conducted on IBM’s quantum computing devices suggest that our approach provides better error mitigation performance than existing techniques used by the vendor. Also, our approach outperforms the standard Bayesian inference method in some scenarios.

97 MATHEMATICS AND COMPUTING↗

A Bayesian analysis of classical shadows

Abstract The method of classical shadows proposed by Huang, Kueng, and Preskill heralds remarkable opportunities for quantum estimation with limited measurements. Yet its relationship to established quantum tomographic approaches, particularly those based on likelihood models, remains unclear. In this article, we investigate classical shadows through the lens of Bayesian mean estimation (BME). In direct tests on numerical data, BME is found to attain significantly lower error on average, but classical shadows prove remarkably more accurate in specific situations—such as high-fidelity ground truth states—which are improbable in a fully uniform Hilbert space. We then introduce an observable-oriented pseudo-likelihood that successfully emulates the dimension-independence and state-specific optimality of classical shadows, but within a Bayesian framework that ensures only physical states. Our research reveals how classical shadows effect important departures from conventional thinking in quantum state estimation, as well as the utility of Bayesian methods for uncovering and formalizing statistical assumptions.

97 MATHEMATICS AND COMPUTING↗

Galaxy cluster profiles: a Gaussian mixture model approach to halo miscentering

Measurements of the galaxy density and weak-lensing profiles of galaxy clusters typically rely on an assumed cluster center, which is taken to be the brightest cluster galaxy or other proxies for the true halo center defined as the minimum in the potential well. Departure of the assumed cluster center from the true halo center bias the resultant profile measurements, an effect known as miscentering bias. Currently, miscentering is typically modeled in stacked profiles of clusters with a two parameter model. We use an alternate approach in which the profiles of individual clusters are used with the corresponding likelihood computed using a Gaussian mixture model. We test the approach using halos and the corresponding subhalo profiles from the IllustrisTNG hydrodynamic simulations. We obtain significantly improved estimates of the miscentering parameters for both 3D and projected 2D profiles relevant for imaging surveys. We discuss applications to upcoming cosmological surveys. Our Python package for the Gaussian mixture model is publicly available at https://github.com/KyleMiller1/Halo-Miscentering-Mixture-Model.

Bayesian reasoning↗

Quantifying correlated truncation errors in effective field theory

Effective field theories (EFTs) organize the description of complex systems into an infinite sequence of decreasing importance. Predictions are made with a finite number of terms, which induces a truncation error that is often left unquantified. Here, we formalize the notion of EFT convergence and propose a Bayesian truncation error model for predictions that are correlated across the independent variables, e.g., energy or scattering angle. Central to our approach are Gaussian processes that encode both the naturalness and correlation structure of EFT coefficients. Our use of Gaussian processes permits efficient and accurate assessment of credible intervals, allows EFT fits to easily include correlated theory errors, and provides analytic posteriors for physical EFT-related quantities such as the expansion parameter. Furthermore, we demonstrate that model-checking diagnostics—applied to the case of multiple curves—are powerful tools for EFT validation. As an example, we assess a set of nucleon-nucleon scattering observables in chiral EFT. In an effort to be self-contained, appendices include thorough derivations of our statistical results. Our methods are packaged in Python code, called gsum, that is available for download on GitHub.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

EFIT‐AI: Machine Learning and Artificial Intelligence Assisted Equilibrium Reconstruction for Tokamak Experiments and Burning Plasmas (Final Report)

The EFIT-AI project is creating a modern advanced equilibrium reconstruction code suitable for tokamak experiments of burning plasmas. EFIT [1,2] was the first and is the most extensively used equilibrium reconstruction code in the world. This project builds on the production-level experience and adds key elements as follows. 1. A Model Order Reduction (MOR) version of the two-dimensional (2D) Grad-Shafranov equation solver (EFIT-MORNN) using physics-informed neural networks. 2. Improved optimization and data analysis capabilities using a Bayesian framework enhanced with machine learning. 3. A MOR version of the three-dimensional (3D) perturbed equilibrium reconstruction tool.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Use of Stable Isotopes in Forensic Analysis of Microorganisms

The use of isotopic signatures for forensic analysis of biological materials is well-established, and the same general principles that apply to interpretation of stable isotope content of C, N, O, and H apply to the analysis of microorganisms. Heterotrophic microorganisms derive their isotopic content from their growth substrates, which are largely plant and animal products, and the water in their culture medium. Thus the isotope signatures of microbes are tied to their growth environment. The C, N, O, and H isotope ratios of spores have been demonstrated to constitute highly discriminating signatures for sample matching. They can rule out specific samples of media and/or water as possible production media, and can predict isotope ratio ranges of the culture media and water used to produce a given sample. These applications have been developed and tested through analyses of approximately 250 samples of Bacillus subtilis spores and over 500 samples of culture media, providing a strong statistical basis for data interpretation. A Bayesian statistical framework for integrating stable isotope data with other types of signatures derived from microorganisms has been able to characterize the culture medium used to produce spores of various Bacillus species, leveraging isotopic differences in different medium types and demonstrating the power of data integration for forensic investigations.

59 BASIC BIOLOGICAL SCIENCES↗

Multiscale influenza forecasting

Abstract Influenza forecasting in the United States (US) is complex and challenging due to spatial and temporal variability, nested geographic scales of interest, and heterogeneous surveillance participation. Here we present Dante, a multiscale influenza forecasting model that learns rather than prescribes spatial, temporal, and surveillance data structure and generates coherent forecasts across state, regional, and national scales. We retrospectively compare Dante’s short-term and seasonal forecasts for previous flu seasons to the Dynamic Bayesian Model (DBM), a leading competitor. Dante outperformed DBM for nearly all spatial units, flu seasons, geographic scales, and forecasting targets. Dante’s sharper and more accurate forecasts also suggest greater public health utility. Dante placed 1st in the Centers for Disease Control and Prevention’s prospective 2018/19 FluSight challenge in both the national and regional competition and the state competition. The methodology underpinning Dante can be used in other seasonal disease forecasting contexts having nested geographic scales of interest.

59 BASIC BIOLOGICAL SCIENCES↗

Statistical Symbolic Execution with Informed Sampling

Symbolic execution techniques have been proposed recently for the probabilistic analysis of programs. These techniques seek to quantify the likelihood of reaching program events of interest, e.g., assert violations. They have many promising applications but have scalability issues due to high computational demand. To address this challenge, we propose a statistical symbolic execution technique that performs Monte Carlo sampling of the symbolic program paths and uses the obtained information for Bayesian estimation and hypothesis testing with respect to the probability of reaching the target events. To speed up the convergence of the statistical analysis, we propose Informed Sampling, an iterative symbolic execution that first explores the paths that have high statistical significance, prunes them from the state space and guides the execution towards less likely paths. The technique combines Bayesian estimation with a partial exact analysis for the pruned paths leading to provably improved convergence of the statistical analysis. We have implemented statistical symbolic execution with in- formed sampling in the Symbolic PathFinder tool. We show experimentally that the informed sampling obtains more precise results and converges faster than a purely statistical analysis and may also be more efficient than an exact symbolic analysis. When the latter does not terminate symbolic execution with informed sampling can give meaningful results under the same time and memory limits.

Reliability↗

Parameter estimation for X-ray scattering analysis with Hamiltonian Markov Chain Monte Carlo

Bayesian-inference-based approaches, in particular the random-walk Markov Chain Monte Carlo (MCMC) method, have received much attention recently for X-ray scattering analysis. Hamiltonian MCMC, a state-of-the-art development in the field of MCMC, has become popular in recent years. It utilizes Hamiltonian dynamics for indirect but much more efficient drawings of the model parameters. We described the principle of the Hamiltonian MCMC for inversion problems in X-ray scattering analysis by estimating high-dimensional models for several motivating scenarios in small-angle X-ray scattering, reflectivity, and X-ray fluorescence holography. Hamiltonian MCMC with appropriate preconditioning can deliver superior performance over the random-walk MCMC, and thus can be used as an efficient tool for the statistical analysis of the parameter distributions, as well as model predictions and confidence analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Bayesian investigation of isochrone consistency using the old open cluster NGC 188

This paper provides a detailed comparison of the differences in parameters derived for a star cluster from its color–magnitude diagrams (CMDs) depending on the filters and models used. We examine the consistency and reliability of fitting three widely used stellar evolution models to 15 combinations of optical and near-IR photometry for the old open cluster NGC 188. The optical filter response curves match those of theoretical systems and are thus not the source of fit inconsistencies. NGC 188 is ideally suited to this study thanks to a wide variety of high-quality photometry and available proper motions and radial velocities that enable us to remove non-cluster members and many binaries. Our Bayesian fitting technique yields inferred values of age, metallicity, distance modulus, and absorption as a function of the photometric band combinations and stellar models. We show that the historically favored three-band combinations of UBV and VRI can be meaningfully inconsistent with each other and with longer baseline data sets such as UBVRIJHK{sub S}. Differences among model sets can also be substantial. For instance, fitting Yi et al. (2001) and Dotter et al. (2008) models to UBVRIJHK{sub S} photometry for NGC 188 yields the following cluster parameters: age = (5.78 ± 0.03, 6.45 ± 0.04) Gyr, [Fe/H] = (+0.125 ± 0.003, −0.077 ± 0.003) dex, (m−M){sub V} = (11.441 ± 0.007, 11.525 ± 0.005) mag, and A{sub V} = (0.162 ± 0.003, 0.236 ± 0.003) mag, respectively. Within the formal fitting errors, these two fits are substantially and statistically different. Such differences among fits using different filters and models are a cautionary tale regarding our current ability to fit star cluster CMDs. Additional modeling of this kind, with more models and star clusters, and future Gaia parallaxes are critical for isolating and quantifying the most relevant uncertainties in stellar evolutionary models.

79 ASTRONOMY AND ASTROPHYSICS↗

Interpreting internal consistency of DES measurements

ABSTRACT Bayesian evidence ratios are widely used to quantify the statistical consistency between different experiments. However, since the evidence ratio is prior dependent, the precise translation between its value and the degree of concordance/discordance requires additional information. The most commonly adopted metric, the Jeffreys scale, can falsely suggest agreement between data sets when priors are chosen to be sufficiently wide. This work examines evidence ratios in a DES-Y1 simulated analysis, focusing on the internal consistency between weak lensing and galaxy clustering. We study two scenarios using simulated data in controlled experiments. First, we calibrate the expected evidence ratio distribution given noise realizations around the best-fitting DES-Y1 ΛCDM cosmology. Secondly, we show the behaviour of evidence ratios for noiseless fiducial data vectors simulated using a modified gravity model, which generates internal tension in the LCDM analysis. We find that the evidence ratio of noise realizations generated at all confidence levels was biased towards agreement and show, with a modified gravity model, that the choice of prior could conceal the discrepancies between weak lensing and galaxy clustering induced by prior effects in unlike cosmological models, concluding that the evidence ratio in a DES-Y1 study is, indeed, biased towards agreement. Boundary effects can also influence conclusions about the inconsistency induced by modified gravity, even in a noiseless data vector simulation.

79 ASTRONOMY AND ASTROPHYSICS↗

Parkes Pulsar Timing Array constraints on ultralight scalar-field dark matter

It is widely accepted that dark matter contributes about a quarter of the critical mass-energy density in our Universe. The nature of dark matter is currently unknown, with the mass of possible constituents spanning nearly one hundred orders of magnitude. The ultralight scalar field dark matter, consisting of extremely light bosons with m~10 –22 eV and often called “fuzzy” dark matter, provides intriguing solutions to some challenges at sub-Galactic scales for the standard cold dark matter model. As shown by Khmelnitsky and Rubakov, such a scalar field in the Galaxy would produce an oscillating gravitational potential with nanohertz frequencies, resulting in periodic variations in the times of arrival of radio pulses from pulsars. The Parkes Pulsar Timing Array (PPTA) has been monitoring 20 millisecond pulsars at two- to three-week intervals for more than a decade. In addition to the detection of nanohertz gravitational waves, PPTA offers the opportunity for direct searches for fuzzy dark matter in an astrophysically feasible range of masses. We analyze the latest PPTA data set which includes timing observations for 26 pulsars made between 2004 and 2016. Here, we perform a search in this data set for evidence of ultralight dark matter in the Galaxy using Bayesian and Frequentist methods. No statistically significant detection has been made. We, therefore, place upper limits on the local dark matter density. Our limits, improving on previous searches by a factor of 2 to 5, constrain the dark matter density of ultralight bosons with m ≤ 10 –23 eV to be below 6 GeV cm –3 with 95% confidence in the Earth neighborhood. Finally, we discuss the prospect of probing the astrophysically favored mass range m ≳ 10 –22 eV with next-generation pulsar timing facilities.

79 ASTRONOMY AND ASTROPHYSICS↗