Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian Testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Adaptive behavior and different thermal experiences of real people: A Bayesian neural network approach to thermal preference prediction and classification

Various observed and unquantifiable factors affect the thermal comfort of occupants in indoor environments and can lead to high uncertainty in the prediction and classification of their thermal preferences. The behavioral adaptation of occupants, by operating window systems for example, changes their thermal experience and expectations and therefore contributes to even higher prediction uncertainty. In this study, we applied a Bayesian neural network (BNN) algorithm to build a predictive model for occupant thermal preference using the ASHRAE Global Thermal Comfort Database II. The Bayesian method allows us to synthesize prior knowledge and available measurements into a unified modeling framework. It also offers a way to express and quantify uncertainty. Here we have performed a systematic study to test the efficiency and robustness of different BNN model configurations. In this study, the results show that the BNN model outperforms conventional thermal comfort models such as Predicted Mean Vote (PMV) and adaptive comfort model. The BNN model tends to produce more confident “prefer cooler” predictions with high possibility and low uncertainty. In contrast, the BNN model produces less certain predictions for “prefer no change” and “prefer warmer” across all occupants. Our findings suggest that linking occupants’ subjective evaluation measures and window opening/closing behavior to thermal comfort modeling effectively improves predictive performance.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

An Adaptive-Importance-Sampling-Enhanced Bayesian Approach for Topology Estimation in an Unbalanced Power Distribution System

The reliable operation of a power distribution system relies on a good prior knowledge of its topology and its system state. Although crucial, due to the lack of direct monitoring devices on the switch statuses, the topology information is often unavailable or outdated for the distribution system operators for real-time applications. Apart from the limited observability of the power distribution system, other challenges are the nonlinearity of the model, the complicated, unbalanced structure of the distribution system, and the scale of the system. To overcome the above challenges, we, in this paper, propose a Bayesian-inference framework that allows us to simultaneously estimate the topology and the state of a three-phase, unbalanced power distribution system. Specifically, by using the very limited number of measurements available that are associated with the forecast load data, we efficiently recover the full Bayesian posterior distributions of the system topology under both normal and outage operation conditions. This is performed through an adaptive importance sampling procedure that greatly alleviates the computational burden of the traditional Monte-Carlo (MC)-sampling-based approach while maintaining a good estimation accuracy. The simulations conducted on the IEEE 123-bus test system and an unbalanced 1282-bus system reveal the excellent performances of the proposed method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Bayesian calibration of a physics-based crystal plasticity and damage model

In this work, we present a model parameter calibration procedure for a physics-based crystal plasticity model. The calibration process utilizes a powerful statistics-based Bayesian calibration method. Calibration of the crystal plasticity parameters makes use of experimentally-measured data, i.e. compressive stress–strain response, from $\langle$100$\rangle$ and $\langle$123$\rangle$ single crystal copper dynamically loaded via Kolsky bar tests. The calibration of damage parameters is achieved using experimentally-measured free-surface velocity history data from plate impact test on $\langle$100$\rangle$ and $\langle$110$\rangle$ single crystal copper, which generates shock compression followed by dynamic tensile failure. A validation assessment is then carried out by comparing the calibrated model predictions and experimental measurements of the dynamic tensile damage generated in an impacted bicrystal copper plate. Lastly, a model-informed rationale for the experimentally-observed dependence of the spatial distribution of ductile damage (porosity) on crystallography is provided.

42 ENGINEERING↗

The impact of response measurement error on the analysis of designed experiments

This study considers the analysis of designed experiments when there is measurement error in the true response or so-called response measurement error. We consider both additive and multiplicative response measurement errors. Through a simulation study, we investigate the impact of ignoring the response measurement error in the analysis, that is, by using a standard analysis based on t-tests. In addition, we examine the role of repeat measurements in improving the quality of estimation and prediction in the presence of response measurement error. We also study a Bayesian approach that accounts for the response measurement error directly through the specification of the model, and allows including additional information about variability in the analysis. We consider the impact on power, prediction, and optimization. Copyright © 2015 John Wiley & Sons, Ltd.

97 MATHEMATICS AND COMPUTING↗

Bayesian Neural Networks for Uncertainty Analysis of Hydrologic Modeling: A Comparison of Two Schemes

Bayesian Neural Networks (BNNs) have been shown as useful tools to analyze modeling uncertainty of Neural Networks (NNs). This research focuses on the comparison of two BNNs. The first BNNs (BNN-I) use statistical methods to describe the characteristics of different uncertainty sources (input, parameter, and model structure) and integrate these uncertainties into a Markov Chain Monte Carlo (MCMC) framework to estimate total uncertainty. The second BNNs (BNN-II) lump all uncertainties into a single error term (i.e. the residual between model prediction and measurement). In this study, we propose a simple BNN-II, which use Genetic Algorithms (GA) and Bayesian Model Averaging (BMA) to calibrate Neural Networks with different structures (number of hidden units) and combine the predictions from different NNs to derive predictions and uncertainty analysis. We tested these two BNNs in two watersheds for daily and monthly hydrologic simulation. The BMA based BNNs developed in this study outperforms BNN-I in the two watersheds in terms of both accurate prediction and uncertainty estimation. These results show that, given incomplete understanding of the characteristics associated with each uncertainty source, the simple lumped error approach may yield better prediction and uncertainty estimation.

99 GENERAL AND MISCELLANEOUS↗

Is the Jeffreys' scale a reliable tool for Bayesian model comparison in cosmology?

We are entering an era where progress in cosmology is driven by data, and alternative models will have to be compared and ruled out according to some consistent criterium. The most conservative and widely used approach is Bayesian model comparison. In this paper we explicitly calculate the Bayes factors for all models that are linear with respect to their parameters. We do this in order to test the so called Jeffreys' scale and determine analytically how accurate its predictions are in a simple case where we fully understand and can calculate everything analytically. We also discuss the case of nested models, e.g. one with M{sub 1} and another with M{sub 2} superset of M{sub 1} parameters and we derive analytic expressions for both the Bayes factor and the figure of Merit, defined as the inverse area of the model parameter's confidence contours. With all this machinery and the use of an explicit example we demonstrate that the threshold nature of Jeffreys' scale is not a ''one size fits all'' reliable tool for model comparison and that it may lead to biased conclusions. Furthermore, we discuss the importance of choosing the right basis in the context of models that are linear with respect to their parameters and how that basis affects the parameter estimation and the derived constraints.

79 ASTRONOMY AND ASTROPHYSICS↗

A general Bayesian algorithm for the autonomous alignment of beamlines

Autonomous methods to align beamlines can decrease the amount of time spent on diagnostics, and also uncover better global optima leading to better beam quality. The alignment of these beamlines is a high-dimensional expensive-to-sample optimization problem involving the simultaneous treatment of many optical elements with correlated and nonlinear dynamics. Bayesian optimization is a strategy of efficient global optimization that has proved successful in similar regimes in a wide variety of beamline alignment applications, though it has typically been implemented for particular beamlines and optimization tasks. In this paper, we present a basic formulation of Bayesian inference and Gaussian process models as they relate to multi-objective Bayesian optimization, as well as the practical challenges presented by beamline alignment. We show that the same general implementation of Bayesian optimization with special consideration for beamline alignment can quickly learn the dynamics of particular beamlines in an online fashion through hyperparameter fitting with no prior information. We present the implementation of a concise software framework for beamline alignment and test it on four different optimization problems for experiments on X-ray beamlines at the National Synchrotron Light Source II and the Advanced Light Source, and an electron beam at the Accelerator Test Facility, along with benchmarking on a simulated digital twin. We discuss new applications of the framework, and the potential for a unified approach to beamline alignment at synchrotron facilities.

47 OTHER INSTRUMENTATION↗

Adaptation of fan motor and VFD efficiency correlations using Bayesian inference

Energy performance contracts (EPC) are types of agreements in which a service provider guarantees that customers’ buildings will achieve a specified energy performance (i.e., minimum energy savings) to reduce the risk of their investment in energy efficiency improvements. EPC requires prediction of future energy consumption of the building, at the design stage, before construction or major retrofit. To this end, building energy simulations taking into account all the major energy-using components are performed. In particular, fans can contribute significantly to the total building consumption. The overall efficiency of fans is the combination of three factors: mechanical, motor, and variable frequency drive (VFD). Manufacturers usually provide fan mechanical efficiency curves for a broad operating range. In contrast, motor and VFD efficiencies are generally given at rating conditions only. To represent part-load conditions, correlations are typically used to estimate motor and VFD efficiency variations, to evaluate the overall electricity consumption. The first aim of this study is to evaluate existing correlations for motor and VFD efficiency as a function of load and speed, by comparison with manufacturer data, for a vendor that has shared its detailed test data. While VFD efficiency correlations from the literature provide reasonable accuracy against real data, motor correlations under predict actual motor efficiency at low loads. Finally, the second aim of the paper is to improve such correlations using Bayesian inference to fit the available data.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Protein Conformational States—A First Principles Bayesian Method

Automated identification of protein conformational states from simulation of an ensemble of structures is a hard problem because it requires teaching a computer to recognize shapes. We adapt the naïve Bayes classifier from the machine learning community for use on atom-to-atom pairwise contacts. The result is an unsupervised learning algorithm that samples a ‘distribution’ over potential classification schemes. We apply the classifier to a series of test structures and one real protein, showing that it identifies the conformational transition with >95% accuracy in most cases. A nontrivial feature of our adaptation is a new connection to information entropy that allows us to vary the level of structural detail without spoiling the categorization. This is confirmed by comparing results as the number of atoms and time-samples are varied over 1.5 orders of magnitude. Further, the method’s derivation from Bayesian analysis on the set of inter-atomic contacts makes it easy to understand and extend to more complex cases.

97 MATHEMATICS AND COMPUTING↗

Multi-Detection Events, Probability Density Functions, and Reduced Location Area

Abstract Several efforts have been made in the Comprehensive Nuclear-Test-Ban Treaty (CTBT) community to assess the benefits of combining detections of radionuclides to improve the location estimates available from atmospheric transport modeling (ATM) backtrack calculations. We present a Bayesian estimation approach rather than a simple dilution field of regard approach to allow xenon detections and non-detections to be combined mathematically. This system represents one possible probabilistic approach to radionuclide event formation. Application of this method to a recent interesting radionuclide event shows a substantial reduction in the location uncertainty of that event.

atmospheric modeling↗

Development of an exchange–correlation functional with uncertainty quantification capabilities for density functional theory

This paper presents the development of a new exchange–correlation functional from the point of view of machine learning. Using atomization energies of solids and small molecules, we train a linear model for the exchange enhancement factor using a Bayesian approach which allows for the quantification of uncertainties in the predictions. A relevance vector machine is used to automatically select the most relevant terms of the model. We then test this model on atomization energies and also on bulk properties. The average model provides a mean absolute error of only 0.116 eV for the test points of the G2/97 set but a larger 0.314 eV for the test solids. In terms of bulk properties, the prediction for transition metals and monovalent semiconductors has a very low test error. However, as expected, predictions for types of materials not represented in the training set such as ionic solids show much larger errors.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

THE VELOCITY DISTRIBUTION OF NEARBY STARS FROM HIPPARCOS DATA. I. THE SIGNIFICANCE OF THE MOVING GROUPS

We present a three-dimensional reconstruction of the velocity distribution of nearby stars ({approx}<100 pc) using a maximum likelihood density estimation technique applied to the two-dimensional tangential velocities of stars. The underlying distribution is modeled as a mixture of Gaussian components. The algorithm reconstructs the error-deconvolved distribution function, even when the individual stars have unique error and missing-data properties. We apply this technique to the tangential velocity measurements from a kinematically unbiased sample of 11,865 main-sequence stars observed by the Hipparcos satellite. We explore various methods for validating the complexity of the resulting velocity distribution function, including criteria based on Bayesian model selection and how accurately our reconstruction predicts the radial velocities of a sample of stars from the Geneva-Copenhagen Survey (GCS). Using this very conservative external validation test based on the GCS, we find that there is little evidence for structure in the distribution function beyond the moving groups established prior to the Hipparcos mission. This is in sharp contrast with internal tests performed here and in previous analyses, which point consistently to maximal structure in the velocity distribution. We quantify the information content of the radial velocity measurements and find that the mean amount of new information gained from a radial velocity measurement of a single star is significant. This argues for complementary radial velocity surveys to upcoming astrometric surveys.

99 GENERAL AND MISCELLANEOUS↗

SU-E-T-49: Automatic Beam Angle Determination for Lung IMRT Planning Using a Beam Configuration Atlas

Purpose: To present a technique to automatically determine beam angle configurations for lung IMRT planning based on the patient-specific anatomy and tumor geometry. Methods: The relationship between individual patient anatomy and proper beam configurations was learned from high quality clinical plans in three steps. First, a beam configuration atlas was obtained by classifying 60 lung IMRT plans into 6 beam configuration clusters based on a dissimilarity measure defined between different beam configurations. A beam configuration template was extracted from each cluster to form an atlas. Second, a beam efficiency index map (EI map) was constructed to characterize the geometry of the tumor relative to the lungs, the body and other OARs along each candidate beam direction. Finally, the EI maps of the clinical cases and the cluster assignments of their beam configurations were paired to train a Bayesian classification model. This technique was validated by leave-one-out cross validation with 16 cases randomly selected from the original dataset. An IMRT plan (autobeam plan) for each test case was generated using the beam configuration template according to the cluster assignment given by the model and was compared with the corresponding clinical plan. Results: The dosimetric parameters (mean±S.D. in percentage of prescription dose) in the auto-beam plans and in the clinical plans, respectively, and the p-values by a paired ttest (in parenthesis) are: lung Dmean: 16.3±9.3, 18.6±7.4 (0.48), esophagus Dmean: 28.4±18, 30.7±19.3 (0.02), Heart Dmean: 21.5±17.5,21.1±17.2 (0.76), Spinal Cord D2%: 48±23, 51.2±21.8 (0.01), PTV dose homogeneity (D2%–D99%): 22±27.4, 20.4±12.8 (0.10).The dose reductions by the autobeam plans in esophagus Dmean and cord D02 are statistically significant but the differences (<4%) may not be clinically significant. The other dosimetric parameters are not statistically different. Conclusion: Plans generated by the automatic beam angle determination method can achieve dosimetric quality equivalent to that of clinical plans. Partially supported by NIH/NCI under grant #R21CA161389 and a master research grant by Varian Medical System.

60 APPLIED LIFE SCIENCES↗

Synthesis of observed and simulated rain microphysics to inform a new Bayesian statistical framework for microphysical parameterization in climate models (Final Scientific Report)

This project aimed to investigate a new approach to bulk microphysics schemes. We identified the need to move beyond the fixed structural assumptions and approximation of existing schemes. For example, most schemes assume some functional form for the rain drop size distribution (e.g. a gamma or exponential distribution). Most schemes then evolve some number of statistical moments of that distribution via various processes, such as evaporation, sedimentation, collision-coalescence, and collisional breakup. These microphysical processes, in turn, are typically some fixed functional form derived from either some other (more detailed) model, or using some single-particle rates that are then integrated over the size distribution. While these process rate functions may have some free parameters to adjust, in other cases doing so is impossible (e.g. when the process rates are analytical or piecewise solutions to some target function). Our goal was to build and test a scheme that assumed no size distribution form, and used a series of power laws as the basis for the process rates. Moments of the size distribution would be predicted, but no underlying size distribution would be specified. Any number or choice of size distribution moments could be used, and any number of power laws could be employed to model the process rates. Thus, our approach is flexible, and can seamlessly scale across levels of complexity, as demanded by the data. Bayesian inference then would provide the formalism to estimate the model parameters and structure, allowing for robust uncertainty quantification. We proposed testing this framework in idealized simulations using bin microphysical schemes as a data source. We also proposed using real data to inform our microphysics scheme, and also that we would integrate our scheme into WRF.

58 GEOSCIENCES↗

Mass of 101 Sn and Bayesian extrapolations to the proton drip line

The favorable energy configurations of nuclei at magic numbers of 𝑁 neutrons and 𝑍 protons are fundamental for understanding the evolution of nuclear structure. The 𝑍 = 50 (tin) isotopic chain is a frontier for such studies, with particular interest at and around the doubly magic 100 Sn isotope, for which the mass is a topic of debate. Precise mass values for neutron-deficient isotopes provide necessary anchor points for mass models to test extrapolations near the proton drip line, where experimental studies remain out of reach. In this work, we report a Penning trap mass measurement of 101 Sn . The determined mass excess of −59889.89⁢(96) keV for 101 Sn represents a factor-of-300 improvement over the current precision and indicates that 101 Sn is less bound than previously thought. Mass predictions from a recently developed Bayesian model combination framework employing statistical machine learning and nuclear masses computed within seven global models based on nuclear density functional theory agree within 1⁢𝜎 with experimental masses from the 48 ≤ 𝑍 ≤ 52 isotopic chains. The framework's resilience to new mass data gave confidence in the extrapolation of tin masses down to 𝑁 = 46. Our calculations suggest that 96 Sn is a two-proton drip line nucleus and predict a mass excess of −58090⁢(800) keV for 100 Sn , showing a preference within 1⁢𝜎 for the mass of 100 Sn derived from the 𝛽-delayed 𝑄 value measured at GSI.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

X{sub max}{sup μ} vs. N{sup μ} from extensive air showers as estimator for the mass of primary UHECR's. Application for the Pierre Auger Observatory

We study the possibility of primary mass estimation for Ultra High Energy Cosmic Rays (UHECR's) using the X{sub max}{sup μ} (the height where the number of muons produced on the core of Extensive Air Showers (EAS) is maximum) and the number N{sup μ} of muons detected on ground. We use the 2D distribution - X{sub max}{sup μ} against N{sup μ} in order to find its sensitivity to the mass of the primary particle. For that, we construct a 2D Probability Function Prob(p,Fe | X{sub max}{sup μ}, N{sup μ}) which estimates the probability that a certain point from the plane (X{sub max}{sup μ}, N{sup μ}) corresponds to a shower induced by a proton, respectively an iron nucleus. To test the procedure, we analyze a set of simulated EAS induced by protons and iron nuclei at energies of 10{sup 19}eV and 20° zenith angle with CORSIKA. Using the Bayesian approach and taking into account the geometry of the infill detectors from the Pierre Auger Observatory, we observe an improvement in the accuracy of the primary mass reconstruction in comparison with the results obtained using only the X{sub max}{sup μ} distributions.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗