Search NASA⌕ Search

SEARCH · Search NASA

Results for “bayesian”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

Posterior Regularized Bayesian Neural Network

Traditional NNs often lack the ability for uncertainty quantification. Bayesian NNs(BNNs) could help measure the confidence level by using distributions in NNs modeling. Besides, knowledge is commonly available and could improve the performance of BNNs if it can be properly incorporated. In this work, we propose a novel Posterior-Regularized BNN(PR-BNN) model by incorporating soft and hard constraints as a posterior regularization term. We also propose an augmented Lagrangian method and stochastic optimization algorithm for efficient updating via Monte Carlo sampling. The simulations and case studies in solar energy prediction have shown the performance improvement of the proposed model over traditional BNNs.

14 SOLAR ENERGY↗

Risk-Informed Condition Evaluation of Solar-centered Energy Generation and Distribution Networks through Bayesian Learning and Inference

We develop a methodology based on Bayesian inference over Probabilistic Graphical Models (PGMs) to understand and quantify risk in solar-centered grids using targeted measurements and learned system behavior. Being non-prescriptive but, rather, able to infer system behavior and, ultimately, address risk queries from data, our machine learning-type paradigm is tailored for diverse topologies and threat scenarios often associated with distributed energy generation and photovoltaic distributed energy resources (PV-DERs) in particular. We describe algorithmic processes for: (i) learning the structure of PGMs that result from attack-prone PV-DER-proliferated distribution systems, (ii) quantifying cause-effect relationships, and (iii) evaluating risk queries based on diverse evidence. The contributions are illustrated on a residential grid subject to output impairment attacks on its PV-DER infrastructure.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Bayesian calibration of reactor neutron flux spectrum using activation detectors measurements: Application to CALIBAN reactor

In this paper, we present calibration methods in order to estimate reactor neutron flux spectrum and its uncertainties by using integral activation measurements. These techniques are performed using Bayesian and MCMC framework. These methods are applied to integral activation experiments in the cavity of the CALIBAN reactor. We estimate the neutron flux and its related uncertainties. The originality of this work is that these uncertainties take into account measurements uncertainties, cross-sections uncertainties and model error. In particular, our results give a very good approximation of the total flux and indicate that neutron flux from MCNP simulation for energies above about 5 MeV seems to overestimate the 'real flux'. (authors)

97 MATHEMATICS AND COMPUTING↗

Characteristics of SiC neutron sensor spectrum unfolding process based on Bayesian inference

This paper deals with SiC detector signal interpretation in neutron radiation measurements in mixed neutron gamma radiation fields, which is called the detector inverse problem or the spectrum unfolding, and it aims in finding a representation of the primary radiation, based on the measured detector signals. In our novel methodology we resort to Bayesian inference approach. In the developed procedure the resultant spectra is unfolded form detector channels reading, where the estimated neutron fluence in a group structure is obtained with its statistical characteristic comprising of standard deviation and correlation matrix. In the paper we present results of unfolding process for case of D-T neutron source in neutron moderating environment. Discussions of statistical properties of obtained results are presented as well as of the physical meaning of obtained correlation matrix of estimated group fluence. The presented works has been carried out within the I-SMART project, which is part of the KIC InnoEnergy R and D program. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Application of a bayesian belief network model to reliability assessment of nuclear safety-related software - 207

As the instrumentation and control (I and C) systems in nuclear power plants (NPPs) have been replaced with digital-based systems, the need to incorporate software failures into NPP probabilistic risk assessments has arisen. In order to assess the probability of software failure on demand, a Bayesian belief network (BBN) model was developed which estimates the number of defects and the resulting probability of software failure on demand in nuclear safety-related software. To assess the feasibility of the BBN framework, the BBN model was applied to the prototype Integrated Digital Protection System-Reactor Protection System (IDiPS-RPS) to estimate the number of remaining faults and the software failure probability of a target software. The developmental- and V and V-activities carried out during the IDiPS-RPS development process were evaluated based on the well-defined checklist derived by the V and V team and were estimated based on expert elicitation. In addition, the attribute evaluations and the number of FPs of the target software is provided as the inputs for the BBN model. The application results showed the feasibility of using BBNs for quantifying software failure probabilities and several insights were gained from the applications of the BBN model. The proposed BBN framework can be applied to estimate the software failure probability for other safety-related NPP software and provide an insight on modeling the software development process that involves iterations between different development phases. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Bayesian estimation of cross-section and errors of experiment and calculation for accurate prediction of neutronic characteristics

In some experiments, there might be a correlation of experimental errors such as an error caused by fabrication. The correlation of calculation errors also might exist among analyses of experiments. In the present study, considering these correlations, the cross-section and errors of experiment and calculation are adjusted for the accurate prediction of neutronic characteristics. The adjustment method is derived based on Bayesian theory. The 'a posteriori' distributions of cross-section and errors of experiment and calculation are obtained by the derivation. The case study is performed by using the benchmarks of light-water moderated experiments reported in ICSBEP. The error from fuel rod fabrication and measurement are included in the experiment error, and the error from the simplification of the benchmark model is included in the calculation error. Since these errors have a positive correlation among the benchmarks, the prediction accuracy is expected to be improved by considering these correlations. For the sensitivity analysis of the correlation among benchmarks, the correlation coefficient of experiment error and that of calculation error is assumed from 0.0 to 0.9. The results indicate that the prediction accuracy of the multiplication factor can be improved by increasing the correlation coefficient of experiment error and that of calculation error. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Bayesian Learning Approach to Wireless Outdoor Heatmap Construction using Deep Gaussian Process

We present a novel Bayesian learning approach to outdoor radio heatmap construction utilizing deep Gaussian process (GP). The proposed approach employs a two-layer hierarchy which consists of two cascaded Gaussian processes that are capable of modeling more complex input-output relations than standard single-layer Gaussian processes. Since deriving the exact model likelihood is challenging, a lower bound is optimized instead so that gradient descent-based methods can be performed to find out the optimal model parameters. Typically, inducing points are used in GPs to facilitate low-rank approximation of covariance (kernel) matrices for computation speedup. However, the inaccuracy induced by inducing points can accumulate when stacking multiple layers of GP which may hinder the performance of deep GP. Moreover, since inducing points need to be learned, having them at all layers of deep GP also incurs computational burden. To overcome the above challenges, in contrast to the canonical deep GP model, we use a modified architecture where a full standard GP resides in the first layer and inducing points are only introduced for the second layer. This modified architecture strikes a balance between model accuracy and training complexity. In the proposed model, the noise parameter of the first GP layer is also eliminated to improve the training efficiency as the noise parameter at the output of the second layer suffices to model the uncertainty in the output. The proposed approach is evaluated on real-world datasets, in the form of location-Received Signal Strength (RSS) pairs, collected from the Platform for Open Wireless Data-driven Experimental Research (POWDER) located at the campus of the University of Utah. Experiment results show that the proposed approach can achieve smaller prediction errors on various training and testing data configurations than DNN-based and GP-based methods.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Design optimization of an ethanol heavy-duty engine using design of experiments and bayesian optimization

Diesel-fueled engines still hold a large market share in the medium and heavy-duty transportation sector. However, the increase in fossil fuel prices and the strict emission regulations are leading engine manufacturers to seek cleaner alternatives without a compromise in performance. Alcohol-based fuels, such as ethanol, offer a promising alternative to diesel fuel in meeting regulatory demands. Ethanol provides cleaner combustion and lower levels of soot due to its chemical properties, in particular its lower level of carbon content. In addition, the stoichiometric operating conditions of alcohol fueled engines enable the mitigation of NOx emissions in aftertreatment stage. With the promise of retrofitting diesel engines to run on ethanol to reduce emissions, the thermal efficiency of these engines remains the primary optimization target. In order to find the optimal ethanol-fueled engine design that maximizes the thermal efficiency, a large design space needs to be investigated using engineering tools. In this study, previous research by the authors on optimizing the design of a single-cylinder ethanol-fueled engine was extended to explore the design space for a heavy-duty multi-cylinder engine configuration. A heavy-duty engine setup with multiple operating conditions at different engine speeds and loads were considered. A design optimization analysis was performed to identify the potential designs that maximize the indicated thermal efficiency in an ethanol-fueled compression ignition engine. First, a computational fluid dynamics (CFD) model of the engine was validated using experimental data for four drive cycle points. Using a design of experiments (DoE) approach and a parameterized piston bowl geometry, the model was then exercised to explore the relationship among geometric features of the piston bowl and spray targeting angle and indicated thermal efficiency across all tested operating conditions. After evaluating 165~candidate designs, a piston bowl geometry was identified that yielded an increase between 1.3 to 2.2 percentage points in indicated thermal efficiency for all tested conditions, while satisfying the operational design constraints for peak pressure and maximum pressure rise rate. The increased performance was attributed to enhanced mixing that led to the formation of a more homogeneous distribution of in-cylinder temperature and equivalence ratio, higher combustion temperatures, and shorter combustion duration. Finally, a Bayesian optimization (BOpt) analysis was employed to find the optimal piston bowl geometry with a fixed spray injector angle for one of the operating conditions. Using BOpt, a piston candidate was identified that resulted in a 1.9~percentage point increase in thermal efficiency from the baseline design, yet only required 65\% of the design samples investigated using the DoE approach.

Tekgul, Bulut↗

Robust Multi-fidelity Bayesian Optimization with Deep Kernel and Partition

Multi-fidelity Bayesian optimization (MFBO) is a powerful approach that utilizes lowfidelity, cost-effective sources to expedite the exploration and exploitation of a high-fidelity objective function. Existing MFBO methods with theoretical foundations either lack justification for performance improvements over single-fidelity optimization or rely on strong assumptions about the relationships between fidelity sources to construct surrogate models and direct queries to low-fidelity sources. To mitigate the dependency on cross-fidelity assumptions while maintaining the advantages of low-fidelity queries, we introduce a random sampling and partition-based MFBO framework with deep kernel learning. This framework is robust to cross-fidelity model misspecification and explicitly illustrates the benefits of low-fidelity queries. Our results demonstrate that the proposed algorithm effectively manages complex cross-fidelity relationships and efficiently optimizes the target fidelity function.

Zhang, Fengxue [University of Chicago, Illinois, U↗

Automating Sensor Characterization with Bayesian Optimization

The development of novel instrumentation requires an iterative cycle with three stages: design, prototyping, and testing. Recent advancements in simulation and nanofabrication techniques have significantly accelerated the design and prototyping phases. Nonetheless, detector characterization continues to be a major bottleneck in device development. During the testing phase, a significant time investment is required to characterize the device in different operating conditions and find optimal operating parameters. The total effort spent on characterization and parameter optimization can occupy a year or more of an expert's time. In this work, we present a novel technique for automated sensor calibration that aims to accelerate the testing stage of the development cycle. This technique leverages closed-loop Bayesian optimization (BO), using real-time measurements to guide parameter selection and identify optimal operating states. We demonstrate the method with a novel low-noise CCD, showing that the machine learning-driven tool can efficiently characterize and optimize operation of the sensor in a couple of days without supervision of a device expert.

Cuevas-Zepeda, Julian [Chicago U., KICP; Chicago U↗

A Bayesian method for inferring transmission chains in a partially observed epidemic.

We present a Bayesian approach for estimating transmission chains and rates in the Abakaliki smallpox epidemic of 1967. The epidemic affected 30 individuals in a community of 74; only the dates of appearance of symptoms were recorded. Our model assumes stochastic transmission of the infections over a social network. Distinct binomial random graphs model intra- and inter-compound social connections, while disease transmission over each link is treated as a Poisson process. Link probabilities and rate parameters are objects of inference. Dates of infection and recovery comprise the remaining unknowns. Distributions for smallpox incubation and recovery periods are obtained from historical data. Using Markov chain Monte Carlo, we explore the joint posterior distribution of the scalar parameters and provide an expected connectivity pattern for the social graph and infection pathway.

59 BASIC BIOLOGICAL SCIENCES↗

An Anticipatory and Deceptive AI Utilizing Bayesian Belief Networks

The U.S. military defines antiterrorism as the defensive posture taken against terrorist threats. Antiterrorism includes fostering awareness of potential threats, deterring aggressors, developing security measures, planning for future events, interdicting an event in progress, and ultimately mitigating and managing the consequences of an event. Recent events highlight the need for efficient tools for training our military and homeland security officers for anticipating threats posed by terrorists. These tools need to be easy enough so that they are readily usable without substantial training, but still maintain the complexity to allow for a level of deceptive reasoning on the part of the opponent. To meet this need, we propose to integrate a Bayesian Belief Network (BBN) model for threat anticipation and deceptive reasoning into training simulation environments currently utilized by several organizations within the Department of Defense (DoD). BBNs have the ability to deal with various types of uncertainties; such as identities, capabilities, target attractiveness, and the combinations of the previous. They also allow for disparate types of data to be fused in a coherent, analytically defensible, and understandable manner. A BBN has been developed by ORNL uses a network engineering process that treats the probability distributions of each node with in the broader context of the system development effort as a whole, and not in isolation. The network will be integrated into the Research Network Inc,(RNI) developed Game Distributed Interactive Simulation (GDIS) as a smart artificial intelligence module. GDIS is utilized by several DoD and civilian organizations as a distributed training tool for a multiplicity of reasons. It has garnered several awards for its realism, ease of use, and popularity. One area that it still has room to excel in, as most video training tools do, is in the area of artificial intelligence of opponent combatants. It is believed that by utilizing BBN as the backbone of the artificial intelligence code, a more realistic and helpful training experience will be available and enemy combatants that move and strategize with purpose will be obtained.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

THREAT ANTICIPATION AND DECEPTIVE REASONING USING BAYESIAN BELIEF NETWORKS

Recent events highlight the need for tools to anticipate threats posed by terrorists. Assessing these threats requires combining information from disparate data sources such as analytic models, simulations, historical data, sensor networks, and user judgments. These disparate data can be combined in a coherent, analytically defensible, and understandable manner using a Bayesian belief network (BBN). In this paper, we develop a BBN threat anticipatory model based on a deceptive reasoning algorithm using a network engineering process that treats the probability distributions of the BBN nodes within the broader context of the system development process.

97 MATHEMATICS AND COMPUTING↗

Utilization of extended bayesian networks in decision making under uncertainty

Bayesian network tool (called IKE for Integrated Knowledge Engine) has been developed to assess the probability of undesirable events. The tool allows indications and observables from sensors and/or intelligence to feed directly into hypotheses of interest, thus allowing one to quantify the probability and uncertainty of these events resulting from very disparate evidence. For example, the probability that a facility is processing nuclear fuel or assembling a weapon can be assessed by examining the processes required, establishing the observables that should be present, then assembling information from intelligence, sensors and other information sources related to the observables. IKE also has the capability to determine tasking plans, that is, prioritize which observable should be collected next to most quickly ascertain the 'true' state and drive the probability toward 'zero' or 'one.' This optimization capability is called 'evidence marshaling.' One example to be discussed is a denied facility monitoring situation; there is concern that certain process(es) are being executed at the site (due to some intelligence or other data). We will show how additional pieces of evidence will then ascertain with some degree of certainty the likelihood of this process(es) as each piece of evidence is obtained. This example shows how both intelligence and sensor data can be incorporated into the analysis. A second example involves real-time perimeter security. For this demonstration we used seismic, acoustic, and optical sensors linked back to IKE. We show how these sensors identified and assessed the likelihood of 'intruder' versus friendly vehicles.

97 MATHEMATICS AND COMPUTING↗

Bayesian time-varying occupancy model for West Nile virus in Ontario, Canada

Occupancy models determine the true presence or absence of a species by adjusting for imperfect detection in surveys. They often assume that species presences can be detected only if sites are occupied during a sampling season. We extended these models to estimate occupancy rates that vary throughout a sampling season as well as account for spatial dependence among sites. For these methods, we constructed a fast Gibbs sampler with the Pólya-Gamma augmentation strategy to conduct inference on covariate effects. We applied these methods to evaluate how environmental conditions and surveillance practices are associated with the presence of West Nile virus in mosquito traps across Ontario, Canada from 2002 to 2017. We found that urban land cover and warm temperatures drove viral occupancy, whereas viral testing on pools with higher proportions of Culex mosquitoes was more likely to result in a positive test for West Nile virus. Models with time-varying occupancy effects achieved much lower Watanabe-Akaike information criteria than models without such effects. Our final model had strong predictive performance on test data that included some of the most extreme seasons, demonstrating the promise of these methods in the study of pathogens spread by mosquito vectors.

60 APPLIED LIFE SCIENCES↗