Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian Testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

Radioactive Source Localization via Bayesian Particle Filter

In the event of a misplaced radioactive source or other emergency situation, measuring a radiation field, mapping its distribution, and determining a source location are essential tasks to ameliorating the situation. However, radiation fields may be extremely hazardous to human surveyors and minimizing received radiation doses is just as essential. Robots appear to be a potential solution to these problems. Beyond simply measuring radiation, the robot's computer processing capabilities offer a way to apply complex data analysis methods to radiation measurements in real-time. Methods which predict likely source locations can then feed this information into other processes, potentially improving path planning and enabling more efficient measurements. Given a robot mounted with a gamma-ray detector, can we: develop a methodology to account for detector performance across a wide range of source angles, distances, and photon energies? operate an autonomously navigating robot to effectively survey and characterize an area of interest? implement a data analysis method, conventionally used in measurements of motion, for source localization purposes? An open-source TurtleBot 3 robot, running Robot Operating System (ROS) on Ubuntu 16.04 LTS, was fitted with a Kromek GR1{sup R} Cadmium Zinc Telluride (CZT) solid-state gamma-ray detector. As a part of ROS, the packages OpenSlam, gmapping, and amcl were used to perform Simultaneous Localization and Mapping (SLAM), determining the robot's position and mapping the surrounding area. Data was acquired via Lidar mounted on top the TurtleBot 3. Detector Calibration Fit: The equation was fit to 365 counts of various energies, distances, and angles. A MATLAB{sup R} program was written to simulate measurements taken a robot on a random walk, with count data and positions discretized into finite element pixels. Using this program, a sample of 100 runs was performed on a map with a simulated source at the center, with a total of 200 of 2 pixels each. Similarly, multiple runs of the filter were performed on recorded robot measurement data. In both simulation and real tests, when corrected for errors (particles placed outside of bounds or on the robot, and simulation-specific errors), corresponding t-tests of predicted x and y-coordinates were within a 95% confidence interval of the actual position. For the real trial, these positions are slightly skewed right in the x-axis as the robot remained mainly to the left side of the source within the sample area. These simulations demonstrate potential validity for the usage of a particle filter as method of radioactive source localization. In the future, true real-time implementation and data fusion may further augment the performance of the robot to localize lost sources. Additionally, identification of multiple sources, determination of source types, and usage of a collimator are areas to potentially be explored.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Stochastic inversion of permeability and dispersivities from time lapse self‐potential measurements: A controlled sandbox study

We test the ability of the self‐potential method to provide information that can be used to invert the permeability and the dispersivities of a porous material. We first formulate the semi‐coupled system of equations describing the occurrence of self‐potential signals associated with the transport of salt in a porous material like sand. Two contributions in the source current density arise from the electrokinetic coupling associated with the flow of the pore water and the diffusion potential due to the gradient in the activity of the salt. A controlled laboratory sandbox experiment is performed to show that time‐lapse self‐potential measurements can be used to invert, in a Bayesian framework, the permeability and dispersivities.

self-potential, dispersivity, permeability↗

Towards Improving luminosity using optics tuning and data-driven methods

The results of Run 24 experiments at Relativistic Heavy Ion Collider (RHIC) for improving luminosity using optics tuning are presented in this study. In the first experiment, MADx matching was used to output magnet strengths corresponding to specific s star movements around Interaction Region 8 (IR8). The corresponding Zero Degree Calorimeter (ZDC) signal was measured in place of luminosity, and Bayesian Optimization aids search of optimal movements. It was found that values retrieved from matching were inaccurate, resulting in negative feedback loops. The second experiment focused on calculating accurate s star movements. The matching method was replaced with a linear sensitivity matrix, directly relating optics to power supply, and its null space was used to fit constraints such as hysteresis effects. At the experiment, beam losses were observed at collimators around boundary of IR8, which were fixed for the third experiment. Dynamic mode decomposition was also introduced to improve quality of turn-by-turn (TBT) data as well as accuracy and consistency of optics measurements at IR8. These improvements will be tested in the experiment of next RHIC run for luminosity optimization.

Accelerator Physics↗

PANCHROMATIC OBSERVATIONS AND MODELING OF THE HV TAU C EDGE-ON DISK

We present new high spatial resolution ({approx}<0.''1) 1-5 {mu}m adaptive optics images, interferometric 1.3 mm continuum and {sup 12}CO 2-1 maps, and 350 {mu}m, 2.8 and 3.3 mm fluxes measurements of the HV Tau system. Our adaptive optics images unambiguously demonstrate that HV Tau AB-C is a common proper motion pair. They further reveal an unusually slow orbital motion within the tight HV Tau AB pair that suggests a highly eccentric orbit and/or a large deprojected physical separation. Scattered light images of the HV Tau C edge-on protoplanetary disk suggest that the anisotropy of the dust scattering phase function is almost independent of wavelength from 0.8 to 5 {mu}m, whereas the dust opacity decreases significantly over the same range. The images further reveal a marked lateral asymmetry in the disk that does not vary over a timescale of two years. We further detect a radial velocity gradient in the disk in our {sup 12}CO map that lies along the same position angle as the elongation of the continuum emission, which is consistent with Keplerian rotation around a 0.5-1 M{sub sun} central star, suggesting that it could be the most massive component in the triple system. To obtain a global representation of the HV Tau C disk, we search for a model that self-consistently reproduces observations of the disk from the visible regime up to millimeter wavelengths. We use a powerful radiative transfer model to compute synthetic disk observations and use a Bayesian inference method to extract constraints on the disk properties. Each individual image, as well as the spectral energy distribution, of HV Tau C can be well reproduced by our models with fully mixed dust provided grain growth has already produced larger-than-interstellar dust grains. However, no single model can satisfactorily simultaneously account for all observations. We suggest that future attempts to model this source include more complex dust properties and possibly vertical stratification. While both grain growth and stratification have already been suggested in many disks, only a panchromatic analysis, such as presented here, can provide a complete picture of the structure of a disk, a necessary step toward quantitatively testing the predictions of numerical models of disk evolution.

79 ASTRONOMY AND ASTROPHYSICS↗

Standing on the shoulders of dwarfs: the kepler asteroseismic legacy sample. I. Oscillation mode parameters

The advent of space-based missions like Kepler has revolutionized the study of solar-type stars, particularly through the measurement and modeling of their resonant modes of oscillation. Here we analyze a sample of 66 Kepler main-sequence stars showing solar-like oscillations as part of the Kepler seismic LEGACY project. We use Kepler short-cadence data, of which each star has at least 12 months, to create frequency-power spectra optimized for asteroseismology. For each star, we identify its modes of oscillation and extract parameters such as frequency, amplitude, and line width using a Bayesian Markov chain Monte Carlo “peak-bagging” approach. We report the extracted mode parameters for all 66 stars, as well as derived quantities such as frequency difference ratios, the large and small separations Δν and δν{sub 02}; the behavior of line widths with frequency and line widths at ν{sub max} with T{sub eff}, for which we derive parametrizations; and behavior of mode visibilities. These average properties can be applied in future peak-bagging exercises to better constrain the parameters of the stellar oscillation spectra. The frequencies and frequency ratios can tightly constrain the fundamental parameters of these solar-type stars, and mode line widths and amplitudes can test models of mode damping and excitation.

79 ASTRONOMY AND ASTROPHYSICS↗

Binning is Sinning: Redemption for Hubble Diagram Using Photometrically Classified Type Ia Supernovae

Bayesian Estimation Applied to Multiple Species (BEAMS) is implemented in the BEAMS with Bias Corrections (BBC) framework to produce a redshift-binned Hubble diagram (HD) for Type Ia supernovae (SNe Ia). BBC corrects for selection effects and non–SN Ia contamination, and systematic uncertainties are described by a covariance matrix with dimension matching the number of BBC redshift bins. For spectroscopically confirmed SN Ia samples, a recent "Binning is Sinning" article showed that an unbinned HD and covariance matrix reduces the systematic uncertainty by a factor of ~1.5 compared to the binned approach. Here we extend their analysis to obtain an unbinned HD for a photometrically identified sample processed with BBC. To test this new method, we simulate and analyze 50 samples corresponding to the Dark Energy Survey (DES) with a low-redshift anchor; the simulation includes SNe Ia, and contaminants from core-collapse SNe and peculiar SNe Ia. The analysis includes systematic uncertainties for calibration and measures the dark energy equation of state parameter (w). Compared to a redshift-binned HD, the unbinned HD with nearly 2000 events results in a smaller systematic uncertainty, in qualitative agreement with BHS21, and averaging results among the 50 samples we find no evidence for a w-bias. To reduce computation time for fitting an unbinned HD with large samples, we propose an HD-rebinning method that defines the HD in bins of redshift, color, and stretch; the rebinned HD results in similar uncertainty as the unbinned case, and shows no evidence for a w-bias.

79 ASTRONOMY AND ASTROPHYSICS↗

Monitoring a Complex Physical System using a Hybrid Dynamic Bayes Net

The Reverse Water Gas Shift system (RWGS) is a complex physical system designed to produce oxygen from the carbon dioxide atmosphere on Mars. If sent to Mars, it would operate without human supervision, thus requiring a reliable automated system for monitoring and control. The RWGS presents many challenges typical of real-world systems, including: noisy and biased sensors, nonlinear behavior, effects that are manifested over different time granularities, and unobservability of many important quantities. In this paper we model the RWGS using a hybrid (discrete/continuous) Dynamic Bayesian Network (DBN), where the state at each time slice contains 33 discrete and 184 continuous variables. We show how the system state can be tracked using probabilistic inference over the model. We discuss how to deal with the various challenges presented by the RWGS, providing a suite of techniques that are likely to be useful in a wide range of applications. In particular, we describe a general framework for dealing with nonlinear behavior using numerical integration techniques, extending the successful Unscented Filter. We also show how to use a fixed-point computation to deal with effects that develop at different time scales, specifically rapid changes occuring during slowly changing processes. We test our model using real data collected from the RWGS, demonstrating the feasibility of hybrid DBNs for monitoring complex real-world physical systems.

Lerner, Uri↗

Discovery of Self-Assembling π-Conjugated Peptides by Active Learning-Directed Coarse-Grained Molecular Simulation

Electronically active organic molecules have demonstrated great promise as novel soft materials for energy harvesting and transport. Self-assembled nanoaggregates formed from π-conjugated oligopeptides composed of an aromatic core flanked by oligopeptide wings offer emergent optoelectronic properties within a water-soluble and biocompatible substrate. Nanoaggregate properties can be controlled by tuning core chemistry and peptide composition, but the sequence–structure–function relations remain poorly characterized. Here, we employ coarse-grained molecular dynamics simulations within an active learning protocol employing deep representational learning and Bayesian optimization to efficiently identify molecules capable of assembling pseudo-1D nanoaggregates with good stacking of the electronically active π-cores. We consider the DXXX-OPV3-XXXD oligopeptide family, where D is an Asp residue and OPV3 is an oligophenylenevinylene oligomer (1,4-distyrylbenzene), to identify the top performing XXX tripeptides within all 20 3 = 8000 possible sequences. By direct simulation of only 2.3% of this space, we identify molecules predicted to exhibit superior assembly relative to those reported in prior work. Spectral clustering of the top candidates reveals new design rules governing assembly. This work establishes new understanding of DXXX-OPV3-XXXD assembly, identifies promising new candidates for experimental testing, and presents a computational design platform that can be generically extended to other peptide-based and peptide-like systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multiple objective optimization in reliability demonstration test

Reliability demonstration tests are usually performed in product design or validation processes to demonstrate whether a product meets specified requirements on reliability. For binomial demonstration tests, the zero-failure test has been most commonly used due to its simplicity and use of minimum sample size to achieve an acceptable consumer’s risk level. However, this test can often result in unacceptably high risk for producers as well as a low probability of passing the test even when the product has good reliability. This paper explicitly explores the interrelationship between multiple objectives that are commonly of interest when planning a demonstration test and proposes structured decision-making procedures using a Pareto front approach for selecting an optimal test plan based on simultaneously balancing multiple criteria. Different strategies are suggested for scenarios with different user priorities and graphical tools are developed to help quantify the trade-offs between choices and to facilitate informed decision making. As a result, potential impacts of some subjective user inputs on the final decision are studied to offer insights and useful guidance for general applications.

97 MATHEMATICS AND COMPUTING↗

Advancements in Constitutive Model Calibration: Leveraging the Power of Full‐Field DIC Measurements and In Situ Load Path Selection for Reliable Parameter Inference

Accurate material characterization and model calibration are essential for computationally supported high-consequence engineering decisions. Historically, characterization and calibration methods (1) use simplified test specimen geometries and global data, (2) cannot guarantee that sufficient characterization data are collected for a specific model of interest, (3) use deterministic methods that provide best-fit parameter values with no uncertainty quantification, and (4) are sequential, inflexible, and time-consuming. This work brings together several recent advancements into an improved workflow called interlaced characterization and calibration (ICC) that advances the state-of-the-art in constitutive model calibration. The ICC paradigm (1) employs tools to efficiently use full-field data to calibrate high-fidelity material models, (2) aligns the data needed with the data collected by adopting an optimal experimental design protocol, (3) quantifies parameter uncertainty through Bayesian inference and (4) incorporates these advancements into a quasi real-time feedback loop. The ICC framework is demonstrated here on the calibration of a material model using simulated full-field data for an aluminium cruciform specimen being deformed biaxially. The cruciform is actively driven through the myopically preferred load path using Bayesian optimal experimental design, which selects load steps that yield the maximum expected information gain (EIG). Principal component analysis (PCA) is performed on the model predictions of full-field displacements, and fast surrogate models are built to approximate the input-output relationships of the expensive finite element model. Furthermore, the tools developed and demonstrated here show that high-fidelity constitutive models can be efficiently and reliably calibrated with quantified uncertainty, thus supporting credible decision-making and potentially increasing the agility of solid mechanics modelling by enabling utilization of computational simulations at earlier stages of the design cycle.

Bayesian optimal experimental design↗

Improved uncertainty quantification in nondestructive assay for nonproliferation

This paper illustrates methods to improve uncertainty quantification (UQ) for non-destructive assay (NDA) measurements used in nuclear nonproliferation. First, it is shown that current bottom-up UQ applied to calibration data is not always adequate, for three main reasons: (1) Because there are errors in both the predictors and the response, calibration involves a ratio of random quantities, and calibration data sets in NDA usually consist of only a modest number of samples (3–10); therefore, asymptotic approximations involving quantities needed for UQ such as means and variances are often not sufficiently accurate; (2) Common practice overlooks that calibration implies a partitioning of total error into random and systematic error, and (3) In many NDA applications, test items exhibit non-negligible departures in physical properties from calibration items, so model-based adjustments are used, but item-specific bias remains in some data. Therefore, improved bottom-up UQ using calibration data should predict the typical magnitude of item-specific bias, and the suggestion is to do so by including sources of item-specific bias in synthetic calibration data that is generated using a combination of modeling and real calibration data. Second, for measurements of the same nuclear material item by both the facility operator and international inspectors, current empirical (top-down) UQ is described for estimating operator and inspector systematic and random error variance components. A Bayesian alternative is introduced that easily accommodates constraints on variance components, and is more robust than current top-down methods to the underlying measurement error distributions.

97 MATHEMATICS AND COMPUTING↗

MULTIPLE STAR FORMATION TO THE BOTTOM OF THE INITIAL MASS FUNCTION

The frequency and properties of multiple star systems offer powerful tests of star formation models. Multiplicity surveys over the past decade have shown that binary properties vary strongly with mass, but the functional forms and the interplay between frequency and semimajor axis remain largely unconstrained. We present the results of a large-scale survey of multiplicity at the bottom of the initial mass function in several nearby young associations, encompassing 78 very low mass members observed with Keck laser guide star adaptive optics. Our survey confirms the overall trend observed in the field for lower-mass binary systems to be less frequent and more compact, including a null detection for any substellar binary systems with separations wider than {approx}7 AU. Combined with a Bayesian re-analysis of existing surveys, our results demonstrate that the binary frequency and binary separations decline smoothly between masses of 0.5 M{sub Sun} and 0.02 M{sub Sun }, though we cannot distinguish the functional form of this decline due to a degeneracy between the total binary frequency and the mean binary separation. We also show that the mass ratio distribution becomes progressively more concentrated at q {approx} 1 for declining masses, though a small number of systems appear to have unusually wide separations and low-mass ratios for their mass. Finally, we compare our results to synthetic binary populations generated by smoothed particle hydrodynamic simulations, noting the similarities and discussing possible explanations for the differences.

79 ASTRONOMY AND ASTROPHYSICS↗

Deeply uncertain: comparing methods of uncertainty quantification in deep learning algorithms

We present a comparison of methods for uncertainty quantification (UQ) in deep learning algorithms in the context of a simple physical system. Three of the most common uncertainty quantification methods - Bayesian Neural Networks (BNN), Concrete Dropout (CD), and Deep Ensembles (DE) - are compared to the standard analytic error propagation. We discuss this comparison in terms endemic to both machine learning ("epistemic" and "aleatoric") and the physical sciences ("statistical" and "systematic"). The comparisons are presented in terms of simulated experimental measurements of a single pendulum - a prototypical physical system for studying measurement and analysis techniques. Our results highlight some pitfalls that may occur when using these UQ methods. For example, when the variation of noise in the training set is small, all methods predicted the same relative uncertainty independently of the inputs. This issue is particularly hard to avoid in BNN. On the other hand, when the test set contains samples far from the training distribution, we found that no methods sufficiently increased the uncertainties associated to their predictions. This problem was particularly clear for CD. In light of these results, we make some recommendations for usage and interpretation of UQ methods.

59 BASIC BIOLOGICAL SCIENCES↗

Multilevel Logistic Regression with Random Slope for Community Annoyance Survey Data

This paper documents recent dose-response modeling work at NASA in anticipation of follow-on work by a contactor. Specifically, this paper compares the results of a Bayesian MLR model with a fixed slope to one with a random slope using WSPR and QSF18 data. Previously reported dose-response modeling efforts of WSPR and QSF18 data have used a MLR model with a fixed slope term. A random slope may more accurately depict the dose-response relationship of individuals in the efforts to produce a population summary dose-response curve. Results of a fixed versus random slope model with WSPR and QSF18 data indicate minimal difference between the modeling methods. The simpler fixed slope model is preferable for these data, but these results do not preclude consideration of a random slope term in modeling efforts of future X-59 community test data.

dose-response↗

TESTING NONSTANDARD COSMOLOGICAL MODELS WITH SNLS3 SUPERNOVA DATA AND OTHER COSMOLOGICAL PROBES

We investigate the implications for some nonstandard cosmological models using data from the first three years of the Supernova Legacy Survey (SNLS3), assuming a spatially flat universe. A comparison between the constraints from the SNLS3 and those from other SN Ia samples, such as the ESSENCE, Union2, SDSS-II, and Constitution samples, is given and the effects of different light-curve fitters are considered. We find that analyzing SNe Ia with SALT2 or SALT or SiFTO can give consistent results and the tensions between different data sets and different light-curve fitters are obvious for fewer-free-parameters models. At the same time, we also study the constraints from SNLS3 along with data from the cosmic microwave background and the baryonic acoustic oscillations (CMB/BAO), and the latest Hubble parameter versus redshift (H(z)). Using model selection criteria such as {chi}{sup 2}/dof, goodness of fit, Akaike information criterion, and Bayesian information criterion, we find that, among all the cosmological models considered here ({Lambda}CDM, constant w, varying w, Dvali-Gabadadze-Porrati (DGP), modified polytropic Cardassian, and the generalized Chaplygin gas), the flat DGP is favored by SNLS3 alone. However, when additional CMB/BAO or H(z) constraints are included, this is no longer the case, and the flat {Lambda}CDM becomes preferred.

79 ASTRONOMY AND ASTROPHYSICS↗

MOA-2011-BLG-293Lb: A TEST OF PURE SURVEY MICROLENSING PLANET DETECTIONS

Because of the development of large-format, wide-field cameras, microlensing surveys are now able to monitor millions of stars with sufficient cadence to detect planets. These new discoveries will span the full range of significance levels including planetary signals too small to be distinguished from the noise. At present, we do not understand where the threshold is for detecting planets. MOA-2011-BLG-293Lb is the first planet to be published from the new surveys, and it also has substantial follow-up observations. This planet is robustly detected in survey+follow-up data ({Delta}{chi}{sup 2} {approx} 5400). The planet/host mass ratio is q = (5.3 {+-} 0.2) Multiplication-Sign 10{sup -3}. The best-fit projected separation is s = 0.548 {+-} 0.005 Einstein radii. However, due to the s{r_reversible}s{sup -1} degeneracy, projected separations of s{sup -1} are only marginally disfavored at {Delta}{chi}{sup 2} = 3. A Bayesian estimate of the host mass gives M{sub L} = 0.43{sup +0.27}{sub -0.17} M{sub Sun }, with a sharp upper limit of M{sub L} < 1.2 M{sub Sun} from upper limits on the lens flux. Hence, the planet mass is m{sub p} = 2.4{sup +1.5}{sub -0.9} M{sub Jup}, and the physical projected separation is either r {approx_equal} 1.0 AU or r {approx_equal} 3.4 AU. We show that survey data alone predict this solution and are able to characterize the planet, but the {Delta}{chi}{sup 2} is much smaller ({Delta}{chi}{sup 2} {approx} 500) than with the follow-up data. The {Delta}{chi}{sup 2} for the survey data alone is smaller than for any other securely detected planet. This event suggests a means to probe the detection threshold, by analyzing a large sample of events like MOA-2011-BLG-293, which have both follow-up data and high-cadence survey data, to provide a guide for the interpretation of pure survey microlensing data.

79 ASTRONOMY AND ASTROPHYSICS↗

Preserving nonlinear constraints in variational flow filtering data assimilation

Data assimilation aims to estimate the states of a dynamical system by optimally combining sparse and noisy observations of the physical system with uncertain forecasts produced by a computational model. The states of many dynamical systems of interest obey nonlinear physical constraints, and the corresponding dynamics is confined to a certain sub-manifold of the state space. Standard data assimilation techniques applied to such systems yield posterior states lying outside the manifold, violating the physical constraints. This work focuses on particle flow filters which use stochastic differential equations to evolve state samples from a prior distribution to samples from an observation-informed posterior distribution. The variational Fokker-Planck (VFP)—a generic particle flow filtering framework—is extended to incorporate non-linear, equality state constraints in the analysis. To this end, two algorithmic approaches that modify the VFP stochastic differential equation are discussed: (i) VFPSTAB, to inexactly preserve constraints with the addition of a stabilizing drift term, and (ii) VFPDAE, to exactly preserve constraints by treating the VFP dynamics as a stochastic differential-algebraic equation (SDAE). Additionally, an implicit-explicit time integrator is developed to evolve the VFPDAE dynamics. The strength of the proposed approach for constraint preservation in data assimilation is demonstrated on three test problems: the double pendulum, Korteweg-de-Vries, and the incompressible Navier-Stokes equations.

97 MATHEMATICS AND COMPUTING↗

Iterative Importance Sampling Algorithms for Parameter Estimation

In parameter estimation problems one computes a posterior distribution over uncertain parameters defined jointly by a prior distribution, a model, and noisy data. Markov chain Monte Carlo (MCMC) is often used for the numerical solution of such problems. An alternative to MCMC is importance sampling, which can exhibit near perfect scaling with the number of cores on high performance computing systems because samples are drawn independently. However, finding a suitable proposal distribution is a challenging task. Several sampling algorithms have been proposed over the past years that take an iterative approach to constructing a proposal distribution. We investigate the applicability of such algorithms by applying them to two realistic and challenging test problems, one in subsurface flow, and one in combustion modeling. More specifically, we implement importance sampling algorithms that iterate over the mean and covariance matrix of Gaussian or multivariate t-proposal distributions. Our implementation leverages massively parallel computers, and we present strategies to initialize the iterations using “coarse” MCMC runs or Gaussian mixture models.

97 MATHEMATICS AND COMPUTING↗