Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Evaluation of kriging based surrogate models constructed from mesoscale computations of shock interaction with particles

Macro-scale computations of shocked particulate flows require closure laws that model the exchange of momentum/energy between the fluid and particle phases. Closure laws are constructed in this work in the form of surrogate models derived from highly resolved mesoscale computations of shock-particle interactions. The mesoscale computations are performed to calculate the drag force on a cluster of particles for different values of Mach Number and particle volume fraction. Two Kriging-based methods, viz. the Dynamic Kriging Method (DKG) and the Modified Bayesian Kriging Method (MBKG) are evaluated for their ability to construct surrogate models with sparse data; i.e. using the least number of mesoscale simulations. It is shown that if the input data is noise-free, the DKG method converges monotonically; convergence is less robust in the presence of noise. The MBKG method converges monotonically even with noisy input data and is therefore more suitable for surrogate model construction from numerical experiments. This work is the first step towards a full multiscale modeling of interaction of shocked particle laden flows.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Sparse Bayesian mass mapping with uncertainties: hypothesis testing of structure

ABSTRACT A crucial aspect of mass mapping, via weak lensing, is quantification of the uncertainty introduced during the reconstruction process. Properly accounting for these errors has been largely ignored to date. We present a new method to reconstruct maximum a posteriori (MAP) convergence maps by formulating an unconstrained Bayesian inference problem with Laplace-type l1-norm sparsity-promoting priors, which we solve via convex optimization. Approaching mass mapping in this manner allows us to exploit recent developments in probability concentration theory to infer theoretically conservative uncertainties for our MAP reconstructions, without relying on assumptions of Gaussianity. For the first time, these methods allow us to perform hypothesis testing of structure, from which it is possible to distinguish between physical objects and artefacts of the reconstruction. Here, we present this new formalism, and demonstrate the method on simulations, before applying the developed formalism to two observational data sets of the Abell 520 cluster. Initial reconstructions of the Abell 520 catalogues reported the detection of an anomalous ‘dark core’ – an overdense region with no optical counterpart – which was taken to be evidence for self-interacting dark matter. In our Bayesian framework, it is found that neither Abell 520 data set can conclusively determine the physicality of such dark cores at $99{{\ \rm per\ cent}}$ confidence. However, in both cases the recovered MAP estimators are consistent with both sets of data.

Price, M. A.↗

Π4U: A high performance computing framework for Bayesian uncertainty quantification of complex models

We present Π4U,{sup 1} an extensible framework, for non-intrusive Bayesian Uncertainty Quantification and Propagation (UQ+P) of complex and computationally demanding physical models, that can exploit massively parallel computer architectures. The framework incorporates Laplace asymptotic approximations as well as stochastic algorithms, along with distributed numerical differentiation and task-based parallelism for heterogeneous clusters. Sampling is based on the Transitional Markov Chain Monte Carlo (TMCMC) algorithm and its variants. The optimization tasks associated with the asymptotic approximations are treated via the Covariance Matrix Adaptation Evolution Strategy (CMA-ES). A modified subset simulation method is used for posterior reliability measurements of rare events. The framework accommodates scheduling of multiple physical model evaluations based on an adaptive load balancing library and shows excellent scalability. In addition to the software framework, we also provide guidelines as to the applicability and efficiency of Bayesian tools when applied to computationally demanding physical models. Theoretical and computational developments are demonstrated with applications drawn from molecular dynamics, structural dynamics and granular flow.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Q-BEEP: Quantum Bayesian Error Mitigation Employing Poisson Modeling over the Hamming Spectrum

Quantum computing technology has grown rapidly in recent years, with new technologies being explored, error rates being reduced, and quantum processor’s qubit capacity growing. However, near-term quantum algorithms are still unable to be induced without compounding consequential levels of noise, leading to non-trivial erroneous results. Quantum Error Correction (in-situ error mitigation) and Quantum Error Mitigation (post-induction error mitigation) are promising fields of research within the quantum algorithm scene, aiming to alleviate quantum errors, increasing the overall fidelity and hence the overall quality of circuit induction. Earlier this year, a pioneering work, namely HAMMER, published in ASPLOS-22 demonstrated the existence of a latent structure regarding post-circuit induction errors when mapping to the Hamming spectrum. However, they intuitively assumed that errors occur in local clusters, and that at higher average Hamming distances this structure falls away. In this work, we show that such a correlation structure is not only local but extends certain non-local clustering patterns which can be precisely described by a Poisson distribution model taking the input circuit, the device run time status (i.e., calibration statistics) and qubit topology into consideration. Using this quantum error characterizing model, we developed an iterative algorithm over the generated Bayesian network state-graph for post-induction error mitigation. Thanks to more precise modeling of the error distribution latent structure and the new iterative method, our Q-Beep approach provides state of the art performance and can boost circuit execution fidelity by up to 234.6% on Bernstein-Vazirani circuits and on average 71.0% on QAOA solution quality, using 16 practical IBMQ quantum processors. For other benchmarks such as those in QASMBench, the fidelity improvement is up to 17.8%. Q-Beep is a light-weight post-processing technique that can be performed offline and remotely, making it a useful tool for quantum vendors to integrate and provide more reliable circuit induction results.

Stein, Samuel A.↗

CROSS-IDENTIFICATION PERFORMANCE FROM SIMULATED DETECTIONS: GALEX AND SDSS

We investigate the quality of associations of astronomical sources from multi-wavelength observations using simulated detections that are realistic in terms of their astrometric accuracy, small-scale clustering properties and selection functions. We present a general method to build such mock catalogs for studying associations, and compare the statistics of cross-identifications based on angular separation and Bayesian probability criteria. In particular, we focus on the highly relevant problem of cross-correlating the ultraviolet Galaxy Evolution Explorer (GALEX) and optical Sloan Digital Sky Survey (SDSS) surveys. Using refined simulations of the relevant catalogs, we find that the probability thresholds yield lower contamination of false associations, and are more efficient than angular separation. Our study presents a set of recommended criteria to construct reliable cross-match catalogs between SDSS and GALEX with minimal artifacts.

79 ASTRONOMY AND ASTROPHYSICS↗

Forensic analysis of the microbiome of phones and shoes

Background: Microbial interaction between human-associated objects and the environments we inhabit may have forensic implications, and the extent to which microbes are shared between individuals inhabiting the same space may be relevant to human health and disease transmission. In this study, two participants sampled the front and back of their cell phones, four different locations on the soles of their shoes, and the floor beneath them every waking hour over a 2-day period. A further 89 participants took individual samples of their shoes and phones at three different scientific conferences. Results: Samples taken from different surface types maintained significantly different microbial community structures. The impact of the floor microbial community on that of the shoe environments was strong and immediate, as evidenced by Procrustes analysis of shoe replicates and significant correlation between shoe and floor samples taken at the same time point. Supervised learning was highly effective at determining which participant had taken a given shoe or phone sample, and a Bayesian method was able to determine which participant had taken each shoe sample based entirely on its similarity to the floor samples. Both shoe and phone samples taken by conference participants clustered into distinct groups based on location, though much more so when an unweighted distance metric was used, suggesting sharing of low-abundance microbial taxa between individuals inhabiting the same space. In conclusion, correlations between microbial community sources and sinks allow for inference of the interactions between humans and their environment.

59 BASIC BIOLOGICAL SCIENCES↗

The X-Ray Halo Scaling Relations of Supermassive Black Holes

We carry out a comprehensive Bayesian correlation analysis between hot halos and direct masses of supermassive black holes (SMBHs), by retrieving the X-ray plasma properties (temperature, luminosity, density, pressure, and masses) over galactic to cluster scales for 85 diverse systems. We find new key scalings, with the tightest relation being −, followed by −. The tighter scatter (down to 0.2 dex) and stronger correlation coefficient of all the X-ray halo scalings compared with the optical counterparts (as the −) suggest that plasma halos play a more central role than stars in tracing and growing SMBHs (especially those that are ultramassive). Moreover, correlates better with the gas mass than dark matter mass. We show the important role of the environment, morphology, and relic galaxies/coronae, as well as the main departures from virialization/self-similarity via the optical/X-ray fundamental planes. We test the three major channels for SMBH growth: hot/Bondi-like models have inconsistent anticorrelation with X-ray halos and too low feeding; cosmological simulations find SMBH mergers as subdominant over most of cosmic time and too rare to induce a central-limit-theorem effect; the scalings are consistent with chaotic cold accretion, the rain of matter condensing out of the turbulent X-ray halos that sustains a long-term self-regulated feedback loop. The new correlations are major observational constraints for models of SMBH feeding/feedback in galaxies, groups, and clusters (e.g., to test cosmological hydrodynamical simulations), and enable the study of SMBHs not only through X-rays, but also via the Sunyaev–Zel'dovich effect (Compton parameter), lensing (total masses), and cosmology (gas fractions).

Supermassive black holes↗

Dark Energy Survey Year 1 Results: Cross-Correlation Redshifts - Methods and Systematics Characterization

We use numerical simulations to characterize the performance of a clustering-based method to calibrate photometric redshift biases. In particular, we cross-correlate the weak lensing (WL) source galaxies from the Dark Energy Survey Year 1 (DES Y1) sample with redMaGiC galaxies (luminous red galaxies with secure photometric red- shifts) to estimate the redshift distribution of the former sample. The recovered redshift distributions are used to calibrate the photometric redshift bias of standard photo-z methods applied to the same source galaxy sample. We also apply the method to three photo-z codes run in our simulated data: Bayesian Photometric Redshift (BPZ), Directional Neighborhood Fitting (DNF), and Random Forest-based photo-z (RF). We characterize the systematic uncertainties of our calibration procedure, and find that these systematic uncertainties dominate our error budget. The dominant systematics are due to our assumption of unevolving bias and clustering across each redshift bin, and to differences between the shapes of the redshift distributions derived by clustering vs photo-z's. The systematic uncertainty in the mean redshift bias of the source galaxy sample is z ≲ 0.02, though the precise value depends on the redshift bin under consideration. Here, we discuss possible ways to mitigate the impact of our dominant systematics in future analyses.

79 ASTRONOMY AND ASTROPHYSICS↗

AAOMEGA OBSERVATIONS OF 47 TUCANAE: EVIDENCE FOR A PAST MERGER?

The globular cluster 47 Tucanae (47 Tuc) is well studied but it has many characteristics that are unexplained, including a significant rise in the velocity dispersion profile at large radii, indicating the exciting possibility of two distinct kinematic populations. In this Letter, we employ a Bayesian approach to the analysis of the largest available spectral data set of 47 Tuc to determine whether this apparently two-component population is real. Assuming the two models were equally likely before taking the data into account, we find that the evidence favors the two-component population model by a factor of {approx}3 x 10{sup 7}. Several possible explanations for this result are explored, namely, the evaporation of low-mass stars, a hierarchical merger, extant remnants of two initially segregated populations, and multiple star formation epochs. We find the most compelling explanation for the two-component velocity distribution is that 47 Tuc formed as two separate populations arising from the same proto-cluster cloud which merged {approx}< 7.3 {+-} 1.5 Gyr ago. This may also explain the extreme rotation, low mass-to-light ratio, and mixed stellar populations of this cluster.

79 ASTRONOMY AND ASTROPHYSICS↗

Self-optimized construction of transition rate matrices from accelerated atomistic simulations with Bayesian uncertainty quantification

Here, a massively parallel method to build large transition rate matrices from temperature-accelerated molecular dynamics trajectories is presented. Bayesian Markov model analysis is used to estimate the expected residence time in the known state space, providing crucial uncertainty quantification for higher-scale simulation schemes such as kinetic Monte Carlo or cluster dynamics. The estimators are additionally used to optimize where exploration is performed and the degree of temperature acceleration on the fly, giving an autonomous, optimal procedure to explore the state space of complex systems. The method is tested against exactly solvable models and used to explore the dynamics of C15 interstitial defects in iron. Our uncertainty quantification scheme allows for accurate modeling of the evolution of these defects over timescales of several seconds.

36 MATERIALS SCIENCE↗

ALMA-SZ detection of a galaxy cluster merger shock at half the age of the universe

We present ALMA measurements of a merger shock using the thermal Sunyaev–Zel’dovich (SZ) effect signal, at the location of a radio relic in the famous El Gordo galaxy cluster at z≈0.9. Multi-wavelength analysis in combination with the archival Chandra data and a high-resolution radio image provides a consistent picture of the thermal and non-thermal signal variation across the shock front and helps to put robust constraints on the shock Mach number as well as the relic magnetic field. We employ a Bayesian analysis technique for modeling the SZ and X-ray data self-consistently, illustrating respective parameter degeneracies. Combined results indicate a shock with Mach number M=2.4{sub −0.6}{sup +1.3}, which in turn suggests a high value of the magnetic field (of the order of 4–10 μG) to account for the observed relic width at 2 GHz. At roughly half the current age of the universe, this is the highest-redshift direct detection of a cluster shock to date, and one of the first instances of an ALMA-SZ observation in a galaxy cluster. It shows the tremendous potential for future ALMA-SZ observations to detect merger shocks and other cluster substructures out to the highest redshifts.

79 ASTRONOMY AND ASTROPHYSICS↗

HyperSpace: Distributed Bayesian Hyperparameter Optimization

As machine learning models continue to increase in complexity, so does the potential number of free model parameters commonly known as hyperparameters. While there has been considerable progress toward finding optimal configurations of these hyperparameters, many optimization procedures are treated as black boxes. We believe optimization methods should not only return a set of optimized hyperparameters, but also give insight into the effects of model hyperparameter settings. To this end, we present HyperSpace, a parallel implementation of Bayesian sequential model-based optimization. HyperSpace leverages high performance computing (HPC) resources to better understand unknown, potentially non-convex hyperparameter search spaces. We show that it is possible to learn the dependencies between model hyperparameters through the optimization process. By partitioning large search spaces and running many optimization procedures in parallel, we also show that it is possible to discover families of good hyperparameter settings over a variety of models including unsupervised clustering, regression, and classification tasks.

Computer Science↗

Producing a BOSS CMASS sample with DES imaging

We present a sample of galaxies with the Dark Energy Survey (DES) photometry that replicates the properties of the BOSS CMASS sample. The CMASS galaxy sample has been well characterized by the Sloan Digital Sky Survey (SDSS) collaboration and was used to obtain the most powerful redshift-space galaxy clustering measurements to date. A joint analysis of redshift-space distortions (such as those probed by CMASS from SDSS) and a galaxy-galaxy lensing measurement for an equivalent sample from DES can provide powerful cosmological constraints. Unfortunately, the DES and SDSS-BOSS footprints have only minimal overlap, primarily on the celestial equator near the SDSS Stripe 82 region. Using this overlap, we build a robust Bayesian model to select CMASS-like galaxies in the remainder of the DES footprint. The newly defined DES-CMASS (DMASS) sample consists of 117,293 effective galaxies covering $1,244 {\rm deg}^2$. Through various validation tests, we show that the DMASS sample selected by this model matches well with the BOSS CMASS sample, specifically in the South Galactic cap (SGC) region that includes Stripe 82. Combining measurements of the angular correlation function and the clustering-z distribution of DMASS, we constrain the difference in mean galaxy bias and mean redshift between the BOSS CMASS and DMASS samples to be $\Delta b = 0.010^{+0.045}_{-0.052}$ and $\Delta z = \left( 3.46^{+5.48}_{-5.55} \right) \times 10^{-3}$ for the SGC portion of CMASS, and $\Delta b = 0.044^{+0.044}_{-0.043} $ and $\Delta z= ( 3.51^{+4.93}_{-5.91}) \times 10^{-3}$ for the full CMASS sample. These values indicate that the mean bias of galaxies and mean redshift in the DMASS sample is consistent with both CMASS samples within $1\sigma$.

79 ASTRONOMY AND ASTROPHYSICS↗

Towards optimal extraction of cosmological information from nonlinear data

One of the main unsolved problems of cosmology is how to maximize the extraction of information from nonlinear data. If the data are nonlinear the usual approach is to employ a sequence of statistics (N-point statistics, counting statistics of clusters, density peaks or voids etc.), along with the corresponding covariance matrices. However, this approach is computationally prohibitive and has not been shown to be exhaustive in terms of information content. Here we instead develop a hierarchical Bayesian approach, expanding the likelihood around the maximum posterior of linear modes, which we solve for using optimization methods. By integrating out the modes using perturbative expansion of the likelihood we construct an initial power spectrum estimator, which for a fixed forward model contains all the cosmological information if the initial modes are gaussian distributed. We develop a method to construct the window and covariance matrix such that the estimator is explicitly unbiased and nearly optimal. We then generalize the method to include the forward model parameters, including cosmological and nuisance parameters, and primordial non-gaussianity. We apply the method in the simplified context of nonlinear structure formation, using either simplified 2-LPT dynamics or N-body simulations as the nonlinear mapping between linear and nonlinear density, and 2-LPT dynamics in the optimization steps used to reconstruct the initial density modes. We demonstrate that the method gives an unbiased estimator of the initial power spectrum, providing among other a near optimal reconstruction of linear baryonic acoustic oscillations.

79 ASTRONOMY AND ASTROPHYSICS↗

16 O Electroweak Response Functions from First Principles

We present calculations of various electroweak response functions for the 16 O nucleus obtained using coupled-cluster theory in conjunction with the Lorentz integral transform method. We employ nuclear forces derived at next-to-leading order and next-to-next-to-leading order in chiral effective field theory and perform a Bayesian analysis to assess uncertainties. Our results are in good agreement with available electron-scattering data at |𝐪|≈326 MeV/c. Additionally, we provide several predictions for the weak response functions in the quasielastic peak region at |𝐪| =300 and 400 MeV/c, which are critical for long-baseline neutrino experiments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Cataloging the visible universe through Bayesian inference in Julia at petascale

A key task in astronomy is to locate astronomical objects in images and to characterize them according to physical parameters such as brightness, color, and morphology. This task, known as cataloging, is challenging for several reasons: many astronomical objects are much dimmer than the sky background, labeled data is generally unavailable, overlapping astronomical objects must be resolved collectively, and the datasets are enormous – terabytes now, petabytes soon. In this work, we infer an astronomical catalog from 55 TB of imaging data using Celeste, a Bayesian variational inference code written entirely in the high-productivity programming language Julia. Using over 1.3 million threads on 650,000 Intel Xeon Phi cores of the Cori Phase II supercomputer, Celeste achieves a peak rate of 1.54 DP PFLOP/s. Celeste is able to jointly optimize parameters for 188 M stars and galaxies, loading and processing 178 TB across 8192 nodes in 14.6 min. To achieve this, Celeste exploits parallelism at multiple levels (cluster, node, and thread) and accelerates I/O through Cori’s burst buffer. Julia’s native performance enables Celeste to employ high-level constructs without resorting to hand-written or generated low-level code (C/C++/Fortran) while still achieving petascale performance.

Regier, Jeffrey↗

STRUCTURE IN THE THREE-DIMENSIONAL GALAXY DISTRIBUTION. I. METHODS AND EXAMPLE RESULTS

Three methods for detecting and characterizing structure in point data, such as that generated by redshift surveys, are described: classification using self-organizing maps, segmentation using Bayesian blocks, and density estimation using adaptive kernels. The first two methods are new, and allow detection and characterization of structures of arbitrary shape and at a wide range of spatial scales. These methods should elucidate not only clusters, but also the more distributed, wide-ranging filaments and sheets, and further allow the possibility of detecting and characterizing an even broader class of shapes. The methods are demonstrated and compared in application to three data sets: a carefully selected volume-limited sample from the Sloan Digital Sky Survey redshift data, a similarly selected sample from the Millennium Simulation, and a set of points independently drawn from a uniform probability distribution-a so-called Poisson distribution. We demonstrate a few of the many ways in which these methods elucidate large-scale structure in the distribution of galaxies in the nearby universe.

79 ASTRONOMY AND ASTROPHYSICS↗