Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed clustering methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

THE PANCHROMATIC HUBBLE ANDROMEDA TREASURY. IV. A PROBABILISTIC APPROACH TO INFERRING THE HIGH-MASS STELLAR INITIAL MASS FUNCTION AND OTHER POWER-LAW FUNCTIONS

We present a probabilistic approach for inferring the parameters of the present-day power-law stellar mass function (MF) of a resolved young star cluster. This technique (1) fully exploits the information content of a given data set; (2) can account for observational uncertainties in a straightforward way; (3) assigns meaningful uncertainties to the inferred parameters; (4) avoids the pitfalls associated with binning data; and (5) can be applied to virtually any resolved young cluster, laying the groundwork for a systematic study of the high-mass stellar MF (M {approx}> 1 M {sub Sun }). Using simulated clusters and Markov Chain Monte Carlo sampling of the probability distribution functions, we show that estimates of the MF slope, {alpha}, are unbiased and that the uncertainty, {Delta}{alpha}, depends primarily on the number of observed stars and on the range of stellar masses they span, assuming that the uncertainties on individual masses and the completeness are both well characterized. Using idealized mock data, we compute the theoretical precision, i.e., lower limits, on {alpha}, and provide an analytic approximation for {Delta}{alpha} as a function of the observed number of stars and mass range. Comparison with literature studies shows that {approx}3/4 of quoted uncertainties are smaller than the theoretical lower limit. By correcting these uncertainties to the theoretical lower limits, we find that the literature studies yield ({alpha}) = 2.46, with a 1{sigma} dispersion of 0.35 dex. We verify that it is impossible for a power-law MF to obtain meaningful constraints on the upper mass limit of the initial mass function, beyond the lower bound of the most massive star actually observed. We show that avoiding substantial biases in the MF slope requires (1) including the MF as a prior when deriving individual stellar mass estimates, (2) modeling the uncertainties in the individual stellar masses, and (3) fully characterizing and then explicitly modeling the completeness for stars of a given mass. The precision on MF slope recovery in this paper are lower limits, as we do not explicitly consider all possible sources of uncertainty, including dynamical effects (e.g., mass segregation), unresolved binaries, and non-coeval populations. We briefly discuss how each of these effects can be incorporated into extensions of the present framework. Finally, we emphasize that the technique and lessons learned are applicable to more general problems involving power-law fitting.

79 ASTRONOMY AND ASTROPHYSICS↗

Mapping causal patterns in crystalline solids

The evolution of the atomic structures of the combinatorial library of Sm-substituted thin film BiFeO 3 along the phase transition boundary from the ferroelectric rhombohedral phase to the non-ferroelectric orthorhombic phase is explored using scanning transmission electron microscopy. Localized properties, including polarization, lattice parameter, and chemical composition, are parameterized from atomic-scale imaging, and their causal relationships are reconstructed using a linear non-Gaussian acyclic model. This approach is further extended to explore the spatial variability of the causal coupling using the sliding window transform method, which revealed that new causal relationships emerged at both the expected locations, such as domain walls and interfaces, and at additional regions forming clusters in the vicinity of the walls or spatially distributed features. While the exact physical origins of these relationships are unclear, they likely represent nanophase-separated regions in the morphotropic phase boundaries. Overall, we posit that an in-depth understanding of complex disordered materials away from thermodynamic equilibrium necessitates understanding not only the generative processes that can lead to observed microscopic states but also the causal links between multiple interacting subsystems.

Causal inference↗

Testing the Archivas Cluster (Arc) for Ozone Monitoring Instrument (OMI) Scientific Data Storage

The Ozone Monitoring Instrument (OMI) launched on NASA's Aura Spacecraft, the third of the major platforms of the EOS program on July 15,2004. In addition to the long term archive and distribution of the data from OM1 through the Goddard Earth Science Distributed Active Archive Center (GESDAAC), we are evaluating other archive mechanisms that can archive the data in a more immediately available method where it can be used for futher data production and analysis. In 2004, Archivas, Inc. was selected by NASA s Small Business Innovative Research (SBIR) program for the development of their Archivas Cluster (ArC) product. Arc is an online disk based system utilizing self-management and automation on a Linux cluster. Its goal is to produce a low cost solution coupled with the ease of management. The OM1 project is an application partner of the SBIR program, and has deployed a small cluster (5TB) based on the beta Archwas software. We performed extensive testing of the unit using production OM1 data since launch. In 2005, Archivas, Inc. was funded in SBIR Phase II for further development, which will include testing scalability with the deployment of a larger (35TB) cluster at Goddard. We plan to include Arc in the OM1 Team Leader Computing Facility (TLCF) hosting OM1 data for direct access and analysis by the OMI Science Team. This presentation will include a brief technical description of the Archivas Cluster, a summary of the SBIR Phase I beta testing results, and an overview of the OMI ground data processing architecture including its interaction with the Phase II Archivas Cluster and hosting of OMI data for the scientists.

Tilmes, Curt↗

PSF and MTF Measurement Methods for Thick CCD Sensor Characterization

Knowledge of the point spread function (PSF) of the sensors to be used in the Large Synoptic Survey Telescope (LSST) camera is essential for optimal extraction of subtle galaxy shape distortions caused by gravitational weak lensing. We have developed a number of techniques for measuring the PSF of candidate CCD sensors to be used in the LSST camera, each with its own strengths and weaknesses. The two main optical PSF measurement techniques that we use are the direct Virtual Knife Edge (VKE) scan as developed by Karcher, et al. and the indirect interference fringe method after Andersen and Sorensen that measures the modulation transfer function (MTF) directly. The PSF is derived from the MTF by Fourier transform. Other non-optical PSF measurement techniques that we employ include {sup 55}Fe x-ray cluster image size measurements and statistical distribution analysis, and cosmic ray muon track size measurements, but are not addressed here. The VKE technique utilizes a diffraction-limited spot produced by a Point-Projection Microscope (PPM) that is scanned across the sensor with sub-pixel resolution. This technique closely simulates the actual operating condition of the sensor in the telescope with the source spot size having an f/number close to the actual telescope design value. The interference fringe method uses a simple equal-optical-path Michelson-type interferometer with a single-mode fiber source that produces interference fringes with 100% contrast over a wide spatial frequency range sufficient to measure the MTF of the sensor directly. The merits of each measurement technique and results from the various measurement techniques on prototype LSST sensors are presented and compared.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A comparative analysis of clustering algorithms: O{sub 2} migration in truncated hemoglobin I from transition networks

The ligand migration network for O{sub 2}–diffusion in truncated Hemoglobin N is analyzed based on three different clustering schemes. For coordinate-based clustering, the conventional k–means and the kinetics-based Markov Clustering (MCL) methods are employed, whereas the locally scaled diffusion map (LSDMap) method is a collective-variable-based approach. It is found that all three methods agree well in their geometrical definition of the most important docking site, and all experimentally known docking sites are recovered by all three methods. Also, for most of the states, their population coincides quite favourably, whereas the kinetics of and between the states differs. One of the major differences between k–means and MCL clustering on the one hand and LSDMap on the other is that the latter finds one large primary cluster containing the Xe1a, IS1, and ENT states. This is related to the fact that the motion within the state occurs on similar time scales, whereas structurally the state is found to be quite diverse. In agreement with previous explicit atomistic simulations, the Xe3 pocket is found to be a highly dynamical site which points to its potential role as a hub in the network. This is also highlighted in the fact that LSDMap cannot identify this state. First passage time distributions from MCL clusterings using a one- (ligand-position) and two-dimensional (ligand-position and protein-structure) descriptor suggest that ligand- and protein-motions are coupled. The benefits and drawbacks of the three methods are discussed in a comparative fashion and highlight that depending on the questions at hand the best-performing method for a particular data set may differ.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Combining Galaxy-Galaxy Lensing and Galaxy Clustering

Combining galaxy-galaxy lensing and galaxy clustering is a promising method for inferring the growth rate of large scale structure, a quantity that will shed light on the mechanism driving the acceleration of the Universe. The Dark Energy Survey (DES) is a prime candidate for such an analysis, with its measurements of both the distribution of galaxies on the sky and the tangential shears of background galaxies induced by these foreground lenses. By constructing an end-to-end analysis that combines large-scale galaxy clustering and small-scale galaxy-galaxy lensing, we also forecast the potential of a combined probes analysis on DES datasets. In particular, we develop a practical approach to a DES combined probes analysis by jointly modeling the assumptions and systematics affecting the different components of the data vector, employing a shared halo model, HOD parametrization, photometric redshift errors, and shear measurement errors. Furthermore, we study the effect of external priors on different subsets of these parameters. We conclude that DES data will provide powerful constraints on the evolution of structure growth in the universe, conservatively/ optimistically constraining the growth function to 8%/4.9% with its first-year data covering 1000 square degrees, and to 4%/2.3% with its full five-year data covering 5000 square degrees.

Park, Youngsoo↗

Dark Energy Survey Year 3 results: redshift calibration of the weak lensing source galaxies

ABSTRACT Determining the distribution of redshifts of galaxies observed by wide-field photometric experiments like the Dark Energy Survey (DES) is an essential component to mapping the matter density field with gravitational lensing. In this work we describe the methods used to assign individual weak lensing source galaxies from the DES Year 3 Weak Lensing Source Catalogue to four tomographic bins and to estimate the redshift distributions in these bins. As the first application of these methods to data, we validate that the assumptions made apply to the DES Y3 weak lensing source galaxies and develop a full treatment of systematic uncertainties. Our method consists of combining information from three independent likelihood functions: self-organizing map p(z) (sompz), a method for constraining redshifts from galaxy photometry; clustering redshifts (WZ), constraints on redshifts from cross-correlations of galaxy density functions; and shear ratios (SRs), which provide constraints on redshifts from the ratios of the galaxy-shear correlation functions at small scales. Finally, we describe how these independent probes are combined to yield an ensemble of redshift distributions encapsulating our full uncertainty. We calibrate redshifts with combined effective uncertainties of σ〈z〉 ∼ 0.01 on the mean redshift in each tomographic bin.

79 ASTRONOMY AND ASTROPHYSICS↗

Tomographic analysis of tangential viewing cameras (invited)

Many tokamaks now use visible light cameras to observe plasma-wall interactions and integrated line emission. The DIII-D coherence imaging spectroscopy diagnostic cameras image interferograms that encode line integrated velocity. By modeling the 2D camera image pixels as line of sight integrals through an axisymmetric discrete grid, it is possible to do tomographic analysis to determine the local plasma line emissivity and parallel velocity. Approaches to solve the inverse problem posed by these tangential viewing cameras are presented. The inversion begins with calculation of the sparse response matrix that encompasses all the geometry and diagnostic information and reduces the process of image formation to a sparse matrix-vector multiply. Our report includes techniques for determining the detailed geometry of the camera views and methods for handling physical quantities that vary spatially. Additionally, the size of the response matrix has driven the development of capability to distribute the coarse parallel calculation across a heterogeneous cluster of computers on the Energy Sciences Network. Iterative techniques are then used to solve the sparse matrix-vector linear system

47 OTHER INSTRUMENTATION↗

The Universal Einstein Radius Distribution from 10,000 SDSS Clusters

We present results from strong-lens modelling of 10,000 SDSS clusters, to establish the universal distribution of Einstein radii. Detailed lensing analyses have shown that the inner mass distribution of clusters can be accurately modelled by assuming light traces mass, successfully uncovering large numbers of multiple-images. Approximate critical curves and the effective Einstein radius of each cluster can therefore be readily calculated, from the distribution of member galaxies and scaled by their luminosities. We use a subsample of 10 well-studied clusters covered by both SDSS and HST to calibrate and test this method, and show that an accurate determination of the Einstein radius and mass can be achieved by this approach "blindly", in an automated way, and without requiring multiple images as input. We present the results of the first 10,000 clusters analysed in the range $0.1 =0.73^{+0.02}_{-0.03}$, $\sigma=0.316^{+0.004}_{-0.002}$, and with higher abundance of large $\theta_{e}$ clusters than predicted by $\Lambda$CDM. We visually inspect each of the clusters with $\theta_{e}>40 \arcsec$ ($z_{s}=2$) and find that $\sim20%$ are boosted by various projection effects detailed here, remaining with $\sim40$ real giant-lens candidates, with a maximum of $\theta_{e}=69\pm12 \arcsec$ ($z_{s}=2$) for the most massive candidate, in agreement with semi-analytic calculations. The results of this work should be verified further when an extended calibration sample is available.

79 ASTRONOMY AND ASTROPHYSICS↗

The CLASSY clustering algorithm: Description, evaluation, and comparison with the iterative self-organizing clustering system (ISOCLS)

A clustering method, CLASSY, was developed, which alternates maximum likelihood iteration with a procedure for splitting, combining, and eliminating the resulting statistics. The method maximizes the fit of a mixture of normal distributions to the observed first through fourth central moments of the data and produces an estimate of the proportions, means, and covariances in this mixture. The mathematical model which is the basic for CLASSY and the actual operation of the algorithm is described. Data comparing the performances of CLASSY and ISOCLS on simulated and actual LACIE data are presented.

Lennington, R. K.↗

Detecting low-mass perturbers in cluster lenses using curved arc bases

ABSTRACT Strong gravitationally lensed arcs produced by galaxy clusters have been observationally detected for several decades now. These strong lensing constraints provided high-fidelity mass models for cluster lenses that include substructure down to $10^{9{-}10}\, \mathrm{M}_\odot$. Optimizing lens models, where the cluster mass distribution is modelled by a smooth component and subhaloes associated with the locations of individual cluster galaxies, has enabled deriving the subhalo mass function, providing important constraints on the nature and granularity of dark matter. In this work, we explore and present a novel method to detect and measure individual perturbers (subhaloes, line-of-sight haloes, and wandering supermassive black holes) by exploiting their proximity to highly distorted lensed arcs in galaxy clusters, and by modelling the local lensing distortions with curved arc bases. This method offers the possibility of detecting individual low-mass perturber subhaloes in clusters and haloes along the line of sight down to a mass resolution of $10^8\, \mathrm{M}_\odot$. We quantify our sensitivity to low-mass perturbers ($M\sim 10^{7{-}9}\, \mathrm{M}_\odot$) in clusters (M ∼ 1014–15 M⊙), by creating realistic mock data. Using three lensed images of a background galaxy in the cluster SMACS J0723, taken by JWST, we study the retrieval of the properties of potential perturbers with masses $M=10^{7{-}9}\, \mathrm{M}_\odot$. From the derived posterior probability distributions for the perturber, we constrain its concentration, redshift, and ellipticity. By allowing us to probe lower mass substructures, the use of curved arc bases can lead to powerful constraints on the nature of dark matter as discrimination between dark matter models appears on smaller scales.

Astronomy & Astrophysics↗

Multiresolution edge detection using enhanced fuzzy c-means clustering for ultrasound image speckle reduction

Purpose: Speckle suppression in ultrasound (US) images of various anatomic structures via a novel speckle noise reduction algorithm. Methods: The proposed algorithm employs an enhanced fuzzy c-means (EFCM) clustering and multiresolution wavelet analysis to distinguish edges from speckle noise in US images. The edge detection procedure involves a coarse-to-fine strategy with spatial and interscale constraints so as to classify wavelet local maxima distribution at different frequency bands. As an outcome, an edge map across scales is derived whereas the wavelet coefficients that correspond to speckle are suppressed in the inverse wavelet transform acquiring the denoised US image. Results: A total of 34 thyroid, liver, and breast US examinations were performed on a Logiq 9 US system. Each of these images was subjected to the proposed EFCM algorithm and, for comparison, to commercial speckle reduction imaging (SRI) software and another well-known denoising approach, Pizurica's method. The quantification of the speckle suppression performance in the selected set of US images was carried out via Speckle Suppression Index (SSI) with results of 0.61, 0.71, and 0.73 for EFCM, SRI, and Pizurica's methods, respectively. Peak signal-to-noise ratios of 35.12, 33.95, and 29.78 and edge preservation indices of 0.94, 0.93, and 0.86 were found for the EFCM, SIR, and Pizurica's method, respectively, demonstrating that the proposed method achieves superior speckle reduction performance and edge preservation properties. Based on two independent radiologists’ qualitative evaluation the proposed method significantly improved image characteristics over standard baseline B mode images, and those processed with the Pizurica's method. Furthermore, it yielded results similar to those for SRI for breast and thyroid images significantly better results than SRI for liver imaging, thus improving diagnostic accuracy in both superficial and in-depth structures. Conclusions: A new wavelet-based EFCM clustering model was introduced toward noise reduction and detail preservation. The proposed method improves the overall US image quality, which in turn could affect the decision-making on whether additional imaging and/or intervention is needed.

60 APPLIED LIFE SCIENCES↗

Detection of extended galactic sources with an underwater neutrino telescope

In this study we investigate the discovery capability of a Very Large Volume Neutrino Telescope to Galactic extended sources. We focus on the brightest HESS gamma rays sources which are considered also as very high energy neutrino emitters. We use the unbinned method taking into account both the spatial and the energy distribution of high energy neutrinos and we investigate parts of the Galactic plane where nearby potential neutrino emitters form neutrino source clusters. Neutrino source clusters as well as isolated neutrino sources are combined to estimate the observation period for 5 sigma discovery of neutrino signals from these objects.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Neutron Time Interval Distributions with Background Neutrons

A single cosmic ray air shower event can produce multiple neutrons. The arrival times of neutron counts from such an event creates a clustering pattern distinctly different from random sources. A theory for the time interval distribution between neutron counts from both a correlated source and cosmic ray air showers is given and a method is developed to compute the probability distributions for a cosmic ray air shower to create detected neutrons.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Aerosol Models for the CALIPSO Lidar Inversion Algorithms

We use measurements and models to develop aerosol models for use in the inversion algorithms for the Cloud Aerosol Lidar and Imager Pathfinder Spaceborne Observations (CALIPSO). Radiance measurements and inversions of the AErosol RObotic NETwork (AERONET1, 2) are used to group global atmospheric aerosols using optical and microphysical parameters. This study uses more than 105 records of radiance measurements, aerosol size distributions, and complex refractive indices to generate the optical properties of the aerosol at more 200 sites worldwide. These properties together with the radiance measurements are then classified using classical clustering methods to group the sites according to the type of aerosol with the greatest frequency of occurrence at each site. Six significant clusters are identified: desert dust, biomass burning, urban industrial pollution, rural background, marine, and dirty pollution. Three of these are used in the CALIPSO aerosol models to characterize desert dust, biomass burning, and polluted continental aerosols. The CALIPSO aerosol model also uses the coarse mode of desert dust and the fine mode of biomass burning to build a polluted dust model. For marine aerosol, the CALIPSO aerosol model uses measurements from the SEAS experiment 3. In addition to categorizing the aerosol types, the cluster analysis provides all the column optical and microphysical properties for each cluster.

Omar, Ali H.↗

Determination of the Cosmic Distance Scale from Sunyaev-Zel'dovich Effect and Chandra X-ray Measurements of High Redshift Galaxy Clusters

We determine the distance to 38 clusters of galaxies in the redshift range 0.14 less than or equal to z less than or equal to 0.89 using X-ray data from Chandra and Sunyaev-Zeldovich Effect data from the Owens Valley Radio Observatory and the Berkeley-Illinois-Maryland Association interferometric arrays. The cluster plasma and dark matter distributions are analyzed using a hydrostatic equilibrium model that accounts for radial variations in density, temperature and abundance, and, the statistical and systematic errors of this method are quantified. The analysis is performed via a Markov chain Monte Carlo technique that provides simultaneous estimation of all model parameters. W

Bonamente, Massimiliano↗

QAARM: Quasi-anharmonic auto-regressive model reveals molecular recognition pathways in ubiquitin

Molecular dynamics (MD) simulations have dramatically improved the atomistic understanding of protein motions, energetics and function. These growing datasets have necessitated a corresponding emphasis on trajectory analysis methods for characterizing simulation data, particularly since functional protein motions and transitions are often rare and/or intricate events. Observing that such events give rise to long-tailed spatial distributions, we recently developed a higher-order statistics based dimensionality reduction method, called quasi-anharmonic analysis (QAA), for identifying biophysically-relevant reaction coordinates and substates within MD simulations. Further characterization of conformation space should consider the temporal dynamics specific to each identified substate. Our model uses hierarchical clustering to learn energetically coherent substates and dynamic modes of motion from a 0.5 {mu}s ubiqutin simulation. Autoregressive (AR) modeling within and between states enables a compact and generative description of the conformational landscape as it relates to functional transitions between binding poses. Lacking a predictive component, QAA is extended here within a general AR model appreciative of the trajectory's temporal dependencies and the specific, local dynamics accessible to a protein within identified energy wells. These metastable states and their transition rates are extracted within a QAA-derived subspace using hierarchical Markov clustering to provide parameter sets for the second-order AR model. We show the learned model can be extrapolated to synthesize trajectories of arbitrary length.

59 BASIC BIOLOGICAL SCIENCES↗

Structure and dynamics in liquid bismuth and Bi{sub n} clusters: A density functional study

Density functional/molecular dynamics simulations with more than 500 atoms have been performed on liquid bismuth at 573, 773, 923, and 1023 K and on neutral Bi clusters with up to 14 atoms. There are similar structural patterns (coordination numbers, bond angles, and ring patterns) in the liquid and the clusters, with significant differences from the rhombohedral crystalline form. We study the details of the structure (structure factor, pair, and cavity distribution functions) and dynamical properties (vibration frequencies, diffusion constants, power spectra), and compare with experimental results where available. While the three short covalent bonds typical to pnictogens are characteristic in both liquid and clusters, the number of large voids and the total cavity volume is much larger in the liquid at 1023 K, with larger local concentration variations. The inclusion of spin-orbit coupling results in a lowering of the cohesive energies in Bi{sub n} clusters of 0.3–0.5 eV/atom.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗