Search NASA⌕ Search

SEARCH · Search NASA

Results for “cluster number”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Hiperclust

This software leverages transfer learning to analyze atom probe tomography (APT) data. It is trained on synthetic data and then applies this knowledge to predict the optimal number of clusters for a given APT dataset. Initially, the software used preliminary clustering to estimate the general structure of the data. Based on this, it provides suggestions for key parameters like minimum cluster size and minimum number of points. These parameters are critical for algorithms like HDBSCAN, ensuring accurate cluster formation without the need for trial-and-error testing. The software runs on High-Performance computing (HPC) systems, enabling fast, scalable analysis of large APT datasets, ultimately saving time and improving the reliability of clustering outcomes.

Tang, Yalei [Idaho National Laboratory (INL), Idah↗
DOE OSTI2020

Constraining radio mode feedback in galaxy clusters with the cluster radio AGNs properties to z ∼ 1

ABSTRACT We study the properties of the Sydney University Molonglo Sky Survey (SUMSS) 843 MHz radio active galactic nuclei (AGNs) population in galaxy clusters from two large catalogues created using the Dark Energy Survey (DES): ∼11 800 optically selected RM-Y3 and ∼1000 X-ray selected MARD-Y3 clusters. We show that cluster radio loud AGNs are highly concentrated around cluster centres to $z$ ∼ 1. We measure the halo occupation number for cluster radio AGNs above a threshold luminosity, finding that the number of radio AGNs per cluster increases with cluster halo mass as N ∝ M1.2 ± 0.1 (N ∝ M0.68 ± 0.34) for the RM-Y3 (MARD-Y3) sample. Together, these results indicate that radio mode feedback is favoured in more massive galaxy clusters. Using optical counterparts for these sources, we demonstrate weak redshift evolution in the host broad-band colours and the radio luminosity at fixed host galaxy stellar mass. We use the redshift evolution in radio luminosity to break the degeneracy between density and luminosity evolution scenarios in the redshift trend of the radio AGNs luminosity function (LF). The LF exhibits a redshift trend of the form (1 + $z$)γ in density and luminosity, respectively, of γD = 3.0 ± 0.4 and γP = 0.21 ± 0.15 in the RM-Y3 sample, and γD = 2.6 ± 0.7 and γP = 0.31 ± 0.15 in MARD-Y3. We discuss the physical drivers of radio mode feedback in cluster AGNs, and we use the cluster radio galaxy LF to estimate the average radio-mode feedback energy as a function of cluster mass and redshift and compare it to the core (<0.1R500) X-ray radiative losses for clusters at $z$ < 1.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Bi-cross validation of spectral clustering hyperparameters

One challenge impeding the analysis of terabyte scale X-ray scattering data from the Linac Coherent Light Source (LCLS) is determining the number of clusters required for the execution of traditional clustering algorithms. Here, we demonstrate that the previous work using bi-cross validation to determine the number of singular vectors directly maps to the spectral clustering problem of estimating both the number of clusters and hyperparameter values. Here by applying this method to LCLS X-ray scattering data enables the identification of dropped shots without manually setting boundaries on detector fluence and provides a path toward identifying rare and anomalous events.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

G-Mapper: Learning a Cover in the Mapper Construction

The Mapper algorithm is a visualization technique in topological data analysis (TDA) that outputs a graph reflecting the structure of a given dataset. However, the Mapper algorithm requires tuning several parameters in order to generate a “nice” Mapper graph. This paper focuses on selecting the cover parameter. We present an algorithm that optimizes the cover of a Mapper graph by splitting a cover repeatedly according to a statistical test for normality. Our algorithm is based on G-means clustering, which searches for the optimal number of clusters in 𝑘-means by iteratively applying the Anderson–Darling test. Our splitting procedure employs a Gaussian mixture model to carefully choose the cover according to the distribution of the given data. In conclusion, experiments for synthetic and real-world datasets demonstrate that our algorithm generates covers so that the Mapper graphs retain the essence of the datasets, while also running significantly faster than a previous iterative method.

G-means clustering↗
DOE OSTI2024

The cluster decomposition of the configurational energy of multicomponent alloys

Abstract The cluster expansion method (CEM) is a widely used lattice-based technique in the study of multicomponent alloys. Despite its prevalent use, a clear understanding of expansion terms is lacking. We present a modern mathematical formalism of the CEM and introduce thecluster decomposition—a unique and basis-independent decomposition for functions of the atomic configuration in a crystal. We identify the cluster decomposition as an invariant ANOVA decomposition; and demonstrate how functional analysis of variance and sensitivity analysis can be used to interpret interactions among species. Furthermore, we show how the mathematical structure of the cluster decomposition enables numerical evaluation that scales with the number of clusters and is independent of the number of species. Overall, our work enables rigorous interpretations of interactions among species, provides opportunities to explore parameter estimation beyond linear regression, introduces a numerical efficient implementation, and enables analysis of cluster expansions based on established mathematical and statistical principles.

Chemistry↗
DOE OSTI2022

Manifold Learning-Based Polynomial Chaos Expansions for High-Dimensional Surrogate Models

In this work we introduce a manifold learning-based method for uncertainty quantification (UQ) in systems describing complex spatiotemporal processes. Our first objective is to identify the embedding of a set of high-dimensional data representing quantities of interest of the computational or analytical model. For this purpose, we employ Grassmannian diffusion maps, a two-step nonlinear dimension reduction technique which allows us to reduce the dimensionality of the data and identify meaningful geometric descriptions in a parsimonious and inexpensive manner. Polynomial chaos expansion is then used to construct a mapping between the stochastic input parameters and the diffusion coordinates of the reduced space. An adaptive clustering technique is proposed to identify an optimal number of clusters of points in the latent space. The similarity of points allows us to construct a number of geometric harmonic emulators which are finally utilized as a set of inexpensive pretrained models to perform an inverse map of realizations of latent features to the ambient space and thus perform accurate out-of-sample predictions. Thus, the proposed method acts as an encoder-decoder system which is able to automatically handle very high-dimensional data while simultaneously operating successfully in the small-data regime. The method is demonstrated on two benchmark problems and on a system of advection-diffusion-reaction equations which model a first-order chemical reaction between two species. In all test cases, the proposed method is able to achieve highly accurate approximations which ultimately lead to the significant acceleration of UQ tasks.

42 ENGINEERING↗
DOE OSTI2025

Optical galaxy cluster mock catalogs with realistic projection effects: Validations with the SDSS clusters

Galaxy clusters identified in optical imaging surveys suffer from projection effects: Physically unassociated galaxies along a cluster’s line of sight can be counted as its members and boost the observed richness (the number of cluster members). To model the impact of projection on cluster cosmology analyses, we apply a halo occupation distribution model to 𝑁-body simulations to simulate the red galaxies contributing to cluster members, and we use the number of galaxies in a cylinder along the line of sight (counts in cylinders) to model the impact of projection on cluster richness. We compare three projection models: uniform, quadratic, and Gaussian, and we convert between them by matching their effective cylinder volumes. We validate our mock catalogs using SDSS redMaPPer clusters’ data vectors, including counts vs richness, stacked lensing signal, spectroscopic redshift distribution of member galaxies, and richness remeasured on a redshift grid. We find the former two are insensitive to the projection model, while the latter two favor a quadratic projection model with a width of ≈180 ℎ −1 Mpc (equivalent to the volume of a uniform model with a width of 100 ℎ −1 Mpc and a Gaussian model with a width of 110 ℎ −1 Mpc, or a Gaussian redshift error of 0.04). Furthermore, our framework provides an efficient and flexible way to model optical cluster data vectors, paving the way for a simulation-based joint analysis for clusters, galaxies, and shear.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

Accelerating the Global Arrays ComEx Runtime using Multiple Progress Ranks

Partitioned Global Address Space (PGAS) models are part of system software that are being designed to support communication runtime for exascale applications. Suitability of using MPI as a scalable PGAS communication subsystem has been shown as a viable option due to its standardization and higher performance. We used MPI two-sided semantics with a combination of automatic and user defined splitting of MPI communicators to achieve asynchronous progress. Our implementation can make use of multiple asynchronous progress ranks (PR) per node that can be mapped to the computing architecture of a node in a distributed cluster. We are able to show significant speed up of over 2.0X and scaling of communication bound computational chemistry application over 1024 nodes of state- of-the-art HPC clusters. Our results show that while running a communication bound application workload on a certain number of cluster nodes, a use of optimum number of ranks dedicated for communication may be used to achieve asynchronous communication progress and obtain highest performance.

PGAS, global-arrays, NWCHEM, NWChemEx, HPC, GPGPU↗
DOE OSTI2021

Revisiting Newly Large Magellanic Cloud Age-gap Star Clusters

Recently, a noticeable number of new star clusters was identified in the outskirts of the Large Magellanic Cloud (LMC) populating the so-called star-cluster age gap, a space of time (∼4–12 Gyr) where the only known star cluster is up-to-date ESO 121-SC 03. We used Survey of the Magellanic Stellar History DR2 data sets, as well as those employed to identify these star-cluster candidates, to produce relatively deep color–magnitude diagrams (CMDs) of 17 out of 20 discovered age-gap star clusters with the aim of investigating them in detail. Our analysis relies on a thorough CMD cleaning procedure of the field-star contamination, which presents variations in its stellar density and astrophysical properties, such as luminosity and effective temperature, around the star-cluster fields. We built star-cluster CMDs from stars with membership probabilities assigned from the cleaning procedure. These CMDs and their respective spatial distribution maps favor the existence of LMC star field density fluctuations rather than age-gap star clusters, although a definitive assessment on them will be possible from further deeper photometry.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Poisson hurdle model-based method for clustering microbiome features

Abstract Motivation High-throughput sequencing technologies have greatly facilitated microbiome research and have generated a large volume of microbiome data with the potential to answer key questions regarding microbiome assembly, structure and function. Cluster analysis aims to group features that behave similarly across treatments, and such grouping helps to highlight the functional relationships among features and may provide biological insights into microbiome networks. However, clustering microbiome data are challenging due to the sparsity and high dimensionality. Results We propose a model-based clustering method based on Poisson hurdle models for sparse microbiome count data. We describe an expectation–maximization algorithm and a modified version using simulated annealing to conduct the cluster analysis. Moreover, we provide algorithms for initialization and choosing the number of clusters. Simulation results demonstrate that our proposed methods provide better clustering results than alternative methods under a variety of settings. We also apply the proposed method to a sorghum rhizosphere microbiome dataset that results in interesting biological findings. Availability and implementation R package is freely available for download at https://cran.r-project.org/package=PHclust. Supplementary information Supplementary data are available at Bioinformatics online.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Galaxy Clustering with LSST: Effects of Number Count Bias from Blending

The Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) will survey the southern sky to create the largest galaxy catalog to date, and its statistical power demands an improved understanding of systematic effects such as source overlaps, also known as blending. In this work we study how blending introduces a bias in the number counts of galaxies (instead of the flux and colors), and how it propagates into galaxy clustering statistics. We use the 300 deg 2 DC2 image simulation and its resulting galaxy catalog (LSST Dark Energy Science Collaboration et al. 2021) to carry out this study. We find that, for a LSST Year 1 (Y1)-like cosmological analyses, the number count bias due to blending leads to small but statistically significant differences in mean redshift measurements when comparing an observed sample to an unblended calibration sample. In the two-point correlation function, blending causes differences greater than 3σ on scales below approximately 10', but large scales are unaffected. We fit Ω m and linear galaxy bias in a Bayesian cosmological analysis and find that the recovered parameters from this limited area sample, with the LSST Y1 scale cuts, are largely unaffected by blending. Our main results hold when considering photometric redshift and a LSST Year 5 (Y5)-like sample.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

A Vertex-Aligned Model for Packing 4-Hexagonal Clusters in a Regular Hexagonal Container

This paper deals with a problem the packing polyhex clusters in a regular hexagonal container. It is a common problem in many applications with various cluster shapes used, but symmetric polyhex is the most useful in engineering due to its geometrical properties. Hence, we concentrate on mathematical modeling in such an application, where using the “bee” tetrahex is chosen for the new Compact Muon Solenoid (CMS) design upgrade, which is one of four detectors used in Large Hadron Collider (LHC) experiment at European Laboratory for Particle Physics (CERN). We start from the existing hexagonal containers with hexagonal cells packed inside, and uniform clustering applied. We compare the center-aligned (CA) and vertex-aligned (VA) models, analyzing cluster rotations providing the increased packing efficiency. We formally describe the geometrical properties of clustering approaches and show that cluster sharing is inevitable at the container border with uniform clustering. In addition, we propose a new vertex-aligned model decreasing the number of shared clusters in the uniform scenario, but with a smaller number of clusters contained inside the container. Also, we describe a non-uniform tetrahex cluster packing scheme in the proposed container model. With the proposed cluster packing solution, it is accomplished that all clusters are contained inside the container region. Since cluster-sharing is completely avoided at the container border, the maximal packing efficiency is obtained compared to the existing models.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Galaxy Clusters Selected via the Sunyaev-Zel'dovich Effect in 5 year data from the SPT-3G Main Survey

We report a new galaxy cluster catalog, selected using the thermal Sunyaev-Zel'dovich (SZ) effect, from 5 years of observations of the SPT-3G Main field. Drawn from arcminute-resolution data with white noise levels of 3.2, 2.5, and 8.9 $μ$K-arcmin at 95, 150, and 220 GHz, respectively, the sample consists of 8,892 cluster candidates detected above significance $ξ=4$, with an expected purity of $>82\%$ (4,480 at $ξ\ge5$ with purity $>99\%$). Using optical and infrared data we have confirmed 7,190 candidates as clusters. The sample spans a mass range $7.9 \times 10^{13}M_\odot/h_{70}< M_\textrm{500c} < 1.6 \times 10^{15}M_\odot/h_{70}$ with a median mass of $1.65 \times 10^{14}M_\odot/h_{70}$, and a redshift range of $0.0371$ and 271 at $z>1.5$. Compared to previous SZ cluster samples from South Pole Telescope and Atacama Cosmology Telescope data, the SPT-3G sample is highly consistent in mass and redshift but is significantly deeper, with per-cluster detection signal-to-noise 2-4 times higher and a cluster density of 4.5 confirmed clusters/deg$^2$. We cross match with eRASS1 cluster and point source catalogs, finding 1,279 and 1,319 matches, respectively. The SPT and eROSITA cluster mass estimates are in relatively good agreement. We perform a series of validation checks using both internal data splits and comparisons to external samples. These tests show increasing correlated (dusty) emission with redshift, with a $\sim17\times$ larger 220 GHz temperature increment for clusters at $z\sim1.5$ than $z\sim0.25$, but only weak evidence for correlated synchrotron emission. Finally, a number of clusters are flagged as candidate strong gravitational lenses.

Bleem, L. E. [Argonne (main); Chicago U., KICP; Ch↗
DOE OSTI2020

Development and Clustering of Rate-Oriented Load Metrics for Customer Price-Plan Analysis

One of the few methods electric utilities can use to motivate and change customer energy consumption is through retail rate structures. Utilities are increasingly moving toward more dynamic rate plans to encourage energy conservation, utilization of onsite renewable generation, peak demand reduction and flattening of demand profiles. This paper creates a set of rate-oriented load metrics that are the determinants of customers' bills under four unique rate plans. These metrics are not only indicative of which rate structure can provide customer bill reductions based on their load profile characteristics, but also convey useful information about load consumption behavior. With these metrics, utilities can analyze their customers and identify classes that are rewarded under each rate plan. This can help inform utilities whether the customers rewarded under each rate plans are meeting their original objectives. To develop these customer classes, we calculate these rate-oriented load metrics for each customer and perform k-means clustering. The analysis is conducted on a set of 300 customer profiles, examining four different rate plans, different numbers of clusters, customer bills and cluster load profile characteristics.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Effects of Ionic Group Distribution on the Structure and Dynamics of Amorphous Polymer Melts

Ionizable groups tethered to a polymer backbone often associate to form ionic clusters, whose features are determined by the balance of the polymer backbone and electrostatics. These assemblies impact the dynamics of the macromolecules and their ability to transport ions. Here, using fully atomistic molecular dynamics (MD) simulations, we investigate the effects of the distribution of ionizable groups along the polymer backbone on cluster characteristics and the resulting impacts on the structure and dynamics of amorphous polymers. Particularly, we probe polystyrene sulfonates (PSS) with random, precise, and block configurations of the SO 3 – sulfonate groups along the backbone with Na + as the counterion. We find that the distribution of the ionic groups affects the shape and distribution of the clusters as well as the internal packing of the ionizable groups in the cluster and the number of unique chains that participate in each cluster, affecting the structure and the dynamics of the polymers. Furthermore, the signature of ionic clusters, observed in the static structure factor S(q) for all three distributions, is significantly more pronounced for the precise and blocky polymers compared to the random one. Remarkably, we find that the local mobility of the polymer segments is not only affected by the number and size of the clusters but also by the number of polymer chains associated with clusters.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Causal interaction in high frequency turbulence at the biosphere–atmosphere interface: Structural behavior

High-frequency (e.g., 10 Hz) eddy covariance measurements are typically used to estimate fluxes at the land–atmosphere interface at timescales of 15–60 min. These multivariate data contain information about the interdependency at high frequency between the interacting variables such as wind, humidity, temperature, and CO 2⁠ . We use data at 10 Hz from an eddy covariance instrument located at 25 m above agricultural land in the Midwestern US, which offers an opportunity to move beyond the traditional spectral analyses to explore causal dependency among variables. In this study, we quantify the structure of inter-dependencies of interacting variables at high frequency represented by a directed acyclic graph (DAG). We compare DAGs to investigate changes in structural differences in causal interactions. We then apply a distance-based classification and -means clustering approach to identify the evolution of the causal structure represented by a DAG. Our method selects an unbiased number of clusters of similar structures and characterizes the similarities and differences between them. We explore a range of dynamic behavior using data from a clear sky day and during a solar eclipse in 2017. Our results show well-defined clusters of similar causal dependencies as the system evolves. Furthermore, our approach provides a methodological framework to understand how causal dependence in turbulence manifests in high-frequency data when represented through a DAG.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Substructure in the stellar halo near the Sun: II. Characterisation of independent structures

In an accompanying paper, we present a data-driven method for clustering in ‘integrals of motion’ space and apply it to a large sample of nearby halo stars with 6D phase-space information. The algorithm identified a large number of clusters, many of which could tentatively be merged into larger groups. The goal here is to establish the reality of the clusters and groups through a combined study of their stellar populations (average age, metallicity, and chemical and dynamical properties) to gain more insights into the accretion history of the Milky Way. To this end, we developed a procedure that quantifies the similarity of clusters based on the Kolmogorov–Smirnov test using their metallicity distribution functions, and an isochrone fitting method to determine their average age, which is also used to compare the distribution of stars in the colour–absolute magnitude diagram. Also taking into consideration how the clusters are distributed in integrals of motion space allows us to group clusters into substructures and to compare substructures with one another. We find that the 67 clusters identified by our algorithm can be merged into 12 extended substructures and 8 small clusters that remain as such. The large substructures include the previously known Gaia-Enceladus, Helmi streams, Sequoia, and Thamnos 1 and 2. We identify a few over-densities that can be associated with the hot thick disc and host a small metal-poor population. Especially notable is the largest (by number of member stars) substructure in our sample which, although peaking at the metallicity characteristic of the thick disc, has a very well populated metal-poor component, and dynamics intermediate between the hot thick disc and the halo. We also identify additional debris in the region occupied by Sequoia with clearly distinct kinematics, likely remnants of three different accretion events with progenitors of similar masses. Although only a small subset of the stars in our sample have chemical abundance information, we are able to identify different trends of [Mg/Fe] versus [Fe/H] for the various substructures, confirming our dissection of the nearby halo. We find that at least 20% of the halo near the Sun is associated to substructures. When comparing their global properties, we note that those substructures on retrograde orbits are not only more metal-poor on average but are also older. We provide a table summarising the properties of the substructures, as well as a membership list that can be used for follow-up chemical abundance studies for example.

79 ASTRONOMY AND ASTROPHYSICS↗