Search NASA⌕ Search

DOE OSTI · 21371925

A GROUP FINDING ALGORITHM FOR MULTIDIMENSIONAL DATA SETS

Abstract

We describe a density-based hierarchical group finding algorithm capable of identifying structures and substructures of any shape and density in multidimensional data sets where each dimension can be a numeric attribute with arbitrary measurement scale. This has applications in a wide variety of fields from finding structures in galaxy redshift surveys, to identifying halos and subhalos in N-body simulations and group finding in Local Group chemodynamical data sets. In general, clustering schemes require an a priori definition of a metric (a non-negative function that gives the distance between two points in a space) and the quality of clustering depends upon this choice. The general practice is to use a constant global metric which is optimal only if the clusters in the data are self-similar. For complex data configurations even the most finely tuned constant global metric turns out to be suboptimal. Moreover, the correct choice of metric also becomes increasingly important as the number of dimensions increase. To address these problems, we present an entropy-based binary space partitioning algorithm which uses a locally adaptive metric for each data point. The metric is employed to calculate the density at each point and a list of its nearest neighbors, and this information is then used to form a hierarchy of groups. Finally, the ratio of maximum to minimum density of points in a group is used to estimate the significance of the groups. Setting a threshold on this significance can effectively screen out groups arising due to Poisson noise and helps organize the groups into meaningful clusters. For a data set of N points, the algorithm requires only O(N) space and O(N(log N){sup 3}) time which makes it ideally suitable for analyzing large data sets. As an example, we apply the algorithm to identify structures in a simulated stellar halo using the full six-dimensional phase space coordinates.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Sharma, Sanjib. 2009-09-20. A GROUP FINDING ALGORITHM FOR MULTIDIMENSIONAL DATA SETS. https://doi.org/10.1088/0004-637x%2F703%2F1%2F1061

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

Dust Survival in Galactic Winds

This repository contains three-dimensional volumetric data from an Eulerian hydrodynamical simulation (conducted on a uniform Cartesian grid) generated by the Cholla hydrodynamics code. The datasets contain snapshots (full-grid, projections, and slices) in the HDF5 format of a multi-phase medium in which a hot, diffuse, dust-free background wind accelerates a cool, dense cloud of gas and dust. This scenario is intended to represent a supernova-driven galactic outflow, in which hot supernova winds are thought to accelerate cool interstellar medium material out of the galactic disk into the surrounding circumgalactic medium. There are three separate datasets for simulations corresponding to three cloud evolutionary scenarios: long-term cloud survival (surv), marginal cloud survival (disr), and cloud destruction (dest). Projection and slice images of the simulations are also included in this repository.

79 ASTRONOMY AND ASTROPHYSICS↗

Unraveling TeV halos with the Cherenkov Telescope Array

Pulsars are observed to emit bright and spatially extended gamma-ray emission at multi-TeV energies. These so-called "TeV halos" are now understood to be a nearly universal feature of middle-aged pulsars. However, many of the key physical processes that govern these systems, particularly those affecting particle diffusion, remain poorly constrained. We aim to evaluate the ability of the Cherenkov Telescope Array (CTA) to probe the physical properties of TeV halos, with a focus on the nearby and well-studied case of the Geminga pulsar. We simulate gamma-ray emission from various TeV halo models, incorporating different assumptions for the injected electron spectrum, spin-down evolution, and energy-dependent diffusion. These models are then used to forecast CTA's sensitivity to spectral and spatial differences, based on realistic mock observations and instrument response simulations. We find that CTA will be able to distinguish between a wide range of TeV halo models that are currently consistent with existing data. In particular, CTA observations can constrain the normalization, energy dependence, and spatial extent of the diffusion coefficient surrounding Geminga, as well as the spectral shape of the injected electron population.

79 ASTRONOMY AND ASTROPHYSICS↗