Search NASA⌕ Search

SEARCH · Search NASA

Results for “data clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Nanoscale Cluster Detection in Massive Atom Probe Tomography Data

Recent technological advances in atom probe tomography (APT) have led to unprecedented data acquisition capabilities that routinely generate data sets containing hundreds of millions of atoms. Detecting nanoscale clusters of different atom types present in these enormous amounts of data and analyzing their spatial correlations with one another are fundamental to understanding the structural properties of the material from which the data is derived. Extant algorithms for nanoscale cluster detection do not scale to large data sets. Here, a scalable, CUDA-based implementation of an autocorrelation algorithm is presented. It isolates spatial correlations amongst atomic clusters present in massive APT data sets in linear time using a linear amount of storage. Correctness of the algorithm is demonstrated using large synthetically generated data with known spatial distributions. Benefits and limitations of using GPU-acceleration for autocorrelation-based APT data analyses are presented with supporting performance results on data sets with up to billions of atoms. To our knowledge, this is the first nanoscale cluster detection algorithm that scales to massive APT data sets and executes on commodity hardware.

Seal, Sudip K↗

Using NVMe Gen3 PCIe SSD Cards in High-density Servers for High-performance Big Data Transfer Over Multiple Network Channels

This Technical Note describes how the Zettar team came up with a data transfer cluster design that convincingly proved the feasibility of using high-density servers for high-performance Big Data transfers. It then outlines the tests, operations, and observations that address a potential over-heating concern regarding the use of Non-Volatile Memory Host Controller Interface Specification (NVMHCI aka NVM Express or NVMe) Gen 3 PCIe SSD cards in high-density servers. Finally, it points out the possibility of developing a new generation of high-performance Science DMZ data transfer system for the data-intensive research community and commercial enterprises.

97 MATHEMATICS AND COMPUTING↗

TH-E-BRF-08: Subpopulations of Similarly-Responding Lesions in Metastatic Prostate Cancer

Purpose: In patients with multiple lesions, resistance to cancer treatments and subsequent disease recurrence may be due to heterogeneity of response across lesions. This study aims to identify subpopulations of similarly-responding metastatic prostate cancer lesions in bone using quantitative PET metrics. Methods: Seven metastatic prostate cancer patients treated with AR-directed therapy received pre-treatment and mid-treatment [F-18]NaF PET/CT scans. Images were registered using an articulated CT registration algorithm and transformations were applied to PET segmentations. Midtreatment response was calculated on PET-based texture features. Hierarchical agglomerative clustering was used to form groups of similarly-responding lesions, with the number of natural clusters (K) determined by the inconsistency coefficient. Lesion clustering was performed within each patient, and for the pooled population. The cophenetic coefficient (C) quantified how well the data was clustered. The Jaccard Index (JI) assessed similarity of cluster assignments from patient clustering and from population clustering. Results: 188 lesions in seven patients were identified for analysis (between 6 to 53 lesions per patient). Lesion response was defined as percent change relative to pre-treatment for 23 uncorrelated PET-based feature identifiers. . High response heterogeneity was found across all lesions (i.e. range ΔSUVmax =−95.98% to 775.00%). For intra-patient clustering, K ranged from 1–20. Population-based clustering resulted in 75 clusters, of 1-6 lesions each. Intra-patient clustering resulted in higher quality clusters than population clustering (mean C=0.95, range=0.89 to 1.00). For all patients, cluster assignments from population clustering showed good agreement to intra-patient clustering (mean JI=0.87, range=0.68 to 1.00). Conclusion: Subpopulations of similarly-responding lesions were identified in patients with multiple metastatic lesions. Good agreement was found between population- and patient-level clustering, indicating that PET-based response features may be used to quantify disease heterogeneity in advanced metastatic disease. This method for categorizing lesion response could help in identifying lesions with similar phenotypic- or genetic-based resistances to therapy. Research Supported by the Prostate Cancer Foundation.

60 APPLIED LIFE SCIENCES↗

Charliecloud

Charliecloud is a set of scripts to let users run a virtual cluster of virtual machines (VMs) on a desktop or supercomputer. Key functions include: 1. Creating (typically by installing an operating system from vendor media) and updating VM images; 2. Running a single VM; 3. Running multiple VMs in a virtual cluster. The virtual machines can talk to one another over the network and (in some cases) the outside world. This is accomplished by calling external programs such as QEMU and the Virtual Distributed Ethernet (VDE) suite. The goal is to let users have a virtual cluster containing nodes where they have privileged access, while isolating that privilege within the virtual cluster so it cannot affect the physical compute resources. Host configuration enforces security; this is not included in Charliecloud, though security guidelines are included in its documentation and Charliecloud is designed to facilitate such configuration. Charliecloud manages passing information from host computers into and out of the virtual machines, such as parameters of the virtual cluster, input data specified by the user, output data from virtual compute jobs, VM console display, and network connections (e.g., SSH or X11). Parameters for the virtual cluster (number of VMs, RAM and disk per VM, etc.) are specified by the user or gathered from the environment (e.g., SLURM environment variables). Example job scripts are included. These include computation examples (such as a "hello world" MPI job) as well as performance tests. They also include a security test script to verify that the virtual cluster is appropriately sandboxed. Tests include: 1. Pinging hosts inside and outside the virtual cluster to explore connectivity; 2. Port scans (again inside and outside) to see what services are available; 3. Sniffing tests to see what traffic is visible to running VMs; 4. IP address spoofing to test network functionality in this case; 5. File access tests to make sure host access permissions are enforced. This test script is not a comprehensive scanner and does not test for specific vulnerabilities. Importantly, no information about physical hosts or network topology is included in this script (or any of Charliecloud); while part of a sensible test, such information is specified by the user when the test is run. That is, one cannot learn anything about the LANL network or computing infrastructure by examining Charliecloud code.

Priedhorsky, Reid↗

Charliecloud

Charliecloud is a set of scripts to let users run a virtual cluster of virtual machines (VMs) on a desktop or supercomputer. Key functions include: 1. Creating (typically by installing an operating system from vendor media) and updating VM images; 2. Running a single VM; 3. Running multiple VMs in a virtual cluster. The virtual machines can talk to one another over the network and (in some cases) the outside world. This is accomplished by calling external programs such as QEMU and the Virtual Distributed Ethernet (VDE) suite. The goal is to let users have a virtual cluster containing nodes where they have privileged access, while isolating that privilege within the virtual cluster so it cannot affect the physical compute resources. Host configuration enforces security; this is not included in Charliecloud, though security guidelines are included in its documentation and Charliecloud is designed to facilitate such configuration. Charliecloud manages passing information from host computers into and out of the virtual machines, such as parameters of the virtual cluster, input data specified by the user, output data from virtual compute jobs, VM console display, and network connections (e.g., SSH or X11). Parameters for the virtual cluster (number of VMs, RAM and disk per VM, etc.) are specified by the user or gathered from the environment (e.g., SLURM environment variables). Example job scripts are included. These include computation examples (such as a "hello world" MPI job) as well as performance tests. They also include a security test script to verify that the virtual cluster is appropriately sandboxed. Tests include: 1. Pinging hosts inside and outside the virtual cluster to explore connectivity; 2. Port scans (again inside and outside) to see what services are available; 3. Sniffing tests to see what traffic is visible to running VMs; 4. IP address spoofing to test network functionality in this case; 5. File access tests to make sure host access permissions are enforced. This test script is not a comprehensive scanner and does not test for specific vulnerabilities. Importantly, no information about physical hosts or network topology is included in this script (or any of Charliecloud); while part of a sensible test, such information is specified by the user when the test is run. That is, one cannot learn anything about the LANL network or computing infrastructure by examining Charliecloud code.

Priedhorsky, Reid↗

Galaxy clustering in harmonic space from the dark energy survey year 1 data: compatibility with real-space results

ABSTRACT We perform an analysis in harmonic space of the Dark Energy Survey Year 1 Data (DES-Y1) galaxy clustering photometric data using products obtained for the real-space analysis. We test our pipeline with a suite of lognormal simulations, which are used to validate scale cuts in harmonic space as well as to provide a covariance matrix that takes into account the DES-Y1 mask. We then apply this pipeline to DES-Y1 data taking into account survey property maps derived for the real-space analysis. We compare with real-space DES-Y1 results obtained from a similar pipeline. We show that the harmonic space analysis we develop yields results that are compatible with the real-space analysis for the bias parameters. This verification paves the way to performing a harmonic space analysis for the upcoming DES-Y3 data.

79 ASTRONOMY AND ASTROPHYSICS↗

Clustered BSRs: Evidence for gas hydrate-bearing turbidite complexes in folded regions, example from the Perdido Fold Belt, northern Gulf of Mexico

We detail previously undocumented but extensive gas hydrate accumulations in the mouth of Perdido Canyon in the northern Gulf of Mexico. The accumulations are located within central parts of structural domes (four-way closures) and are characterized by stacked, high-amplitude bottom simulating reflections (BSRs) that we call clustered BSRs. Seismic data from Perdido Canyon show two clustered BSRs associated with turbidite sequences within two dome folds formed from tectonic folding and salt diapir rise. The northwestern (NW) and southeastern (SE) clustered BSRs have aerial extents of ~25 km2 and 50 km2, respectively. Well log data confirm gas hydrate occurs above the NW clustered BSR, within a 225 m-thick consistently high-resistivity interval that we interpret as gas hydrate in near-vertical fractures and turbidite sands. The SE dome is only drilled at the edge of the BSR; nevertheless, the well log data indicate that a 30 m-thick gas hydrate accumulation is present. Gas chromatographic logs in both domes suggest a gradual transition from predominantly microbial gas below the BSR (500–1000 m below seafloor (mbsf)) to thermogenic gas at 1000–2000 mbsf. Based on the well log data and seismic stratigraphic analysis, we find gas hydrate is concentrated in fractures in marine mud, as well as in the pores of submarine fan turbidities, where saturations reach as high as 75%. An estimate of the total gas hydrate-bound gas volume at standard temperature and pressure is between 0.04 and 0.17 trillion cubic meters (TCM) assuming average hydrate saturation of 5-20% in a ~45 m thick turbidite sand unit above the Perdido Canyon BSR area. Measured BSR extent and gas volume estimates indicate that the NW and SE reservoirs are among the largest gas hydrate occurrences known in the Gulf of Mexico.

58 GEOSCIENCES↗

Parameter splitting in dark energy: is dark energy the same in the background and in the cosmic structures?

We perform an empirical consistency test of General Relativity/dark energy by disentangling expansion history and growth of structure constraints. We replace each late-universe parameter that describes the behavior of dark energy with two meta-parameters: one describing geometrical information in cosmological probes, and the other controlling the growth of structure. If the underlying model (a standard wCDM cosmology with General Relativity) is correct, that is under the null hypothesis, the two meta-parameters coincide. If they do not, it could indicate a failure of the model or systematics in the data. We present a global analysis using state-of-the-art cosmological data sets which points in the direction that cosmic structures prefer a weaker growth than that inferred by background probes. This result could signify inconsistencies of the model, the necessity of extensions to it or the presence of systematic errors in the data. We examine all these possibilities. The fact that the result is mostly driven by a specific sub-set of galaxy clusters abundance data, points to the need of a better understanding of this probe.

79 ASTRONOMY AND ASTROPHYSICS↗

Measurement of inclusive jet and dijet production in p p collisions at s = 7 TeV using the ATLAS detector

CERN-LHC. Measurements of the inclusive jet and di-jet cross sections in proton-proton collisions at a centre-of-mass energy of 7 TeV. The analysis is based on the 2010 data sample with a total integrated luminosity of 37 pb^{-1}. The anti-KT algorithm is used for jet clustering with data given using both the parameters R=0.4 and R=0.6. Double-differential cross sections are given as a function of the inclusive jet PT in rapidity (y) bins and of the di-jet invariant mass in bins of half of the rapidity separation of the two jets (y*). Details of the systematic errors and their correlations are given in the link below. In the tables the first (sys) error is the correlated (in PT) systematic error and the second is the uncorrelated systematic error, both produced by combining the relevant errors in quadrature.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Einstein imaging observations of clusters of galaxies

X-ray observations suggest a broad division between clusters having a centrally-located, X-ray dominant galaxy characterized by a centrally-peaked X-ray emission, and clusters with a broader X-ray profile. Within these categories, such evolutionary indicators as X-ray temperature, vorticity dispersion, spiral fraction and central galaxy density may indicate the relative stages of evolution. X-ray imaging observations are presented for (1) the Virgo cluster, (2) other dynamically unevolved clusters, (3) double clusters which may be in an intermediate evolutionary stage, and (4) dynamically evolved clusters. The data are analyzed under the assumption of an isothermal X-ray gas which is gravitationally bound by galaxies and clusters.

Forman, W.↗

Enhancing Cluster Identification in Atom Probe Tomography Data Using Transfer Learning

Atom Probe Tomography (APT) is a powerful technique for visualizing the atomic-scale distribution of solutes in materials, but quantitative cluster analysis of APT datasets remains a challenge due to the need for subjective parameter selection in clustering algorithms. While distance-based and density-based methods such as HDBSCAN are widely used, their performance is highly sensitive to user-defined parameters, which undermines reproducibility and accuracy. This study proposes an image-based, deep learning-aided workflow for automating parameter selection and cluster detection in APT data analysis. By projecting 3D APT point clouds onto 2D planes, we leverage pretrained convolutional neural networks (ConvNeXt-Tiny and ResNet-50) through transfer learning to predict the number of clusters present in synthetic datasets. The output is used to guide K-means clustering and estimate HDBSCAN parameters, specifically minimum cluster size and minimum sample points. This approach reduces reliance on manual parameter tuning, improving consistency and scalability. The methodology demonstrates the feasibility of using image-based deep learning for interpreting complex spatial patterns in APT data, enabling faster and more objective analysis. The complete workflow and code are made publicly available to support reproducibility and future research.

Density-based clustering↗

The discovery of an O subdwarf in the globular cluster NGC 6712

Spectral data for C49 in the globular cluster NGC 6712 are examined with reference to evolutionary models for low-mass stars that are contracting into white dwarfs. The spectrum of this star is found to be almost identical to that of the first sdO star found in a globular cluster, star A in NGC 6397. Analysis of the spectral data using nonlocal thermodynamic equilibrium models gives surface parameters T not less than 50,000 K, log g = 5.5 plus or minus 0.5, and N(He)/N(H) approximately equal to 0.1. The results are consistent with the models considered.

Remillard, R. A.↗

Observational constraints on early dark energy

In this paper, we review and update constraints on the Early Dark Energy (EDE) model from cosmological data sets, in particular Planck PR3 and PR4 cosmic microwave background (CMB) data and large-scale structure (LSS) data sets including galaxy clustering and weak lensing data from the Dark Energy Survey, Subaru Hyper Suprime-Cam and KiDS+VIKING-450, as well as BOSS/eBOSS galaxy clustering and Lyman-[Formula: see text] forest data. We detail the fit to CMB data, and perform the first analyses of EDE using the CAMSPEC and Hillipop likelihoods for Planck CMB data, rather than Plik, both of which yield a tighter upper bound on the allowed EDE fraction than that found with Plik. We then supplement CMB data with LSS data in a series of new analyses. All these analyses are concordant in their Bayesian preference for [Formula: see text]CDM over EDE, as indicated by marginalized posterior distributions. We perform a series of tests of the impact of priors in these results, and compare with frequentist analyses based on the profile likelihood, finding qualitative agreement with the Bayesian results. All these tests suggest prior volume effects are not a determining factor in analyses of EDE. This work provides both a review of existing constraints and several new analyses.

Astronomy & Astrophysics↗

A soft X-ray map of the Perseus cluster of galaxies

A 0.5-3-keV X-ray map of the Perseus cluster of galaxies is presented. The map shows a region of strong emission centered near NGC 1275 plus a highly elongated emission region which lies along the line of bright galaxies that dominates the core of the cluster. The data are compared with various models that include point and diffuse sources. One model which adequately represents the data is the superposition of a point source at NGC 1275 and an isothermal ellipsoid resulting from the bremsstrahlung emission of cluster gas. The ellipsoid has a major core radius of 20.5 arcmin and a minor core radius of 5.5 arcmin, consistent with the values obtained from galaxy counts. All acceptable models provide evidence for a compact source (less than 3 arcmin FWHM) at NGC 1275 containing about 25% of the total emission. Since the diffuse X-ray and radio components have radically different morphologies, it is unlikely that the emissions arise from a common source, as proposed in inverse-Compton models.

Cash, W.↗

Spatio-Temporal Surrogates for Interaction of a Jet with High Explosives: Part II - Clustering Extremely High-Dimensional Grid-Based Data

Building an accurate surrogate model for the spatio-temporal outputs of a computer simulation is a challenging task. A simple approach to improve the accuracy of the surrogate is to cluster the outputs based on similarity and build a separate surrogate model for each cluster. This clustering is relatively straightforward when the output at each time step is of moderate size. However, when the spatial domain is represented by a large number of grid points, numbering in the millions, the clustering of the data becomes more challenging. In this report, we consider output data from simulations of a jet interacting with high explosives. These data are available on spatial domains of different sizes, at grid points that vary in their spatial coordinates, and in a format that distributes the output across multiple files at each time step of the simulation. We first describe how we bring these data into a consistent format prior to clustering. Borrowing the idea of random projections from data mining, we reduce the dimension of our data by a factor of thousand, making it possible to use the iterative k-means method for clustering. We show how we can use the randomness of both the random projections, and the choice of initial centroids in k-means clustering, to determine the number of clusters in our data set. Our approach makes clustering of extremely high dimensional data tractable, generating meaningful cluster assignments for our problem, despite the approximation introduced in the random projections.

97 MATHEMATICS AND COMPUTING↗

THE CLUSTER LENSING AND SUPERNOVA SURVEY WITH HUBBLE: AN OVERVIEW

The Cluster Lensing And Supernova survey with Hubble (CLASH) is a 524-orbit Multi-Cycle Treasury Program to use the gravitational lensing properties of 25 galaxy clusters to accurately constrain their mass distributions. The survey, described in detail in this paper, will definitively establish the degree of concentration of dark matter in the cluster cores, a key prediction of structure formation models. The CLASH cluster sample is larger and less biased than current samples of space-based imaging studies of clusters to similar depth, as we have minimized lensing-based selection that favors systems with overly dense cores. Specifically, 20 CLASH clusters are solely X-ray selected. The X-ray-selected clusters are massive (kT > 5 keV) and, in most cases, dynamically relaxed. Five additional clusters are included for their lensing strength ({theta}{sub Ein} > 35'' at z{sub s} = 2) to optimize the likelihood of finding highly magnified high-z (z > 7) galaxies. A total of 16 broadband filters, spanning the near-UV to near-IR, are employed for each 20-orbit campaign on each cluster. These data are used to measure precise ({sigma}{sub z} {approx} 0.02(1 + z)) photometric redshifts for newly discovered arcs. Observations of each cluster are spread over eight epochs to enable a search for Type Ia supernovae at z > 1 to improve constraints on the time dependence of the dark energy equation of state and the evolution of supernovae. We present newly re-derived X-ray luminosities, temperatures, and Fe abundances for the CLASH clusters as well as a representative source list for MACS1149.6+2223 (z 0.544).

79 ASTRONOMY AND ASTROPHYSICS↗

A Generative Model for Realistic Galaxy Cluster X-Ray Morphologies

Abstract The X-ray morphologies of clusters of galaxies display significant variations, reflecting their dynamical histories and the nonlinear dependence of X-ray emissivity on the density of the intracluster gas. Qualitative and quantitative assessments of X-ray morphology have long been considered a proxy for determining whether clusters are dynamically active or “relaxed.” Conversely, the use of circularly or elliptically symmetric models for cluster emission can be complicated by the variety of complex features realized in nature, spanning scales from megaparsecs down to the resolution limit of current X-ray observatories. In this work, we use mock X-ray images from simulated clusters from The Three Hundred project to define a basis set of cluster image features. We take advantage of the clusters’ approximate self-similarity to minimize the differences between images before encoding the remaining diversity through a distribution of high-order polynomial coefficients. Principal component analysis then provides an orthogonal basis for this distribution, corresponding to natural perturbations from an average model. This representation allows novel, realistically complex X-ray cluster images to be easily generated, and we provide code to do so. The approach provides a simple way to generate training data for cluster image analysis algorithms and could be straightforwardly adapted to generate clusters displaying specific types of features or selected by physical characteristics available in the original simulations.

79 ASTRONOMY AND ASTROPHYSICS↗

Clustering of tethered satellite system simulation data by an adaptive neuro-fuzzy algorithm

Recent developments in neuro-fuzzy systems indicate that the concepts of adaptive pattern recognition, when used to identify appropriate control actions corresponding to clusters of patterns representing system states in dynamic nonlinear control systems, may result in innovative designs. A modular, unsupervised neural network architecture, in which fuzzy learning rules have been embedded is used for on-line identification of similar states. The architecture and control rules involved in Adaptive Fuzzy Leader Clustering (AFLC) allow this system to be incorporated in control systems for identification of system states corresponding to specific control actions. We have used this algorithm to cluster the simulation data of Tethered Satellite System (TSS) to estimate the range of delta voltages necessary to maintain the desired length rate of the tether. The AFLC algorithm is capable of on-line estimation of the appropriate control voltages from the corresponding length error and length rate error without a priori knowledge of their membership functions and familarity with the behavior of the Tethered Satellite System.

Mitra, Sunanda↗