Search NASA⌕ Search

SEARCH · Search NASA

Results for “data clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

A GMBCG galaxy cluster catalog of 55,880 rich clusters from SDSS DR7

We present a large catalog of optically selected galaxy clusters from the application of a new Gaussian Mixture Brightest Cluster Galaxy (GMBCG) algorithm to SDSS Data Release 7 data. The algorithm detects clusters by identifying the red sequence plus Brightest Cluster Galaxy (BCG) feature, which is unique for galaxy clusters and does not exist among field galaxies. Red sequence clustering in color space is detected using an Error Corrected Gaussian Mixture Model. We run GMBCG on 8240 square degrees of photometric data from SDSS DR7 to assemble the largest ever optical galaxy cluster catalog, consisting of over 55,000 rich clusters across the redshift range from 0.1 < z < 0.55. We present Monte Carlo tests of completeness and purity and perform cross-matching with X-ray clusters and with the maxBCG sample at low redshift. These tests indicate high completeness and purity across the full redshift range for clusters with 15 or more members.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

THE MASSIVE DISTANT CLUSTERS OF WISE SURVEY: THE FIRST DISTANT GALAXY CLUSTER DISCOVERED BY WISE

We present spectroscopic confirmation of a z = 0.99 galaxy cluster discovered using data from the Wide-field Infrared Survey Explorer (WISE). This is the first z {approx} 1 cluster candidate from the Massive Distant Clusters of WISE Survey to be confirmed. It was selected as an overdensity of probable z {approx}> 1 sources using a combination of WISE and Sloan Digital Sky Survey DR8 photometric catalogs. Deeper follow-up imaging data from Subaru and WIYN reveal the cluster to be a rich system of galaxies, and multi-object spectroscopic observations from Keck confirm five cluster members at z = 0.99. The detection and confirmation of this cluster represents a first step toward constructing a uniformly selected sample of distant, high-mass galaxy clusters over the full extragalactic sky using WISE data.

79 ASTRONOMY AND ASTROPHYSICS↗

A GMBCG GALAXY CLUSTER CATALOG OF 55,424 RICH CLUSTERS FROM SDSS DR7

We present a large catalog of optically selected galaxy clusters from the application of a new Gaussian Mixture Brightest Cluster Galaxy (GMBCG) algorithm to SDSS Data Release 7 data. The algorithm detects clusters by identifying the red-sequence plus brightest cluster galaxy (BCG) feature, which is unique for galaxy clusters and does not exist among field galaxies. Red-sequence clustering in color space is detected using an Error Corrected Gaussian Mixture Model. We run GMBCG on 8240 deg{sup 2} of photometric data from SDSS DR7 to assemble the largest ever optical galaxy cluster catalog, consisting of over 55,000 rich clusters across the redshift range from 0.1 < z < 0.55. We present Monte Carlo tests of completeness and purity and perform cross-matching with X-ray clusters and with the maxBCG sample at low redshift. These tests indicate high completeness and purity across the full redshift range for clusters with 15 or more members.

79 ASTRONOMY AND ASTROPHYSICS↗

The Mismeasure of Mergers: Revised Limits on Self-interacting Dark Matter in Merging Galaxy Clusters

In an influential recent paper, Harvey et al. derive an upper limit to the self-interaction cross section of dark matter (DM) (${\sigma }_{{\rm{DM}}}/m$ < 0.47 cm 2 g -1 at 95% confidence) by averaging the DM–galaxy offsets in a sample of merging galaxy clusters. Using much more comprehensive data on the same clusters, we identify several substantial errors in their offset measurements. Correcting these errors relaxes the upper limit on ${\sigma }_{{\rm{DM}}}/m$ to $\lesssim$2 cm 2 g -1 , following the Harvey et al. prescription for relating offsets to cross sections in a simple solid-body scattering model. Furthermore, many clusters in the sample violate the assumptions behind this prescription, so even this revised upper limit should be used with caution. Although this particular sample does not tightly constrain self-interacting DM models when analyzed this way, we discuss how merger ensembles may be used more effectively in the future. Finally, we conclude that errors inherent in using single-band imaging to identify mass and light peaks do not necessarily average out in a sample of this size, particularly when a handful of substructures constitute a majority of the weight in the ensemble.

79 ASTRONOMY AND ASTROPHYSICS↗

General Purpose Data-Driven Monitoring for Space Operations

As modern space propulsion and exploration systems improve in capability and efficiency, their designs are becoming increasingly sophisticated and complex. Determining the health state of these systems, using traditional parameter limit checking, model-based, or rule-based methods, is becoming more difficult as the number of sensors and component interactions grow. Data-driven monitoring techniques have been developed to address these issues by analyzing system operations data to automatically characterize normal system behavior. System health can be monitored by comparing real-time operating data with these nominal characterizations, providing detection of anomalous data signatures indicative of system faults or failures. The Inductive Monitoring System (IMS) is a data-driven system health monitoring software tool that has been successfully applied to several aerospace applications. IMS uses a data mining technique called clustering to analyze archived system data and characterize normal interactions between parameters. The scope of IMS based data-driven monitoring applications continues to expand with current development activities. Successful IMS deployment in the International Space Station (ISS) flight control room to monitor ISS attitude control systems has led to applications in other ISS flight control disciplines, such as thermal control. It has also generated interest in data-driven monitoring capability for Constellation, NASA's program to replace the Space Shuttle with new launch vehicles and spacecraft capable of returning astronauts to the moon, and then on to Mars. Several projects are currently underway to evaluate and mature the IMS technology and complementary tools for use in the Constellation program. These include an experiment on board the Air Force TacSat-3 satellite, and ground systems monitoring for NASA's Ares I-X and Ares I launch vehicles. The TacSat-3 Vehicle System Management (TVSM) project is a software experiment to integrate fault and anomaly detection algorithms and diagnosis tools with executive and adaptive planning functions contained in the flight software on-board the Air Force Research Laboratory TacSat-3 satellite. The TVSM software package will be uploaded after launch to monitor spacecraft subsystems such as power and guidance, navigation, and control (GN&C). It will analyze data in real-time to demonstrate detection of faults and unusual conditions, diagnose problems, and react to threats to spacecraft health and mission goals. The experiment will demonstrate the feasibility and effectiveness of integrated system health management (ISHM) technologies with both ground and on-board experiments.

Iverson, David L.↗

General Purpose Data-Driven System Monitoring for Space Operations

Modern space propulsion and exploration system designs are becoming increasingly sophisticated and complex. Determining the health state of these systems using traditional methods is becoming more difficult as the number of sensors and component interactions grows. Data-driven monitoring techniques have been developed to address these issues by analyzing system operations data to automatically characterize normal system behavior. The Inductive Monitoring System (IMS) is a data-driven system health monitoring software tool that has been successfully applied to several aerospace applications. IMS uses a data mining technique called clustering to analyze archived system data and characterize normal interactions between parameters. This characterization, or model, of nominal operation is stored in a knowledge base that can be used for real-time system monitoring or for analysis of archived events. Ongoing and developing IMS space operations applications include International Space Station flight control, satellite vehicle system health management, launch vehicle ground operations, and fleet supportability. As a common thread of discussion this paper will employ the evolution of the IMS data-driven technique as related to several Integrated Systems Health Management (ISHM) elements. Thematically, the projects listed will be used as case studies. The maturation of IMS via projects where it has been deployed, or is currently being integrated to aid in fault detection will be described. The paper will also explain how IMS can be used to complement a suite of other ISHM tools, providing initial fault detection support for diagnosis and recovery.

Satellites↗

General Purpose Data-Driven System Monitoring for Space Operations

Modern space propulsion and exploration system designs are becoming increasingly sophisticated and complex. Determining the health state of these systems using traditional methods is becoming more difficult as the number of sensors and component interactions grows. Data-driven monitoring techniques have been developed to address these issues by analyzing system operations data to automatically characterize normal system behavior. The Inductive Monitoring System (IMS) is a data-driven system health monitoring software tool that has been successfully applied to several aerospace applications. IMS uses a data mining technique called clustering to analyze archived system data and characterize normal interactions between parameters. This characterization, or model, of nominal operation is stored in a knowledge base that can be used for real-time system monitoring or for analysis of archived events. Ongoing and developing IMS space operations applications include International Space Station flight control, spacecraft vehicle system health management, launch vehicle ground operations, and fleet supportability. As a common thread of discussion this paper will employ the evolution of the IMS data-driven technique as related to several Integrated Systems Health Management (ISHM) elements. Thematically, the projects listed will be used as case studies. The maturation of IMS via projects where it has been deployed or is currently being integrated to aid in fault detection will be described. The paper will also explain how IMS can be used to complement a suite of other ISHM tools, providing initial fault detection support for diagnosis and recovery

Space Propulsion↗

A high-resolution optical survey of interstellar absorption lines toward globular clusters and extragalactic objects. II - Further data

A status report is given on an ongoing survey of narrow-line, visual absorption components, which has been expanded to include lines of sight to the 3C 273 quasar, the nucleus of M87, and the NGC 1851, NGC 2808, and 47 Tuc globular cluster cores. The number density of components of the halo is calculated to lie between one-third and one per 100 kpc, though with substantial uncertainty. This estimate is held to be consistent with the galactic halo interpretation of the origin of high column density, quasar absorption-line systems.

Songaila, A.↗

Anomalous dust in the open cluster Trumpler 37

New IUE data were obtained towards stars in the open cluster Trumpler 37. Extinction curves derived from these data show that the anomalous dust detected towards HD 204827 and HD 210072 is not unique to those lines of sight but occurs generally in that region of the sky. The dust is apparently associated with the Trumpler 37 cluster, which forms the center of Cepheus OB2. This is a complex region of star formation where the evolution of dust grains through shock waves could be considered likely. A supernova in a slightly older star-forming region of Cep OB2 located next to Trumpler 37 is a possible source of such a shock wave.

Clayton, Geoffrey C.↗

Cluster Analysis of Combined EDS and EBSD Data to Solve Ambiguous Phase Identifications

A common problem in analytical scanning electron microscopy (SEM) using electron backscatter diffraction (EBSD) is the differentiation of phases with distinct chemistry but the same or very similar crystal structure. X-ray energy dispersive spectroscopy (EDS) is useful to help differentiate these phases of similar crystal structures but different elemental makeups. However, open, automated, and unbiased methods of differentiating phases of similar EBSD responses based on their EDS response are lacking. This paper describes a simple data analytics-based method, using a combination of singular value decomposition and cluster analysis, to merge simultaneously acquired EDS + EBSD information and automatically determine phases from both their crystal and elemental data. I use hexagonal TiB 2 ceramic contaminated with multiple crystallographically ambiguous but chemically distinct cubic phases to illustrate the method. Code, in the form of a Python 3 Jupyter Notebook, and the necessary data to replicate the analysis are provided as Supplementary material.

47 OTHER INSTRUMENTATION↗

The distances to open clusters from main-sequence fitting. V. Extension of color calibration and test using cool and metal-rich stars in NGC 6791

We extend our effort to calibrate stellar isochrones in the Johnson–Cousins (BVI{sub C}) and the 2MASS (JHK{sub s}) filter systems based on observations of well-studied open clusters. Using cool main-sequence (MS) stars in Praesepe, we define empirical corrections to the Lejeune et al. color–effective temperature (T{sub eff}) relations down to T{sub eff}∼3600 K, complementing our previous work based on the Hyades and the Pleiades. We apply empirically corrected isochrones to existing optical and near-infrared photometry of cool (T{sub eff}≲5500 K) and metal-rich ([Fe/H]= +0.37) MS stars in NGC 6791. The current methodology relies on an assumption that color–T{sub eff} corrections are independent of metallicity, but we find that estimates of color excess and distance from color–magnitude diagrams with different color indices converge on each other at the precisely known metallicity of the cluster. Along with a satisfactory agreement with eclipsing binary data in the cluster, we view the improved internal consistency as a validation of our calibrated isochrones at super-solar metallicities. For very cool stars (T{sub eff}≲4800 K), however, we find that B − V colors of our models are systematically redder than the cluster photometry by ∼0.02 mag. We use color–T{sub eff} transformations from the infrared flux method and alternative photometry to examine a potential color-scale error in the input cluster photometry. After excluding B − V photometry of these cool MS stars, we derive E(B − V)=0.105±0.014, [M/H] = +0.42±0.07, (m − M){sub 0}=13.04±0.08, and the age of 9.5 ± 0.3 Gyr for NGC 6791.

79 ASTRONOMY AND ASTROPHYSICS↗

Automated clustering-based workload characterization

The demands placed on the mass storage systems at various federal agencies and national laboratories are continuously increasing in intensity. This forces system managers to constantly monitor the system, evaluate the demand placed on it, and tune it appropriately using either heuristics based on experience or analytic models. Performance models require an accurate workload characterization. This can be a laborious and time consuming process. It became evident from our experience that a tool is necessary to automate the workload characterization process. This paper presents the design and discusses the implementation of a tool for workload characterization of mass storage systems. The main features of the tool discussed here are: (1)Automatic support for peak-period determination. Histograms of system activity are generated and presented to the user for peak-period determination; (2) Automatic clustering analysis. The data collected from the mass storage system logs is clustered using clustering algorithms and tightness measures to limit the number of generated clusters; (3) Reporting of varied file statistics. The tool computes several statistics on file sizes such as average, standard deviation, minimum, maximum, frequency, as well as average transfer time. These statistics are given on a per cluster basis; (4) Portability. The tool can easily be used to characterize the workload in mass storage systems of different vendors. The user needs to specify through a simple log description language how the a specific log should be interpreted. The rest of this paper is organized as follows. Section two presents basic concepts in workload characterization as they apply to mass storage systems. Section three describes clustering algorithms and tightness measures. The following section presents the architecture of the tool. Section five presents some results of workload characterization using the tool.Finally, section six presents some concluding remarks.

Pentakalos, Odysseas I.↗

Synthetic galaxy clusters and observations based on Dark Energy Survey Year 3 Data

ABSTRACT We develop a novel data-driven method for generating synthetic optical observations of galaxy clusters. In cluster weak lensing, the interplay between analysis choices and systematic effects related to source galaxy selection, shape measurement, and photometric redshift estimation can be best characterized in end-to-end tests going from mock observations to recovered cluster masses. To create such test scenarios, we measure and model the photometric properties of galaxy clusters and their sky environments from the Dark Energy Survey Year 3 (DES Y3) data in two bins of cluster richness $\lambda \in [30; 45)$, $\lambda \in [45; 60)$ and three bins in cluster redshift ($z\in [0.3; 0.35)$, $z\in [0.45; 0.5)$ and $z\in [0.6; 0.65)$. Using deep-field imaging data, we extrapolate galaxy populations beyond the limiting magnitude of DES Y3 and calculate the properties of cluster member galaxies via statistical background subtraction. We construct mock galaxy clusters as random draws from a distribution function, and render mock clusters and line-of-sight catalogues into synthetic images in the same format as actual survey observations. Synthetic galaxy clusters are generated from real observational data, and thus are independent from the assumptions inherent to cosmological simulations. The recipe can be straightforwardly modified to incorporate extra information, and correct for survey incompleteness. New realizations of synthetic clusters can be created at minimal cost, which will allow future analyses to generate the large number of images needed to characterize systematic uncertainties in cluster mass measurements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

SU-F-R-33: Can CT and CBCT Be Used Simultaneously for Radiomics Analysis

Purpose: To investigate whether CBCT and CT can be used in radiomics analysis simultaneously. To establish a batch correction method for radiomics in two similar image modalities. Methods: Four sites including rectum, bladder, femoral head and lung were considered as region of interest (ROI) in this study. For each site, 10 treatment planning CT images were collected. And 10 CBCT images which came from same site of same patient were acquired at first radiotherapy fraction. 253 radiomics features, which were selected by our test-retest study at rectum cancer CT (ICC>0.8), were calculated for both CBCT and CT images in MATLAB. Simple scaling (z-score) and nonlinear correction methods were applied to the CBCT radiomics features. The Pearson Correlation Coefficient was calculated to analyze the correlation between radiomics features of CT and CBCT images before and after correction. Cluster analysis of mixed data (for each site, 5 CT and 5 CBCT data are randomly selected) was implemented to validate the feasibility to merge radiomics data from CBCT and CT. The consistency of clustering result and site grouping was verified by a chi-square test for different datasets respectively. Results: For simple scaling, 234 of the 253 features have correlation coefficient ρ>0.8 among which 154 features haveρ>0.9 . For radiomics data after nonlinear correction, 240 of the 253 features have ρ>0.8 among which 220 features have ρ>0.9. Cluster analysis of mixed data shows that data of four sites was almost precisely separated for simple scaling(p=1.29 * 10{sup −7}, χ{sup 2} test) and nonlinear correction (p=5.98 * 10{sup −7}, χ{sup 2} test), which is similar to the cluster result of CT data (p=4.52 * 10{sup −8}, χ{sup 2} test). Conclusion: Radiomics data from CBCT can be merged with those from CT by simple scaling or nonlinear correction for radiomics analysis.

60 APPLIED LIFE SCIENCES↗

Fusion of Surface Ceilometer Data and Satellite Cloud Retrievals in 2D Mesh Interpolating Model with Clustering

For accurate cloud ceiling information, a data fusion approach is proposed that utilizes satellite data to extend surface station information to much wider areas. Cloud base height (CBH) retrieved from satellite observations provides for much larger spatial coverage and higher resolution. The direct comparison of GOES-16 CBH with surface station ceiling yields a local bias that has to be corrected for in the initial GOES-16 cloud base information. This sparsely sampled bias correction presents an irregular 2D mesh of control points, which is then interpolated by constructing a continuous smooth field using polyharmonic splines. The influence of remote stations is restricted by grouping the control points into clusters depending on an effective distance. This cluster-based approach allows for constructing separate spline surfaces corresponding to physically different clouds. The obtained continuous bias correction function is then applied to the entire GOES-16 pixel level CBH except for areas far away from surface stations in data sparse regions such as offshore. The described method is currently being tested using daytime-only observations over the central and eastern United States. Overall, this approach has potential to provide more accurate, high spatial resolution cloud ceiling information for the aviation community.

Khlopenkov, Konstantin↗

AN OPTICAL CATALOG OF GALAXY CLUSTERS OBTAINED FROM AN ADAPTIVE MATCHED FILTER FINDER APPLIED TO SLOAN DIGITAL SKY SURVEY DATA RELEASE 6

We present a new cluster catalog extracted from the Sloan Digital Sky Survey Data Release 6 (SDSS DR6) using an adaptive matched filter (AMF) cluster finder. We identify 69,173 galaxy clusters in the redshift range 0.045 {<=} z < 0.78 in 8420 deg{sup 2} of the sky. We provide angular position, redshift, richness, core, and virial radii estimates for these clusters, as well as an error analysis for each of these quantities. We also provide a catalog of more than 205,000 galaxies representing the three brightest galaxies in the r band which are possible brightest cluster galaxy (BCG) candidates. We show basic properties of the BCG candidates and study how their luminosity scales in redshift and cluster richness. We compare our catalog with the maxBCG and GMBCG catalogs, as well as with that of Wen et al. We match between 30% and 50% of clusters between catalogs over all overlapping redshift ranges. We find that the percentage of matches increases with the richness for all catalogs. We cross match the AMF catalog with available X-ray data in the same area of the sky and find 539 matches, 119 of which with temperature measurements. We present scaling relations between optical and X-ray properties and cluster center comparison. We find that both {Lambda}{sub 200} and R{sub 200} correlate well with both L{sub X} and T{sub X} , with no significant difference in trend if we restrict the matches to flux-limited X-ray samples.

79 ASTRONOMY AND ASTROPHYSICS↗

Detection of the significant impact of source clustering on higher order statistics with DES Year 3 weak gravitational lensing data

We measure the impact of source galaxy clustering on higher order summary statistics of weak gravitational lensing data. By comparing simulated data with galaxies that either trace or do not trace the underlying density field, we show that this effect can exceed measurement uncertainties for common higher order statistics for certain analysis choices. We evaluate the impact on different weak lensing observables, finding that third moments and wavelet phase harmonics are more affected than peak count statistics. Using Dark Energy Survey (DES) Year 3 (Y3) data, we construct null tests for the source-clustering-free case, finding a p-value of p = 4 × 10 −3 (2.6σ) using third-order map moments and p = 3 × 10 −11 (6.5σ) using wavelet phase harmonics. The impact of source clustering on cosmological inference can be either included in the model or minimized through ad hoc procedures (e.g. scale cuts). We verify that the procedures adopted in existing DES Y3 cosmological analyses were sufficient to render this effect negligible. Failing to account for source clustering can significantly impact cosmological inference from higher order gravitational lensing statistics, e.g. higher order N-point functions, wavelet-moment observables, and deep learning or field-level summary statistics of weak lensing maps.

79 ASTRONOMY AND ASTROPHYSICS↗

Deep structural clustering for single-cell RNA-seq data jointly through autoencoder and graph neural network

Abstract Single-cell RNA sequencing (scRNA-seq) permits researchers to study the complex mechanisms of cell heterogeneity and diversity. Unsupervised clustering is of central importance for the analysis of the scRNA-seq data, as it can be used to identify putative cell types. However, due to noise impacts, high dimensionality and pervasive dropout events, clustering analysis of scRNA-seq data remains a computational challenge. Here, we propose a new deep structural clustering method for scRNA-seq data, named scDSC, which integrate the structural information into deep clustering of single cells. The proposed scDSC consists of a Zero-Inflated Negative Binomial (ZINB) model-based autoencoder, a graph neural network (GNN) module and a mutual-supervised module. To learn the data representation from the sparse and zero-inflated scRNA-seq data, we add a ZINB model to the basic autoencoder. The GNN module is introduced to capture the structural information among cells. By joining the ZINB-based autoencoder with the GNN module, the model transfers the data representation learned by autoencoder to the corresponding GNN layer. Furthermore, we adopt a mutual supervised strategy to unify these two different deep neural architectures and to guide the clustering task. Extensive experimental results on six real scRNA-seq datasets demonstrate that scDSC outperforms state-of-the-art methods in terms of clustering accuracy and scalability. Our method scDSC is implemented in Python using the Pytorch machine-learning library, and it is freely available at https://github.com/DHUDBlab/scDSC.

Gan, Yanglan↗