Search NASA⌕ Search

SEARCH · Search NASA

Results for “data clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Cosmological constraints from DES Y1 cluster abundances and SPT multiwavelength data

We perform a joint analysis of the counts of redMaPPer clusters selected from the Dark Energy Survey (DES) year 1 data and multiwavelength follow-up data collected within the 2500 deg2 South Pole Telescope (SPT) Sunyaev-Zel’dovich (SZ) survey. The SPT follow-up data, calibrating the richness-mass relation of the optically selected redMaPPer catalog, enable the cosmological exploitation of the DES cluster abundance data. To explore possible systematics related to the modeling of projection effects, we consider two calibrations of the observational scatter on richness estimates: a simple Gaussian model which account only for the background contamination (BKG), and a model which further includes contamination and incompleteness due to projection effects (PRJ). Assuming either a ΛCDM+∑mν or wCDM+∑mν cosmology, and for both scatter models, we derive cosmological constraints consistent with multiple cosmological probes of the low and high redshift Universe, and in particular with the SPT cluster abundance data. This result demonstrates that the DES Y1 and SPT cluster counts provide consistent cosmological constraints, if the same mass calibration data set is adopted. It thus supports the conclusion of the DES Y1 cluster cosmology analysis which interprets the tension observed with other cosmological probes in terms of systematics affecting the stacked weak lensing analysis of optically selected low–richness clusters. Finally, we analyze the first combined optically SZ selected cluster catalog obtained by including the SPT sample above the maximum redshift probed by the DES Y1 redMaPPer sample (z=0.65). Besides providing a mild improvement of the cosmological constraints, this data combination serves as a stricter test of our scatter models: the PRJ model, providing scaling relations consistent between the two abundance and multiwavelength follow-up data, is favored over the BKG model.

79 ASTRONOMY AND ASTROPHYSICS↗

Monitoring by Use of Clusters of Sensor-Data Vectors

The inductive monitoring system (IMS) is a system of computer hardware and software for automated monitoring of the performance, operational condition, physical integrity, and other aspects of the health of a complex engineering system (e.g., an industrial process line or a spacecraft). The input to the IMS consists of streams of digitized readings from sensors in the monitored system. The IMS determines the type and amount of any deviation of the monitored system from a nominal or normal ( healthy ) condition on the basis of a comparison between (1) vectors constructed from the incoming sensor data and (2) corresponding vectors in a database of nominal or normal behavior. The term inductive reflects the use of a process reminiscent of traditional mathematical induction to learn about normal operation and build the nominal-condition database. The IMS offers two major advantages over prior computational monitoring systems: The computational burden of the IMS is significantly smaller, and there is no need for abnormal-condition sensor data for training the IMS to recognize abnormal conditions. The figure schematically depicts the relationships among the computational processes effected by the IMS. Training sensor data are gathered during normal operation of the monitored system, detailed computational simulation of operation of the monitored system, or both. The training data are formed into vectors that are used to generate the database. The vectors in the database are clustered into regions that represent normal or nominal operation. Once the database has been generated, the IMS compares the vectors of incoming sensor data with vectors representative of the clusters. The monitored system is deemed to be operating normally or abnormally, depending on whether the vector of incoming sensor data is or is not, respectively, sufficiently close to one of the clusters. For this purpose, a distance between two vectors is calculated by a suitable metric (e.g., Euclidean distance) and "sufficiently close" signifies lying at a distance less than a specified threshold value. It must be emphasized that although the IMS is intended to detect off-nominal or abnormal performance or health, it is not necessarily capable of performing a thorough or detailed diagnosis. Limited diagnostic information may be available under some circumstances. For example, the distance of a vector of incoming sensor data from the nearest cluster could serve as an indication of the severity of a malfunction. The identity of the nearest cluster may be a clue as to the identity of the malfunctioning component or subsystem. It is possible to decrease the IMS computation time by use of a combination of cluster-indexing and -retrieval methods. For example, in one method, the distances between each cluster and two or more reference vectors can be used for the purpose of indexing and retrieval. The clusters are sorted into a list according to these distance values, typically in ascending order of distance. When a set of input data arrives and is to be tested, the data are first arranged as an ordered set (that is, a vector). The distances from the input vector to the reference points are computed. The search of clusters from the list can then be limited to those clusters lying within a certain distance range from the input vector; the computation time is reduced by not searching the clusters at a greater distance.

Iverson, David L.↗

Detection of CMB-Cluster Lensing using Polarization Data from SPTpol

Here, we report the first detection of gravitational lensing due to galaxy clusters using only the polarization of the cosmic microwave background (CMB). The lensing signal is obtained using a new estimator that extracts the lensing dipole signature from stacked images formed by rotating the cluster-centered Stokes QU map cutouts along the direction of the locally measured background CMB polarization gradient. Using data from the SPTpol 500 deg 2 survey at the locations of roughly 18 000 clusters with richness λ ≥ 10 from the Dark Energy Survey (DES) Year-3 full galaxy cluster catalog, we detect lensing at 4.8σ. The mean stacked mass of the selected sample is found to be (1.43 ± 0.40) × 10 14 M ⊙ which is in good agreement with optical weak lensing based estimates using DES data and CMB-lensing based estimates using SPTpol temperature data. This measurement is a key first step for cluster cosmology with future low-noise CMB surveys, like CMB-S4, for which CMB polarization will be the primary channel for cluster lensing measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

Probabilistic cluster labeling of imagery data

The problem of obtaining the probabilities of class labels for the clusters using spectral and spatial information from a given set of labeled patterns and their neighbors is considered. A relationship is developed between class and clusters conditional densities in terms of probabilities of class labels for the clusters. Expressions are presented for updating the a posteriori probabilities of the classes of a pixel using information from its local neighborhood. Fixed-point iteration schemes are developed for obtaining the optimal probabilities of class labels for the clusters. These schemes utilize spatial information and also the probabilities of label imperfections. Experimental results from the processing of remotely sensed multispectral scanner imagery data are presented.

Chittineni, C. B.↗

The ANI-1ccx and ANI-1x data sets, coupled-cluster and density functional theory properties for molecules

Abstract Maximum diversification of data is a central theme in building generalized and accurate machine learning (ML) models. In chemistry, ML has been used to develop models for predicting molecular properties, for example quantum mechanics (QM) calculated potential energy surfaces and atomic charge models. The ANI-1x and ANI-1ccx ML-based general-purpose potentials for organic molecules were developed through active learning; an automated data diversification process. Here, we describe the ANI-1x and ANI-1ccx data sets. To demonstrate data diversity, we visualize it with a dimensionality reduction scheme, and contrast against existing data sets. The ANI-1x data set contains multiple QM properties from 5 M density functional theory calculations, while the ANI-1ccx data set contains 500 k data points obtained with an accurate CCSD(T)/CBS extrapolation. Approximately 14 million CPU core-hours were expended to generate this data. Multiple QM calculated properties for the chemical elements C, H, N, and O are provided: energies, atomic forces, multipole moments, atomic charges, etc. We provide this data to the community to aid research and development of ML models for chemistry.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Data Science Techniques, Assumptions, and Challenges in Alloy Clustering and Property Prediction

Data analytics methods have been increasingly applied to understanding materials chemistry, processing due to the manufacturing approach, and uni-axial and cyclic property relationships in the highly complex space of alloy design. There are several benefits to applying data analytics to this space, including the ability to manage non-linearities in the responses of the alloy attributes and the resulting mechanical properties. However, key difficulties in applying and understanding the results of data analytics include the often lack of reported assumptions and data processing steps necessary to improve interpretation and reproducibility in derived results. In this work, the methods used to generate clustering and correlation analyses for experimental 9% Cr ferritic-martensitic steel data were investigated and the resulting implications for mechanical property predictions were assessed. This work uses principal component analysis, partitioning around medoids, t-SNE, and k-means clustering to investigate trends in composition, processing and microstructure information with creep and tensile properties, building on work done previously using a smaller version of the same dataset. The initial assumptions, preprocessing steps and methods are investigated and outlined in order to depict the fine level of detail required to convey the steps taken to process data and produce analytical results. Here, the variations in the resulting analyses are explored due to the influence of new and more varied data.

36 MATERIALS SCIENCE↗

Mapping of terrain by computer clustering techniques using multispectral scanner data and using color aerial film

Two clustering techniques were used for terrain mapping by computer of test sites in Yellowstone National Park. One test was made with multispectral scanner data using a composite technique which consists of (1) a strictly sequential statistical clustering which is a sequential variance analysis, and (2) a generalized K-means clustering. In this composite technique, the output of (1) is a first approximation of the cluster centers. This is the input to (2) which consists of steps to improve the determination of cluster centers by iterative procedures. Another test was made using the three emulsion layers of color-infrared aerial film as a three-band spectrometer. Relative film densities were analyzed using a simple clustering technique in three-color space. Important advantages of the clustering technique over conventional supervised computer programs are (1) human intervention, preparation time, and manipulation of data are reduced, (2) the computer map, gives unbiased indication of where best to select the reference ground control data, (3) use of easy to obtain inexpensive film, and (4) the geometric distortions can be easily rectified by simple standard photogrammetric techniques.

Smedes, H. W.↗

Fluorescence Color by Data-Driven Design of Genomic Silver Clusters

DNA nucleobase sequence controls the size of DNA-stabilized silver clusters, leading to their well-known yet little understood sequence-tuned colors. The enormous space of possible DNA sequences for templating clusters has challenged the understanding of how sequence selects cluster properties and has limited the design of applications that employ these clusters. Here, we investigate the genomic role of DNA sequence for fluorescent silver clusters using a data-driven approach. Employing rapid parallel silver cluster synthesis and fluorimetry, we determine the fluorescence spectra of silver cluster products stabilized by 1432 distinct DNA oligomers. By applying pattern recognition algorithms to this large experimental data set, we discover certain DNA base patterns, or “motifs,” that correlate to silver clusters with similar fluorescence spectra. These motifs are employed in machine learning classifiers to predictively design DNA template sequences for specific fluorescence color bands. Our method improves selectivity of templates by 330% for silver clusters with peak emission wavelengths beyond 660 nm. The discovered base motifs also provide physical insights into how DNA sequence controls silver cluster size and color. Finally, this predictive design approach for color of DNA-stabilized silver clusters exhibits the potential of machine learning and data mining to increase the precision and efficiency of nanomaterials design, even for a soft-matter-inorganic hybrid system characterized by an extremely large parameter space.

59 BASIC BIOLOGICAL SCIENCES↗

A Network-Based Algorithm for Clustering Multivariate Repeated Measures Data

The National Aeronautics and Space Administration (NASA) Astronaut Corps is a unique occupational cohort for which vast amounts of measures data have been collected repeatedly in research or operational studies pre-, in-, and post-flight, as well as during multiple clinical care visits. In exploratory analyses aimed at generating hypotheses regarding physiological changes associated with spaceflight exposure, such as impaired vision, it is of interest to identify anomalies and trends across these expansive datasets. Multivariate clustering algorithms for repeated measures data may help parse the data to identify homogeneous groups of astronauts that have higher risks for a particular physiological change. However, available clustering methods may not be able to accommodate the complex data structures found in NASA data, since the methods often rely on strict model assumptions, require equally-spaced and balanced assessment times, cannot accommodate missing data or differing time scales across variables, and cannot process continuous and discrete data simultaneously. To fill this gap, we propose a network-based, multivariate clustering algorithm for repeated measures data that can be tailored to fit various research settings. Using simulated data, we demonstrate how our method can be used to identify patterns in complex data structures found in practice.

Koslovsky, Matthew↗

The Virgo cluster redshift survey

A complete (99 percent) velocity survey is presented of the 471 galaxies brighter than m(pg) = 15.5 that are within the 6-deg radius of the central region of the Virgo cluster. There are 602 galaxies with measured velocities in the 6-deg circle, of which about 362 have the velocities lower than 3000 km/s and are assumed to be cluster members. From the velocity data, the cluster luminosity function was derived, and the mean Virgo velocity (for the Hubble constant and Virgo infall calculations) was calculated. In addition, the velocity data were used to study internal dynamics of the Virgo cluster.

Huchra, J. P.↗

On the clustering of multidimensional pictorial data

Obvious approaches to reducing the cost (in computer resources) of applying current clustering techniques to the problem of remote sensing are discussed. The use of spatial information in finding fields and in classifying mixture pixels is examined, and the AMOEBA clustering program is described. Internally, a pattern recognition program, from without, AMOEBA appears to be an unsupervised clustering program. It is fast and automatic. No choices (such as arbitrary thresholds to set split/combine sequences) need be made. The problem of finding the number of clusters is solved automatically. At the conclusion of the program, all points in the scene are classified; however, a provision is included for a reject classification of some points which, within the theoretical framework, cannot rationally be assigned to any cluster.

Bryant, J. D.↗

The joint far-infrared-optical luminosity function for spiral galaxies and data for the Abell 400 and Cancer clusters

Visual and IRAS data for an optically selected sample of 183 late-type galaxies are compiled in tables and graphs and analyzed in detail to determine the joint FIR-optical luminosity function Psi from the FIR/blue luminosity ratio, r = L(FIR)/L(B). It is found that Psi can be approximated by a function of a single variable psi(r-prime), where r-prime is defined as r times L(B)/L(asterisk) exp -delta, with L(asterisk) a constant and delta = about 0.08. A lognormal curve peaking at r-prime = 0.35 and with dispersion of 0.28 is shown to give a good fit to psi(r-prime). From a lack of galaxies with very low r-prime in the present sample it is inferred that there are few spiral galaxies with low interstellar-dust abundances. Also included are data on the distribution function of r-prime for the more distant clusters Abell 400 and Cancer.

Corbelli, Edvige↗

HUBBLE SPACE TELESCOPE PROPER MOTION (HSTPROMO) CATALOGS OF GALACTIC GLOBULAR CLUSTERS. I. SAMPLE SELECTION, DATA REDUCTION, AND NGC 7078 RESULTS

We present the first study of high-precision internal proper motions (PMs) in a large sample of globular clusters, based on Hubble Space Telescope (HST) data obtained over the past decade with the ACS/WFC, ACS/HRC, and WFC3/UVIS instruments. We determine PMs for over 1.3 million stars in the central regions of 22 clusters, with a median number of ∼60,000 stars per cluster. These PMs have the potential to significantly advance our understanding of the internal kinematics of globular clusters by extending past line-of-sight (LOS) velocity measurements to two- or three-dimensional velocities, lower stellar masses, and larger sample sizes. We describe the reduction pipeline that we developed to derive homogeneous PMs from the very heterogeneous archival data. We demonstrate the quality of the measurements through extensive Monte Carlo simulations. We also discuss the PM errors introduced by various systematic effects and the techniques that we have developed to correct or remove them to the extent possible. We provide in electronic form the catalog for NGC 7078 (M 15), which consists of 77,837 stars in the central 2.'4. We validate the catalog by comparison with existing PM measurements and LOS velocities and use it to study the dependence of the velocity dispersion on radius, stellar magnitude (or mass) along the main sequence, and direction in the plane of the sky (radial or tangential). Subsequent papers in this series will explore a range of applications in globular-cluster science and will also present the PM catalogs for the other sample clusters.

79 ASTRONOMY AND ASTROPHYSICS↗

SITCOMTN-161: PSF assessment in the field of Abell 360 and shapeHSM shear profile using LSSTComCam data

The Rubin LSSTComCam on-sky campaign performed at the end of 2024 provided observations of the Abell 360 galaxy cluster; these data allow a preliminary study of cluster weak lensing analysis using Rubin Data Preview 1 (DP1) data. Among all the steps required for such analyses, accurate modeling of the PSF is essential. This work uses several diagnostics, mostly based on the residuals between the second moments of stars and the PSF model, to characterize the accuracy of the PSF modeling in the A360 field. We find the level of the residuals to be sufficiently low not to hinder the measurement of the tangential shear profile around A360. With a simple source selection process, we demonstrate that outputs of the LSST Science Pipelines can be used to detect the tangential shear profile in Abell 360 at the 3.6σ level, and our analysis indicates that contamination from PSF modeling systematics is negligible.

Dell'Antonio, Ian [Brown University]↗

Fast mass spectrometry search and clustering of untargeted metabolomics data

The throughput of mass spectrometers and the amount of publicly available metabolomics data are growing rapidly, but analysis tools such as molecular networking and Mass Spectrometry Search Tool do not scale to searching and clustering billions of mass spectral data in metabolomics repositories. To address this limitation, we designed MASST+ and Networking+, which can process datasets that are up to three orders of magnitude larger than those processed by state-of-the-art tools.

59 BASIC BIOLOGICAL SCIENCES↗

GD-1: The Relic of an Old Metal-poor Globular Cluster

Combining data from Gaia DR2, SDSS DR14 and LAMOST DR6, we update the fit tomodel of the properties of the stellar stream GD-1 and find that it has an ageof $\sim 13$ Gyr, [Fe/H] of $-2.2\pm 0.12$, and a distance from the sun of $\sim 8$ kpc. We tabulate 6D phase-space fiducial points along the GD-1 streamorbit over a 90$^\circ$ arc. The fitted orbit shows that the stream has aneccentricity $e \sim 0.3$, perigalacticon of 14.2 kpc, apogalacticon of 27.0 kpc and inclination $i \sim 40^{\circ}$. There is evidence along the arc for 4candidate stellar overdensities, one candidate gap, two candidate stellarunderdensities and is cut off at $\phi_1 \sim 2^{\circ}$ (in the stream-aligned$(\phi_1,\phi_2)$ coordinate system. The spur originating at $\phi_1 \sim -40^{\circ}$ implies stars were pulled away from the stream traceby an encounter (potentially a dark matter subhalo). The narrowest place ( FWHM$\sim 44.6$ pc) of the GD-1 trace is at $(\phi_1, \phi_2^c) \sim (-14^{\circ},0.15^{\circ})$, which is $\sim (178.18^{\circ}, 52.19^{\circ})$ in (R. A.,Decl.), where the progenitor is possibly located. In conclusion, we also find six BHB and 10BS spectroscopic stars in the GD-1 stream.

79 ASTRONOMY AND ASTROPHYSICS↗