Search NASA⌕ Search

SEARCH · Search NASA

Results for “data clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

Utah FORGE: Seismic DAS and Geophone Borehole Data Processing and 3D Imaging of Vp/Vs Ratio in the 2024 Stimulated Reservoir

This dataset includes a final report and a 3D velocity model derived from seismic DAS and geophone borehole data collected during the April 2024 stimulation of the reservoir at Utah FORGE. The report details the processing of over 50,000 P- and S-wave travel times used in a tomographic inversion to estimate the Vp/Vs ratio, revealing anomalies adjacent to wells 16A and 16B that may be associated with injected fracturing fluids. Additionally, Wadati analysis of more than 27,000 pairs of differential P- and S-wave travel times supports this interpretation with a high Vp/Vs estimate of 1.86, averaged over the dimensions of the earthquake cluster. The accompanying data file provides a 3D model of P- and S-wave velocities and Vp/Vs ratios, structured with spatial coordinates and velocity values.

15 GEOTHERMAL ENERGY↗

A Novel Data Segmentation Method for Data-driven Phase Identification

This paper presents a smart meter phase identification algorithm for two cases: meter-phase-label-known and meter-phase-label-unknown. To improve the identification accuracy, a data segmentation method is proposed to exclude data segments that are collected when the voltage correlation between smart meters on the same phase is weakened. Then, using the selected data segments, a hierarchical clustering method is used to calculate the correlation distances and cluster the smart meters. If the phase labels are unknown, a Connected-Triple-based Similarity (CTS) method is adapted to further improve the phase identification accuracy of the ensemble clustering method. The methods are developed and tested on both synthetic and real feeder data sets. Here, simulation results show that the proposed phase identification algorithm outperforms the state-of-the-art methods in both accuracy and robustness.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Ruprecht 147: A Paradigm of Dissolving Star Cluster

We employed recent Gaia/DR2 data to investigate the dynamical status of the nearby (300 pc), old (2.5 Gyr) open cluster Ruprecht 147. We found prominent leading and trailing tails of stars along the cluster orbit, which demonstrates that Ruprecht 147 is losing stars at fast pace. Star counts indicate the cluster has a core radius of 33.3 arcmin and a tidal radius of 137.5 arcmin. The cluster also possesses an extended corona, which cannot be reproduced by a simple King model. We computed the present-day cluster mass using its luminosity and mass function, and derived an estimate of 234 ± 52 M {sub ⊙}. We also estimated the cluster original mass using available recipes extracted from N-body simulations obtaining a mass at birth of 50,000 ± 6500 M {sub ⊙}. Therefore dynamical mass loss, mostly caused by tidal interaction with the Milky Way, reduced the cluster mass by about 99%. We then conclude that Ruprecht 147 is rapidly dissolving into the general Galactic disk.

79 ASTRONOMY AND ASTROPHYSICS↗

POSSIBLE SUBGROUPS OF GLOBULAR CLUSTERS AND PLANETARY NEBULAE IN NGC 5128

We use recently compiled position and velocity data for the globular cluster and planetary nebula subsystems in NGC 5128, the nearby giant elliptical, to search for evidence of past dwarf-satellite accretion events. Beyond a 10' ({approx}11 kpc) radius in galactocentric distance, we find tentative evidence for four subgroups of globular clusters and four subgroups of planetary nebulae. These each have more than four members within a search radius of 2' and internal velocity dispersion of {approx}<40 km s{sup -1}, typical parameters for a dwarf galaxy. In addition, two of the globular cluster groupings overlap with two of the planetary nebulae groupings, and two subgroupings also appear to overlap with previously known arc and shell features in the halo light. Simulation tests of our procedure indicate that the probability of finding false groups due to chance is <1%.

79 ASTRONOMY AND ASTROPHYSICS↗

RESOLVING THE COSMIC FAR-INFRARED BACKGROUND AT 450 AND 850 μm WITH SCUBA-2

We use the SCUBA-2 submillimeter camera mounted on the James Clerk Maxwell Telescope to obtain extremely deep number counts at 450 and 850 μm. We combine data on two cluster lensing fields, A1689 and A370, and three blank fields, CDF-N, CDF-S, and COSMOS, to measure the counts over a wide flux range at each wavelength. We use statistical fits to broken power law representations to determine the number counts. This allows us to probe to the deepest possible level in the data. At both wavelengths our results agree well with the literature in the flux range over which they have been measured, with the exception of the 850 μm counts in CDF-S, where we do not observe the counts deficit found by previous single-dish observations. At 450 μm, we detect significant counts down to ∼1 mJy, an unprecedented depth at this wavelength. By integrating the number counts above this flux limit, we measure 113.9{sup +49.7}{sub -28.4} Jy deg{sup –2} of the 450 μm extragalactic background light (EBL). The majority of this contribution is from sources with S{sub 450{sub μm}} between 1-10 mJy, and these sources are likely to be the ones that are analogous to the local luminous infrared galaxies. At 850 μm, we measure 37.3{sup +21.1}{sub -12.9} Jy deg{sup –2} of the EBL. Because of the large systematic uncertainties on the COBE measurements, the percentage of the EBL we resolve could range from 48%-153% (44%-178%) at 450 (850) μm. Based on high-resolution Submillimeter Array observations of around half of the 4 σ 850 μm sample in CDF-N, we find that 12.5{sup +12.1}{sub -6.8}% of the sources are blends of multiple fainter sources. This is a low multiple fraction, and we find no significant difference between our original SCUBA-2 850 μm counts and the multiplicity-corrected counts.

79 ASTRONOMY AND ASTROPHYSICS↗

Online anomaly detection for multi‐source VMware using a distributed streaming framework

Summary Anomaly detection refers to the identification of patterns in a dataset that do not conform to expected patterns. Such non‐conformant patterns typically correspond to samples of interest and are assigned to different labels in different domains, such as outliers, anomalies, exceptions, and malware. A daunting challenge is to detect anomalies in rapid voluminous streams of data. This paper presents a novel, generic real‐time distributed anomaly detection framework for multi‐source stream data. As a case study, we investigate anomaly detection for a multi‐source VMware‐based cloud data center, which maintains a large number of virtual machines (VMs). This framework continuously monitors VMware performance stream data related to CPU statistics (e.g., load and usage). It collects data simultaneously from all of the VMs connected to the network and notifies the resource manager to reschedule its CPU resources dynamically when it identifies any abnormal behavior from its collected data. A semi‐supervised clustering technique is used to build a model from benign training data only. During testing, if a data instance deviates significantly from the model, then it is flagged as an anomaly. Effective anomaly detection in this case demands a distributed framework with high throughput and low latency. Distributed streaming frameworks like Apache Storm, Apache Spark, S4, and others are designed for a lower data processing time and a higher throughput than standard centralized frameworks. We have experimentally compared the average processing latency of a tuple during clustering and prediction in both Spark and Storm and demonstrated that Spark processes a tuple much quicker than storm on average. Copyright © 2016 John Wiley & Sons, Ltd.

Solaimani, Mohiuddin↗

The metal abundance and specific energy of intracluster gas

The hot gas in the cores of rich galaxy clusters is metal-rich with nearly solar abundances of metals. It is not clear whether the metals were shed from galaxies via protogalactic winds or via ram-pressure stripping. It has been suggested that if metals were injected via centrally concentrated stripping, the overall abundances could be much less than those observed in cluster cores, diminishing the degree of stellar processing required. The observed energetics of intracluster gas can be used to deduce the metal injection mechanism, which in turn may allow the global metal abundance uncertainty to be resolved in the absence of spatially resolved X-ray spectra. Existing X-ray spectral and surface brightness data for galaxy clusters indicate that the gas in cool clusters has substantially greater specific energy than could have been gained through cluster collapse. Supernovae-driven protogalactic winds can provide this extra energy, while ram-pressure stripping cannot. Such protogalactic winds will distribute metals fairly homogeneously. Much processing of gas through stars is then required, with protogalaxies losing perhaps one-half of their initial luminous mass in metal-rich winds. Furthermore, the oxygen-to-iron ratio observed in two clusters indicates that the bulk of the iron in cluster gas was produced by Type II supernovae, not Type I supernovae, as is usually supposed.

White, Raymond E., III↗

Cluster observations of quasi-periodic impulsive signatures in the dayside northern lobe: High-latitude flux transfer events?

We report on a series of quasi-periodic reversals in GSM B(sub Z) observed by the four Cluster spacecraft in the northern dayside lobe poleward of the cusp on 23 February 2001. During an interval of about 35 min, multiple reversals (negative to positive) in B(sub Z) of approximately 1-min duration with an approximate 8-min recurrence time were observed. The individual structures do not resemble low-latitude flux transfer events (FTE) [Russell and Elphic, 1979] but the 8-min recurrence frequency suggests that intermittent reconnection may be occurring .Measurements (appropriately lagged) of the solar wind at ACE show that the IMF was southward-oriented with a strong B(sub X) and that a modest dynamic pressure increased as the events started. The multi-point observations afforded by the Cluster spacecraft were used to infer the motion (direction and speed) of the observed magnetic field reversals. The associated currents were also calculated and they are consistent with the spatial confinement of the observed magnetic field reversals. We propose that the observed reversals are due to flux tubes reconnecting with closed field lines on the dayside. Ancillary data from the Cluster Ion Spectrometry (CIS) and Plasma Electron And Current Experiment (PEACE) instruments were used to develop a physical picture of the reversals.

Thompson, S. M.↗

An Automatic Learning Framework for Smart Residential Communities

Predictability has been foundational to matching supply and demand in the day-to-day operation of the electric power system. Demand predictability is eroding because of the increased use of renewable energy resources and more sophisticated loads, such as electric vehicles and smart appliances. In this paper, an automatic software framework is described which can be used for load forecasting in smart communities. A time-varying clustering-based Markov chain approach is used to predict the energy consumption of residential buildings in a smart community. The training data is based on 1-minute meter data of occupied homes over one month. The data points are first clustered based on the energy consumption and the time of the day. Then, the original data is converted using the Centroids of the clusters. A time-varying Markov chain is subsequently trained to model the energy consumption behavior of residents for each home using the transformed data. The trained model is shown to successfully predict load in 5-minute intervals over a 24 hours period.

Zandi, Helia↗

dCache: Inter-disciplinary storage system

The dCache project provides open-source software deployed internationally to satisfy ever more demanding storage requirements. Its multifaceted approach provides an integrated way of supporting different use-cases with the same storage, from high throughput data ingest, data sharing over wide area networks, efficient access from HPC clusters and long term data persistence on a tertiary storage. Though it was originally developed for the HEP experiments, today it is used by various scientific communities, including astrophysics, biomed, life science, which have their specific requirements. In this paper we describe some of the new requirements as well as demonstrate how dCache developers are addressing them.

Mkrtchyan, Tigran↗

Genome Wide DNA Copy Number Analysis of Serous Type Ovarian Carcinomas Identifies Genetic Markers Predictive of Clinical Outcome

Ovarian cancer is the fifth leading cause of cancer death in women. Ovarian cancers display a high degree of complex genetic alterations involving many oncogenes and tumor suppressor genes. Analysis of the association between genetic alterations and clinical endpoints such as survival will lead to improved patient management via genetic stratification of patients into clinically relevant subgroups. In this study, we aim to define subgroups of high-grade serous ovarian carcinomas that differ with respect to prognosis and overall survival. Genome-wide DNA copy number alterations (CNAs) were measured in 72 clinically annotated, high-grade serous tumors using high-resolution oligonucleotide arrays. Two clinically annotated, independent cohorts were used for validation. Unsupervised hierarchical clustering of copy number data derived from the 72 patient cohort resulted in two clusters with significant difference in progression free survival (PFS) and a marginal difference in overall survival (OS). GISTIC analysis of the two clusters identified altered regions unique to each cluster. Supervised clustering of two independent large cohorts of high-grade serous tumors using the classification scheme derived from the two initial clusters validated our results and identified 8 genomic regions that are distinctly different among the subgroups. These 8 regions map to 8p21.3, 8p23.2, 12p12.1, 17p11.2, 17p12, 19q12, 20q11.21 and 20q13.12; and harbor potential oncogenes and tumor suppressor genes that are likely to be involved in the pathogenesis of ovarian carcinoma. We have identified a set of genetic alterations that could be used for stratification of high-grade serous tumors into clinically relevant treatment subgroups.

59 BASIC BIOLOGICAL SCIENCES↗

Using Statistical Multivariable Models to Understand the Relationship Between Interplanetary Coronal Mass Ejecta and Magnetic Flux Ropes

In-situ measurements of interplanetary coronal mass ejections (ICMEs) display a wide range of properties. A distinct subset, "magnetic clouds" (MCs), are readily identifiable by a smooth rotation in an enhanced magnetic field, together with an unusually low solar wind proton temperature. In this study, we analyze Ulysses spacecraft measurements to systematically investigate five possible explanations for why some ICMEs are observed to be MCs and others are not: i) An observational selection effect; that is, all ICMEs do in fact contain MCs, but the trajectory of the spacecraft through the ICME determines whether the MC is actually encountered; ii) interactions of an erupting flux rope (PR) with itself or between neighboring FRs, which produce complex structures in which the coherent magnetic structure has been destroyed; iii) an evolutionary process, such as relaxation to a low plasma-beta state that leads to the formation of an MC; iv) the existence of two (or more) intrinsic initiation mechanisms, some of which produce MCs and some that do not; or v) MCs are just an easily identifiable limit in an otherwise corntinuous spectrum of structures. We apply quantitative statistical models to assess these ideas. In particular, we use the Akaike information criterion (AIC) to rank the candidate models and a Gaussian mixture model (GMM) to uncover any intrinsic clustering of the data. Using a logistic regression, we find that plasma-beta, CME width, and the ratio O(sup 7) / O(sup 6) are the most significant predictor variables for the presence of an MC. Moreover, the propensity for an event to be identified as an MC decreases with heliocentric distance. These results tend to refute ideas ii) and iii). GMM clustering analysis further identifies three distinct groups of ICMEs; two of which match (at the 86% level) with events independently identified as MCs, and a third that matches with non-MCs (68 % overlap), Thus, idea v) is not supported. Choosing between ideas i) and iv) is more challenging, since they may effectively be indistinguishable from one another by a single in-situ spacecraft. We offer some suggestions on how future studies may address this.

Riley, P.↗

Hypergraph Random Walks, Laplacians, and Clustering

We propose a flexible framework for clustering hypergraph-structured data based on recently proposed random walks utilizing edge-dependent vertex weights. When incorporating edge-dependent vertex weights (EDVW), a weight is associated with each vertex-hyperedge pair, yielding a weighted incidence matrix of the hypergraph. Such weightings have been utilized in term-document representations of text data sets. We explain how random walks with EDVW serve to construct different hypergraph Laplacian matrices, and then develop a suite of clustering methods that use these incidence matrices and Laplacians for hypergraph clustering. Using 20Newsgroup, U.S. patent, Reuters' Corpus Volume 1, and genetics data sets, we compare the performance of these clustering algorithms experimentally against a variety of existing hypergraph clustering methods. We show that the proposed methods produce higher-quality clusters.

hypergraphs, clustering, laplacian, random walk, M↗

Dark Energy Survey Year 3 Results: Cosmological Constraints from Cluster Abundances, Weak Lensing, and Galaxy Clustering

Galaxy clusters provide a unique probe of the late-time cosmic structure and serve as a powerful independent test of the $\Lambda$CDM model. This work presents the first set of cosmological constraints derived with ~16,000 optically selected redMaPPer clusters across nearly 5,000 $\rm{deg}^2$ using DES Year 3 data sets. Our analysis leverages a consistent modeling framework for galaxy cluster cosmology and DES-Y3 joint analyses of galaxy clustering and weak lensing (3x2pt), ensuring direct comparability with the DES-Y3 3x2pt analysis. We obtain constraints of $S_8 = 0.864 \pm 0.035$ and $\Omega_{\rm{m}} = 0.265^{+0.019}_{-0.031}$ from the cluster-based data vector. We find that cluster constraints and 3x2pt constraints are consistent under the $\Lambda$CDM model with a Posterior Predictive Distribution (PPD) value of $0.53$. The consistency between clusters and 3x2pt provides a stringent test of $\Lambda$CDM across different mass and spatial scales. Jointly analyzing clusters with 3x2pt further improves cosmological constraints, yielding $S_8 = 0.811^{+0.022}_{-0.020}$ and $\Omega_{\rm{m}} = 0.294^{+0.022}_{-0.033}$, a $24\%$ improvement in the $\Omega_{\rm{m}}-S_8$ figure-of-merit over 3x2pt alone. Moreover, we find no significant deviation from the Planck CMB constraints with a probability to exceed (PTE) value of $0.6$, significantly reducing previous $S_8$ tension claims. Finally, combining DES 3x2pt, DES clusters, and Planck CMB places an upper limit on the sum of neutrino masses of $\sum m_\nu < 0.26$ eV at 95% confidence under the $\Lambda$CDM model. These results establish optically selected clusters as a key cosmological probe and pave the way for cluster-based analyses in upcoming Stage-IV surveys such as LSST, Euclid, and Roman.

79 ASTRONOMY AND ASTROPHYSICS↗

Large-Scale Multi-Dimensional Document Clustering on GPU Clusters

Document clustering plays an important role in data mining systems. Recently, a flocking-based document clustering algorithm has been proposed to solve the problem through simulation resembling the flocking behavior of birds in nature. This method is superior to other clustering algorithms, including k-means, in the sense that the outcome is not sensitive to the initial state. One limitation of this approach is that the algorithmic complexity is inherently quadratic in the number of documents. As a result, execution time becomes a bottleneck with large number of documents. In this paper, we assess the benefits of exploiting the computational power of Beowulf-like clusters equipped with contemporary Graphics Processing Units (GPUs) as a means to significantly reduce the runtime of flocking-based document clustering. Our framework scales up to over one million documents processed simultaneously in a sixteennode GPU cluster. Results are also compared to a four-node cluster with higher-end GPUs. On these clusters, we observe 30X-50X speedups, which demonstrates the potential of GPU clusters to efficiently solve massive data mining problems. Such speedups combined with the scalability potential and accelerator-based parallelization are unique in the domain of document-based data mining, to the best of our knowledge.

99 GENERAL AND MISCELLANEOUS↗