Search NASA⌕ Search

SEARCH · Search NASA

Results for “data clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Evaluation of Clouds, Radiation, and Precipitation in CMIP6 Models Using Global Weather States Derived from ISCCP-H Cloud Property Data

A clustering methodology is applied to cloud optical depth cloud top pressure (TAU-PC) histograms from the new, 1-degree resolution, ISCCP-H dataset, to derive an updated global Weather State (WS) dataset. Then, PC-TAU histograms from current-climate CMIP6 model simulations are assigned to the ISCCP-H WSs along with their concurrent radiation and precipitation properties, to evaluate model cloud, radiation, and precipitation properties in the context of the Weather States. The new ISCCP-H analysis produces WSs that are very similar to those previously found in the lower resolution ISCCP-D dataset. The main difference lies in the splitting of the ISCCP-D thin stratocumulus WS between the ISCCP-H shallow cumulus and stratocumulus WSs, which results in the reduction by one of the total WS number. The evaluation of the CMIP6 models against the ISCCP-H Weather States, shows that, in the ensemble mean, the models are producing an adequate representation of the frequency and geographical distribution of the WSs, with measurable improvements compared to the WSs derived for the CMIP5 ensemble. However, the frequency of shallow cumulus clouds continues to be underestimated, and, in some WSs the good agreement of the ensemble mean with observations comes from averaging models that significantly overpredict and underpredict the ISCCP-H WS frequency. In addition, significant biases exist in the internal cloud properties of the model WSs, such as the model underestimation of cloud fraction in middle-top clouds and secondarily in midlatitude storm and stratocumulus clouds, that result in an underestimation of cloud SW cooling in those regimes.

Clouds↗

The XMM Cluster Survey analysis of the SDSS DR8 redMaPPer catalogue: implications for scatter, selection bias, and isotropy in cluster scaling relations

ABSTRACT In this paper, we present the X-ray analysis of Sloan Digital Sky Survey DR8 redMaPPer (SDSSRM) clusters using data products from the XMM Cluster Survey (XCS). In total, 1189 SDSSRM clusters fall within the XMM–Newton footprint. This has yielded 456 confirmed detections accompanied by X-ray luminosity (LX) measurements. Of these clusters, 381 have an associated X-ray temperature measurement (TX). This represents one of the largest samples of coherently derived cluster TX values to date. Our analysis of the X-ray observable to richness scaling relations has demonstrated that scatter in the TX–λ relation is roughly a third of that in the LX–λ relation, and that the LX–λ scatter is intrinsic, i.e. will not be significantly reduced with larger sample sizes. Analysis of the scaling relation between LX and TX has shown that the fits are sensitive to the selection method of the sample, i.e. whether the sample is made up of clusters detected ‘serendipitously’ compared to those deliberately targeted by XMM. These differences are also seen in the LX–λ relation and, to a lesser extent, in the TX–λ relation. Exclusion of the emission from the cluster core does not make a significant impact on the findings. A combination of selection biases is a likely, but yet unproven, reason for these differences. Finally, we have also used our data to probe recent claims of anisotropy in the LX–TX relation across the sky. We find no evidence of anistropy, but stress this may be masked in our analysis by the incomplete declination coverage of the SDSS.

79 ASTRONOMY AND ASTROPHYSICS↗

Cold dark energy constraints from the abundance of galaxy clusters

We constrain cold dark energy of negligible sound speed using galaxy cluster abundance observations. In contrast to standard quasi-homogeneous dark energy, negligible sound speed implies clustering of the dark energy fluid at all scales, allowing us to measure the effects of dark energy perturbations at cluster scales. We compare those models and set the stage for using non-linear information from semi-analytical modelling in cluster growth data analyses. For this, we recalibrate the halo mass function with non-linear characteristic quantities, the spherical collapse threshold and virial overdensity, that account for model and redshift-dependent behaviours, as well as an additional mass contribution for cold dark energy. Here in this paper, we present the first constraints from this cold dark matter plus cold dark energy mass function using our cluster abundance likelihood, which self-consistently accounts for selection effects, covariances and systematic uncertainties. We combine cluster growth data with cosmic microwave background, supernovae Ia and baryon acoustic oscillation data, and find a shift between cold versus quasi-homogeneous dark energy of up to 1σ. We make a Fisher matrix forecast of constraints attainable with cluster growth data from the ongoing Dark Energy Survey (DES). For DES, we predict ~ 50 percent tighter constraints on (Ωm, w) for cold dark energy versus wCDM models, with the same free parameters. Overall, we show that cluster abundance analyses are sensitive to cold dark energy, an alternative, viable model that should be routinely investigated alongside the standard dark energy scenario.

79 ASTRONOMY AND ASTROPHYSICS↗

Distance Metrics and Clustering Methods for Mixed-type Data

In spite of the abundance of clustering techniques and algorithms, clustering mixed interval (continuous) and categorical (nominal and/or ordinal) scale data remain a challenging problem. In order to identify the most effective approaches for clustering mixed–type data, we use both theoretical and empirical analyses to present a critical review of the strengths and weaknesses of the methods identified in the literature. Here, the guidelines on approaches to use under different scenarios are provided, along with potential directions for future research.

97 MATHEMATICS AND COMPUTING↗

Search for gamma-ray emission from the Coma cluster with six years of Fermi-LAT data

We present results from γ-ray observations of the Coma cluster incorporating six years of Fermi-LAT data and the newly released “Pass 8” event-level analysis. Our analysis of the region reveals low-significance residual structures within the virial radius of the cluster that are too faint for a detailed investigation with the current data. Using a likelihood approach that is free of assumptions on the spectral shape we derive upper limits on the γ-ray flux that is expected from energetic particle interactions in the cluster. We also consider a benchmark spatial and spectral template motivated by models in which the observed radio halo is mostly emission by secondary electrons. In this case, the median expected and observed upper limits for the flux above 100 MeV are 1.7 × 10{sup −9} ph cm{sup −2} s{sup −1} and 5.2 × 10{sup −9} ph cm{sup −2} s{sup −1} respectively (the latter corresponds to residual emission at the level of 1.8σ). These bounds are comparable to or higher than predicted levels of hadronic gamma-ray emission in cosmic-ray (CR) models with or without reacceleration of secondary electrons, although direct comparisons are sensitive to assumptions regarding the origin and propagation mode of CRs and magnetic field properties. The minimal expected γ-ray flux from radio and star-forming galaxies within the Coma cluster is roughly an order of magnitude below the median sensitivity of our analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

Individual Data Sparsity in Smart Thermostat Big Data: Impacts on Modeling Thermostat Use Behavior Dynamics

This study explores the impacts of the sparsity of individual thermostat interaction data on modeling thermostat use behavior dynamics using a dataset of over 100,000 smart thermostats. In developing a data-driven model of Thermal Frustration Theory (TFT), we investigate the challenges and trade-offs in clustering occupant data to enhance predictive accuracy. Our findings reveal that a single, aggregated model fails to capture the diversity of occupant behaviors, resulting in extremely poor prediction performance. Conversely, excessive clustering exacerbates data sparsity, undermining model reliability. By identifying an optimal clustering strategy, we achieve a balance that significantly improves the prediction of manual setpoint changes during demand response (DR) events, enhancing energy management and occupant comfort

Fannon, David↗

Cosmological Constraints from Sunyaev-Zeldovich Effect and X-ray data for 37 Galaxy Clusters

We present a sample of 37 clusters of galaxies (0.14<=z<=0.89) for which we have Sunyaev-Zeldovich Effect data and Chandra X-ray imaging and spectroscopy. We use a Markov chain Monte Carlo technique to determine the spatial properties and surface brightness of the X-ray emitting gas, the X-ray temperature and abundance, and the SZE decrement for each cluster. From these observables, we infer each cluster's total mass, gas mass fraction, and angular diameter distance. The sample properties are used to constrain the Hubble parameter and Omega Matter, and scaling relations between integrated SZE flux and cluster mass and temperature are constructed. We also investigate the cosmological constraints that could be obtained if the X-ray/SZE sample were extended to a redshift of z approximately 2.

Bonamente, Massimiliano↗

Hierarchical Spatio-temporal Visual Analysis of Cluster Evolution in Electrocorticography Data

Here, we present ECoG ClusterFlow, a novel interactive visual analysis tool for the exploration of high-resolution Electrocorticography (ECoG) data. Our system detects and visualizes dynamic high-level structures, such as communities, using the time-varying spatial connectivity network derived from the high-resolution ECoG data. ECoG ClusterFlow provides a multi-scale visualization of the spatio-temporal patterns underlying the time-varying communities using two views: 1) an overview summarizing the evolution of clusters over time and 2) a hierarchical glyph-based technique that uses data aggregation and small multiples techniques to visualize the propagation of clusters in their spatial domain. ECoG ClusterFlow makes it possible 1) to compare the spatio-temporal evolution patterns across various time intervals, 2) to compare the temporal information at varying levels of granularity, and 3) to investigate the evolution of spatial patterns without occluding the spatial context information. Lastly, we present case studies done in collaboration with neuroscientists on our team for both simulated and real epileptic seizure data aimed at evaluating the effectiveness of our approach.

60 APPLIED LIFE SCIENCES↗

Dark energy survey year 3 results: Cosmological constraints from cluster abundances, weak lensing, and galaxy clustering

Galaxy clusters provide a unique probe of the late-time cosmic structure and serve as a powerful independent test of the Λ⁢CDM model. This work presents the first set of cosmological constraints derived with ∼16,000 optically selected redMaPPer clusters across nearly 5000 deg 2 using DES year 3 datasets. Our analysis leverages a consistent modeling framework for galaxy cluster cosmology and DES-Y3 joint analyses of galaxy clustering and weak lensing (3 × 2⁢pt), ensuring direct comparability with the DES-Y3 3 × 2⁢pt analysis. Here, we obtain constraints of 𝑆 8 = 0.864 ± 0.035 and Ω m = $0.26⁢5^{+0.019}_{−0.031}$ from the cluster-based data vector. We find that cluster constraints and 3 × 2⁢pt constraints are consistent under the Λ⁢CDM model with a posterior predictive distribution (PPD) value of 0.53. The consistency between clusters and 3 × 2⁢pt provides a stringent test of Λ⁢CDM across different mass and spatial scales. Jointly analyzing clusters with 3 × 2⁢pt further improves cosmological constraints, yielding 𝑆 8 = $0.81⁢1^{+0.022}_{−0.020}$ and Ω m = $0.29⁢4^{+0.022}_{−0.033}$, a 24% improvement in the Ω m − 𝑆 8 figure of merit over 3 × 2⁢pt alone. Moreover, we find no significant deviation from the Planck CMB constraints with a probability to exceed (PTE) value of 0.6, significantly reducing previous 𝑆 8 tension claims. Finally, combining DES 3 × 2⁢pt, DES clusters, and Planck CMB places an upper limit on the sum of neutrino masses of ∑𝑚 𝜈 < 0.26 eV at 95% confidence under the Λ⁢CDM model. These results establish optically selected clusters as a key cosmological probe and pave the way for cluster-based analyses in upcoming stage-IV surveys such as LSST, Euclid, and Roman.

Abbott, T. M. C. [NSF’s National Optical-Infrared ↗

Nanopore Sequencing-Based Microbial Air Profiling Method for Crewed Spacecraft

Microbial monitoring of the International Space Station (ISS) atmosphere is vital to maintaining the health of the spacecraft and crew. Key to NASA’s microbial risk assessment is the identity of contaminating microorganisms in the environment. Historically, this has been achieved through impaction-based air sampling followed by culture. Identification of the microorganisms present requires sample return to Earth and lab-based analyses. While this culture-based approach has served to provide alerts to anomalies and overall confidence in the controls in place, it is not suitable for exploration missions with no sample return. Recently, significant advancements in molecular-based microbial monitoring via nanopore sequencing have been implemented onboard the ISS. Building on this work, multiple commercially available air samplers, compatible with downstream molecular analysis, were evaluated for use in the spaceflight environment. Through this assessment, the Coriolis Compact (Bertin Technologies), which uses cyclonic technology to collect bioaerosols onto the surface of a sterile cone, was selected for a larger-scale comparison to the current culture-based monitoring method. Using the Coriolis Compact, 1000 L of air was collected from the breakroom of an office building and a fitness center. The buffer used to dissociate the microbial cells from the surface of the cone was split between the NASA Microbiology Laboratory’s standard culture and Sanger sequencing-based method and the culture-independent nanopore sequencing method. The bacteria identified through culture were present in the nanopore data, with Micrococcus, Staphylococcus, and Moraxella being the most common cultured isolates, which is expected based on the media and growth conditions. Not surprisingly, the nanopore data yielded much higher diversity and paralleled that of previous atmospheric microbiome studies of human-occupied built environments. As compared to the culture-based data where the breakroom and fitness center data sets cluster in proximity, the nanopore data depicts the contrast of these atmospheric microbiomes. Moreover, the nanopore data were sufficient to meet NASA’s risk assessment needs and noted the culturable isolates routinely observed. This nanopore-based atmospheric microbial profiling method will enable near real-time environmental monitoring of crewed spacecraft as future missions extend beyond low-Earth orbit.

Brandon Dunbar↗

A Dissimilarity Measure for Clustering High- and Infinite Dimensional Data that Satisfies the Triangle Inequality

The cosine or correlation measures of similarity used to cluster high dimensional data are interpreted as projections, and the orthogonal components are used to define a complementary dissimilarity measure to form a similarity-dissimilarity measure pair. Using a geometrical approach, a number of properties of this pair is established. This approach is also extended to general inner-product spaces of any dimension. These properties include the triangle inequality for the defined dissimilarity measure, error estimates for the triangle inequality and bounds on both measures that can be obtained with a few floating-point operations from previously computed values of the measures. The bounds and error estimates for the similarity and dissimilarity measures can be used to reduce the computational complexity of clustering algorithms and enhance their scalability, and the triangle inequality allows the design of clustering algorithms for high dimensional distributed data.

Socolovsky, Eduardo A.↗

Chandra X-ray Observations of Young Clusters: Orion Flanking Fields Data - Volume II

We present results of Chandra observations of two flanking fields (FFs) in Orion, outside the Orion Nebula Cluster (ONC). The observations were taken with the ACIS-I camera with an exposure time of about 48 ks each field. We present a catalog of 417 sources, which includes X-ray luminosity, optical and infrared photometry, and X-ray variability information. We have found 91 variable sources, 33 of which have a flarelike light curve and 11 of which have a pattern of a steady increase or decrease over a 10 hr period. The optical and infrared photometry for the stars identified as X-ray sources are consistent with most of these objects being pre-main-sequence stars with ages younger than 10 Myr. We present evidence for an age difference among the X-ray-selected samples of NGC 2264, Orion FFs, and ONC, with NGC 2264 being the oldest and ONC being the youngest.

pre-main sequence↗

Atom Probe Tomography Interlaboratory Study on Clustering Analysis in Experimental Data Using the Maximum Separation Distance Approach

We summarize the findings from an interlaboratory study conducted between ten international research groups and investigate the use of the commonly used maximum separation distance and local concentration thresholding methods for solute clustering quantification. The study objectives are: to bring clarity to the range of applicability of the methods; identify existing and/or needed modifications; and interpretation of past published data. Participants collected experimental data from a proton-irradiated 304 stainless steel and analyzed Cu-rich and Ni–Si rich clusters. The datasets were also analyzed by one researcher to clarify variability originating from different operators. The Cu distribution fulfills the ideal requirements of the maximum separation method (MSM), namely a dilute matrix Cu concentration and concentrated Cu clusters. This enabled a relatively tight distribution of the cluster number density among the participants. By contrast, the group analysis of the Ni–Si rich clusters by the MSM was complicated by a high Ni matrix concentration and by the presence of Si-decorated dislocations, leading to larger variability among researchers. While local concentration filtering could, in principle, tighten the results, the cluster identification step inevitably maintained a high scatter. Recommendations regarding reporting, selection of analysis method, and expected variability when interpreting published data are discussed.

APT, Round Robin Studies, atom probe tomography, c↗

MEASURING THE GALAXY CLUSTER BULK FLOW FROM WMAP DATA

We have looked for bulk motions of galaxy clusters in the Wilkinson Microwave Anisotropy Probe (WMAP) seven-year data. We isolate the kinetic Sunyaev-Zeldovich (SZ) signal by filtering the WMAP Q-, V-, and W-band maps with multi-frequency matched filters that utilize the spatial properties of the kinetic SZ signal to optimize detection. We try two filters: a filter that has no spectral dependence, and a filter that utilizes the spectral properties of the kinetic and thermal SZ signals to remove the thermal SZ bias. We measure the monopole and dipole spherical harmonic coefficients of the kinetic SZ signal, as well as the l = 2-5 modes, at the locations of 736 ROSAT observed galaxy clusters. We find no significant power in the kinetic SZ signal at these multipoles with either filter, consistent with the {Lambda}CDM prediction. Our limits are a factor of {approx}3 more sensitive than the claimed bulk flow detection of Kashlinsky et al. Using simulations we estimate that in maps filtered by our matched filter with no spectral dependence there is a thermal SZ dipole that would be mistakenly measured as a bulk motion of {approx}2000-4000 km s{sup -1}. For the WMAP data, the signal-to-noise ratio obtained with the unbiased filter is almost an order of magnitude lower.

79 ASTRONOMY AND ASTROPHYSICS↗

Mass Calibration of Optically Selected DES Clusters Using a Measurement of CMB-cluster Lensing with SPTpol Data

We use cosmic microwave background (CMB) temperature maps from the 500 deg$^{2}$ SPTpol survey to measure the stacked lensing convergence of galaxy clusters from the Dark Energy Survey (DES) Year-3 redMaPPer (RM) cluster catalog. The lensing signal is extracted through a modified quadratic estimator designed to be unbiased by the thermal Sunyaev-Zel{'}dovich (tSZ) effect. The modified estimator uses a tSZ-free map, constructed from the SPTpol 95 and 150 GHz datasets, to estimate the background CMB gradient. For lensing reconstruction, we employ two versions of the RM catalog: a flux-limited sample containing 4003 clusters and a volume-limited sample with 1741 clusters. We detect lensing at a significance of 8.7$\sigma$(6.7$\sigma$) with the flux(volume)-limited sample. By modeling the reconstructed convergence using the Navarro-Frenk-White profile, we find the average lensing masses to be $M_{200m}$ = ($1.62^{+0.32}_{-0.25}$ [stat.] $\pm$ 0.04 [sys.]) and ($1.28^{+0.14}_{-0.18}$ [stat.] $\pm$ 0.03 [sys.]) $\times\ 10^{14}\ M_{\odot}$ for the volume- and flux-limited samples respectively. The systematic error budget is much smaller than the statistical uncertainty and is dominated by the uncertainties in the RM cluster centroids. We use the volume-limited sample to calibrate the normalization of the mass-richness scaling relation, and find a result consistent with the galaxy weak-lensing measurements from DES.

79 ASTRONOMY AND ASTROPHYSICS↗

Differentially Private K -Means Clustering Applied to Meter Data Analysis and Synthesis

The proliferation of smart meters has resulted in a large amount of data being generated. It is increasingly apparent that methods are required for allowing a variety of stakeholders to leverage the data in a manner that preserves the privacy of the consumers. The sector is scrambling to define policies, such as the so called ‘15/15 rule’, to respond to the need. However, the current policies fail to adequately guarantee privacy. Here, in this paper, we address the problem of allowing third parties to apply K-means clustering, obtaining customer labels and centroids for a set of load time series by applying the framework of differential privacy. We leverage the method to design an algorithm that generates differentially private synthetic load data consistent with the labeled data. We test our algorithm’s utility by answering summary statistics such as average daily load profiles for a 2-dimensional synthetic dataset and a real-world power load dataset.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Model-Based Clustering of Regression Time Series Data via APECM -- An AECM Algorithm Sung to an Even Faster Beat

We propose a model-based approach for clustering time series regression data in an unsupervised machine learning framework to identify groups under the assumption that each mixture component follows a Gaussian autoregressive regression model of order p. Given the number of groups, the traditional maximum likelihood approach of estimating the parameters using the expectation-maximization (EM) algorithm can be employed, although it is computationally demanding. The somewhat fast tune to the EM folk song provided by the Alternating Expectation Conditional Maximization (AECM) algorithm can alleviate the problem to some extent. In this article, we develop an alternative partial expectation conditional maximization algorithm (APECM) that uses an additional data augmentation storage step to efficiently implement AECM for finite mixture models. Results on our simulation experiments show improved performance in both fewer numbers of iterations and computation time. The methodology is applied to the problem of clustering mutual funds data on the basis of their average annual per cent returns and in the presence of economic indicators.

99 GENERAL AND MISCELLANEOUS↗