Search NASA⌕ Search

SEARCH · Search NASA

Results for “data clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS1981

The ultraviolet spectra of early type galaxies

The average spectral energy distribution for a sample of bright elliptical galaxies is presented in the range lambda lambda 2000 to 3200 A. Spectral synthesis indicates that elliptical galaxies are most likely older than 9 Gyrs. The ultraviolet flux is consistent with a population of red horizontal branch stars, as those present in metal rich globular clusters. Data for distant first ranked cluster galaxies show indications of spectral evolution.

Bruzual, A. G.↗
NASA NTRS1982

LANDSAT land cover analysis completed for CIRSS/San Bernardino County project

The LANDSAT analysis carried out as part of Ames Research Center's San Bernardino County Project, one of four projects sponsored by NASA as part of the California Integrated Remote Sensing System (CIRSS) effort for generating and utilizing digital geographic data bases, is described. Topics explored include use of data-base modeling with spectral cluster data to improve LANDSAT data classification, and quantitative evaluation of several change techniques. Both 1976 and 1979 LANDSAT data were used in the project.

Likens, W.↗
DOE OSTI2026

Cosmological constraints from the DESI DR1 joint power spectrum and bispectrum analysis

We derive cosmological parameter constraints from the Dark Energy Spectroscopic Instrument (DESI) Data Release 1 (DR1) galaxy clustering data, based on a joint full-shape analysis of the power spectrum multipoles and the bispectrum monopole using the ShapeFit framework. This is the follow-up of our previous work, in which we obtained for the first time constraints on the ShapeFit parameters using the bispectrum of DESI DR1. Here we present the first ShapeFit cosmological inference results using the bispectrum of DESI DR1. We recover values for the matter density parameter and Hubble constant of respectively $Ω_m=0.310\pm0.012$ and $H_0=[68.92\pm0.97]\,\mathrm{km\, s^{-1} Mpc^{-1}}$, consistent with previous results from the full DESI DR1 dataset that did not use the bispectrum signal. The inclusion of the bispectrum significantly tightens the constraints on the amplitude of fluctuations, reducing the error-bars in $\ln(A_s\times10^{10})$ by approximately 20%, compared to using the power spectrum alone. We also explore extended cosmological models by performing fits for the evolving dark energy equation of state $w_0w_a$, and the sum of neutrino masses $\sum m_ν$. In these cases, we obtain constraints slightly larger than the ones from previous works from the DESI collaboration, due to not combining the full-shape results with other probes in all tracers. We find no strong evidence of deviations from standard $Λ$CDM, with the dark energy equation-of-state remaining within 2$σ$ from a cosmological constant $Λ$, and the neutrino mass being consistent with the normal hierarchy, $\sum m_ν<0.1\,[eV]$ at 95% confidence limit. These constraints are broadly consistent with other DESI DR1 analyses, thus validating the robustness of the ShapeFit compression approach and the inclusion of the bispectrum for cosmological inference.

Novell-Masot, S. [ICC, Barcelona U.; Geneva U., De↗
DOE OSTI2026

Cosmological constraints from the DESI DR1 joint power spectrum and bispectrum analysis

We derive cosmological parameter constraints from the Dark Energy Spectroscopic Instrument (DESI) Data Release 1 (DR1) galaxy clustering data, based on a joint full-shape analysis of the power spectrum multipoles and the bispectrum monopole using the ShapeFit framework. This is the follow-up of our previous work, in which we obtained for the first time constraints on the ShapeFit parameters using the bispectrum of DESI DR1. Here we present the first ShapeFit cosmological inference results using the bispectrum of DESI DR1. We recover values for the matter density parameter and Hubble constant of respectively $Ω_m=0.310\pm0.012$ and $H_0=[68.92\pm0.97]\,\mathrm{km\, s^{-1} Mpc^{-1}}$, consistent with previous results from the full DESI DR1 dataset that did not use the bispectrum signal. The inclusion of the bispectrum significantly tightens the constraints on the amplitude of fluctuations, reducing the error-bars in $\ln(A_s\times10^{10})$ by approximately 20%, compared to using the power spectrum alone. We also explore extended cosmological models by performing fits for the evolving dark energy equation of state $w_0w_a$, and the sum of neutrino masses $\sum m_ν$. In these cases, we obtain constraints slightly larger than the ones from previous works from the DESI collaboration, due to not combining the full-shape results with other probes in all tracers. We find no strong evidence of deviations from standard $Λ$CDM, with the dark energy equation-of-state remaining within 2$σ$ from a cosmological constant $Λ$, and the neutrino mass being consistent with the normal hierarchy, $\sum m_ν<0.1\,[eV]$ at 95% confidence limit. These constraints are broadly consistent with other DESI DR1 analyses, thus validating the robustness of the ShapeFit compression approach and the inclusion of the bispectrum for cosmological inference.

Novell-Masot, S. [ICC, Barcelona U.; Geneva U., De↗
NASA NTRS1974

NCUBE - A clustering algorithm based on a discretized data space

Cluster analysis involves the unsupervised grouping of data. The process provides an automatic procedure for generating known training samples for pattern classification. NCUBE, the clustering algorithm presented, is based upon the concept of imposing a gridwork on the data space. The NCUBE computer implementation of this concept provides an easily derived form of piecewise linear discrimination. This piecewise linear discrimination permits the separation of some types of data groups that are not linearly separable.

Eigen, D. J.↗
DOE OSTI2019

Bootstrap AMG for spectral clustering

Graph Laplacian is a popular tool for analyzing graphs, particularly in graph partitioning and clustering. Given a notion of similarity (via an adjacency matrix), graph clustering refers to identifying different groups such that vertices in the same group are more similar compared to vertices across different groups. Data clustering can be reformulated in terms of a graph clustering problem when the given set of data is represented as a graph, also known as similarity graph. In this context, eigenvectors of the graph Laplacian are often used to obtain a new geometric representation of the original data set that generally enhances cluster properties and improves cluster detection. Here, we apply a bootstrap algebraic multigrid (AMG) method that constructs a set of vectors associated with the graph Laplacian. These vectors, referred to as algebraically smooth ones, span a low-dimensional Euclidean space, which we use to represent the data, enabling cluster detection both in synthetic and in realistic well-clustered graphs. We show that, in the case of a good quality bootstrap AMG, the computed smooth vectors employed in the construction of the final AMG operator, which by construction is spectrally equivalent to the originally given graph Laplacian, accurately approximate the space in the lower portion of the spectrum of the preconditioned operator. Thus, our approach can be viewed as a spectral clustering technique associated with the generalized spectral problem (Laplace operator versus the final AMG operator), and hence, it can be seen as an extension of the classical spectral clustering that employs a standard eigenvalue problem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Modified dark matter: Relating dark energy, dark matter and baryonic matter

Modified dark matter (MDM) is a phenomenological model of dark matter, inspired by gravitational thermodynamics. For an accelerating universe with positive cosmological constant (Λ), such phenomenological considerations lead to the emergence of a critical acceleration parameter related to Λ. Such a critical acceleration is an effective phenomenological manifestation of MDM, and it is found in correlations between dark matter and baryonic matter in galaxy rotation curves. Here, the resulting MDM mass profiles, which are sensitive to Λ, are consistent with observational data at both the galactic and cluster scales. In particular, the same critical acceleration appears both in the galactic and cluster data fits based on MDM. Furthermore, using some robust qualitative arguments, MDM appears to work well on cosmological scales, even though quantitative studies are still lacking. Finally, we comment on certain nonlocal aspects of the quanta of modified dark matter, which may lead to novel nonparticle phenomenology and which may explain why, so far, dark matter detection experiments have failed to detect dark matter particles.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Particle Filter Based Inference Testing

The primary intent of PAR-FIT (Particle Filter based Inference Testing) is to provide hard inductive evidence that a machine learning model is capable and proven for an individual test input. By examining training data used to form the underlying model functional correlation, an estimate of the reliability that a model will make the correct prediction can be made. The Sequential Probability Ratio Test is used to derive a qualitative evaluation for reliability based on hypothesis testing. The PAR-FIT framework achieves this by implementing a particle filter and the sequential probability ratio test algorithms on the machine learning model training data to determine relevancy of new individual test samples to the training dataset. The kernel function evaluates the local proximity and density of training data used to derive a prediction outcome. Particles are used to probabilistically determine which training data to evaluate for proximity. For test samples that are within a close proximity to and surrounded by multiple training data points, the evaluated reliability of the prediction is high. For test samples that are anomalies not represented by the training dataset, in low density data clusters, or are far from existing data points, the evaluated reliability is low as insufficient training evidence exists to suggest the model is capable of making the correct prediction. Sequential Probability Ratio Test is further used to determine when a hypothesis on whether a signal can be rejected or accepted for use. The ratio test collects sequence information from the particle filter to test whether the signal is anomalous or normal via hypothesis testing of the underlying distributions.

Chen, Edward [Idaho National Laboratory (INL), Ida↗
DOE OSTI2023

Transparent application-layer/os deeper packet inspector

A computer-implemented method of deep packet inspection (DPI) in a network is provided. The method comprises collecting data packets comprising a number of traffic flows from a number of devices via a number of traffic taps and classifying each traffic flow according to data about network protocol layers of the packets comprising the traffic flow. Application layer metadata is extracted from the packets. Traffic flow classification data and the extracted metadata are ingested into a data cluster and normalized. The normalized classification data and extracted metadata is then correlated to other data sets.

Urias, Vincent↗
DOE OSTI2025

Validation of the DESI DR2 measurements of baryon acoustic oscillations from galaxies and quasars

The Dark Energy Spectroscopic Instrument (DESI) Data Release 2 (DR2) galaxy and quasar clustering data represents a significant expansion of data from Data Release 1 (DR1), providing improved statistical precision in baryon acoustic oscillation (BAO) constraints across multiple tracers, including bright galaxies, luminous red galaxies, emission line galaxies, and quasars. In this paper, we validate the BAO analysis of DR2. We present the results of robustness tests on the blinded DR2 data and, after unblinding, consistency checks on the unblinded DR2 data. All results are compared with those obtained from a suite of mock catalogs that replicate the selection and clustering properties of the DR2 sample. We confirm the consistency of DR2 BAO measurements with DR1 while achieving a reduction in statistical uncertainties due to the increased survey volume and completeness. The combined BAO precision, including both statistical and systematic errors, improves from ∼0.52% in DR1 to 0.30% in DR2—a factor of 1.7 gain. We assess the impact of analysis choices, including different data vectors (correlation function vs power spectrum), modeling approaches and systematics treatments, and an assumption of the Gaussian likelihood, finding that our BAO constraints are stable across these variations and assumptions with a few minor refinements to the baseline setup of the DR1 BAO analysis. We summarize a series of pre-unblinding tests that confirmed the readiness of our analysis pipeline, the final systematic errors, and the DR2 BAO analysis baseline. The successful completion of these tests led to the unblinding of the DR2 BAO measurements, ultimately leading to the DESI DR2 cosmological analysis, with their implications for the expansion history of the Universe and the nature of dark energy presented in the DESI key paper (companion paper).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Cohort organized learning: clustering through agreement

In this article we describe cohort organized learning (CoOL), a method for clustering data without explicit distance or similarity computations. Herein, we will describe CoOL, derive the gradients determined by expectation maximization to train the networks, show how to monitor convergence during training and evaluate the clusters after training, and discuss a series of examples and use cases. We also discuss CoOL’s limitations and future prospects on related tasks. Because CoOL uses neural networks to estimate the clusters, it can be used to cluster any data that can be made compatible and we illustrate this on vector data and images.

clustering↗
DOE OSTI2026

Inference of the linear matter power spectrum at z = 0 using DESI DR1 Full-Shape data

Measurements of galaxy distributions at large cosmic distances capture clustering from the past. In this study, we use a cosmological model to translate these observations into the present-day galaxy distribution. Specifically, we reconstruct the 3D linear matter power spectrum at redshift z = 0 using Dark Energy Spectroscopic Instrument (DESI) Year 1 (DR1) galaxy clustering data and Cosmic Microwave Background (CMB) observations, assuming the ΛCDM model, and compare it to the result assuming the w 0 w a CDM model. Building on previous state-of-the-art methods, we apply Effective Field Theory (EFT) modelling of the galaxy power spectrum to account for small-scale effects in the 2-point statistics of galaxy data. Implementation of the EFT approach improves the modelling of the galaxy power spectrum, providing a more robust consistency test of the assumed cosmological model. By casting both CMB and galaxy clustering observations, spanning distinct redshift regimes, into k-space, we can identify discrepancies between the datasets of different redshifts, which would indicate potential inaccuracies in the assumed expansion history. While previous studies have shown consistency with ΛCDM, this work extends the analysis with higher-quality data to further test the expansion histories of both ΛCDM and w 0 w a CDM. Our findings show that both ΛCDM and w 0 w a CDM provide consistent fits to the linear matter power spectrum recovered from DESI DR1 data.

cosmological parameters from LSS↗
DOE OSTI2019

Disentangling magnification in combined shear-clustering analyses

ABSTRACT We investigate the sensitivity to the effects of lensing magnification on large-scale structure analyses combining photometric cosmic shear and galaxy clustering data (i.e. the now commonly called ‘3 × 2-point’ analysis). Using a Fisher matrix bias formalism, we disentangle the contribution to the bias on cosmological parameters caused by ignoring the effects of magnification in a theory fit from individual elements in the data vector, for Stage-III and Stage-IV surveys. We show that the removal of elements of the data vectors that are dominated by magnification does not guarantee a reduction in the cosmological bias due to the magnification signal, but can instead increase the sensitivity to magnification. We find that the most sensitive elements of the data vector come from the shear-clustering cross-correlations, particularly between the highest redshift shear bin and any lower redshift lens sample, and that the parameters ΩM, $S_8=\sigma _8\sqrt{\Omega _\mathrm{ M}/0.3}$, and w0 show the most significant biases for both survey models. Our forecasts predict that current analyses are not significantly biased by magnification, but this bias will become highly significant with the continued increase of statistical power in the near future. We therefore conclude that future surveys should measure and model the magnification as part of their flagship ‘3 × 2-point’ analysis.

Thiele, Leander↗
DOE OSTI2019

Future SDN-HPON Control Plane Architecture and Protocol for On-Demand Terabit End-to-End Extreme-Scale Science Applications

The UC Davis team conducted architecture, algorithm and experimental studies for next generation ultra-high-bandwidth optical networks in support of extreme-scale science applications. In particular, over the course of this 3-year project, the UC Davis team achieved the following main accomplishments: Designed a network architecture for automated multi-domain service provisioning: Designed information exchange schemes between autonomous systems (domains) Designed application programming interfaces to orchestrate resource reservation in data centers, high performance computation facilities, and communication networks belonging to different autonomous systems Experimentally assessed the multi-domain network architecture in a distributed field trial set-up connecting premises in three continents Designed a broker-based orchestrated multi-domain optical networking framework supporting observe-analyze-act cycle based cognitive inter-domain service provisioning: Designed an inter-domain operation mechanism, e.g., topology abstraction, for the broker plane and domain managers to collaboratively accomplish inter-domain service provisioning while respecting the autonomy of each administrative domain Designed an alien wavelength monitoring scheme and an artificial neural network based optical signal-to-noise ratio estimator for quality-of-transmission aware inter-domain service provisioning Developed a deep neural network based multi-domain traffic predictor and a cognitive routing and spectrum assignment algorithm to realize knowledge-based autonomous traffic engineering in multi-domain networks Implemented an optical signal-to-noise ratio estimator and traffic predictor with Google’s Tensor flow and assessed their performance using experimental and synthetic data Demonstrated the benefits of the proposed cognitive schemes with experiments ona two-domain elastic optical network testbed and evaluations on a six-domain simulation framework Built a two-domain software-defined networking control plane testbed using the ONOS platform and demonstrated the workflow of broker and domain manager cooperation, including hierarchical performance monitoring, topology abstraction and cognitive resource allocation. Designed self-learning cognitive service provisioning schemes using advanced machine learning technologies: Designed a self-taught anomaly detection framework for optical networks, including an unsupervised data clustering module for pattern recognition, a supervised data regression and classification module for online anomaly detection, and the system operation principle Experimentally validated the effectiveness of the self-taught anomaly detection framework with various failure/anomaly scenarios. Designed a self-learning autonomic routing, modulation and spectrum assignment (RMSA) provisioning framework for elastic optical networks with deep reinforcement learning. Designed effective modeling and training mechanisms for the self-learning RMSA framework Conducted extensive numerical simulations with various traffic patterns and topologies to verify the advantage of the self-learning RMSA framework.

42 ENGINEERING↗
DOE OSTI2023

Clustering High-dimensional Toxicogenomics Data with Rare Signals

Toxicogenomics studies the gene and protein activities to drug treatments or toxic exposures. As the drugs and genes are numerous, toxicogenomics data are naturally high dimensional, with dimension sizes up to millions. In addition, the distribution of toxicogenomics data is oftentimes skewed, and they contain rare but important signals representing a cell or organism’s response to toxicity. The combination of high dimension and extremely skewed distribution of toxicogenomics data makes clustering analysis extremely challenging.We present our study of clustering toxicogenomics data using classical approaches such as principal component analysis as well as deep learning approaches such as auto-encoders. Our experiments show that these approaches fail to preserve rare signals and produce high-quality clusters. We then explore augmenting matrix factorization with deep learning techniques such as attention mechanism to produce latent representations for clustering. Our technique is able to better preserve rare signals after dimensionality reduction than prior approaches. Furthermore, we combine our augmented matrix factorization with a mechanism similar to autoencoder to balance separable clusters and low regeneration errors. Our experiments demonstrate better clustering with our proposed approach.

Cong, Guojing↗
DOE OSTI2019

Systems and methods for determining optimal parameters for dynamic quantum clustering analyses

In the present work, quantum clustering is extended to provide a dynamical approach for data clustering using a time-dependent Schrodinger equation. To expedite computations, we can approximate the time-dependent Hamiltonian formalism by a truncated calculation within a set of Gaussian wave-functions (coherent states) centered around the original points. This allows for analytic evaluation of the time evolution of all such states, opening up the possibility of exploration of relationships among data points through observation of varying dynamical-distances among points and convergence of points into clusters. This formalism may be further supplemented by preprocessing, such as dimensional reduction through singular value decomposition and/or feature filtering. Additionally, the parameters of the analysis can be modified in order to improve the efficiency of the dynamic quantum clustering processes.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗