Search NASA⌕ Search

SEARCH · Search NASA

Results for “Cluster Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Enhancing Cluster Identification in Atom Probe Tomography Data Using Transfer Learning

Atom Probe Tomography (APT) is a powerful technique for visualizing the atomic-scale distribution of solutes in materials, but quantitative cluster analysis of APT datasets remains a challenge due to the need for subjective parameter selection in clustering algorithms. While distance-based and density-based methods such as HDBSCAN are widely used, their performance is highly sensitive to user-defined parameters, which undermines reproducibility and accuracy. This study proposes an image-based, deep learning-aided workflow for automating parameter selection and cluster detection in APT data analysis. By projecting 3D APT point clouds onto 2D planes, we leverage pretrained convolutional neural networks (ConvNeXt-Tiny and ResNet-50) through transfer learning to predict the number of clusters present in synthetic datasets. The output is used to guide K-means clustering and estimate HDBSCAN parameters, specifically minimum cluster size and minimum sample points. This approach reduces reliance on manual parameter tuning, improving consistency and scalability. The methodology demonstrates the feasibility of using image-based deep learning for interpreting complex spatial patterns in APT data, enabling faster and more objective analysis. The complete workflow and code are made publicly available to support reproducibility and future research.

Density-based clustering↗

A new step forward in realistic cluster lens mass modelling: analysis of Hubble Frontier Field Cluster Abell S1063 from joint lensing, X-ray, and galaxy kinematics data

We present a new method to simultaneously and self-consistently model the mass distribution of galaxy clusters that combines constraints from strong lensing features, X-ray emission, and galaxy kinematics measurements. We are able to successfully decompose clusters into their collisionless and collisional mass components thanks to the X-ray surface brightness, as well as use the dynamics of cluster members, to obtain more accurate masses exploiting the fundamental plane of elliptical galaxies. Knowledge from all observables is included through a consistent Bayesian approach in the likelihood or in physically motivated priors. We apply this method to the galaxy cluster Abell S1063 and produce a mass model that we publicly release with this paper. The resulting mass distribution presents different ellipticities for the intra-cluster gas and the other large-scale mass components as well as deviation from elliptical symmetry in the main halo. We assess the ability of our method to recover the masses of the different elements of the cluster using a mock cluster based on a simplified version of our Abell S1063 model. Thanks to the wealth of mutliwavelength information provided by the mass model and the detected X-ray emission, we also found evidence for an ongoing merger event with gas sloshing from a smaller infalling structure into the main cluster. In agreement with previous findings, the total mass, gas profile, and gas mass fraction are all consistent with small deviations from the hydrostatic equilibrium. This new mass model for Abell S1063 is publicly available, as the lenstool extension used to construct it.

79 ASTRONOMY AND ASTROPHYSICS↗

The NASA Analogy Software Cost Model: A Web-Based Cost Analysis Tool

This paper provides an overview of the many new features and algorithm updates in the release of the NASA Analogy Software Cost Tool (ASCoT). ASCoT is a web-based tool that provides a suite of estimation tools to support early lifecycle NASA Flight Software analysis. ASCoT employs advanced statistical methods such as Cluster Analysis to provide an analogy based estimate of software delivered lines of code and development effort, a regression based Cost Estimating Relationships (CER) model that estimates cost (dollars), and a COCOMO II based estimate. The ASCoT algorithms are designed to primarily work with system level inputs such as mission type (earth orbiter vs. planetary vs. rover), the number of instruments, and total mission cost. This allows the user to supply a minimal number of mission-level parameters which are better understood early in the life-cycle, rather than a large number of complex inputs.

Hihn, Jairus↗

Untangling the Galaxy. II. Structure within 3 kpc

We present the results of the hierarchical clustering analysis of the Gaia DR2 data to search for clusters, comoving groups, and other stellar structures. The current paper builds on the sample from the previous work, extending it in distance from 1 to 3 kpc and increasing the number of identified structures up to 8292. To aid in the analysis of the population properties, we developed a neural network called Auriga to robustly estimate the age, extinction, and distance of a stellar group based on the input photometry and parallaxes of the individual members. We apply Auriga to derive the properties of not only the structures found in this paper, but also previously identified open clusters. Through this work, we examine the temporal structure of the spiral arms. Specifically, we find that the Sagittarius Arm has moved by >500 pc in the last 100 Myr and the Perseus Arm has been experiencing a relative lull in star formation activity over the last 25 Myr. We confirm the findings of the previous paper on the transient nature of the spiral arms, with the timescale of transition of a few 100 Myr. Finally, we find a peculiar ~1 Gyr old stream of stars that appears to be heliocentric. Its origin is unclear.

79 ASTRONOMY AND ASTROPHYSICS↗

A CLIPS expert system for clinical flow cytometry data analysis

An expert system is being developed using CLIPS to assist clinicians in the analysis of multivariate flow cytometry data from cancer patients. Cluster analysis is used to find subpopulations representing various cell types in multiple datasets each consisting of four to five measurements on each of 5000 cells. CLIPS facts are derived from results of the clustering. CLIPS rules are based on the expertise of Drs. Stewart, Duque, and Braylan. The rules incorporate certainty factors based on case histories.

Salzman, G. C.↗

Forecasting the potential of weak lensing magnification to enhance LSST large-scale structure analyses

ABSTRACT Recent works have shown that weak lensing magnification must be included in upcoming large-scale structure analyses, such as for the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), to avoid biasing the cosmological results. In this work, we investigate whether including magnification has a positive impact on the precision of the cosmological constraints, as well as being necessary to avoid bias. We forecast this using an LSST mock catalogue and a halo model to calculate the galaxy power spectra. We find that including magnification has little effect on the precision of the cosmological parameter constraints for an LSST galaxy clustering analysis, where the halo model parameters are additionally constrained by the galaxy luminosity function. In particular, we find that for the LSST gold sample (i < 25.3) including weak lensing magnification only improves the galaxy clustering constraint on Ωm by a factor of 1.03, and when using a very deep LSST mock sample (i < 26.5) by a factor of 1.3. Since magnification predominantly contributes to the clustering measurement and provides similar information to that of cosmic shear, this improvement would be reduced for a combined galaxy clustering and shear analysis. We also confirm that not modelling weak lensing magnification will catastrophically bias the cosmological results from LSST. Magnification must therefore be included in LSST large-scale structure analyses even though it does not significantly enhance the precision of the cosmological constraints.

79 ASTRONOMY AND ASTROPHYSICS↗

A nonparametric clustering technique which estimates the number of clusters

In applications of cluster analysis, one usually needs to determine the number of clusters, K, and the assignment of observations to each cluster. A clustering technique based on recursive application of a multivariate test of bimodality which automatically estimates both K and the cluster assignments is presented.

Ramey, D. B.↗

Microwave remote sensing of sea ice

The long term objectives are: (1) to understand the physics of the multispectral microwave radiative characteristics of sea ice as it goes through different phases; (2) to improve characterization of sea ice cover using satellite microwave sensors; and (3) to study ice/ocean physical and biological processes associated with polynya formations and variability of the marginal sea ice region. Two field experiments were conducted to pursue these objectives. One involved measurements of radiative and physical characteristics of sea ice from a ship during a 3-month long cruise through the Weddell Sea ice pack during the Austral winter of 1986. The other involved similar measurements from two aircrafts and a submarine over the Central Arctic and Greenland Sea region. Preliminary results have already led to an enhanced understanding of the microwave signatures of pancake ice, nilas, first year ice, multiyear ice and effects of snow cover. Coastal and deep ocean polynyas and their role in bottom water formation and ocean circulation were studied using a time series of ice images from SMMR. An unsupervised cluster analysis of Arctic sea ice using SMMR and THIR emissivity and brightness temperature data was implemented. The analysis indicates the existence of several unique and persistent clusters in the Central Arctic region during winter and that the sum of the area of these clusters excluding those of first year ice is about 20 percent less than minimum ice cover area inferred from a previous summer data. This result is consistent with saline surface for some multiyear ice floes as observed during MIZEZ and suggests that a significant fraction of multiyear ice floes in the Arctic have first year ice signatures.

Comiso, J. C.↗

Identification of sea ice types in spaceborne synthetic aperture radar data

This study presents an approach for identification of sea ice types in spaceborne SAR image data. The unsupervised classification approach involves cluster analysis for segmentation of the image data followed by cluster labeling based on previously defined look-up tables containing the expected backscatter signatures of different ice types measured by a land-based scatterometer. Extensive scatterometer observations and experience accumulated in field campaigns during the last 10 yr were used to construct these look-up tables. The classification approach, its expected performance, the dependence of this performance on radar system performance, and expected ice scattering characteristics are discussed. Results using both aircraft and simulated ERS-1 SAR data are presented and compared to limited field ice property measurements and coincident passive microwave imagery. The importance of an integrated postlaunch program for the validation and improvement of this approach is discussed.

Kwok, Ronald↗

Illustrating galaxy–halo connection in the DESI era with illustrisTNG

ABSTRACT We employ the hydrodynamical simulation illustrisTNG to inform the galaxy–halo connection of the Luminous Red Galaxy (LRG) and Emission Line Galaxy (ELG) samples of the Dark Energy Spectroscopic Instrument (DESI) survey at redshift z ∼ 0.8. Specifically, we model the galaxy colours of illustrisTNG and apply sliding DESI colour–magnitude cuts, matching the DESI target densities. We study the halo occupation distribution (HOD) model of the selected samples by matching them to their corresponding dark matter haloes in the illustrisTNG dark matter run. We find the HOD of both the LRG and ELG samples to be consistent with their respective baseline models, but also we find important deviations from common assumptions about the satellite distribution, velocity bias, and galaxy secondary biases. We identify strong evidence for concentration-based and environment-based occupational variance in both samples, an effect known as ‘galaxy assembly bias’. The central and satellite galaxies have distinct dependencies on secondary halo properties, showing that centrals and satellites have distinct evolutionary trajectories and should be modelled separately. These results serve to inform the necessary complexities in modelling galaxy–halo connection for DESI analyses and also prepare for building high-fidelity mock galaxies. Finally, we present a shuffling-based clustering analysis that reveals a 10–15 ${{\ \rm per\ cent}}$ excess in the LRG clustering of modest statistical significance due to secondary galaxy biases. We also find a similar excess signature for the ELGs, but with much lower statistical significance. When a larger hydrodynamical simulation volume becomes available, we expect our analysis pipeline to pinpoint the exact sources of such excess clustering signatures.

79 ASTRONOMY AND ASTROPHYSICS↗

Characterizing the Effect of Capillary Heterogeneity on Multiphase Flow Pulsation in an Intermediate–Scale Beadpack Experiment using Time Series Clustering and Frequency Analysis

An intermediate-scale beadpack drainage experiment was conducted to investigate how simple layered lamination heterogeneity affects CO 2 flow. Two simple layers of capillary barriers are manually packed in the tank and slow drainage was carried out using analog fluids to mimic the capillary- and gravity-dominated CO 2 upward migration process in deep saline aquifers. Nonwetting phase saturation time series clustering analysis and frequency analysis have been conducted on the experimental data. Additionally, modified invasion percolation numerical simulations were done on a digital model of the beadpack to compare to experimental results. Results show that capillary barriers can lead to strong pulsation behavior, which in turn can cause unexpected early breaching through other barriers. The inlet pressure is found to be able to respond to saturation changes in far regions of the domain, indicating that the wetting phase can transmit pressure changes from the other phase. Although static simulations were not able to capture all the dynamic behavior observed in the experiment, Monte Carlo composite simulation results combining many different realizations can better illustrate how the nonwetting phase will behave in the heterogeneous domain. Furthermore, our results suggest the need for CO 2 storage site selection with preference given to aquifers with more capillary barriers with finer grain sizes to avoid flow pulsation and to retard plume upward migration.

58 GEOSCIENCES↗

Global radar units on Venus derived from statistical analysis of Pioneer Venus Orbiter radar data

The classification of surface radar units on Venus using an unsupervised cluster analysis of Pioneer Venus radar reflectivity and root-mean-square (rms)-slope data is described. The advantages of the unsupervised analysis are discussed. F tests are utilized to evaluate the numerical significance of the clusters. The derived rms-slope data and reflectivity for 15 radar units are presented. The relations between radar data bases and elevation are studied. The lowlands, rolling plains, highlands, and mountainous surface of Venus are examined. The geology of Venus landing sites and radar properties, and the surface radar reflectivity images and earth-based images are compared. The spatial relations between classification units are calculated. It is concluded that the unsupervised analysis data correlate well with Head et al. (1985b) data and produce more detailed classification images.

Davis, P. A.↗

Impacts of the Variability of Ice Types on the Decline of the Arctic Perennial Sea Ice Cover

The observed rapid decline in the Arctic perennial ice cover is one of the most remarkable signal of change in the Arctic region. Updated data now show an even higher rate of decline of 9.8% per decade than the previous report of 8.9% per decade mainly because of abnormally low values in the last 4 years. To gain insights into this decline, the variability of the second year ice, which is the relatively thin component of the perennial ice cover, and other ice types is studied. The perennial ice cover in the 1990s was observed to be highly variable which might have led to higher production of second year ice and may in part explain the observed ice thinning during the period and triggered further decline. The passive microwave signature of second year ice is also studied and results show that while the signature is different from that of the older multiyear ice, it is surprisingly more similar to that of first year ice. This in part explains why previous estimates of the area of multiyear ice during the winter period are considerably lower than the area of the perennial ice cover during the preceding summer. Four distinct clusters representing radiometrically different types have been identified using multi-channel cluster analysis of passive microwave data. Data from two of these clusters, postulated to come from second year and older multiyear ice regions are also shown to have average thicknesses of 2.4 and 4.1 m, respectively, indicating that the passive microwave data may contain some ice thickness information that can be utilized for mass balance studies. The yearly anomaly maps indicate high gains of first year ice cover in the Arctic during the last decade which means higher production of second year ice and fraction of this type in the declining perennial ice cover. While not the only cause, the rapid decline in the perennial ice cover is in part caused by the increasing fractional component of the thinner second year ice cover that is very vulnerable to total melt due to warming in the Arctic, especially in spring.

Comiso, Josefino C.↗

Machine Learning Approaches for Nuclear Material Accounting Data from Irradiation and Reprocessing

We are currently exploring data analysis methods for their ability to strengthen the synthesis and evaluation of information generated within domestic and international safeguard regimes. Safeguard data typically includes rich heterogenous datasets amenable to advanced data analytics methods, such as machine learning. We have converted transactional data containing both numerical and categorical attributes from a domestic nuclear material control and accountability (NMC&A) system into a low-dimensional numerical structure via linear principal component analysis. This data representation allows for global structure discovery via cluster analysis, which can characterize the typical behavior of each of the primary types of transaction events. Furthermore, the structure of the top principal components captures the “typical behavior” of the data and is thus amenable to anomaly detection through statistical hypothesis testing. We explored this capability by generating erroneous permutations of the data and computing the Q-residual quantity increase associated with the information loss when these data are projected into the low-dimensional principal component analysis space representative of typical transactions.Future work will focus on identifying data transformations (e.g., graph networks) that more closely align with the inherent structure of these transactions to explain more salient information and disambiguate the underlying nuclear process—in this case, irradiation and reprocessing—from artifacts of NMC&A system transactional record keeping data.

Drescher, Adam↗

Analyzing human errors in flight mission operations

A long-term program is in progress at JPL to reduce cost and risk of flight mission operations through a defect prevention/error management program. The main thrust of this program is to create an environment in which the performance of the total system, both the human operator and the computer system, is optimized. To this end, 1580 Incident Surprise Anomaly reports (ISA's) from 1977-1991 were analyzed from the Voyager and Magellan projects. A Pareto analysis revealed that 38 percent of the errors were classified as human errors. A preliminary cluster analysis based on the Magellan human errors (204 ISA's) is presented here. The resulting clusters described the underlying relationships among the ISA's. Initial models of human error in flight mission operations are presented. Next, the Voyager ISA's will be scored and included in the analysis. Eventually, these relationships will be used to derive a theoretically motivated and empirically validated model of human error in flight mission operations. Ultimately, this analysis will be used to make continuous process improvements continuous process improvements to end-user applications and training requirements. This Total Quality Management approach will enable the management and prevention of errors in the future.

Bruno, Kristin J.↗

A bootstrap approach to bump hunting

An important question in cluster analysis and pattern recognition is the determination of the number of clusters into which a given population should be divided. Frequently, particularly when certain specific clustering methods are being used, the number of clusters is taken to be equal to the number of modes, or local maxima, in the probability density function underlying the given data set. The use of kernal density estimates in mode estimation is discussed. The test statistic to be used is defined and a bootstrap technique for assessing significance is given. An illustrative application is followed by an examination of the asymptotic behavior of the test statistic.

Silverman, B. W.↗

Automated clustering-based workload characterization

The demands placed on the mass storage systems at various federal agencies and national laboratories are continuously increasing in intensity. This forces system managers to constantly monitor the system, evaluate the demand placed on it, and tune it appropriately using either heuristics based on experience or analytic models. Performance models require an accurate workload characterization. This can be a laborious and time consuming process. It became evident from our experience that a tool is necessary to automate the workload characterization process. This paper presents the design and discusses the implementation of a tool for workload characterization of mass storage systems. The main features of the tool discussed here are: (1)Automatic support for peak-period determination. Histograms of system activity are generated and presented to the user for peak-period determination; (2) Automatic clustering analysis. The data collected from the mass storage system logs is clustered using clustering algorithms and tightness measures to limit the number of generated clusters; (3) Reporting of varied file statistics. The tool computes several statistics on file sizes such as average, standard deviation, minimum, maximum, frequency, as well as average transfer time. These statistics are given on a per cluster basis; (4) Portability. The tool can easily be used to characterize the workload in mass storage systems of different vendors. The user needs to specify through a simple log description language how the a specific log should be interpreted. The rest of this paper is organized as follows. Section two presents basic concepts in workload characterization as they apply to mass storage systems. Section three describes clustering algorithms and tightness measures. The following section presents the architecture of the tool. Section five presents some results of workload characterization using the tool.Finally, section six presents some concluding remarks.

Pentakalos, Odysseas I.↗

Aerosol Models for the CALIPSO Lidar Inversion Algorithms

We use measurements and models to develop aerosol models for use in the inversion algorithms for the Cloud Aerosol Lidar and Imager Pathfinder Spaceborne Observations (CALIPSO). Radiance measurements and inversions of the AErosol RObotic NETwork (AERONET1, 2) are used to group global atmospheric aerosols using optical and microphysical parameters. This study uses more than 105 records of radiance measurements, aerosol size distributions, and complex refractive indices to generate the optical properties of the aerosol at more 200 sites worldwide. These properties together with the radiance measurements are then classified using classical clustering methods to group the sites according to the type of aerosol with the greatest frequency of occurrence at each site. Six significant clusters are identified: desert dust, biomass burning, urban industrial pollution, rural background, marine, and dirty pollution. Three of these are used in the CALIPSO aerosol models to characterize desert dust, biomass burning, and polluted continental aerosols. The CALIPSO aerosol model also uses the coarse mode of desert dust and the fine mode of biomass burning to build a polluted dust model. For marine aerosol, the CALIPSO aerosol model uses measurements from the SEAS experiment 3. In addition to categorizing the aerosol types, the cluster analysis provides all the column optical and microphysical properties for each cluster.

Omar, Ali H.↗