Search NASA⌕ Search

SEARCH · Search NASA

Results for “cluster methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS2005

A Fast Implementation of the ISODATA Clustering Algorithm

Clustering is central to many image processing and remote sensing applications. ISODATA is one of the most popular and widely used clustering methods in geoscience applications, but it can run slowly, particularly with large data sets. We present a more efficient approach to ISODATA clustering, which achieves better running times by storing the points in a kd-tree and through a modification of the way in which the algorithm estimates the dispersion of each cluster. We also present an approximate version of the algorithm which allows the user to further improve the running time, at the expense of lower fidelity in computing the nearest cluster center to each point. We provide both theoretical and empirical justification that our modified approach produces clusterings that are very similar to those produced by the standard ISODATA approach. We also provide empirical studies on both synthetic data and remotely sensed Landsat and MODIS images that show that our approach has significantly lower running times.

Memarsadeghi, Nargess↗
NASA NTRS2007

A Fast Implementation of the Isodata Clustering Algorithm

Clustering is central to many image processing and remote sensing applications. ISODATA is one of the most popular and widely used clustering methods in geoscience applications, but it can run slowly, particularly with large data sets. We present a more efficient approach to IsoDATA clustering, which achieves better running times by storing the points in a kd-tree and through a modification of the way in which the algorithm estimates the dispersion of each cluster. We also present an approximate version of the algorithm which allows the user to further improve the running time, at the expense of lower fidelity in computing the nearest cluster center to each point. We provide both theoretical and empirical justification that our modified approach produces clusterings that are very similar to those produced by the standard ISODATA approach. We also provide empirical studies on both synthetic data and remotely sensed Landsat and MODIS images that show that our approach has significantly lower running times.

Memarsadeghi, Nargess↗
NASA NTRS2021

Application of Gaussian Mixture Regression for the Correction of Low Cost PM2.5 Monitoring Data in Accra, Ghana

Low-cost sensors (LCSs) for air quality monitoring have enormous potential to improve air quality data coverage in resource-limited parts of the world such as sub-Saharan Africa. LCSs, however, are affected by environment and source conditions. To establish high-quality data, LCSs must be collocated and calibrated with reference grade PM2.5 monitors. From March 2020, a low-cost PurpleAir PM2.5 monitor was collocated with a Met One Beta Attenuation Monitor 1020 in Accra, Ghana. While previous studies have shown that multiple linear regression (MLR) and random forest regression (RF) can improve accuracy and correlation between PurpleAir and reference data, MLR and RF yielded suboptimal improvement in the Accra collocation (R2 = 0.81 and R2 = 0.81, respectively). We present the first application of Gaussian mixture regression (GMR) to air quality data calibration and demonstrate improvement over traditional methods by increasing the collocated PM2.5 correlation and accuracy to R2 = 0.88 and MAE = 2.2 μg/cu. m. Gaussian mixture models (GMMs) are a probability density estimator and clustering method from which nonlinear regressions that tolerate missing inputs can be derived. We find that even when given missing inputs, GMR provides better correlation than MLR and RF performed with complete data. GMR also allows us to estimate calibration certainty. When evaluated, 95% confidence intervals agreed with reference PM2.5 data 96% of the time, suggesting that the model accurately assesses its own confidence. Additionally, clustering within the GMM is consistent with climate characteristics, providing confidence that the calibration approach can learn underlying relationships in data.

Sensors↗
NASA NTRS2004

Clustering with Missing Values: No Imputation Required

Clustering algorithms can identify groups in large data sets, such as star catalogs and hyperspectral images. In general, clustering methods cannot analyze items that have missing data values. Common solutions either fill in the missing values (imputation) or ignore the missing data (marginalization). Imputed values are treated as just as reliable as the truly observed data, but they are only as good as the assumptions used to create them. In contrast, we present a method for encoding partially observed features as a set of supplemental soft constraints and introduce the KSC algorithm, which incorporates constraints into the clustering process. In experiments on artificial data and data from the Sloan Digital Sky Survey, we show that soft constraints are an effective way to enable clustering with missing values.

constraints↗
NASA NTRSDate not supplied

Synthesis Analysis of Mulit-Dimensional Ozone Lidar Measurements in Coastal Environments Toward Improving Ozone Simulation

Large surface ozone variations are frequently observed in coastal regions which makes the modeling of air quality in these regions challenging. The ability to properly model coastal regions relies heavily on the proper detailed observations. There have been three air quality studies (over Chesapeake Bay and the Long Island Sound) that focused on thorough measurements in these complex coastal regions; OWLETS 1 & 2 and LISTOS. Over the course of the campaigns, there were surface ozone observations taken from LIDAR (LIght Detection And Ranging) instruments for a total of 89 days at a high temporal rate. We developed a clustering method that characterizes the multiple timestamps of measurements into a range of ozone events that are specific to these coastal regions. We simulated coastal ozone for these cluster groups using WRF-GC and WRF-Chem to identify gaps within the model. Using the characterized ozone clusters, we were able to identify multiple coastal mechanisms that led to incorrect model simulations.

Claudia Bernier↗
NASA NTRS2017

An Orbital Meteoroid Stream Survey Using the Southern Argentina Agile Meteor Radar (SAAMER) Based on a Wavelet Approach

Over a million individually measured meteoroid orbits were collected with the Southern Argentina Agile MEteor Radar (SAAMER) between 2012-2015. This provides a robust statistical database to perform an initial orbital survey of meteor showers in the Southern Hemisphere via the application of a 3D wavelet transform. The method results in a composite year from all 4 years of data, enabling us to obtain an undisturbed year of meteor activity with more than one thousand meteors per day. Our automated meteor shower search methodology identified 58 showers. Of these showers, 24 were associated with previously reported showers from the IAU catalogue while 34 showers are new and not listed in the catalogue. Our searching method combined with our large data sample provides unprecedented accuracy in measuring meteor shower activity and description of shower characteristics in the Southern Hemisphere. Using simple modeling and clustering methods we also propose potential parent bodies for the newly discovered showers.

Meteor showers↗
NASA NTRS2017

A Network-Based Algorithm for Clustering Multivariate Repeated Measures Data

The National Aeronautics and Space Administration (NASA) Astronaut Corps is a unique occupational cohort for which vast amounts of measures data have been collected repeatedly in research or operational studies pre-, in-, and post-flight, as well as during multiple clinical care visits. In exploratory analyses aimed at generating hypotheses regarding physiological changes associated with spaceflight exposure, such as impaired vision, it is of interest to identify anomalies and trends across these expansive datasets. Multivariate clustering algorithms for repeated measures data may help parse the data to identify homogeneous groups of astronauts that have higher risks for a particular physiological change. However, available clustering methods may not be able to accommodate the complex data structures found in NASA data, since the methods often rely on strict model assumptions, require equally-spaced and balanced assessment times, cannot accommodate missing data or differing time scales across variables, and cannot process continuous and discrete data simultaneously. To fill this gap, we propose a network-based, multivariate clustering algorithm for repeated measures data that can be tailored to fit various research settings. Using simulated data, we demonstrate how our method can be used to identify patterns in complex data structures found in practice.

Koslovsky, Matthew↗
NASA NTRS2011

Clonal Selection Based Artificial Immune System for Generalized Pattern Recognition

The last two decades has seen a rapid increase in the application of AIS (Artificial Immune Systems) modeled after the human immune system to a wide range of areas including network intrusion detection, job shop scheduling, classification, pattern recognition, and robot control. JPL (Jet Propulsion Laboratory) has developed an integrated pattern recognition/classification system called AISLE (Artificial Immune System for Learning and Exploration) based on biologically inspired models of B-cell dynamics in the immune system. When used for unsupervised or supervised classification, the method scales linearly with the number of dimensions, has performance that is relatively independent of the total size of the dataset, and has been shown to perform as well as traditional clustering methods. When used for pattern recognition, the method efficiently isolates the appropriate matches in the data set. The paper presents the underlying structure of AISLE and the results from a number of experimental studies.

pattern recognition↗
NASA NTRS1995

The Ozonide Anion: A Theoretical Study

Complete active space self-consistent field (CASSCF) and CASSCF second order perturbation theory (CASPT2) methods have been used for the geometry optimization and calculation of harmonic and fundamental frequencies of the ozonide ion O3(-) and the ozonide lithium complex Li(+)O3(-). For O3(-) harmonic frequencies have also been obtained using the coupled-cluster method, CCSD(T). Infrared intensities are computed from dipole moment derivatives at the CASSCF level. The predicted equilibrium geometry for O3(-) is: Roo = 1.361 Angstroms and angle ooo = 115.4 degrees, and the fundamental frequencies are: nu(sub 1) = 989 per centimeter, nu(sub 2) 556 per centimeter, nu(sub 3) = 870 per centimeter (experimental values are: Roo =1.36 plus or minus 0.02 Angstroms, angle (ooo) = 111.8 plus or minus 2.0 degrees, nu(sub 1) = 975(50) per centimeter, nu(sub 2) = 550(50) per centimeter, nu(sub 3) = 880(50) per centimeter). Corresponding data for the lithium ozonide complex have also been obtained. The presented data contradict the previous interpretation of the IR and Raman spectrum obtained after deposition of ozone in N2, argon, or neon matrices with atomic beams of alkali metals. The presence of the lithium cation raises the asymmetric stretch frequency to about 940 per centimeter, which is contradictory to assumptions made in the assignments of the matrix spectra. Calculations made in a dielectric medium strongly suggest that the effect of the matrix on the IR spectrum is small for O3(-) itself. The dissociation and atomization energies of O3(-) are found to be in agreement with experiment.

Borowski, Poitr↗
NASA NTRSDate not supplied

Retrieve Methane from IR sounder measurements Using Machine Learning-Enhanced Physical Inversion

The sensitivity of IR sounder measurements to atmospheric CH 4 is often limited due to interferences from signals of other trace gases, insufficient thermal contrast, and cloud blockage. In order to resolve the geographical and vertical distribution of atmospheric CH 4 profiles, accurate scene-dependent a priori information is critically needed to support an optimal estimation method-based physical inversion scheme. Following the principles of indexing, representation, and retrieval, a spectral fingerprinting methodology is developed to address the needs for both accuracy and computational efficiency in sounder-based CH 4 retrieval. Within this framework, a clustering method based on machine learning is first employed to stratify and identify the a priori state within the pre-constructed database, using optimized spectral radiances as predictors. The corresponding radiative kernel is then used to establish the physical inversion scheme for finding the solution. High-quality data from CH 4 data assimilation systems like the Carbon-Tracker and the Copernicus Atmosphere Monitoring Service (CAMS) reanalysis, as well as the state-of-art sounder products are used to build the training database, including radiative kernels. We will demonstrate the results retrieved from CrIS observations and the associated validation work.

Wan Wu↗
NASA NTRS1997

Advanced Signal Processing Methods Applied to Digital Mammography

The work reported here is on the extension of the earlier proposal of the same title, August 1994-June 1996. The report for that work is also being submitted. The work reported there forms the foundation for this work from January 1997 to September 1997. After the earlier work was completed there were a few items that needed to be completed prior to submission of a new and more comprehensive proposal for further research. Those tasks have been completed and two new proposals have been submitted, one to NASA, and one to Health & Human Services WS). The main purpose of this extension was to refine some of the techniques that lead to automatic large scale evaluation of full mammograms. Progress on each of the proposed tasks follows. Task 1: A multiresolution segmentation of background from breast has been developed and tested. The method is based on the different noise characteristics of the two different fields. The breast field has more power in the lower octaves and the off-breast field behaves similar to a wideband process, where more power is in the high frequency octaves. After the two fields are separated by lowpass filtering, a region labeling routine is used to find the largest contiguous region, the breast. Task 2: A wavelet expansion that can decompose the image without zero padding has been developed. The method preserves all properties of the power-of-two wavelet transform and does not add appreciably to computation time or storage. This work is essential for analysis of the full mammogram, as opposed to selecting sections from the full mammogram. Task 3: A clustering method has been developed based on a simple counting mechanism. No ROC analysis has been performed (and was not proposed), so we cannot finally evaluate this work without further support. Task 4: Further testing of the filter reveals that different wavelet bases do yield slightly different qualitative results. We cannot provide quantitative conclusions about this for all possible bases without further support. Task 5: Better modeling does indeed make an improvement in the detection output. After the proposal ended, we came up with some new theoretical explanations that helps in understanding when the D4 filter should be better. This work is currently in the review process. Task 6: N/A. This no longer applies in view of Tasks 4-5. Task 7: Comprehensive plans for further work have been completed. These plans are the subject of two proposals, one to NASA and one to HHS. These proposals represent plans for a complete evaluation of the methods for identifying normal mammograms, augmented with significant further theoretical work.

Stauduhar, Richard P.↗
NASA NTRS2002

Gas-Phase Reaction Pathways and Rate Coefficients for the Dichlorosilane-Hydrogen and Trichlorosilane-Hydrogen Systems

As part of NASA Ames Research Center's Integrated Process Team on Device/Process Modeling and Nanotechnology our goal is to create/contribute to a gas-phase chemical database for use in modeling microelectronics devices. In particular, we use ab initio methods to determine chemical reaction pathways and to evaluate reaction rate coefficients. Our initial studies concern reactions involved in the dichlorosilane-hydrogen (SiCl2H2--H2) and trichlorosilane-hydrogen (SiCl2H-H2) systems. Reactant, saddle point (transition state), and product geometries and their vibrational harmonic frequencies are determined using the complete-active-space self-consistent-field (CASSCF) electronic structure method with the correlation consistent polarized valence double-zeta basis set (cc-pVDZ). Reaction pathways are constructed by following the imaginary frequency mode of the saddle point to both the reactant and product. Accurate energetics are determined using the singles and doubles coupled-cluster method that includes a perturbational estimate of the effects of connected triple excitations (CCSD(T)) extrapolated to the complete basis set limit. Using the data from the electronic structure calculations, reaction rate coefficients are obtained using conventional and variational transition state and RRKM theories.

Dateo, Christopher E.↗
NASA NTRS2012

The Gas Distribution in the Outer Regions of Galaxy Clusters

Aims. We present our analysis of a local (z = 0.04 - 0.2) sample of 31 galaxy clusters with the aim of measuring the density of the X-ray emitting gas in cluster outskirts. We compare our results with numerical simulations to set constraints on the azimuthal symmetry and gas clumping in the outer regions of galaxy clusters. Methods. We have exploited the large field-of-view and low instrumental background of ROSAT/PSPC to trace the density of the intracluster gas out to the virial radius, We stacked the density profiles to detect a signal beyond T200 and measured the typical density and scatter in cluster outskirts. We also computed the azimuthal scatter of the profiles with respect to the mean value to look for deviations from spherical symmetry. Finally, we compared our average density and scatter profiles with the results of numerical simulations. Results. As opposed to some recent Suzaku results, and confirming previous evidence from ROSAT and Chandra, we observe a steepening of the density profiles beyond approximately r(sub 500). Comparing our density profiles with simulations, we find that non-radiative runs predict density profiles that are too steep, whereas runs including additional physics and/ or treating gas clumping agree better with the observed gas distribution. We report high-confidence detection of a systematic difference between cool-core and non cool-core clusters beyond approximately 0.3r(sub 200), which we explain by a different distribution of the gas in the two classes. Beyond approximately r(sub 500), galaxy clusters deviate significantly from spherical symmetry, with only small differences between relaxed and disturbed systems. We find good agreement between the observed and predicted scatter profiles, but only when the 1% densest clumps are filtered out in the ENZO simulations. Conclusions. Comparing our results with numerical simulations, we find that non-radiative simulations fail to reproduce the gas distribution, even well outside cluster cores. Although their general behavior agrees more closely with the observations, simulations including cooling and star formation convert a large amount of gas into stars, which results in a low gas fraction with respect to the observations. Consequently, a detailed treatment of gas cooling, star formation, AGN feedback, and consideration of gas clumping is required to construct realistic models of the outer regions of clusters.

Eckert, D.↗
NASA NTRS1992

Concerted hydrogen atom exchange between three HF molecules

We have investigated the termolecular reaction involving concerted hydrogen exchange between three HF molecules, with particular emphasis on the effects of correlation at the various stationary points along the reaction. Using an extended basis, we have located the geometries of the stable hydrogen-bonded trimer, which is of C(sub 3h) symmetry, and the transition state for hydrogen exchange, which is of D(sub 3h) symmetry. The energies of the exchange reation were then evaluated at the correlated level, using a large atomic natural orbital basis and correlating all valence electrons. Several correlation treatments were used, namely, configration interaction with single and double excitations, coupled-pair functional, and coupled-cluster methods. We are thus able to measure the effect of accounting for size-extensivity. Zero-point corrections to the correlated level energetics were determined using analytic second derivative techniques at the SCF level. Our best calculations, which include the effects of connected triple excitations in the coupled-cluster procedure, indicate that the trimer is bound by 9 +/- 1 kcal/mol relative to three separate monomers, in excellent agreement with previous estimates. The barrier to concerted hydrogen exchange is 15 kcal/mol above the trimer, or only 4.7 kcal/mol above three separated monomers. Thus the barrier to hydrogen exchange between HF molecules via this termolecular process is very low.

Komornicki, Andrew↗
NASA NTRS2006

Value, Cost, and Sharing: Open Issues in Constrained Clustering

Clustering is an important tool for data mining, since it can identify major patterns or trends without any supervision (labeled data). Over the past five years, semi-supervised (constrained) clustering methods have become very popular. These methods began with incorporating pairwise constraints and have developed into more general methods that can learn appropriate distance metrics. However, several important open questions have arisen about which constraints are most useful, how they can be actively acquired, and when and how they should be propagated to neighboring points. This position paper describes these open questions and suggests future directions for constrained clustering research.

constraints↗
NASA NTRS2012

The Gas Distribution in Galaxy Cluster Outer Regions

Aims. We present the analysis of a local (z = 0.04 - 0.2) sample of 31 galaxy clusters with the aim of measuring the density of the X-ray emitting gas in cluster outskirts. We compare our results with numerical simulations to set constraints on the azimuthal symmetry and gas clumping in the outer regions of galaxy clusters. Methods. We exploit the large field-of-view and low instrumental background of ROSAT/PSPC to trace the density of the intracluster gas out to the virial radius. We perform a stacking of the density profiles to detect a signal beyond r200 and measure the typical density and scatter in cluster outskirts. We also compute the azimuthal scatter of the profiles with respect to the mean value to look for deviations from spherical symmetry. Finally, we compare our average density and scatter profiles with the results of numerical simulations. Results. As opposed to some recent Suzaku results, and confirming previous evidence from ROSAT and Chandra, we observe a steepening of the density profiles beyond approximately r(sub 500). Comparing our density profiles with simulations, we find that non-radiative runs predict too steep density profiles, whereas runs including additional physics and/or treating gas clumping are in better agreement with the observed gas distribution. We report for the first time the high-confidence detection of a systematic difference between cool-core and non-cool core clusters beyond 0.3r(sub 200), which we explain by a different distribution of the gas in the two classes. Beyond r(sub 500), galaxy clusters deviate significantly from spherical symmetry, with only little differences between relaxed and disturbed systems. We find good agreement between the observed and predicted scatter profiles, but only when the 1% densest clumps are filtered out in the simulations. Conclusions. Comparing our results with numerical simulations, we find that non-radiative simulations fail to reproduce the gas distribution, even well outside cluster cores. Although their general behavior is in better agreement with the observations, simulations including cooling and star formation convert a large amount of gas into stars, which results in a low gas fraction with respect to the observations. Consequently, a detailed treatment of gas cooling, star formation, AGN feedback, and taking into account gas clumping is required to construct realistic models of cluster outer regions.

Eckert, D.↗
NASA NTRS2011

Observational and Numerical Diagnostics of Galaxy Cluster Outer Regions

Aims. We present the analysis of a local (z = 0.04 - 0.2) sample of 31 galaxy clusters with the aim of measuring the density of the X-ray emitting gas in cluster outskirts. We compare our results with numerical simulations to set constraints on the azimuthal symmetry and gas clumping in the outer regions of galaxy clusters. Methods. We exploit the large field-of-view and low instrumental background of ROSAT/PSPC to trace the density of the intracluster gas out to the virial radius. We perform a stacking of the density profiles to detect a signal beyond r(sub 200) and measure the typical density and scatter in cluster outskirts. We also compute the azimuthal scatter of the profiles with respect to the mean value to look for deviations from spherical symmetry. Finally, we compare our average density and scatter profiles with the results of numerical simulations. Results. As opposed to several recent results, we observe a steepening of the density profiles beyond approximately 0.3r(sub 500). Comparing our density profiles with simulations, we find that non-radiative runs predict too steep density profiles, whereas runs including additional physics and/or gas clumping are in better agreement with the observed gas distribution. We note a systematic difference between cool-core and non-cool core clusters beyond approximately 0.3r(sub 200), which we explain by a different distribution of the gas in the two classes. Beyond approximately r(sub 500), galaxy clusters deviate significantly from spherical symmetry, with only little differences between relaxed and disturbed systems. We find good agreement between the observed and predicted scatter profiles, but only when the 1% densest clumps are filtered out in the simulations. Conclusions. The general trend of steepening density around the virial radius indicates that the shallow density profiles found in several recent works were probably obtained along particular directions (e.g., filaments) and are not representative of the typical behavior of clusters. Comparing our results with numerical simulations, we find that non-radiative simulations fail to reproduce the gas distribution, even well outside cluster cores. Therefore, a detailed treatment of gas cooling, star formation, clumping, and AGN feedback is required to construct realistic models of cluster outer regions.

Eckert, D.↗
NASA NTRS1993

X ray studies of the Hyades cluster

The Hyades cluster occupies a unique position in both the history of astronomy and at the frontiers of contemporary astronomical research. At a distance of only 45 pc, the Hyades is the nearest star cluster in the Galaxy which is localized in the sky: the UMa cluster, which is closer, but much sparser, essentially surrounds the Solar neighborhood. The Hyades is the prototype cluster for distance determination using the 'moving-cluster' method, and thus serves to define the zero-age main sequence from which the cosmic distance scale is essentially bootstrapped. The Hyades age (0.6-0.7 Gyr), nearly 8 times younger than the Sun, guarantees the Hyades critical importance to studies of stellar evolution. The results of a complete survey of the Hyades cluster using the ROSAT All Sky Survey (RASS) are reported.

Stern, Robert A.↗