Search NASA⌕ Search

SEARCH · Search NASA

Results for “clustering methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

DCA++: A case for science driven application development for leadership computing platforms

Abstract. The DCA++ code was one of the early science applications that ran on jaguar at the National Center for Computational Sciences, and the rst application code to sustain a peta op/s under production conditions on a general-purpose supercomputer. The code implements a quantum cluster method with a Quantum Monte Carlo kernel to solve the 2D Hubbard model for high-temperature superconductivity. It is implemented in C++, making heavy use of the generic programming model. In this paper, we discuss how this code was developed, reaching scalability and high ef ciency on the world s fastest supercomputer in only a few years. We show how the use of generic concepts combined with systematic refactoring of codes is a better strategy for computational sciences than a comprehensive upfront design.

99 GENERAL AND MISCELLANEOUS↗

Evaluation of tropical cloud and precipitation statistics of CAM3 using CloudSat and CALIPSO data

The combined CloudSat and CALIPSO satellite observations provide the first simultaneous measurements of cloud and precipitation vertical structure, and are used to examine the representation of tropical clouds and precipitation in the Community Atmosphere Model Version 3 (CAM3). A simulator package utilizing a model-to-satellite approach facilitates comparison of model simulations to observations, and a revised clustering method is used to sort the subgrid-scale patterns of clouds and precipitation into principal cloud regimes. Results from weather forecasts performed with CAM3 suggest that the model underestimates the horizontal extent of low and mid-level clouds in subsidence regions, but overestimates that of high clouds in ascending regions. CAM3 strongly overestimates the frequency of occurrence of the deep convection with heavy precipitation regime, but underestimates the horizontal extent of clouds and precipitation at low and middle levels when this regime occurs. This suggests that the model overestimates convective precipitation and underestimates stratiform precipitation consistent with a previous study that used only precipitation observations. Tropical cloud regimes are also evaluated in a different version of the model, CAM3.5, which uses a highly entraining plume in the parameterization of deep convection. While the frequency of occurrence of the deep convection with heavy precipitation regime from CAM3.5 forecasts decreases, the incidence of the low clouds with precipitation and congestus regimes increases. As a result, the parameterization change does not reduce the frequency of precipitating convection that is far too high relative to observations. For both versions of CAM, clouds and precipitation are overly reflective at the frequency of the CloudSat radar and thin clouds that could be detected by the lidar only are underestimated.

54 ENVIRONMENTAL SCIENCES↗

Toward A National Early Warning System for Forest Disturbances Using Remotely Sensed Land Surface Phenology

We are using a statistical clustering method for delineating homogeneous ecoregions as a basis for identifying disturbances in forests through time over large areas, up to national and global extents. Such changes can be shown relative to past conditions, or can be predicted relative to present conditions, as with forecasts of future climatic change. This quantitative ecoregion approach can be used to predict destinations for populations whose local environments are forecast to become unsuitable and are forced to migrate as their habitat shifts, and is also useful for predicting the susceptibility of new locations to invasive species like Sudden Oak Death. EFETAC and our sister western center WWETAC, along with our NASA and ORNL collaborators, are designing a new national-scale early warning system for forest threats, called FIRST. Envisioned as a change-detection system, FIRST will identify all land surface cover changes at the MODIS observational scale, and then try to discriminate normal, expected seasonal changes from locations having unusual activity that may represent potential forest threats. As a start, we have developed new national data sets every 16 days from 2002 through 2008, based on land surface phenology, or timing of leaf-out in the spring and brown-down in the fall. Changes in such phenological maps will be shown to contain important information about vegetation health status across the United States. The standard deviation of the duration of fall can be mapped, showing places where length of fall is relatively constant or is variable in length from year to year.

54 ENVIRONMENTAL SCIENCES↗

Loss Informed Dispatcher for Battery Systems (LIDBS)

LIDBS takes battery-system operational data as an input. It then cleans the data using density-based clustering methods, forms an initial loss model, and then embeds the loss model into the optimization formulation. LIDBS provides a much more informed dispatch strategy over state-of-the-art approaches.

Latif, Aadil↗

Systematic Quantum Cluster Typical Medium Method for the Study of Localization in Strongly Disordered Electronic Systems

Great progress has been made in recent years towards understanding the properties of disordered electronic systems. In part, this is made possible by recent advances in quantum effective medium methods which enable the study of disorder and electron-electronic interactions on equal footing. They include dynamical mean-field theory and the Coherent Potential Approximation, and their cluster extension, the dynamical cluster approximation. Despite their successes, these methods do not enable the first-principles study of the strongly disordered regime, including the effects of electronic localization. The main focus of this review is the recently developed typical medium dynamical cluster approximation for disordered electronic systems. This method has been constructed to capture disorder-induced localization and is based on a mapping of a lattice onto a quantum cluster embedded in an effective typical medium, which is determined self-consistently. Unlike the average effective medium-based methods mentioned above, typical medium-based methods properly capture the states localized by disorder. The typical medium dynamical cluster approximation not only provides the proper order parameter for Anderson localized states, but it can also incorporate the full complexity of Density-Functional Theory (DFT)-derived potentials into the analysis, including the effect of multiple bands, non-local disorder, and electron-electron interactions. After a brief historical review of other numerical methods for disordered systems, we discuss coarse-graining as a unifying principle for the development of translationally invariant quantum cluster methods. Together, the Coherent Potential Approximation, the Dynamical Mean-Field Theory and the Dynamical Cluster Approximation may be viewed as a single class of approximations with a much-needed small parameter of the inverse cluster size which may be used to control the approximation. We then present an overview of various recent applications of the typical medium dynamical cluster approximation to a variety of models and systems, including single and multiband Anderson model, and models with local and off-diagonal disorder. We then present the application of the method to realistic systems in the framework of the DFT and demonstrate that the resulting method can provide a systematic first-principles method validated by experiment and capable of making experimentally relevant predictions. We also discuss the application of the typical medium dynamical cluster approximation to systems with disorder and electron-electron interactions. Most significantly, we show that in the limits of strong disorder and weak interactions treated perturbatively, that the phenomena of 3D localization, including a mobility edge, remains intact. However, the metal-insulator transition is pushed to larger disorder values by the local interactions. We also study the limits of strong disorder and strong interactions capable of producing moment formation and screening, with a non-perturbative local approximation. Here, we find that the Anderson localization quantum phase transition is accompanied by a quantum-critical fan in the energy-disorder phase diagram.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Recognition Method of Vehicle Cluster Situation Based on Set Pair Logic considering Driver’s Cognition

The recognition of vehicle cluster situations is one of the critical technologies of advanced driving, such as intelligent driving and automated driving. The accurate recognition of vehicle cluster situations is helpful for behavior decision‐making safe and efficient. In order to accurately and objectively identify the vehicle cluster situation, a vehicle cluster situation model is proposed based on the interval number of set pair logic. The proposed model can express the traffic environment’s knowledge considering each vehicle’s characteristics, grouping relationships, and traffic flow characteristics in the target vehicle’s interest region. A recognition method of vehicle cluster situation is designed to infer the traffic environment and driving conditions based on the connection number of set pair logic. In the proposed model, the uncertainty of the driver’s cognition is fully considered. In the recognition method, the relative uncertainty and relative certainty of driver’s cognition, traffic information, and vehicle cluster situation are fully considered. The verification results show that the proposed recognition method of vehicle cluster situations can realize accurate and objective recognition. The proposed anthropomorphic recognition method could provide a basis for vehicle autonomous behavior decision‐making.

Liu, Shijie↗

Electronic excitation spectra of molecules in solution calculated using the symmetry-adapted cluster-configuration interaction method in the polarizable continuum model with perturbative approach

A perturbative approximation of the state specific polarizable continuum model (PCM) symmetry-adapted cluster-configuration interaction (SAC-CI) method is proposed for efficient calculations of the electronic excitations and absorption spectra of molecules in solutions. This first-order PCM SAC-CI method considers the solvent effects on the energies of excited states up to the first-order with using the zeroth-order wavefunctions. This method can avoid the costly iterative procedure of the self-consistent reaction field calculations. The first-order PCM SAC-CI calculations well reproduce the results obtained by the iterative method for various types of excitations of molecules in polar and nonpolar solvents. The first-order contribution is significant for the excitation energies. The results obtained by the zeroth-order PCM SAC-CI, which considers the fixed ground-state reaction field for the excited-state calculations, are deviated from the results by the iterative method about 0.1 eV, and the zeroth-order PCM SAC-CI cannot predict even the direction of solvent shifts in n-hexane for many cases. The first-order PCM SAC-CI is applied to studying the solvatochromisms of (2,2{sup ′}-bipyridine)tetracarbonyltungsten [W(CO){sub 4}(bpy), bpy = 2,2{sup ′}-bipyridine] and bis(pentacarbonyltungsten)pyrazine [(OC){sub 5}W(pyz)W(CO){sub 5}, pyz = pyrazine]. The SAC-CI calculations reveal the detailed character of the excited states and the mechanisms of solvent shifts. The energies of metal to ligand charge transfer states are significantly sensitive to solvents. The first-order PCM SAC-CI well reproduces the observed absorption spectra of the tungsten carbonyl complexes in several solvents.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A method of using cluster analysis to study statistical dependence in multivariate data

A technique is presented that uses both cluster analysis and a Monte Carlo significance test of clusters to discover associations between variables in multidimensional data. The method is applied to an example of a noisy function in three-dimensional space, to a sample from a mixture of three bivariate normal distributions, and to the well-known Fisher's Iris data.

Borucki, W. J.↗

An efficient computational scheme for electronic excitation spectra of molecules in solution using the symmetry-adapted cluster–configuration interaction method: The accuracy of excitation energies and intuitive charge-transfer indices

Solvent effects on electronic excitation spectra are considerable in many situations; therefore, we propose an efficient and reliable computational scheme that is based on the symmetry-adapted cluster-configuration interaction (SAC-CI) method and the polarizable continuum model (PCM) for describing electronic excitations in solution. The new scheme combines the recently proposed first-order PCM SAC-CI method with the PTE (perturbation theory at the energy level) PCM SAC scheme. This is essentially equivalent to the usual SAC and SAC-CI computations with using the PCM Hartree-Fock orbital and integrals, except for the additional correction terms that represent solute-solvent interactions. The test calculations demonstrate that the present method is a very good approximation of the more costly iterative PCM SAC-CI method for excitation energies of closed-shell molecules in their equilibrium geometry. This method provides very accurate values of electric dipole moments but is insufficient for describing the charge-transfer (CT) indices in polar solvent. The present method accurately reproduces the absorption spectra and their solvatochromism of push-pull type 2,2{sup ′}-bithiophene molecules. Significant solvent and substituent effects on these molecules are intuitively visualized using the CT indices. The present method is the simplest and theoretically consistent extension of SAC-CI method for including PCM environment, and therefore, it is useful for theoretical and computational spectroscopy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Incorporating a completely renormalized coupled cluster approach into a composite method for thermodynamic properties and reaction paths

The correlation consistent composite approach (ccCA), using the S4 complete basis set two-point extrapolation scheme (ccCA-S4), has been modified to incorporate the left-eigenstate completely renormalized coupled cluster method, including singles, doubles, and non-iterative triples (CR-CC(2,3)) as the highest level component. The new ccCA-CC(2,3) method predicts thermodynamic properties with an accuracy that is similar to that of the original ccCA-S4 method. At the same time, the inclusion of the single-reference CR-CC(2,3) approach provides a ccCA scheme that can correctly treat reaction pathways that contain certain classes of multi-reference species such as diradicals, which would normally need to be treated by more computationally demanding multi-reference methods. The new ccCA-CC(2,3) method produces a mean absolute deviation of 1.7 kcal/mol for predicted heats of formation at 298 K, based on calibration with the G2/97 set of 148 molecules, which is comparable to that of 1.0 kcal/mol obtained using the ccCA-S4 method, while significantly improving the performance of the ccCA-S4 approach in calculations involving more demanding radical and diradical species. Both the ccCA-CC(2,3) and ccCA-S4 composite methods are used to characterize the conrotatory and disrotatory isomerization pathways of bicyclo[1.1.0]butane to trans-1,3-butadiene, for which conventional coupled cluster methods, such as the CCSD(T) approach used in the ccCA-S4 model and, in consequence, the ccCA-S4 method itself might fail by incorrectly placing the disrotatory pathway below the conrotatory one. The ccCA-CC(2,3) scheme provides correct pathway ordering while providing an accurate description of the activation and reaction energies characterizing the lowest-energy conrotatory pathway. The ccCA-CC(2,3) method is thus a viable method for the analyses of reaction mechanisms that have significant multi-reference character, and presents a generally less computationally intensive alternative to true multi-reference methods, with computer costs and ease of use that are similar to those that characterize the more established, CCSD(T)-based, ccCA-S4 methodology.

36 MATERIALS SCIENCE↗

Electronic excitation of molecules in solution calculated using the symmetry-adapted cluster–configuration interaction method in the polarizable continuum model

The effects from solvent environment are specific to the electronic states; therefore, a computational scheme for solvent effects consistent with the electronic states is necessary to discuss electronic excitation of molecules in solution. The PCM (polarizable continuum model) SAC (symmetry-adapted cluster) and SAC-CI (configuration interaction) methods are developed for such purposes. The PCM SAC-CI adopts the state-specific (SS) solvation scheme where solvent effects are self-consistently considered for every ground and excited states. For efficient computations of many excited states, we develop a perturbative approximation for the PCM SAC-CI method, which is called corrected linear response (cLR) scheme. Our test calculations show that the cLR PCM SAC-CI is a very good approximation of the SS PCM SAC-CI method for polar and nonpolar solvents.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Automated cloud screening of AVHRR imagery using split-and-merge clustering

Previous methods to segment clouds from ocean in AVHRR imagery have shown varying degrees of success, with nighttime approaches being the most limited. An improved method of automatic image segmentation, the principal component transformation split-and-merge clustering (PCTSMC) algorithm, is presented and applied to cloud screening of both nighttime and daytime AVHRR data. The method combines spectral differencing, the principal component transformation, and split-and-merge clustering to sample objectively the natural classes in the data. This segmentation method is then augmented by supervised classification techniques to screen clouds from the imagery. Comparisons with other nighttime methods demonstrate its improved capability in this application. The sensitivity of the method to clustering parameters is presented; the results show that the method is insensitive to the split-and-merge thresholds.

Gallaudet, Timothy C.↗

System and Method for Outlier Detection via Estimating Clusters

An efficient method and system for real-time or offline analysis of multivariate sensor data for use in anomaly detection, fault detection, and system health monitoring is provided. Models automatically derived from training data, typically nominal system data acquired from sensors in normally operating conditions or from detailed simulations, are used to identify unusual, out of family data samples (outliers) that indicate possible system failure or degradation. Outliers are determined through analyzing a degree of deviation of current system behavior from the models formed from the nominal system data. The deviation of current system behavior is presented as an easy to interpret numerical score along with a measure of the relative contribution of each system parameter to any off-nominal deviation. The techniques described herein may also be used to "clean" the training data.

Iverson, David J.↗

Robust Tensor Hypercontraction of the Particle–Particle Ladder Term in Equation-of-Motion Coupled Cluster Theory

One method of representing a high-rank tensor as a (hyper-)product of lower-rank tensors is the tensor hypercontraction (THC) method of Hohenstein et al. This strategy has been found to be useful for reducing the polynomial scaling of coupled-cluster methods by representation of a four-dimensional tensor of electron-repulsion integrals in terms of five two-dimensional matrices. Pierce et al. have already shown that the application of a robust form of THC to the particle–particle ladder (PPL) term reduces the cost of this term in couple-cluster singles and doubles (CCSD) from O(N 6 ) to O(N 5 ) with negligible errors in energy with respect to the density-fitted variant. In this work, we have implemented the least-squares variant of THC (LS-THC) which does not require a nonlinear tensor factorization, including the robust form (R-LS-THC), for the calculation of the excitation and electron attachment energies using equation-of-motion coupled cluster methods EOMEE-CCSD and EOMEA-CCSD, respectively. We have benchmarked the effect of the R-LS-THC-PPL approximation on excitation energies using the comprehensive QUEST database and the accuracy of electron attachment energies using the NAB22 database. Here, we find that errors on the order of 1 meV are achievable with a reduction in total calculation time of approximately 5x.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Cooling rate dependence of structural order in Al{sub 90}Sm{sub 10} metallic glass

The atomic structure of Al{sub 90}Sm{sub 10} metallic glass is studied using molecular dynamics simulations. By performing a long sub-T{sub g} annealing, we developed a glass model closer to the experiments than the models prepared by continuous cooling. Using the cluster alignment method, we found that “3661” cluster is the dominating short-range order in the glass samples. The connection and arrangement of “3661” clusters, which define the medium-range order in the system, are enhanced significantly in the sub-T{sub g} annealed sample as compared with the fast cooled glass samples. Unlike some strong binary glass formers such as Cu{sub 64.5}Zr{sub 35.5}, the clusters representing the short-range order do not form an interconnected interpenetrating network in Al{sub 90}Sm{sub 10,} which has only marginal glass formability.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Characterization of DESI fiber assignment incompleteness effect on 2-point clustering and mitigation methods for DR1 analysis

We present an in-depth analysis of the fiber assignment incompleteness in the Dark Energy Spectroscopic Instrument (DESI) Data Release 1 (DR1). This incompleteness is caused by the restricted mobility of the robotic fiber positioner in the DESI focal plane, which limits the number of galaxies that can be observed at the same time, especially at small angular separations. As a result, the observed clustering amplitude is suppressed in a scale-dependent manner, which, if not addressed, can severely impact the inference of cosmological parameters. We discuss the methods adopted for simulating fiber assignment on mocks and data. In particular, we introduce the fast fiber assignment (FFA) emulator, which was employed to obtain the power spectrum covariance adopted for the DR1 full-shape analysis. We present the mitigation techniques, organised in two classes: measurement stage and model stage. We then use high fidelity mocks as a reference to quantify both the accuracy of the FFA emulator and the effectiveness of the different measurement-stage mitigation techniques. This complements the studies conducted in a parallel paper for the model-stage techniques, namely the θ-cut approach. We find that pairwise inverse probability (PIP) weights with angular upweighting recover the “true” clustering in all the cases considered, in both Fourier and configuration space. Notably, we present the first ever power spectrum measurement with PIP weights from real data.

cosmological simulations↗

Characterization of DESI fiber assignment incompleteness effect on 2-point clustering and mitigation methods for DR1 analysis

We present an in-depth analysis of the fiber assignment incompleteness in the Dark EnergySpectroscopic Instrument (DESI) Data Release 1 (DR1). This incompleteness is caused by therestricted mobility of the robotic fiber positioner in the DESI focal plane, which limits thenumber of galaxies that can be observed at the same time, especially at small angular separations.As a result, the observed clustering amplitude is suppressed in a scale-dependent manner, which,if not addressed, can severely impact the inference of cosmological parameters. We discuss themethods adopted for simulating fiber assignment on mocks and data. In particular, we introducethe fast fiber assignment (FFA) emulator, which was employed to obtain the power spectrumcovariance adopted for the DR1 full-shape analysis. We present the mitigation techniques,organised in two classes: measurement stage and model stage. We then use high fidelity mocks as areference to quantify both the accuracy of the FFA emulator and the effectiveness of the differentmeasurement-stage mitigation techniques. This complements the studies conducted in a parallelpaper for the model-stage techniques, namely the θ-cut approach. We find that pairwiseinverse probability (PIP) weights with angular upweighting recover the “true” clustering in allthe cases considered, in both Fourier and configuration space. Notably, we present the first everpower spectrum measurement with PIP weights from real data.

79 ASTRONOMY AND ASTROPHYSICS↗