Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed clustering methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Structural features and the microscopic dynamics of the three-component Zr{sub 47}Cu{sub 46}Al{sub 7} system: Equilibrium melt, supercooled melt, and amorphous alloy

The structural and dynamic properties of the three-component Zr{sub 47}Cu{sub 46}Al{sub 7} system are subjected to a molecular dynamics simulation in the temperature range T = 250–3000 K at a pressure p = 1.0 bar. The temperature dependences of the Wendt–Abraham parameter and the translation order parameter are used to determine the glass transition temperature in the Zr{sub 47}Cu{sub 46}Al{sub 7} system, which is found to be T{sub c} ≈ 750 K. It is found that the bulk amorphous Zr{sub 47}Cu{sub 46}Al{sub 7} alloy contains localized regions with an ordered atomic structures. Cluster analysis of configuration simulation data reveals the existence of quasi-icosahedral clusters in amorphous metallic Zr–Cu–Al alloys. The spectral densities of time radial distribution functions of the longitudinal (C̃{sub L}(k, ω)) and transverse (C̃{sub T}(k, ω)) fluxes are calculated in a wide wavenumber range in order to study the mechanisms of formation of atomic collective excitations in the Zr{sub 47}Cu{sub 46}Al{sub 7} system. It was found that a linear combination of three Gaussian functions is sufficient to reproduce the (C̃{sub L}(k, ω)) spectra, whereas at least four Gaussian contributions are necessary to exactly describe the (C̃{sub T}(k, ω)) spectra of the supercooled melt and the amorphous metallic alloy. It is shown that the collective atomic excitations in the equilibrium melt at T = 3000 K and in the amorphous metallic alloy at T = 250 K are characterized by two dispersion acoustic-like branches related with longitudinal and transverse polarizations.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

NASA Instrument Cost/Schedule Model

NASA's Office of Independent Program and Cost Evaluation (IPCE) has established a number of initiatives to improve its cost and schedule estimating capabilities. 12One of these initiatives has resulted in the JPL developed NASA Instrument Cost Model. NICM is a cost and schedule estimator that contains: A system level cost estimation tool; a subsystem level cost estimation tool; a database of cost and technical parameters of over 140 previously flown remote sensing and in-situ instruments; a schedule estimator; a set of rules to estimate cost and schedule by life cycle phases (B/C/D); and a novel tool for developing joint probability distributions for cost and schedule risk (Joint Confidence Level (JCL)). This paper describes the development and use of NICM, including the data normalization processes, data mining methods (cluster analysis, principal components analysis, regression analysis and bootstrap cross validation), the estimating equations themselves and a demonstration of the NICM tool suite.

JCL↗

TeraChem Cloud: A High-Performance Computing Service for Scalable Distributed GPU-Accelerated Electronic Structure Calculations

The encapsulation and commoditization of electronic structure arise naturally as interoperability, and the use of nontraditional compute resources (e.g., new hardware accelerators, cloud computing) remains important for the computational chemistry community. Here, we present TERACHEM CLOUD, a high-performance computing service (HPCS) that offers on-demand electronic structure calculations on both traditional HPC clusters and cloud-based hardware. The framework is designed using off-the-shelf web technologies and containerization to be extremely scalable and portable. Within the HPCS model, users can quickly develop new methods and algorithms in an interactive environment on their laptop while allowing TERACHEM CLOUD to distribute ab initio calculations across all available resources. This approach greatly increases the accessibility of hardware accelerators such as graphics processing units (GPUs) and flexibility for the development of new methods as additional electronic structure packages are integrated into the framework as alternative backends. Cost-performance analysis indicates that traditional nodes are the most cost-effective long-term solution, but commercial cloud providers offer cutting-edge hardware with competitive rates for short-term large-scale calculations. We demonstrate the power of the TERACHEM CLOUD framework by carrying out several showcase calculations, including the generation of 300,000 density functional theory energy and gradient evaluations on medium-sized organic molecules and reproducing 300 fs of nonadiabatic dynamics on the B800-B850 antenna complex in LH2, with the latter demonstration using over 50 Tesla V100 GPUs in a commercial cloud environment in 8 h for approximately $1250.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Efficient Network Partitioning: Application for Decentralized State Estimation in Power Distribution Grids

Increase in the proliferation of distributed energy resources require real-time situational awareness for efficient grid operations. State estimation plays an important role for the real-time control and management of the power grid. As the sensing infrastructure grows, aggregating and handling high volumes of data at a centralized location is extremely difficult. To address this challenge, this paper first proposes a novel and efficient hier-archical spectral clustering-based network partitioning algorithm followed by a decentralized compressive sensing (DCS)-based state estimation. The applicability of the proposed network partitioning algorithm is tested on an IEEE 123-bus network, an IEEE 8,500-node system, and a 6,000+ node distribution network. The results shows that the proposed approach efficiently divides the network into multiple sub-networks with the minimum number of edge connections among the neighbors. Then, we perform DCS-based state estimation on the 6,000+ node distribution network after dividing the network into 18 optimal partitions. Simulation results show that the DCS-based state estimation recovers the system states with high accuracy and low complexity.

alternating direction method of multipliers↗

LUMINOUS SATELLITES VERSUS DARK SUBHALOS: CLUSTERING IN THE MILKY WAY

The observed population of the Milky Way satellite galaxies offers a unique testing ground for galaxy formation theory on small scales. Our novel approach was to investigate the clustering of the known Milky Way satellite galaxies and to quantify the amount of substructure within their distribution using a two-point correlation function statistic in each of three spaces: configuration space, line-of-sight velocity space, and four-dimensional (4D) phase space. These results were compared to those for three sets of subhalos in the Via Lactea II cold dark matter (CDM) simulation defined to represent the luminous dwarfs. We found no evidence at a significance level above 2{sigma} of substructure within the distribution of the Milky Way satellite galaxies in any of the three spaces. The 'luminous' subhalo sets are more strongly clustered than are the Milky Way satellites in all three spaces and over a broader range of scales in 4D phase space. Each of the 'luminous' subhalo sets are clustered as a result of substructure within their line-of-sight velocity space distributions at greater than 3{sigma} significance, whereas the Milky Way satellite galaxies are randomly distributed in line-of-sight velocity space. While our comparison is with only one CDM simulation, the inconsistencies between the Milky Way satellite galaxies and the Via Lactea II subhalo sets for all clustering methods suggest a potential new 'small-scale' tension between CDM theory and the observed Milky Way satellites. Future work will obtain a more robust comparison between the observed Milky Way satellites and CDM theory by studying additional simulations.

79 ASTRONOMY AND ASTROPHYSICS↗

Bus Clustering for Distribution Grid Topology Identification

Recovering the distribution grid topology is essential to perform several distribution system operator functions. Many algorithms that address the topology recovery problem have already been proposed in the literature. Most are based on a priori information regarding which buses are fed by which substation; however, this information might not be available because frequent grid reconfigurations change the distribution grid portion connected to each substation. This paper addresses the problem of assigning every substation the set of buses that it is feeding, given field data. First, the aforementioned task is cast as a nonconvex optimization problem. Second, a relaxed version of the optimization problem is solved via the alternating direction method of multipliers. Finally, the performance of our approach is validated through numerical simulations of realistic scenarios using a standard IEEE benchmark feeder.

bus clustering↗

The eROSITA Final Equatorial-Depth Survey (eFEDS)

In 2019, the eROSITA telescope on board the Russian-German satellite Spectrum-Roentgen-Gamma (SRG) began to perform a deep all-sky X-ray survey with the aim of identifying ~100 000 clusters and groups over the course of four years. As part of its performance verification phase, a ~140 deg 2 survey, called eROSITA Final Equatorial-Depth Survey (eFEDS), was performed. With a depth typical of the all-sky survey after four years, it allows tests of tools and methods as well as improved predictions for the all-sky survey. As part of this effort, a catalog of 542 X-ray selected galaxy group and cluster candidates was compiled. Here, in this paper, we present the optical follow-up, with the aim of providing redshifts and cluster confirmation for the full sample. Furthermore, we aim to provide additional information on the dynamical state, richness, and optical center of the clusters. Finally, we aim to evaluate the impact of optical cluster confirmation on the purity and completeness of the X-ray selected sample. We used optical imaging data from the Hyper Suprime-Cam Subaru Strategic Program and from the Legacy Survey to identify optical counterparts to the X-ray detected cluster candidates. We make use of the multi-component matched filter cluster confirmation tool (MCMF), as well as of the optical cluster finder CAMIRA to derive cluster redshifts and richnesses. MCMF provided the probabilities with which an optical structure would be a chance superposition with the X-ray candidate. These probabilities were used to identify the best optical counterpart as well as to confirm an X-ray candidate as a cluster. The impact of this confirmation process on catalog purity and completeness was estimated using optical to X-ray scaling relations as well as simulations. The resulting catalog was furthermore matched with public group and cluster catalogs. Optical estimators of the cluster dynamical state were constructed based on density maps of the red-sequence galaxies at the cluster redshift. By providing redshift estimates for all 542 candidates, we construct an optically confirmed sample of 477 clusters and groups with a residual contamination of 6%. Of these, 470 (98.5%) are confirmed using MCMF, and 7 systems are added through cross-matching with spectroscopic group catalogs. Using observable-to-observable scaling and the applied confirmation threshold, we predict that 8 ± 2 real systems have been excluded with the MCMF cut required to build this low-contamination sample. This number agrees well with the 7 systems found through cross-matching that were not confirmed with MCMF. The predicted redshift and mass distribution of this catalog agree well with simulations. Thus, we expect that these 477 systems include >99% of all true clusters in the candidate list. Using an MCMF-independent method, we confirm that the catalog contamination of the confirmed subsample is 6 ± 3%. Application of the same method to the full candidate list yields 17 ± 3%, consistent with estimates coming from the fraction of confirmed systems of ~17% and with expectations from simulations of ~20%. We also present a sample of merging cluster candidates based on the derived estimators of the cluster dynamical state.

79 ASTRONOMY AND ASTROPHYSICS↗

Utah FORGE Project 3-2417: DAS Microseismic Event Catalog from the 16A/16B Circulation Test, 2023

This preliminary data archive includes the relocated microseismic event catalog, 1D velocity model, and methods report from DAS acquisition conducted during the Well 16A and 16B circulation test (July 19th and 20th, 2023) at Utah FORGE. The methods report describes all processing steps, including real-time event detection, hierarchical clustering, joint velocity/hypocenter inversion, and relocation. The resulting work is accepted and will be presented at IMAGE 2024. This dataset was acquired by the FOGMORE R&D project (Fiber Optic MOnitoring for Reservoir Evolution), Utah FORGE R&D Project 3-2417.

15 GEOTHERMAL ENERGY↗

Data augmentation for disruption prediction via robust surrogate models

The goal of this work is to generate large statistically representative data sets to train machine learning models for disruption prediction provided by data from few existing discharges. Such a comprehensive training database is important to achieve satisfying and reliable prediction results in artificial neural network classifiers. Here, we aim for a robust augmentation of the training database for multivariate time series data using Student t process regression. We apply Student t process regression in a state space formulation via Bayesian filtering to tackle challenges imposed by outliers and noise in the training data set and to reduce the computational complexity. Thus, the method can also be used if the time resolution is high. We use an uncorrelated model for each dimension and impose correlations afterwards via colouring transformations. We demonstrate the efficacy of our approach on plasma diagnostics data of three different disruption classes from the DIII-D tokamak. To evaluate if the distribution of the generated data is similar to the training data, we additionally perform statistical analyses using methods from time series analysis, descriptive statistics and classic machine learning clustering algorithms.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The persistence of large scale structures. Part I. Primordial non-Gaussianity

Abstract We develop an analysis pipeline for characterizing the topology of large scale structure and extracting cosmological constraints based on persistent homology . Persistent homology is a technique from topological data analysis that quantifies the multiscale topology of a data set, in our context unifying the contributions of clusters, filament loops, and cosmic voids to cosmological constraints. We describe how this method captures the imprint of primordial local non-Gaussianity on the late-time distribution of dark matter halos, using a set of N-body simulations as a proxy for real data analysis. For our best single statistic, running the pipeline on several cubic volumes of size 40 (Gpc/h) 3 , we detect f NL loc =10 at 97.5% confidence on ~ 85% of the volumes. Additionally wetest our ability to resolve degeneracies betweenthe topological signature of f NL loc and variation of σ 8 and argue that correctly identifying nonzero f NL loc in this case is possible via an optimal template method. Our method relies on information living at $\mathcal{O}$(10) Mpc/h, a complementary scale with respect to commonly used methods such as the scale-dependent bias in the halo/galaxy power spectrum. Therefore, while still requiring a large volume, our method does not require sampling long-wavelength modes to constrain primordial non-Gaussianity. Moreover, our statistics are interpretable: we are able to reproduce previous results in certain limits and we make new predictions for unexplored observables, such as filament loops formed by dark matter halos in a simulation box.

Astronomy & Astrophysics↗

Electric dipole polarizability from first principles calculations

The electric dipole polarizability quantifies the low-energy behavior of the dipole strength and is related to critical observables such as the radii of the proton and neutron distributions. Its computation is challenging because most of the dipole strength lies in the scattering continuum. In our paper we combine integral transforms with the coupled-cluster method and compute the dipole polarizability using bound-state techniques. Furthermore, employing different interactions from chiral effective field theory, we confirm the strong correlation between the dipole polarizability and the charge radius, and study its dependence on three-nucleon forces. Finally, we find good agreement with data for the 4 He, 40 Ca, and 16 O nuclei, and predict the dipole polarizability for the rare nucleus 22 O.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

TU-AB-BRC-12: Optimized Parallel MonteCarlo Dose Calculations for Secondary MU Checks

Purpose: Secondary MU checks are an important tool used during a physics review of a treatment plan. Commercial software packages offer varying degrees of theoretical dose calculation accuracy, depending on the modality involved. Dose calculations of VMAT plans are especially prone to error due to the large approximations involved. Monte Carlo (MC) methods are not commonly used due to their long run times. We investigated two methods to increase the computational efficiency of MC dose simulations with the BEAMnrc code. Distributed computing resources, along with optimized code compilation, will allow for accurate and efficient VMAT dose calculations. Methods: The BEAMnrc package was installed on a high performance computing cluster accessible to our clinic. MATLAB and PYTHON scripts were developed to convert a clinical VMAT DICOM plan into BEAMnrc input files. The BEAMnrc installation was optimized by running the VMAT simulations through profiling tools which indicated the behavior of the constituent routines in the code, e.g. the bremsstrahlung splitting routine, and the specified random number generator. This information aided in determining the most efficient compiling parallel configuration for the specific CPU’s available on our cluster, resulting in the fastest VMAT simulation times. Our method was evaluated with calculations involving 10{sup 8} – 10{sup 9} particle histories which are sufficient to verify patient dose using VMAT. Results: Parallelization allowed the calculation of patient dose on the order of 10 – 15 hours with 100 parallel jobs. Due to the compiler optimization process, further speed increases of 23% were achieved when compared with the open-source compiler BEAMnrc packages. Conclusion: Analysis of the BEAMnrc code allowed us to optimize the compiler configuration for VMAT dose calculations. In future work, the optimized MC code, in conjunction with the parallel processing capabilities of BEAMnrc, will be applied to provide accurate and efficient secondary MU checks.

60 APPLIED LIFE SCIENCES↗

Data augmentation for disruption prediction via robust surrogate models

The goal of this work is to generate large statistically representative datasets to train machine learning models for disruption prediction provided by data from few existing discharges. Such a comprehensive training database is important to achieve satisfying and reliable prediction results in artificial neural network classifiers. Here, we aim for a robust augmentation of the training database for multivariate time series data using Student-t process regression. We apply Student-t process regression in a state space formulation via Bayesian filtering to tackle challenges imposed by outliers and noise in the training data set and to reduce the computational complexity. Thus, the method can also be used if the time resolution is high. We use an uncorrelated model for each dimension and impose correlations afterwards via coloring transformations. We demonstrate the efficacy of our approach on plasma diagnostics data of three different disruption classes from the DIII-D tokamak. To evaluate if the distribution of the generated data is similar to the training data, we additionally perform statistical analyses using methods from time series analysis, descriptive statistics, and classic machine learning clustering algorithms.

97 MATHEMATICS AND COMPUTING↗

A cosmological redshift-distance square law

This paper directly examines the claims of Segal (1976) that the (m,z) Hubble diagram is fitted best by a square law z = Kr-squared rather than by the traditional Hubble law z = Hr in the low-redshift range, z no more than about 0.01, corresponding to galaxies brighter than 14th mag. Segal attempts to fit a distance relation to the (m,z) scatter diagram in which each individual galaxy is plotted. The exact relation between the mean redshift for all galaxies in a small magnitude interval and the apparent magnitude is calculated. This relation is independent of luminosity function and peculiar velocity distribution about the general expansion, and is not affected by sample incompleteness as a function of apparent magnitude or the clustering of galaxies in the sample. Segal's method is affected by all of these and requires a highly sophisticated statistical analysis to deal with the non-Gaussian pointwise scatter. The present analysis favors the Hubble law and conclusively rules out the square law for the small redshift region.

Soneira, R. M.↗

Would a Galactic bar destroy the globular cluster system?

Five different dynamical Galaxy models are presented for the Galactic potential which satisfy the observed rotation curve but contain a central bar so that the 3-kpc nonintersecting streamlines have a radial velocity of 50 km/s when viewed at 45 deg to the bar axis. The effect of the central bars on the destruction rates of globular clusters in the Galaxy is investigated. The method of Aguilar et al. (1988) is applied to these barred Galaxy models. The unknown tangential velocity components of each observed cluster are drawn randomly from an assumed distribution function. The cluster's orbit is integrated, and the bulge shocking rate is calculated. The median destruction rate of the cluster is computed by sampling a large number of such orbits. The addition of the rotating bar does not strongly affect the destruction rates of globular clusters. There is a small increase in the destruction rate for those clusters within about 2.5 kpc. Thus it is not possible to rule out the existence of a rotating bar on these grounds.

Long, Kevin↗

CONSTRAINING SOURCE REDSHIFT DISTRIBUTIONS WITH GRAVITATIONAL LENSING

We introduce a new method for constraining the redshift distribution of a set of galaxies, using weak gravitational lensing shear. Instead of using observed shears and redshifts to constrain cosmological parameters, we ask how well the shears around clusters can constrain the redshifts, assuming fixed cosmological parameters. This provides a check on photometric redshifts, independent of source spectral energy distribution properties and therefore free of confounding factors such as misidentification of spectral breaks. We find that {approx}40 massive ({sigma}{sub v} = 1200 km s{sup -1}) cluster lenses are sufficient to determine the fraction of sources in each of six coarse redshift bins to {approx}11%, given weak (20%) priors on the masses of the highest-redshift lenses, tight (5%) priors on the masses of the lowest-redshift lenses, and only modest (20%-50%) priors on calibration and evolution effects. Additional massive lenses drive down uncertainties as N{sub lens}{sup -1/2}, but the improvement slows as one is forced to use lenses further down the mass function. Future large surveys contain enough clusters to reach 1% precision in the bin fractions if the tight lens-mass priors can be maintained for large samples of lenses. In practice this will be difficult to achieve, but the method may be valuable as a complement to other more precise methods because it is based on different physics and therefore has different systematic errors.

79 ASTRONOMY AND ASTROPHYSICS↗

Euclid preparation: IV. Impact of undetected galaxies on weak-lensing shear measurements

In modern weak-lensing surveys, the common approach to correct for residual systematic biases in the shear is to calibrate shape measurement algorithms using simulations. These simulations must fully capture the complexity of the observations to avoid introducing any additional bias. In this paper we study the importance of faint galaxies below the observational detection limit of a survey. We simulate simplified Euclid VIS images including and excluding this faint population, and measure the shift in the multiplicative shear bias between the two sets of simulations. We measure the shear with three different algorithms: a moment-based approach, model fitting, and machine learning. We find that for all methods, a spatially uniform random distribution of faint galaxies introduces a shear multiplicative bias of the order of a few times 10 -3 . This value increases to the order of 10 -2 when including the clustering of the faint galaxies, as measured in the Hubble Space Telescope Ultra-Deep Field. The magnification of the faint background galaxies due to the brighter galaxies along the line of sight is found to have a negligible impact on the multiplicative bias. We conclude that the undetected galaxies must be included in the calibration simulations with proper clustering properties down to magnitude 28 in order to reach a residual uncertainty on the multiplicative shear bias calibration of a few times 10 -4 , in line with the 2 × 10 -3 total accuracy budget required by the scientific objectives of the Euclid survey. We propose two complementary methods for including faint galaxy clustering in the calibration simulations.

79 ASTRONOMY AND ASTROPHYSICS↗

Unsupervised Power System Event Detection and Classification Using Unlabeled PMU Data

This paper proposes a novel data-driven power system event detection and classification method based on 5TB of actual PMU measurements collected from the US western interconnect. Firstly, a set of comprehensive power quality rules are proposed to pre-filter the raw data and extract the regions of interest (ROI). Six distinct event categories are defined and corresponding patterns are chosen as references. Meanwhile, detailed characteristics of patterns are summarized to enhance our understanding of the actual events. Then, the time-independent feature vectors are generated by extracting the statistical, temporal, and spectral features from the raw time-series data. Furthermore, an ensemble model is proposed to cluster the events by combining multiple K-means clustering models using a voting strategy. Besides, both system-level and PMU-level clustering models are developed. The accuracy and robustness of the event detection method are further improved through interactive evaluation of the two-level clustering results. This paper summarizes the actual characteristics of each event category and provides a reliable basis for accurate label generation. The experiments demonstrate the effectiveness of the proposed event detection and classification method.

24 POWER TRANSMISSION AND DISTRIBUTION↗