SEARCH · Search NASA

Results for “parallel clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

All sources NASA NTRS DOE OSTI

DOE OSTI2017

Large-scale atomistic calculations of clusters in intense x-ray pulses

Here, we present the methodology of our recently developed Monte-Carlo/ Molecular-Dynamics method for studying the fundamental ultrafast dynamics induced by high-fluence, high-intensity x-ray free electron laser (XFEL) pulses in clusters. The quantum nature of the initiating ionization process is accounted for by a Monte Carlo method to calculate probabilities of electronic transitions, including photo absorption, inner-shell relaxation, photon scattering, electron collision and recombination dynamics, and thus track the transient electronic configurations explicitly. The freed electrons and ions are followed by classical particle trajectories using a molecular dynamics algorithm. These calculations reveal the surprising role of electron-ion recombination processes that lead to the development of nonuniform spatial charge density profiles in x-ray excited clusters over femtosecond timescales. In the high-intensity limit, it is important to include the recombination dynamics in the calculated scattering response even for a 2- fs pulse. We also demonstrate that our numerical codes and algorithms can make e!cient use of the computational power of massively parallel supercomputers to investigate the intense-field dynamics in systems with increasing complexity and size at the ultrafast timescale and in non-linear x-ray interaction regimes. In particular, picosecond trajectories of XFEL clusters with attosecond time resolution containing millions of particles can be e!ciently computed on upwards of 262,144 processes.

74 ATOMIC AND MOLECULAR PHYSICS↗

DOE OSTI2020

Parallel performance of algebraic multigrid domain decomposition

Algebraic multigrid (AMG) is a widely used scalable solver and preconditioner for large-scale linear systems resulting from the discretization of a wide class of elliptic PDEs. While AMG has optimal computational complexity, the cost of communication has become a significant bottleneck that limits its scalability as processor counts continue to grow on modern machines. This article examines the design, implementation, and parallel performance of a novel algorithm, algebraic multigrid domain decomposition (AMG-DD), designed specifically to limit communication. The goal of AMG-DD is to provide a low-communication alternative to standard AMG V-cycles by trading some additional computational overhead for a significant reduction in communication cost. Numerical results show that AMG-DD achieves superior accuracy per communication cost compared with AMG, and speedup over AMG is demonstrated on a large GPU cluster.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2017

Parallel Fokker–Planck-DSMC algorithm for rarefied gas flow simulation in complex domains at all Knudsen numbers

A major challenge for the conventional Direct Simulation Monte Carlo (DSMC) technique lies in the fact that its computational cost becomes prohibitive in the near continuum regime, where the Knudsen number (Kn)—characterizing the degree of rarefaction—becomes small. In contrast, the Fokker–Planck (FP) based particle Monte Carlo scheme allows for computationally efficient simulations of rarefied gas flows in the low and intermediate Kn regime. The Fokker–Planck collision operator—instead of performing binary collisions employed by the DSMC method—integrates continuous stochastic processes for the phase space evolution in time. This allows for time step and grid cell sizes larger than the respective collisional scales required by DSMC. Dynamically switching between the FP and the DSMC collision operators in each computational cell is the basis of the combined FP-DSMC method, which has been proven successful in simulating flows covering the whole Kn range. Until recently, this algorithm had only been applied to two-dimensional test cases. In this contribution, we present the first general purpose implementation of the combined FP-DSMC method. Utilizing both shared- and distributed-memory parallelization, this implementation provides the capability for simulations involving many particles and complex geometries by exploiting state of the art computer cluster technologies.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2021

Local Distortions and Metal–Semiconductor–Metal Transition in Quasi-One-Dimensional Nanowire Compounds AV 3 Q 3 O δ (A = K, Rb, Cs and Q = Se, Te)

Metal cluster compounds have garnered renewed interest in the search for novel superconductors and topological semimetals owing to structural instabilities of metal-cluster geometries and broken symmetries. Here we synthesized needle-like crystals of the V-cluster-based quasi-one-dimensional (Q1D) materials AV 3 Q 3 O δ (A = K, Rb, Cs, Q= Se, Te) which can also be viewed as being composed of parallel nanowires. We examine how changes in their average and local structure control their electronic properties. All compounds crystallize in the TIFe 3 Te 3 -type structure (P6 3 /m space group) with infinite (V 3 )Q 3 ) - double-walled columnar chains separated by A + cations. Our single-crystal and synchrotron powder diffraction studies indicate oxygen atoms partially occupy the center site of the V 6 octahedral metal cluster cages in KV 3 Te 3 O 0.33 , RbV 3 Te 3 O 0.32 , and CsV 3 Te 3 O 0.35 , whereas KV 3 Se 3 is structurally oxygen-free. Our synchrotron X-ray pair distribution function (PDF) analyses indicate that the oxygen-free V 6 cluster octahedra in KV 3 Se 3 are highly distorted perpendicular to the chain direction even at room temperature, reducing the symmetry of the average structure from hexagonal P6 3 /m to monoclinic P2 1 /m. Our theoretical calculation supports this P2 1 /m distortion and suggests the structure further distorts to P2 1 or P2 1 /c at lower temperatures. In contrast, the oxygen-centered V-cluster in KV 3 Te 3 O 0.33 exhibits a V-3-triangle-trimerization along the chain direction. This feature is discernible from the local PDF and is consistent with lattice dynamical calculations based on density functional theory. Resistivity measurements indicate that KV 3 Se 3 exhibits metallic behavior, whereas a dramatic metal-semiconductor-metal transition emerges in KV 3 Te 3 O 6.33 , RbV 3 Te 3 O 0.32 , and CsV 3 Te 3 O 0.35 because of oxygen disorder and changes in local structure captured from our electronic structure analyses of the Fermi surface. Our investigation of the AV 3 Q 3 O 6 family demonstrates the importance of understanding local changes in structure driven by electronic instabilities, which can guide the search for new quantum materials in other low-dimensional cluster-compound materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

EJFAT: Towards Intelligent Compute Destination Load Balancing

To handle increased data flow, Jefferson Lab (JLab) is partnering with ESnet for development of an AI/ML directed compute work Load Balancer (LB) of UDP streamed data. The LB is FPGA based featuring dynamically configurable, low latency and high throughput destination address switching. The LB provides integration of edge and core computing to support JLab experimental programs, the Electron-Ion Collider, as well as data centers of the future. In the ESnet/JLab FPGA Accelerated Transport (EJFAT) initiative, the function of the LB Data Plane (DP) is to redirect data streams to selectable (but unknown to sender) destination hosts based on current worload and within that host to destination ports as a function of sub- stream id. This effects hierarchical scaling, first across compute machines for processing over a series of events and second, across ports so different data source sub-streams may be assigned to different processors for further parallelization. The LB Control Plane (CP) programs the DP using compute farm telemetry to direct and balance workloads across a compute cluster as the operating conditions require. While Proportional/Integrative/Derivative (PID) controllers are often seen in similar applications, here we investigate the feasibility of a Reinforcement Learning (RL) based schedule manager running in the CP to provide dynamic updates to the DP scheduling policy.

Lawrence, David↗

DOE OSTI2025

Unraveling the Determinant Mechanisms in Flow-Mediated Crystal Growth and Phase Behaviors

To uncover the critical mechanisms responsible for mesoscopic level development during flow-mediated crystal growth, we develop a semi-two-way hydrodynamic coupled structural phase-field crystal formalism (HXPFC-s2). The new formalism, inspired by previous attempts at coupling hydrodynamic and phase-field crystal (PFC) equations, allows for studying mesoscopic flow-mediated crystallization at diffusive timescales pertinent to industrial applications. Unlike previous efforts, the devised coupling to the structural PFC (XPFC) equations allows generalization to more complex crystal structures through explicit parameterization of the direct correlation function (DCF). Utilizing the HXPFC-s2 formalism, we seek to uncover the determinant physical mechanisms in crystallization under simple shear flows by comparing temperature-driven crystallization to flow-mediated crystallization under varying flow-strengths. Parallels and deviations of under-cooling and flow-strength effects on crystal growth are drawn using the crystal cluster-size and system ordering time evolutions. In doing so, we identify scaling behaviors with a Peclet-like number, Pe∼, a critical Peclet-like number, Pe∼*, and flow-field-crystal plane-dependent interactions. Our findings may be relevant for controlling crystal growth and phase behaviors in flow applications.

Willis, L. Connor (ORCID:0009000961321848)↗

DOE OSTI2024

The Effective Fragment Molecular Orbital Method: Achieving High Scalability and Accuracy for Large Systems

The effective fragment molecular orbital (EFMO) method has been developed to predict the total energy of a very large molecular system accurately (with respect to the underlying quantum mechanical method) and efficiently by taking advantage of the locality of strong chemical interactions and employing a two-level hierarchical parallelism. The accuracy of the EFMO method is partly attributed to the accurate and robust intermolecular interaction prediction between distant fragments, in particular, the many-body polarization and dispersion effects, which require the generation of static and dynamic polarizability tensors by solving the coupled perturbed Hartree–Fock (CPHF) and time-dependent HF (TDHF) equations, respectively. Solving the CPHF and TDHF equations is the main EFMO computational bottleneck due to the inefficient (serial) and I/O-intensive implementation of the CPHF and TDHF solvers. In this work, the efficiency and scalability of the EFMO method are significantly improved with a new CPU memory-based implementation for solving the CPHF and TDHF equations that are parallelized by either message passing interface (MPI) or hybrid MPI/OpenMP. Here, the accuracy of the EFMO method is demonstrated for both covalently bonded systems and noncovalently bound molecular clusters by systematically examining the effects of basis sets and a key distance-related cutoff parameter, R cut . R cut determines whether a fragment pair (dimer) is treated by the chosen ab initio method or calculated using the effective fragment potential (EFP) method (separated dimers). Decreasing the value of Rcut increases the number of separated (EFP) dimers, thereby decreasing the computational effort. It is demonstrated that excellent accuracy (<1 kcal/mol error per fragment) can be achieved when using a sufficiently large basis set with diffuse functions coupled with a small R cut value. With the new parallel implementation, the total EFMO wall time is substantially reduced, especially with a high number of MPI ranks. Given a sufficient workload, nearly ideal strong scaling is achieved for the CPHF and TDHF parts of the calculation. For the first time, EFMO calculations with the inclusion of long-range polarization and dispersion interactions on a hydrated mesoporous silica nanoparticle with explicit water solvent molecules (more than 15k atoms) are achieved on a massively parallel supercomputer using nearly 1000 physical nodes. In addition, EFMO calculations on the carbinolamine formation step of an amine-catalyzed aldol reaction at the nanoscale with explicit solvent effects are presented.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2019

GMRT 610 MHz observations of galaxy clusters in the ACT equatorial sample

Abstract We present Giant Metrewave Radio Telescope (GMRT) 610 MHz observations of 14 Atacama Cosmology Telescope (ACT) clusters, including new data for nine. The sample includes 73 per cent of ACT equatorial clusters with M500 > 5 × 1014 M⊙. We detect diffuse emission in three of these (27$^{+20}_{-14}$ per cent): we detect a radio minihalo in ACT-CL J0022.2–0036 at z = 0.8, making it the highest redshift minihalo known; we detect potential radio relic emission in ACT-CL J0014.9–0057 (z = 0.533); and we confirm the presence of a radio halo in low-mass cluster ACT-CL J0256.5+0006, with flux density S610 = 6.3 ± 0.4 mJy. We also detect residual diffuse emission in ACT-CL J0045.9–0152 (z = 0.545), which we cannot conclusively classify. For systems lacking diffuse radio emission, we determine radio halo upper limits in two ways and find via survival analysis that these limits do not significantly affect radio power scaling relations. Several clusters with no diffuse emission detection are known or suspected mergers, based on archival X-ray and/or optical measures; given the limited sensitivity of our observations, deeper observations of these disturbed systems are required in order to rule out the presence of diffuse emission consistent with known scaling relations. In parallel with our diffuse emission results, we present catalogues of individual radio sources, including a few interesting extended sources. Our study represents the first step towards probing the occurrence of diffuse emission in high-redshift (z ≳ 0.5) clusters, and serves as a pilot for statistical studies of larger cluster samples with the new radio telescopes available in the pre-SKA era.

Knowles, Kenda↗

DOE OSTI2016

Parallel Evolutionary Optimization for Neuromorphic Network Training

One of the key impediments to the success of current neuromorphic computing architectures is the issue of how best to program them. Evolutionary optimization (EO) is one promising programming technique; in particular, its wide applicability makes it especially attractive for neuromorphic architectures, which can have many different characteristics. In this paper, we explore different facets of EO on a spiking neuromorphic computing model called DANNA. We focus on the performance of EO in the design of our DANNA simulator, and on how to structure EO on both multicore and massively parallel computing systems. We evaluate how our parallel methods impact the performance of EO on Titan, the U.S.'s largest open science supercomputer, and BOB, a Beowulf-style cluster of Raspberry Pi's. We also focus on how to improve the EO by evaluating commonality in higher performing neural networks, and present the result of a study that evaluates the EO performed by Titan.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2016

Mcqueuer

Mcqueuer is a simple tool that allows anyone from researchers to experienced developers to create multi-node/multi-core jobs by simply creating a file with a list of commands. Users simply combine tasks, which would otherwise each be their own job on the cluster, into a single file that is given to Mcqueuer. Mcqueuer then does the heavy lifting required to process the tasks in parallel in a single multi-node job. In addition, Mcqueuer provides load-balancing, which frees the user from having to worry about complex memory and CPU considerations, and instead focus on the processing itself.

Source record↗

DOE OSTI2012

A Path to Operating System and Runtime Support for Extreme Scale Tools

In this project, we cast distributed resource access as operations on files in a global name space and developed a common, scalable solution for group operations on distributed processes and files. The resulting solution enables tool and middleware developers to quickly create new scalable software or easily improve the scalability of existing software. The cornerstone of the project was the design of a new programming idiom called group file operations that eliminates iterative behavior when a single process must apply the same set of file operations to a group of related files. To demonstrate our novel and scalable ideas for group file operations and global name space composition, we developed a group file system called TBON-FS that leverages a tree-based overlay network (TBON), specifically MRNet, for logarithmic communication and distributed data aggregation. We also developed proc++, a new synthetic file system co-designed for use in scalable group file operations. Over the course of the project, we evaluated the utility and performance of group file operations, global name space composition, TBON-FS, and proc++ in three case studies. The first study focused on the ease in using group file operations and TBON-FS to quickly develop several new scalable tools for distributed system administration and monitoring. The second study evaluated the integration of group file operation and TBON-FS within the Ganglia Distributed Monitoring System to improve its scalability for clusters. The final study involved the integration of group file operations, TBON-FS, and proc++ within TotalView, the widely-used parallel debugger. For this project, the work of the Oak Ridge National Laboratory (ORNL) team occurred primarily in two directions: bringing the MRNet tree-based overlay network (TBON) implementation to the Cray XT platform, and investigating techniques for predicting the performance of MRNet topologies on such systems. Rogue Wave Software (RWS), formerly TotalView Technologies Inc., worked with the University ofWisconsin (UW) team on the design and prototyping of a scalable version of the TotalView debugger. RWS assisted UW with their "proc++" design effort. RWS assisted UW with strategy for integrating proc++ into TotalView.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2016

Mcqueuer

Source record↗

DOE OSTI2016

Parallel Evolutionary Optimization for Neuromorphic Network Training

Schuman, Catherine D↗

DOE OSTI2015

Deactivation and decommissioning web log analysis using big data technology - 15710

The D and D Knowledge Management Information Tool (D and D KM- IT) is a web-based knowledge management information tool built for the D and D user community. Big data is a massive volume of structured and unstructured datasets which is so large that it's difficult to process using traditional database techniques. Web logs are the repository of files which are generated automatically for any operation on the web site. Web log files generated from the D and D KM-IT will be processed using the Apache Hadoop Framework to extract meaningful data. Hadoop is an open-source software framework for storing and processing big data in a distributed environment on large clusters of commodity hardware. Hadoop framework consists of two main layers: Hadoop distributed file system (HDFS) and the Execution engine (MapReduce). Automatic parallelization and distribution; clean and simple programming abstraction. Implementation: Web log files from the D and D KM-IT server are fetched using Apache Flume and loaded into the Hadoop distributed file system. Using the Apache Hcatalog tool, the web log data is parsed and converted into a structured table format. A Pig program is developed to query the tables to retrieve and store the significant information onto the HDFS. The extracted data is fed to business visualization tools such as Microsoft Excel for analysis and reporting. Results The reports generated through the web log data processing will be analyzed to improve the usability and performance of the D and D KM-IT. Conclusion/Future Work: User keyword information can be explored to add new trending topics to the D and D KM-IT application. Statistics generated can be compared to analysis reports from existing analytical tools.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2016

The effects of cation–anion clustering on defect migration in MgAl 2 O 4

Magnesium aluminate spinel (MgAl 2 O 4 ), like many other ceramic materials, offers a range of technological applications, from nuclear reactor materials to military body armor. For many of these applications, it is critical to understand both the formation and evolution of lattice defects throughout the lifetime of the material. We use the Speculatively Parallel Temperature Accelerated Dynamics (SpecTAD) method to investigate the effects of di-vacancy and di-interstitial formation on the mobility of the component defects. From long-time trajectories of the state-to-state dynamics, we characterize the migration pathways of defect clusters, and calculate their self-diffusion constants across a range of temperatures. We find that the clustering of Al and O vacancies drastically reduces the mobility of both defects, while the clustering of Mg and O vacancies completely immobilizes them. For interstitials, we find that the clustering of Mg and O defects greatly reduces O interstitial mobility, but has only a weak effect on Mg. Lastly, these findings illuminate important new details regarding defect kinetics relevant to the application of MgAl 2 O 4 in extreme environments.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Characterization of DESI fiber assignment incompleteness effect on 2-point clustering and mitigation methods for DR1 analysis

We present an in-depth analysis of the fiber assignment incompleteness in the Dark Energy Spectroscopic Instrument (DESI) Data Release 1 (DR1). This incompleteness is caused by the restricted mobility of the robotic fiber positioner in the DESI focal plane, which limits the number of galaxies that can be observed at the same time, especially at small angular separations. As a result, the observed clustering amplitude is suppressed in a scale-dependent manner, which, if not addressed, can severely impact the inference of cosmological parameters. We discuss the methods adopted for simulating fiber assignment on mocks and data. In particular, we introduce the fast fiber assignment (FFA) emulator, which was employed to obtain the power spectrum covariance adopted for the DR1 full-shape analysis. We present the mitigation techniques, organised in two classes: measurement stage and model stage. We then use high fidelity mocks as a reference to quantify both the accuracy of the FFA emulator and the effectiveness of the different measurement-stage mitigation techniques. This complements the studies conducted in a parallel paper for the model-stage techniques, namely the θ-cut approach. We find that pairwise inverse probability (PIP) weights with angular upweighting recover the “true” clustering in all the cases considered, in both Fourier and configuration space. Notably, we present the first ever power spectrum measurement with PIP weights from real data.

cosmological simulations↗

DOE OSTI2011

Reducing the Time to Tune Parallel Dense Linear Algebra Routines with Partial Execution and Performance Modeling

We present a modeling framework to accurately predict time to run dense linear algebra calculation. We report the framework’s accuracy in a number of varied computational environments such as shared memory multicore systems, clusters, and large supercomputing installations with tens of thousands of cores. We also test the accuracy for various algorithms, each of which having a different scaling properties and tolerance to low-bandwidth/high-latency interconnects. The predictive accuracy is very good and on the order of measurement accuracy which makes the method suitable for both dedicated and non-dedicated environments. We also present a practical application of our model to reduce the time required to tune and optimize large parallel runs whose time is dominated by linear algebra computations. We show practical examples of how to apply the methodology to avoid common pitfalls and reduce the influence of measurement errors and the inherent performance variability.

Linear systems↗

DOE OSTI2017

Transitioning NWChem to the Next Generation of Manycore Machines

The NorthWest chemistry (NWChem) modeling software is a popular molecular chemistry simulation software that was designed from the start to work on massively parallel processing supercomputers [1-3]. It contains an umbrella of modules that today includes self-consistent eld (SCF), second order Møller-Plesset perturbation theory (MP2), coupled cluster (CC), multiconguration self-consistent eld (MCSCF), selected conguration interaction (CI), tensor contraction engine (TCE) many body methods, density functional theory (DFT), time-dependent density functional theory (TDDFT), real-time time-dependent density functional theory, pseudopotential plane-wave density functional theory (PSPW), band structure (BAND), ab initio molecular dynamics (AIMD), Car-Parrinello molecular dynamics (MD), classical MD, hybrid quantum mechanics molecular mechanics (QM/MM), hybrid ab initio molecular dynamics molecular mechanics (AIMD/MM), gauge independent atomic orbital nuclear magnetic resonance (GIAO NMR), conductor like screening solvation model (COSMO), conductor-like screening solvation model based on density (COSMO-SMD), and reference interaction site model (RISM) solvation models, free energy simulations, reaction path optimization, parallel in time, among other capabilities [4]. Moreover, new capabilities continue to be added with each new release.

Bylaska, Eric J.↗