Search NASA⌕ Search

SEARCH · Search NASA

Results for “parallel clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
DOE OSTI2015

Deactivation and decommissioning web log analysis using big data technology - 15710

The D and D Knowledge Management Information Tool (D and D KM- IT) is a web-based knowledge management information tool built for the D and D user community. Big data is a massive volume of structured and unstructured datasets which is so large that it's difficult to process using traditional database techniques. Web logs are the repository of files which are generated automatically for any operation on the web site. Web log files generated from the D and D KM-IT will be processed using the Apache Hadoop Framework to extract meaningful data. Hadoop is an open-source software framework for storing and processing big data in a distributed environment on large clusters of commodity hardware. Hadoop framework consists of two main layers: Hadoop distributed file system (HDFS) and the Execution engine (MapReduce). Automatic parallelization and distribution; clean and simple programming abstraction. Implementation: Web log files from the D and D KM-IT server are fetched using Apache Flume and loaded into the Hadoop distributed file system. Using the Apache Hcatalog tool, the web log data is parsed and converted into a structured table format. A Pig program is developed to query the tables to retrieve and store the significant information onto the HDFS. The extracted data is fed to business visualization tools such as Microsoft Excel for analysis and reporting. Results The reports generated through the web log data processing will be analyzed to improve the usability and performance of the D and D KM-IT. Conclusion/Future Work: User keyword information can be explored to add new trending topics to the D and D KM-IT application. Statistics generated can be compared to analysis reports from existing analytical tools.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2016

The effects of cation–anion clustering on defect migration in MgAl 2 O 4

Magnesium aluminate spinel (MgAl 2 O 4 ), like many other ceramic materials, offers a range of technological applications, from nuclear reactor materials to military body armor. For many of these applications, it is critical to understand both the formation and evolution of lattice defects throughout the lifetime of the material. We use the Speculatively Parallel Temperature Accelerated Dynamics (SpecTAD) method to investigate the effects of di-vacancy and di-interstitial formation on the mobility of the component defects. From long-time trajectories of the state-to-state dynamics, we characterize the migration pathways of defect clusters, and calculate their self-diffusion constants across a range of temperatures. We find that the clustering of Al and O vacancies drastically reduces the mobility of both defects, while the clustering of Mg and O vacancies completely immobilizes them. For interstitials, we find that the clustering of Mg and O defects greatly reduces O interstitial mobility, but has only a weak effect on Mg. Lastly, these findings illuminate important new details regarding defect kinetics relevant to the application of MgAl 2 O 4 in extreme environments.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Characterization of DESI fiber assignment incompleteness effect on 2-point clustering and mitigation methods for DR1 analysis

We present an in-depth analysis of the fiber assignment incompleteness in the Dark Energy Spectroscopic Instrument (DESI) Data Release 1 (DR1). This incompleteness is caused by the restricted mobility of the robotic fiber positioner in the DESI focal plane, which limits the number of galaxies that can be observed at the same time, especially at small angular separations. As a result, the observed clustering amplitude is suppressed in a scale-dependent manner, which, if not addressed, can severely impact the inference of cosmological parameters. We discuss the methods adopted for simulating fiber assignment on mocks and data. In particular, we introduce the fast fiber assignment (FFA) emulator, which was employed to obtain the power spectrum covariance adopted for the DR1 full-shape analysis. We present the mitigation techniques, organised in two classes: measurement stage and model stage. We then use high fidelity mocks as a reference to quantify both the accuracy of the FFA emulator and the effectiveness of the different measurement-stage mitigation techniques. This complements the studies conducted in a parallel paper for the model-stage techniques, namely the θ-cut approach. We find that pairwise inverse probability (PIP) weights with angular upweighting recover the “true” clustering in all the cases considered, in both Fourier and configuration space. Notably, we present the first ever power spectrum measurement with PIP weights from real data.

cosmological simulations↗
DOE OSTI2011

Reducing the Time to Tune Parallel Dense Linear Algebra Routines with Partial Execution and Performance Modeling

We present a modeling framework to accurately predict time to run dense linear algebra calculation. We report the framework’s accuracy in a number of varied computational environments such as shared memory multicore systems, clusters, and large supercomputing installations with tens of thousands of cores. We also test the accuracy for various algorithms, each of which having a different scaling properties and tolerance to low-bandwidth/high-latency interconnects. The predictive accuracy is very good and on the order of measurement accuracy which makes the method suitable for both dedicated and non-dedicated environments. We also present a practical application of our model to reduce the time required to tune and optimize large parallel runs whose time is dominated by linear algebra computations. We show practical examples of how to apply the methodology to avoid common pitfalls and reduce the influence of measurement errors and the inherent performance variability.

Linear systems↗
DOE OSTI2017

Transitioning NWChem to the Next Generation of Manycore Machines

The NorthWest chemistry (NWChem) modeling software is a popular molecular chemistry simulation software that was designed from the start to work on massively parallel processing supercomputers [1-3]. It contains an umbrella of modules that today includes self-consistent eld (SCF), second order Møller-Plesset perturbation theory (MP2), coupled cluster (CC), multiconguration self-consistent eld (MCSCF), selected conguration interaction (CI), tensor contraction engine (TCE) many body methods, density functional theory (DFT), time-dependent density functional theory (TDDFT), real-time time-dependent density functional theory, pseudopotential plane-wave density functional theory (PSPW), band structure (BAND), ab initio molecular dynamics (AIMD), Car-Parrinello molecular dynamics (MD), classical MD, hybrid quantum mechanics molecular mechanics (QM/MM), hybrid ab initio molecular dynamics molecular mechanics (AIMD/MM), gauge independent atomic orbital nuclear magnetic resonance (GIAO NMR), conductor like screening solvation model (COSMO), conductor-like screening solvation model based on density (COSMO-SMD), and reference interaction site model (RISM) solvation models, free energy simulations, reaction path optimization, parallel in time, among other capabilities [4]. Moreover, new capabilities continue to be added with each new release.

Bylaska, Eric J.↗
DOE OSTI2013

GYROSURFING ACCELERATION OF IONS IN FRONT OF EARTH's QUASI-PARALLEL BOW SHOCK

It is well known that shocks in space plasmas can accelerate particles to high energies. However, many details of the shock acceleration mechanism are still unknown. A critical element of shock acceleration is the injection problem; i.e., the presence of the so called seed particle population that is needed for the acceleration to work efficiently. In our case study, we present for the first time observational evidence of gyroresonant surfing acceleration in front of Earth's quasi-parallel bow shock resulting in the appearance of the long-suspected seed particle population. For our analysis, we use simultaneous multi-spacecraft measurements provided by the Cluster spacecraft ion (CIS), magnetic (FGM), and electric field and wave instrument (EFW) during a time period of large inter-spacecraft separation distance. The spacecraft were moving toward the bow shock and were situated in the foreshock region. The results show that the gyroresonance surfing acceleration takes place as a consequence of interaction between circularly polarized monochromatic (or quasi-monochromatic) transversal electromagnetic plasma waves and short large amplitude magnetic structures (SLAMSs). The magnetic mirror force of the SLAMS provides the resonant conditions for the ions trapped by the waves and results in the acceleration of ions. Since wave packets with circular polarization and different kinds of magnetic structures are very commonly observed in front of Earth's quasi-parallel bow shock, the gyroresonant surfing acceleration proves to be an important particle injection mechanism. We also show that seed ions are accelerated directly from the solar wind ion population.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

Lattice Quantum Chromodynamics with Overlap Fermions on GPUs

Lattice quantum chromodynamics (QCD) calculations were one of the first applications to demonstrate the potential of GPUs in the area of high-performance computing; the nature of lattice QCD calculations matches well with the GPU's computational model. This article discusses ways to effectively use GPUs for lattice calculations using the overlap operator, a discretization that preserves chiral symmetry even at nonzero lattice spacing and makes possible lattice QCD simulations in the parameter region relevant to nuclear physics. The author shows that the large memory footprint of these codes requires the use of multiple GPUs in parallel and discusses methods for implementing this operator efficiently: hybrid CPU/GPU memory use for eigensolvers and MPI/OpenMP/CUDA parallelization strategies required to take full advantage of both GPU and CPU resources. He then compares the performance of codes on a GPU cluster and a CPU cluster with similar interconnects, discussing the strong scaling for problem sizes relevant to current lattice QCD simulations.

Computer Science↗
NASA NTRS1989

New computing systems and their impact on structural analysis and design

A review is given of the recent advances in computer technology that are likely to impact structural analysis and design. The computational needs for future structures technology are described. The characteristics of new and projected computing systems are summarized. Advances in programming environments, numerical algorithms, and computational strategies for new computing systems are reviewed, and a novel partitioning strategy is outlined for maximizing the degree of parallelism. The strategy is designed for computers with a shared memory and a small number of powerful processors (or a small number of clusters of medium-range processors). It is based on approximating the response of the structure by a combination of symmetric and antisymmetric response vectors, each obtained using a fraction of the degrees of freedom of the original finite element model. The strategy was implemented on the CRAY X-MP/4 and the Alliant FX/8 computers. For nonlinear dynamic problems on the CRAY X-MP with four CPUs, it resulted in an order of magnitude reduction in total analysis time, compared with the direct analysis on a single-CPU CRAY X-MP machine.

Noor, Ahmed K.↗
DOE OSTI2012

Aho-Corasick String Matching on Shared and Distributed Memory Parallel Architectures

String matching is at the core of many critical applications, including network intrusion detection systems, search engines, virus scanners, spam filters, DNA and protein sequencing, and data mining. For all of these applications string matching requires a combination of (sometimes all) the following characteristics: high and/or predictable performance, support for large data sets and flexibility of integration and customization. Many software based implementations targeting conventional cache-based microprocessors fail to achieve high and predictable performance requirements, while Field-Programmable Gate Array (FPGA) implementations and dedicated hardware solutions fail to support large data sets (dictionary sizes) and are difficult to integrate and customize. The advent of multicore, multithreaded, and GPU-based systems is opening the possibility for software based solutions to reach very high performance at a sustained rate. This paper compares several software-based implementations of the Aho-Corasick string searching algorithm for high performance systems. We discuss the implementation of the algorithm on several types of shared-memory high-performance architectures (Niagara 2, large x86 SMPs and Cray XMT), distributed memory with homogeneous processing elements (InfiniBand cluster of x86 multicores) and heterogeneous processing elements (InfiniBand cluster of x86 multicores with NVIDIA Tesla C10 GPUs). We describe in detail how each solution achieves the objectives of supporting large dictionaries, sustaining high performance, and enabling customization and flexibility using various data sets.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

HARD: A performance portable radiation hydrodynamics code based on FleCSI framework

Hydrodynamics And Radiation Diffusion (HARD) is an open-source application for high-performance simulations of compressible hydrodynamics with radiation-diffusion coupling. Built on the FleCSI (Bergen et al., 2021 [1]) (Flexible Computational Science Infrastructure) framework, HARD expresses its computational units as tasks whose execution can be orchestrated by multiple back-end runtimes, including Legion (Bauer et al., 2012 [2]), MPI (Forum, 1994 [3]), and HPX (Kaiser et al., 2020 [4]). Node-level parallelism is handled through Kokkos (Edwards et al., 2014 [5]), providing a single-source, portable code base that runs efficiently on laptops, small homogeneous clusters, and the largest heterogeneous supercomputers currently available. To ensure scientific reliability, HARD includes a regression test suite that automatically reproduces canonical verification problems such as the Sod and LeBlanc shock tubes, and the Sedov blast wave, comparing numerical solutions against known analytical results. The project is distributed under an OSI-approved license, hosted on GitHub, and accompanied by reproducible build scripts and continuous integration workflows. This combination of performance portability, verification infrastructure, and community-focused development makes HARD a sustainable platform for advancing radiation hydrodynamics research across multiple domains.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2013

THE STABILITY OF WEAKLY COLLISIONAL PLASMAS WITH THERMAL AND COMPOSITION GRADIENTS

Over the last decade, substantial efforts have been devoted to understanding the stability properties, transport phenomena, and long-term evolution of weakly collisional, magnetized plasmas which are stratified in temperature. The insights gained via these studies have led to a significant improvement of our understanding of the processes that determine the physical evolution and observational properties of the intracluster medium (ICM) permeating galaxy clusters. These studies have been carried out under the assumption that the ICM is a homogeneous medium. This, however, might not be a good approximation if heavy elements are able to sediment in the inner region of the galaxy cluster. Motivated by the need to obtain a more complete picture of the dynamical properties of the ICM, we analyze the stability of a weakly collisional, magnetized plane-parallel atmosphere which is stratified in both temperature and composition. This allows us to discuss for the first time the dynamics of weakly collisional environments where heat conduction, momentum transport, and ion-diffusion are anisotropic with respect to the direction of the magnetic field. We show that depending on the relative signs and magnitudes of the gradients in the temperature and the mean molecular weight, the plasma can be subject to a wide variety of unstable modes which include modifications to the magnetothermal instability (MTI), the heat-flux-driven buoyancy instability (HBI), and overstable gravity modes previously studied in homogeneous media. We also find that there are new modes which are driven by heat conduction and particle diffusion. We discuss the astrophysical implications of our findings for a representative galaxy cluster where helium has sedimented. Our findings suggest that the core insulation that results from the magnetic field configurations that arise as a natural consequence of the HBI, which would be MTI stable in a homogeneous medium, could be alleviated if the mean molecular weight gradient is steep enough, i.e., ({nabla}{mu})/{mu} > ({nabla}T)/T. This study constitutes a first step toward understanding the interaction between magnetic turbulence and the diffusion of heavy elements, and its consequences for the long-term evolution and observational signatures of the ICM in galaxy clusters.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Two-Stage Gauss-Seidel Preconditioners and Smoothers for Krylov Solvers on a GPU Cluster: Preprint

Gauss-Seidel (GS) relaxation is often employed as a preconditioner for a Krylov solver or as a smoother for Algebraic Multigrid (AMG). However, the requisite sparse triangular solve is difficult to parallelize on many-core architectures such as graphics processing units (GPUs). In the present study, the performance of the sequential GS relaxation based on a triangular solve is compared with two-stage variants, replacing the direct triangular solve with a fixed number of inner Jacobi-Richardson (JR) iterations. When a small number of inner iterations is sufficient to maintain the Krylov convergence rate, the two-stage GS (GS2) often outperforms the sequential algorithm on many-core architectures. The GS2 algorithm is also compared with JR. When they perform the same number of ops for SpMV (e.g. three JR sweeps compared to two GS sweeps with one inner JR sweep), the GS2 iterations, and the Krylov solver preconditioned with GS2, may converge faster than the JR iterations. Moreover, for some problems (e.g. elasticity), it was found that JR may diverge with a damping factor of one, whereas two-stage GS may improve the convergence with more inner iterations. Finally, to study the performance of the two-stage smoother and preconditioner for a practical problem, these were applied to incompressible uid ow simulations on GPUs.

algebraic multigrid↗
NASA NTRS2007

Efficient Mosaicking of Spitzer Space Telescope Images

A parallel version of the MOPEX software, which generates mosaics of infrared astronomical images acquired by the Spitzer Space Telescope, extends the capabilities of the prior serial version. In the parallel version, both the input image space and the output mosaic space are divided among the available parallel processors. This is the only software that performs the point-source detection and the rejection of spurious imaging effects of cosmic rays required by Spitzer scientists. This software includes components that implement outlier-detection algorithms that can be fine-tuned for a particular set of image data by use of a number of adjustable parameters. This software has been used to construct a mosaic of the Spitzer Infrared Array Camera Shallow Survey, which comprises more than 17,000 exposures in four wavelength bands from 3.6 to 8 m and spans a solid angle of about 9 square degrees. When this software was executed on 32 nodes of the 1,024-processor Cosmos cluster computer at NASA s Jet Propulsion Laboratory, a speedup of 8.3 was achieved over the serial version of MOPEX. The performance is expected to improve dramatically once a true parallel file system is installed on Cosmos.

Jacob, Joseph↗
DOE OSTI2022

MPLBM-UT: Multiphase LBM library for permeable media analysis

MPLBM-UT is a specialized lattice-Boltzmann library that makes running single- and two-phase flow simulations in porous media accessible to everyone. We provide a suite of tools to pre-process computational domains for simulation, to set up custom boundary conditions, to run simulations, to post-process simulation outputs, and to visualize simulation results and data. All of these tools are easily accessible to users through the mplbm_utils Python package included in and automatically installed with MPLBM-UT. The high-performance, highly parallel library Palabos is used as the solver backend. MPLBM-UT is easily deployed in a variety of systems, from laptops to supercomputer clusters. MPLBM-UT also features multiple examples and benchmark templates that allow for fast prototyping of different porous media problems. We also provide an interface for reading in different file types and downloading domains from the Digital Rocks Portal to perform simulations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Properties of the Graph Modularity Matrix and its Applications

We study the popular modularity matrix and respective functional used in connection with graph clustering and derive some properties useful when performing vertex aggregation of the associated graph. These properties are employed in the derivation of a multilevel parallel pairwise aggregation algorithm. Some illustrative examples which include algebraic multigrid (AMG) coarsening that follows strong direction of anisotropy in finite element problems as well as comparative performance results of the studied algorithm are presented.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Enhancing Entanglement: Non-Markovian and Floquet Reservoir Engineering in Many-Qubit Superconducting Quantum Circuits

This is an experimental and theoretical project to leverage dissipation engineering under non-Markovian settings in order to aid in the preparation and stabilization of large, non-trivial, entangled quantum states. This project is a collaborative effort between the Painter group at Caltech and the Clerk group at the University of Chicago. By utilization of superconducting qubits coupled to the metamaterial waveguide described in the proposal, we tackle this goal via two parallel thrusts: (i) non-Markovian dynamics of a superconducting qubit strongly coupled to a slow-light waveguide reservoir and generation of 2D cluster states and (ii) many-qubit waveguide circuit QED for studying quantum many-body physics. In addition to device development and testing, we are also developing theoretical methods for understanding physics in the deep non-Markovian regime and driven-dissipative protocols for preparing and stabilizing the quantum many-body states.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗