SEARCH · Search NASA

Results for “parallel clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

All sources NASA NTRS DOE OSTI

DOE OSTI2011

NWChem: scalable parallel computational chemistry

NWChem is a general purpose computational chemistry code specifically designed to run on distributed memory parallel computers. The core functionality of the code focuses on molecular dynamics, Hartree-Fock and density functional theory methods for both plane-wave basis sets as well as Gaussian basis sets, tensor contraction engine based coupled cluster capabilities and combined quantum mechanics/molecular mechanics descriptions. It was realized from the beginning that scalable implementations of these methods required a programming paradigm inherently different from what message passing approaches could offer. In response a global address space library, the Global Array Toolkit, was developed. The programming model it offers is based on using predominantly one-sided communication. This model underpins most of the functionality in NWChem and the power of it is exemplified by the fact that the code scales to tens of thousands of processors. In this paper the core capabilities of NWChem are described as well as their implementation to achieve an efficient computational chemistry code with high parallel scalability. NWChem is a modern, open source, computational chemistry code1 specifically designed for large scale parallel applications2. To meet the challenges of developing efficient, scalable and portable programs of this nature a particular code design was adopted. This code design involved two main features. First of all, the code is build up in a modular fashion so that a large variety of functionality can be integrated easily. Secondly, to facilitate writing complex parallel algorithms the Global Array toolkit was developed. This toolkit allows one to write parallel applications in a shared memory like approach, but offers additional mechanisms to exploit data locality to lower communication overheads. This framework has proven to be very successful in computational chemistry but is applicable to any engineering domain. Within the context created by the features above NWChem has grown into a general purpose computational chemistry code that supports a wide variety of energy expressions and capabilities to calculate properties based there upon. The main energy expressions are classical mechanics force fields, Hartree-Fock and DFT both for finite systems and condensed phase systems, coupled cluster, as well as QM/MM. For most energy expressions single point calculations, geometry optimizations, excited states, and other properties are available. Below we briefly discuss each of the main energy expressions and the critical points involved in scalable implementations thereof.

99 GENERAL AND MISCELLANEOUS↗

NASA NTRS1999

Portability and Cross-Platform Performance of an MPI-Based Parallel Polygon Renderer

Visualizing the results of computations performed on large-scale parallel computers is a challenging problem, due to the size of the datasets involved. One approach is to perform the visualization and graphics operations in place, exploiting the available parallelism to obtain the necessary rendering performance. Over the past several years, we have been developing algorithms and software to support visualization applications on NASA's parallel supercomputers. Our results have been incorporated into a parallel polygon rendering system called PGL. PGL was initially developed on tightly-coupled distributed-memory message-passing systems, including Intel's iPSC/860 and Paragon, and IBM's SP2. Over the past year, we have ported it to a variety of additional platforms, including the HP Exemplar, SGI Origin2OOO, Cray T3E, and clusters of Sun workstations. In implementing PGL, we have had two primary goals: cross-platform portability and high performance. Portability is important because (1) our manpower resources are limited, making it difficult to develop and maintain multiple versions of the code, and (2) NASA's complement of parallel computing platforms is diverse and subject to frequent change. Performance is important in delivering adequate rendering rates for complex scenes and ensuring that parallel computing resources are used effectively. Unfortunately, these two goals are often at odds. In this paper we report on our experiences with portability and performance of the PGL polygon renderer across a range of parallel computing platforms.

Crockett, Thomas W.↗

DOE OSTI2024

Streaming Matching and Edge Cover in Practice

Graph algorithms with polynomial space and time requirements often become infeasible for massive graphs with billions of edges or more. State-of-the-art approaches therefore employ approximate serial, parallel, and distributed algorithms to tackle these challenges. However, such approaches require storing the entire graph in memory and thus need access to costly computing resources such as clusters and supercomputers. In this paper, we present practical streaming approaches for solving massive graph problems using limited memory for two prototypical graph problems: maximum weighted matching and minimum weighted edge cover. For matching, we conduct a thorough computational study on two of the semi-streaming algorithms including a recent breakthrough result that achieves a $1/(2+\varepsilon)$-approximation of the weight while using $O( n \log W /\epsilon)$ memory (here $n$ is the number of vertices and $W$ is the maximum edge weight), designed by Paz and Schwartzman [SODA, 2017]. Empirically, we show that the semi-streaming algorithms produce matchings whose weight is close to the best $1/2$-approximate offline algorithm while requiring less time and an order-of-magnitude less memory. For minimum weighted edge cover, we develop three novel semi-streaming algorithms. Two of these algorithms require a single pass through the input graph, require $O(n \log n)$ memory, and provide a 2-approximation guarantee on the objective. We also leverage a relationship between approximate maximum weighted matching and approximate minimum weighted edge cover to develop a two-pass $3/2+\epsilon$-approximate algorithm with the memory requirement of Paz and Schwartzman's semi-streaming matching algorithm. These streaming approaches are compared against the state-of-the-art 3/2-approximate offline algorithm. The semi-streaming matching and the novel edge cover algorithms proposed in this paper can process graphs with several billions of edges in under 30 minutes using 6 GB of memory, which is at least an order of magnitude improvement from the offline (non-streaming) algorithms. For the largest graph, the best alternative offline parallel approximation algorithm (GPA+ROMA) could not finish in three hours even while employing hundreds of processors and 1 TB of memory. We also demonstrate an application of the semi-streaming algorithm by computing a matching using linearly bounded memory on item intersection graphs derived from three machine learning datasets, whereas the existing offline algorithms could not complete on one of these datasets since their memory requirements exceeded 1TB.

Ferdous, S M.↗

NASA NTRSDate not supplied

Impacts of Hybrid Parallelism and Vectorization on the Performance of Newton-Krylov Methods in Computational Aerodynamics

Finding the numerical solution of moderate and high-fidelity aerodynamics problems on modern computer architectures involves, 1) decomposing the domain into smaller regions of nearly equal size, and 2) allocating computational resources for calculations on each domain and communication between domains. Modern computer clusters are composed from hierarchies of processing, memory, and communication resources with varying capabilities and latencies.This paper focuses on the combination of domain decomposition provided by ParMETIS [1]and Newton-Krylov Methods [2–5] for the solution of Computational Aerodynamics problems of interest to NASA. Herein, trade-offs encountered when mapping aerodynamics problems to modern computer architectures are explored through examples and discussions of trade-offs in parallelism from MPI [6], Open MP [7], and vectorization as partition sizes and computational resources are varied. An example of the impact that domain decomposition and MPI+OpenMPresource allocation can have on an adjoint calculation is presented in this abstract. The full paper will include more detailed examples, discussions of difficulties and potential methods to overcome them, and topics identified for future study.

Computational Aerodynamics, Hybrid Parallelism, Ve↗

DOE OSTI2014

Equation of motion coupled cluster methods for electron attachment and ionization potential in fullerenes C{sub 60} and C{sub 70}

In both molecular and periodic solid-state systems there is a need for the accurate determination of the ionization potential and the electron affinity for systems ranging from light harvesting polymers and photocatalytic compounds to semiconductors. The development of a Green's function approach based on the coupled cluster (CC) formalism would be a valuable tool for addressing many properties involving many-body interactions along with their associated correlation functions. As a first step in this direction, we have developed an accurate and parallel efficient approach based on the equation of motion-CC technique. To demonstrate the high degree of accuracy and numerical efficiency of our approach we calculate the ionization potential and electron affinity for C{sub 60} and C{sub 70}. Accurate predictions for these molecules are well beyond traditional molecular scale studies. We compare our results with experiments and both quantum Monte Carlo and GW calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2018

Beyond the plane-parallel approximation for redshift surveys

Redshift -space distortions privilege the location of the observer in cosmological redshift surveys, breaking the translational symmetry of the underlying theory. This violation of statistical homogeneity has consequences for the modelling of clustering observables, leading to what are frequently called 'wide-angle effects'. We study these effects analytically, computing their signature in the clustering of the multipoles in configuration and Fourier space. We take into account both physical wide-angle contributions as well as the terms generated by the galaxy selection function. Similar considerations also affect the way power spectrum estimators are constructed. We quantify in an analytical way the biases that enter and clarify the relation between what we measure and the underlying theoretical modelling. The presence of an angular window function is also discussed. Motivated by this analysis, we present new estimators for the three dimensional Cartesian power spectrum and bispectrum multipoles written in terms of spherical Fourier-Bessel coefficients. In conclusion, we show how the latter have several interesting properties, allowing in particular a clear separation between angular and radial modes.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2019

Exploiting the Semidestructive Nature of Gas Cluster Ion Beam Time-of-Flight Secondary Ion Mass Spectrometry Imaging for Simultaneous Localization and Confident Lipid Annotations

Lipids have been considered as key players in cell signaling and disease. Information on their location and distribution within a biological system, under varying conditions, is necessary to understand the contributions of different lipid species to an altered phenotype. Imaging mass spectrometry techniques, such as time-of-flight secondary ion mass spectrometry (ToF-SIMS) and matrix-assisted laser desorption/ionization (MALDI), are capable of revealing global lipid distributions in tissues in an untargeted fashion. Yet, to confidently identify the species present in a sample, orthogonal analyses like tandem MS (MS/MS) are often required. This can be accomplished by bulk sample analysis with liquid chromatography (LC)-MS/MS, which can provide confident lipid identifications, at the expense of losing location-specific information. Here, using planarian flatworms as a model system, we demonstrate that imaging gas cluster ion beam (GCIB)-ToF-SIMS has the unique capability to simultaneously detect, identify, and image lipid species with subcellular resolution in tissue sections. The parallel detection of both, intact lipids and their respective fragments, allows for unique identification of some species without the need of performing an additional orthogonal MS/MS analysis. This was accomplished by correlating intact lipid and associated fragment SIMS images. The lipid assignments, respective fragment identities, and locations gathered from ToF-SIMS data were confirmed via LC-MS/MS on lipid extracts and ultrahigh mass resolution MALDI-MS imaging. Together, these data show that the semidestructive nature of ToF-SIMS can be utilized advantageously to enable both confident molecular annotations and to determine the locations of species within a biological sample.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2016

Hot subdwarf stars observed in LAMOST DR1—atmospheric parameters from single-lined spectra

We present a catalog of 166 spectroscopically identified hot subdwarf stars from LAMOST DR1, 44 of which show the characteristics of cool companions in their optical spectra. Atmospheric parameters of 122 subdwarf stars with non-composite spectra were measured by fitting the profiles of hydrogen (H) and helium (He) lines with synthetic spectra from non-LTE model atmospheres. Most of the sdB stars scatter near the Extreme Horizontal Branch in the T{sub eff}–logg diagram and two well defined groups can be outlined. A clustering of He-enriched sdO stars appears near T{sub eff} = 45,000 K and log g = 5.8. The sdB population separates into several nearly parallel sequences in the T{sub eff}–He abundance diagram with clumps corresponding to those in the T{sub eff}–log g diagram. Over 38,000 K (sdO) stars show abundance extremes; they are either He-rich or He-deficient and we observe only a few stars in the abundance range −1<log y<0. With increasing temperature these extremes become less prominent and the He abundance approaches log y ∼ −0.5. A unique property of our sample is that it covers a large range in apparent magnitude and galactic latitude, therefore it contains a mix of stars from different populations and galactic environments. Our results are consistent with the findings of Hirsch and we conclude that He-rich and He-deficient sdB stars (log y < 1) probably originate from different populations. We also find that most sdO and sdB stars lie in a narrow strip in the plane of luminosity and helium abundance, which suggests that these atmospheric parameters are correlated.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1997

Analysis of 100Mb/s Ethernet for the Whitney Commodity Computing Testbed

We evaluate the performance of a Fast Ethernet network configured with a single large switch, a single hub, and a 4x4 2D torus topology in a testbed cluster of "commodity" Pentium Pro PCs. We also evaluated a mixed network composed of ethernet hubs and switches. An MPI collective communication benchmark, and the NAS Parallel Benchmarks version 2.2 (NPB2) show that the torus network performs best for all sizes that we were able to test (up to 16 nodes). For larger networks the ethernet switch outperforms the hub, though its performance is far less than peak. The hub/switch combination tests indicate that the NAS parallel benchmarks are relatively insensitive to hub densities of less than 7 nodes per hub.

Fineberg, Samuel A.↗

DOE OSTI2023

GPU acceleration of Swendsen–Wang dynamics

When simulating a lattice system near its critical temperature, local algorithms for modeling the system’s evolution can introduce very large autocorrelation times into sampled data. Here, this critical slowing down places restrictions on the analysis that can be completed in a timely manner of the behavior of systems around the critical point. Because it is often desirable to study such systems around this point, a new algorithm must be introduced. Therefore, we turn to cluster algorithms, such as the Swendsen–Wang algorithm and the Wolff clustering algorithm. They incorporate global updates which generate new lattice configurations with little correlation to previous states, even near the critical point. We look to accelerate the rate at which these algorithm are capable of running by implementing and benchmarking a parallel implementation of each algorithm designed to run on GPUs under NVIDIA’s CUDA framework. A 17 and 90 fold increase in the computational rate was, respectively, experienced when measured against the equivalent algorithm implemented in serial code.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2011

Kentucky DOE EPSCoR Program

The KY DOE EPSCoR Program supports two research clusters. The Materials Cluster uses unique equipment and computational methods that involve research expertise at the University of Kentucky and University of Louisville. This team determines the physical, chemical and mechanical properties of nanostructured materials and examines the dominant mechanisms involved in the formation of new self-assembled nanostructures. State-of-the-art parallel computational methods and algorithms are used to overcome current limitations of processing that otherwise are restricted to small system sizes and short times. The team also focuses on developing and applying advanced microtechnology fabrication techniques and the application of microelectrornechanical systems (MEMS) for creating new materials, novel microdevices, and integrated microsensors. The second research cluster concentrates on High Energy and Nuclear Physics. lt connects research and educational activities at the University of Kentucky, Eastern Kentucky University and national DOE research laboratories. Its vision is to establish world-class research status dedicated to experimental and theoretical investigations in strong interaction physics. The research provides a forum, facilities, and support for scientists to interact and collaborate in subatomic physics research. The program enables increased student involvement in fundamental physics research through the establishment of graduate fellowships and collaborative work.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2015

Understanding the ionic liquid [NC 4111 ][NTf 2 ] from individual building blocks: an IR-spectroscopic study

This study explores the interactions underlying the IR spectra of the ionic liquid [NC 4111 ][NTf 2 ] and its deuterated isotopomer [d 9 -NC 4111 ][NTf 2 ] by first isolating the spectra of charged ionic building blocks using mass-selective CIVP spectroscopy and then following the evolution of these bands upon sequential assembly of the ionic constituents. The spectra of the (1,1) and (2,2) neutral ion pairs are recorded using superfluid helium droplets as well as a solid neon matrix, while those of the larger charged aggregates are again obtained with CIVP. In general, the cluster spectra are similar to that of the bulk, with the (2,2) system displaying the closest resemblance. Analysis of the polarization-dependent band intensities of the neutral ion pairs in liquid droplets as a function of external electric field yields dipole moments of the neutral aggregates. This information allows a coarse assessment of the packing structure of the neutral pairs to be antiparallel at 0.37 K, in contrast to the parallel arrangement found for the assembly of small, high-dipole neutral molecules with large rotational constants (e.g., HCN). The role of an extra anion or cation attached to both the (1,1) and the (2,2) ion pairs to form the charged clusters is discussed in the context of an additional remote, more unfavorable binding site intrinsic to the nature of the charged IL clusters and as such not anticipated in the bulk phase. Whereas for the anion itself only the lowest energy trans conformer was observed, the higher clusters showed an additional population of the cis conformer. Finally, the interactions are found to be consistent with a minimal role of hydrogen bonding.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2015

Ordering Traces Logically to Identify Lateness in Message Passing Programs

Event traces are valuable for understanding the behavior of parallel programs. However, automatically analyzing a large parallel trace is difficult, especially without a specific objective. We aid this endeavor by extracting a trace's logical structure, an ordering of trace events derived from happened-before relationships, while taking into account developer intent. Using this structure, we can calculate an operation's delay relative to its peers on other processes. The logical structure also serves as a platform for comparing and clustering processes as well as highlighting communication patterns in a trace visualization. We present an algorithm for determining this idealized logical structure from traces of message passing programs, and we develop metrics to quantify delays and differences among processes. We implement our techniques in Ravel, a parallel trace visualization tool that displays both logical and physical timelines. Rather than showing the duration of each operation, we display where delays begin and end, and how they propagate. As a result, we apply our approach to the traces of several message passing applications, demonstrating the accuracy of our extracted structure and its utility in analyzing these codes.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2013

Population of SOHO/STEREO Kreutz sungrazers and the arrival of comet C/2011 W3 (Lovejoy)

We examine properties of the population of SOHO/STEREO (dwarf) Kreutz sungrazing comets from 2004 to 2013, including the arrival rates, peculiar gaps, and a potential relationship to the spectacular comet C/2011 W3 (Lovejoy). Selection effects, influencing the observed distribution, are largely absent among bright dwarf sungrazers, whose temporal sequence implies the presence of a swarm, with objects brighter at maximum than an apparent magnitude of 3 arriving at a peak rate of ∼4.6 yr{sup –1} in late 2010, while those brighter than magnitude 2 arrived at a peak rate of ∼4.3 yr{sup –1} in early 2011, both a few times the pre-swarm rate. The entire population of SOHO/STEREO Kreutz sungrazers also peaked about one year before the appearance of C/2011 W3. Orbital data show, however, that a great majority of bright dwarf sungrazers moved in paths similar to that of comet C/1843 D1, deviating 10° or more from the orbit of C/2011 W3 in the angular elements. The evidence from the swarm and the overall elevated arrival rates suggests the existence of a fragmented sizable sungrazer that shortly preceded C/2011 W3 but was independent of it. On the other hand, these findings represent another warning signal that the expected 21st century cluster of spectacular Kreutz comets is on its way to perihelion, to arrive during the coming decades. It is only in this sense that we find a parallel link between C/2011 W3 and the spikes in the population of SOHO/STEREO Kreutz sungrazers.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2014

Whistler mode waves and the electron heat flux in the solar wind: cluster observations

The nature of the magnetic field fluctuations in the solar wind between the ion and electron scales is still under debate. Using the Cluster/STAFF instrument, we make a survey of the power spectral density and of the polarization of these fluctuations at frequencies f in [1, 400] Hz, during five years (2001-2005), when Cluster was in the free solar wind. In ∼10% of the selected data, we observe narrowband, right-handed, circularly polarized fluctuations, with wave vectors quasi-parallel to the mean magnetic field, superimposed on the spectrum of the permanent background turbulence. We interpret these coherent fluctuations as whistler mode waves. The lifetime of these waves varies between a few seconds and several hours. Here, we present, for the first time, an analysis of long-lived whistler waves, i.e., lasting more than five minutes. We find several necessary (but not sufficient) conditions for the observation of whistler waves, mainly a low level of background turbulence, a slow wind, a relatively large electron heat flux, and a low electron collision frequency. When the electron parallel beta factor β {sub e∥} is larger than 3, the whistler waves are seen along the heat flux threshold of the whistler heat flux instability. The presence of such whistler waves confirms that the whistler heat flux instability contributes to the regulation of the solar wind heat flux, at least for β {sub e∥} ≥ 3, in slow wind at 1 AU.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

Chicken Production and Human Clinical Escherichia coli Isolates Differ in Their Carriage of Antimicrobial Resistance and Virulence Factors

Contamination of food animal products by Escherichia coli is a leading cause of foodborne disease outbreaks, hospitalizations, and deaths in humans. Chicken is the most consumed meat both in the United States and across the globe according to the U.S. Department of Agriculture. Although E. coli is a ubiquitous commensal bacterium of the guts of humans and animals, its ability to acquire antimicrobial resistance (AMR) genes and virulence factors (VFs) can lead to the emergence of pathogenic strains that are resistant to critically important antibiotics. Thus, it is important to identify the genetic factors that contribute to the virulence and AMR of E. coli. In this study, we performed in-depth genomic evaluation of AMR genes and VFs of E. coli genomes available through the National Antimicrobial Resistance Monitoring System GenomeTrackr database. Our objective was to determine the genetic relatedness of chicken production isolates and human clinical isolates. To achieve this aim, we first developed a massively parallel analytical pipeline (Reads2Resistome) to accurately characterize the resistome of each E. coli genome, including the AMR genes and VFs harbored. We used random forests and hierarchical clustering to show that AMR genes and VFs are sufficient to classify isolates into different pathogenic phylogroups and host origin. We found that the presence of key type III secretion system and AMR genes differentiated human clinical isolates from chicken production isolates. These results further improve our understanding of the interconnected role AMR genes and VFs play in shaping the evolution of pathogenic E. coli strains.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2013

National Computational Infrastructure for LatticeGauge Theory SciDAC-2 Closeout Report

As part of the reliability project work, researchers from Vanderbilt University, Fermi National Laboratory and Illinois Institute of technology developed a real-time cluster fault-tolerant cluster monitoring framework. The goal for the scientific workflow project is to investigate and develop domain-specific workflow tools for LQCD to help effectively orchestrate, in parallel, computational campaigns consisting of many loosely-coupled batch processing jobs.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2003

Experiences using OpenMP based on Computer Directed Software DSM on a PC Cluster

In this work we report on our experiences running OpenMP programs on a commodity cluster of PCs running a software distributed shared memory (DSM) system. We describe our test environment and report on the performance of a subset of the NAS Parallel Benchmarks that have been automaticaly parallelized for OpenMP. We compare the performance of the OpenMP implementations with that of their message passing counterparts and discuss performance differences.

Hess, Matthias↗