Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed parallelization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

Π4U: A high performance computing framework for Bayesian uncertainty quantification of complex models

We present Π4U,{sup 1} an extensible framework, for non-intrusive Bayesian Uncertainty Quantification and Propagation (UQ+P) of complex and computationally demanding physical models, that can exploit massively parallel computer architectures. The framework incorporates Laplace asymptotic approximations as well as stochastic algorithms, along with distributed numerical differentiation and task-based parallelism for heterogeneous clusters. Sampling is based on the Transitional Markov Chain Monte Carlo (TMCMC) algorithm and its variants. The optimization tasks associated with the asymptotic approximations are treated via the Covariance Matrix Adaptation Evolution Strategy (CMA-ES). A modified subset simulation method is used for posterior reliability measurements of rare events. The framework accommodates scheduling of multiple physical model evaluations based on an adaptive load balancing library and shows excellent scalability. In addition to the software framework, we also provide guidelines as to the applicability and efficiency of Bayesian tools when applied to computationally demanding physical models. Theoretical and computational developments are demonstrated with applications drawn from molecular dynamics, structural dynamics and granular flow.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Mapping Dense LU Factorization on Multicore Supercomputer Nodes

Dense LU factorization is a prominent benchmark used to rank the performance of supercomputers. Many implementations use block-cyclic distributions of matrix blocks onto a two-dimensional process grid. The process grid dimensions drive a trade-off between communication and computation and are architecture- and implementation-sensitive. The critical panel factorization steps can be made less communication-bound by overlapping asynchronous collectives for pivoting with the computation of rank-k updates. By shifting the computation-communication trade-off, a modified block-cyclic distribution can beneficially exploit more available parallelism on the critical path, and reduce panel factorization's memory hierarchy contention on now-ubiquitous multicore architectures. During active panel factorization, rank-1 updates stream through memory with minimal reuse. In a column-major process grid, the performance of this access pattern degrades as too many streaming processors contend for access to memory. A block-cyclic mapping in the row-major order does not encounter this problem, but consequently sacrifices node and network locality in the critical pivoting steps. We introduce 'striding' to vary between the two extremes of row- and column-major process grids. The maximum available parallelism in the critical path work (active panel factorization, triangular solves, and subsequent broadcasts) is bounded by the length or width of the process grid. Increasing one dimension of the process grid decreases the number of distinct processes and nodes in the other dimension. To increase the harnessed parallelism in both dimensions, we start with a tall process grid. We then apply periodic 'rotation' to this grid to restore exploited parallelism along the row to previous levels. As a test-bed for further mapping experiments, we describe a dense LU implementation that allows a block distribution to be defined as a general function of block to processor. Other mappings can be tested wit...

Computer Science↗

Dynamically Scheduled Region-Based Image Compositing

Algorithms for sort-last parallel volume rendering on large distributed memory machines usually divide a dataset equally across all nodes for rendering. Depending on the features that a user wants to see in a dataset, all the nodes will rarely finish rendering at the same time. Here, existing compositing algorithms do not often take this into consideration, which can lead to significant delays when nodes that are compositing wait for other nodes that are still rendering. In this paper, we present an image compositing algorithm that uses spatial and temporal awareness to dynamically schedule the exchange of regions in an image and progressively composite images as they become available. Running on the Edison supercomputer at NERSC, we show that a scheduler-based algorithm with awareness of the spatial contribution from each rendering node can outperform traditional image compositing algorithms.

97 MATHEMATICS AND COMPUTING↗

SU-F-T-58: Dosimetric Evaluation of Breast Tissue Composition for Electronic Brachytherapy (BET) Source In High Dose Rate Accelerated Partial Breast (APBI) Irradiation

Purpose: To quantitatively evaluate the dosimetric impact of differing breast tissue compositions for electronic brachytherapy source for high dose rate accelerated partial breast irradiation. Methods: A series of Monte Carlo Simulation were created using the GEANT4 toolkit (version 10.0). The breast phantom was modeled as a semi-circle with a radius of 5.0 cm. A water balloon with a radius of 1.5 cm was located in the phantom with the Xoft AxxentTM EBT source placed at center as a point source. A mixed of two tissue types (adipose and glandular tissue) was assigned as the materials for the breast phantom with different weight ratios. The proportionality of glandular and adipose tissue was simulated in four different fashions, 80/20, 70/30, 50/50 and 30/70 respectively. The custom energy spectrum for the 50 kVp XOFT source was provided via the manufacturer and used to generate incident photons. The dose distributions were recorded using a parallel three dimensional mesh with a size of 30 × 30 × 30 cm3 with 1 × 1 × 1 mm3 voxels. The simulated doses absorbed along the transverse axis were normalized at the distance of 1 cm and then compared with the calculations using standard TG-43 formalism. Results: All simulations showed underestimation of dose beyond balloon surface compared to standard TG-43 calculations. The maximum percentage differences within 2 cm distance from balloon surface were found to be 18%, 11%, 10% and 8% for the fat breast (30/70), standard breast (50/50), dense breast (70/30 and 80/20), respectively. Conclusion: The accuracy of dose calculations for low energy EBT source was limited when considering tissue heterogeneous composition. The impact of atomic number on photo-electric effect for lower energy Brachytherapy source is not accounted for and resulting in significant errors in dose calculation.

60 APPLIED LIFE SCIENCES↗

Ultrahigh-order Maxwell solver with extreme scalability for electromagnetic PIC simulations of plasmas

The advent of massively parallel supercomputers, with their distributed-memory technology using many processing units, has favored the development of highly-scalable local low-order solvers at the expense of harder-to-scale global very high-order spectral methods. Indeed, FFT-based methods, which were very popular on shared memory computers, have been largely replaced by finite-difference (FD) methods for the solution of many problems, including plasmas simulations with electromagnetic Particle-In-Cell methods. For some problems, such as the modeling of so-called “plasma mirrors” for the generation of high-energy particles and ultra-short radiations, we have shown that the inaccuracies of standard FD-based PIC methods prevent the modeling on present supercomputers at sufficient accuracy. Here, we demonstrate here that a new method, based on the use of local FFTs, enables ultrahigh-order accuracy with unprecedented scalability, and thus for the first time the accurate modeling of plasma mirrors in 3D.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

EVOLUTION OF THE WATER MASER EXPANDING SHELL IN W75N VLA 2

We present Very Long Baseline Interferometry (VLBI) observations of 22 GHz H{sub 2}O masers in the high-mass star-forming region of W75N, carried out with VLBI Exploration of Radio Astrometry (VERA) for three epochs in 2007 with an angular resolution of {approx}1 mas. We detected H{sub 2}O maser emission toward the radio jet in VLA 1 and the expanding shell-like structure in VLA 2. The spatial distribution of the H{sub 2}O masers detected with VERA and measured proper motions around VLA 1 and VLA 2 are similar to those found with previous VLBI observations in epochs 1999 and 2005, with the masers in VLA 1 mainly distributed along a linear structure parallel to the radio jet and, on the other hand, forming a shell-like structure around VLA 2. We have made elliptical fits to the VLA 2 H{sub 2}O maser shell-like structure observed in the different epochs (1999, 2005, and 2007), and found that the shell is still expanding eight years after its discovery. From the difference in the size of the semi-major axes of the fitted ellipses in epochs 1999 ({approx_equal}71 {+-} 1 mas), 2005 ({approx_equal}97 {+-} 3 mas), and 2007 ({approx_equal}111 {+-} 1 mas), we estimate an average expanding velocity of {approx}5 mas yr{sup -1}, similar to the proper motions measured in the individual H{sub 2}O maser features. A kinematic age of {approx}20 yr is derived for this structure. In addition, our VERA observations indicate an increase in the ellipticity of the expanding shell around VLA 2 from epochs 1999 to 2007. In fact, the elliptical fit of the VERA data shows a ratio of the minor and major axes of {approx}0.6, in contrast with an almost circular shape for the shell detected in 1999 and 2005 (b/a {approx} 0.9). This suggests that we are probably observing the formation of a jet-driven H{sub 2}O maser structure in VLA2, evolving from a non-collimated pulsed-outflow event during the first stages of evolution of a massive young stellar object (YSO). This may support predictions made earlier by other authors on this issue, consistent with recent magnetohydrodynamical simulations. We discuss possible implications of our results in the study of the first stages of evolution of massive YSOs.

79 ASTRONOMY AND ASTROPHYSICS↗

PETSc/TAO Users Manual (Rev. 3.19)

This manual describes the use of the Portable, Extensible Toolkit for Scientific Computation (PETSc) and the Toolkit for Advanced Optimization (TAO) for the numerical solution of partial differential equations and related problems on high-performance computers. PETSc/TAO is a suite of data structures and routines that provide the building blocks for the implementation of large-scale application codes on parallel (and serial) computers. PETSc uses the MPI standard for all distributed memory communication. PETSc/TAO includes a large suite of parallel linear solvers, nonlinear solvers, time integrators, and opti mization that may be used in application codes written in Fortran, C, C++, and Python (via petsc4py; see Getting Started). PETSc provides many of the mechanisms needed within parallel application codes, such as parallel matrix and vector assembly routines. The library is organized hierarchically, enabling users to employ the level of abstraction that is most appropriate for a particular problem. By using techniques of object-oriented programming, PETSc provides enormous flexibility for users. PETSc is a sophisticated set of software tools; as such, for some users it initially has a much steeper learning curve than packages such as MATLAB or a simple subroutine library. In particular, for individuals without some computer science background, experience programming in C, C++, python, or Fortran and experience using a debugger such as gdb or lldb, it may require a significant amount of time to take full advantage of the features that enable efficient software use. However, the power of the PETSc design and the algorithms it incorporates may make the efficient implementation of many application codes simpler than “rolling them” yourself. For many tasks a package such as MATLAB is often the best tool; PETSc is not intended for the classes of problems for which effective MATLAB code can be written. There are several packages, built on PETSc, that may satisfy your needs without requiring directly using PETSc. We recommend reviewing these packages functionality before starting to code directly with PETSc. PETSc can be used to provide a “MPI parallel linear solver” in an otherwise sequential, or OpenMP parallel code. This approach cannot provide extremely large improvements in the application time by utilizing large numbers of MPI processes but can still improve the performance. Certainly all parts of a previously sequential code need not be parallelized but the matrix generation portion must be parallelized to expect true scalability to large numbers of MPI processes. See PCMPI for details on how to utilize the PETSc MPI linear solver server. Since PETSc is under continued development, small changes in usage and calling sequences of routines will occur. PETSc has been supported for twenty-five years; see mailing list information on our website for information on contacting support.

97 MATHEMATICS AND COMPUTING↗

PETSc/TAO Users Manual V.3.21

This manual describes the use of the Portable, Extensible Toolkit for Scientific Computation (PETSc) and the Toolkit for Advanced Optimization (TAO) for the numerical solution of partial differential equations (PDEs) and related problems on high-performance computers. PETSc/TAO is a suite of data structures and routines that provide the building blocks for implementing large-scale application codes on parallel (and serial) computers. PETSc uses the MPI standard for all distributed memory communication. PETSc/TAO includes a large suite of parallel linear solvers, nonlinear solvers, time integrators, and optimizers that may be used in application codes written in Fortran, C, C++, and Python (via petsc4py; see Getting Started ). The library is organized hierarchically, enabling users to employ the abstraction level most appropriate for a particular problem. By using techniques of object-oriented programming, PETSc provides enormous flexibility for users.

97 MATHEMATICS AND COMPUTING↗

The OVIS analysis architecture.

This report summarizes the current statistical analysis capability of OVIS and how it works in conjunction with the OVIS data readers and interpolators. It also documents how to extend these capabilities. OVIS is a tool for parallel statistical analysis of sensor data to improve system reliability. Parallelism is achieved using a distributed data model: many sensors on similar components (metaphorically sheep) insert measurements into a series of databases on computers reserved for analyzing the measurements (metaphorically shepherds). Each shepherd node then processes the sheep data stored locally and the results are aggregated across all shepherds. OVIS uses the Visualization Tool Kit (VTK) statistics algorithm class hierarchy to perform analysis of each process's data but avoids VTK's model aggregation stage which uses the Message Passing Interface (MPI); this is because if a single process in an MPI job fails, the entire job will fail. Instead, OVIS uses asynchronous database replication to aggregate statistical models. OVIS has several additional features beyond those present in VTK that, first, accommodate its particular data format and, second, improve the memory and speed of the statistical analyses. First, because many statistical algorithms are multivariate in nature and sensor data is typically univariate, interpolation of data is required to provide simultaneous observations of metrics. Note that in this report, we will refer to a single value obtained from a sensor as a measurement while a collection of multiple sensor values simultaneously present in the system is an observation. A base class for interpolation is provided that abstracts the operation of converting multiple sensor measurements into simultaneous observations. A concrete implementation is provided that performs piecewise constant temporal interpolation of multiple metrics across a single component. Secondly, because calculations may summarize data too large to fit in memory OVIS analyses batches of observations at a time and aggregates these intermediate intra-process models as it goes before storing the final model for inter-process aggregation via database replication. This reduces the memory footprint of the analysis, interpolation, and the database client and server query processing. This also interleaves processing with the disk I/O required to fetch data from the database - also improving speed. This report documents how OVIS performs analyses and how to create additional analysis components that fetch measurements from the database, perform interpolation, or perform operations on streamed observations (such as model updates or assessments). The rest of this section outlines the OVIS analysis algorithm and is followed by sections specific to each subtask. Note that we are limiting our discussion for now to the creation of a model from a set of measurements, and not including the assessment of observations using a model. The same framework can be used for assessment but that use case is not detailed in this report.

97 MATHEMATICS AND COMPUTING↗

PythonFOAM: In-situ data analyses with OpenFOAM and Python

Here, we outline the development of a general-purpose Python-based data analysis tool for OpenFOAM. Our implementation relies on the construction of OpenFOAM applications that have bindings to data analysis libraries in Python. Double precision data in OpenFOAM is cast to a NumPy array using the NumPy C-API and Python modules may then be used for arbitrary data analysis and manipulation on flow-field information. We highlight how the proposed wrapper may be used for an in-situ online singular value decomposition (SVD) implemented in Python and accessed from the OpenFOAM solver PimpleFOAM. Here, 'in-situ' refers to a programming paradigm that allows for a concurrent computation of the data analysis on the same computational resources utilized for the partial differential equation solver. In addition, to demonstrate parallel deployments, we deploy a distributed SVD, which collects snapshot data across the ranks of a distributed simulation to compute the global left singular vectors. Crucially, both OpenFOAM and Python share the same message passing interface (MPI) communicator for this deployment which allows Python objects and functions to exchange NumPy arrays across ranks. Subsequently, we provide scaling assessments of this distributed SVD on multiple nodes of Intel Broadwell and KNL architectures for canonical test cases such as the large eddy simulations of a backward facing step and a channel flow at friction Reynolds number of 395. Finally, we demonstrate the deployment of a deep neural network for compressing the flow-field information using an autoencoder to demonstrate an ability to use state-of-the-art machine learning tools in the Python ecosystem.

97 MATHEMATICS AND COMPUTING↗

Formation of Fe2Al5-xZnx intermetallic crystals at the Fe-Zn interface in hot-dip galvanizing

Highlights: • Interstitial-free steels were galvanized in Zn baths containing 0.14-0.28 wt% Al. • The Fe-Al layer formed in a 0.14 wt% Al bath is composed of equiaxed Fe{sub 2}Al{sub 5-x}Zn{sub x} crystals without preferred orientations. • The layers formed in baths containing 0.18 wt% Al or more are composed of orientated domains. • Each domain contains 4-12 Fe{sub 2}Al{sub 5-x}Zn{sub x} crystal variants of specific orientations. • A layer of a single variant crystal can grow epitaxially on the α-Fe grains as the Al content reaches 0.28 wt%. - Abstract: The formation of Fe{sub 2}Al{sub 5-x}Zn{sub x} inhibition layer at the Fe-Zn interface has been characterized by scanning electron microscopy/electron backscatter diffraction and transmission electron microscopy for interstitial-free steels galvanized in Zn baths containing 0.14–0.28 wt% Al. The inhibition layer formed in the 0.14 wt% Al bath is composed of fine, equiaxed Fe{sub 2}Al{sub 5-x}Zn{sub x} crystals without preferred orientations. The inhibition layers formed in the baths containing 0.18 wt% Al or more are composed of orientated domains and each domain contains 4–12 Fe{sub 2}Al{sub 5-x}Zn{sub x} crystal variants of specific orientations. All the variants follow the same Fe{sub 2}Al{sub 5-x}Zn{sub x}/Fe orientation relationship of [110]{sub Fe2Al5-xZnx}//[1 1-bar 1]{sub Fe} and (001){sub Fe2Al5-xZnx}//(110){sub Fe}. Therefore, each domain is formed on a single α-Fe grain and the number of variants in the domain is determined by the orientation of the α-Fe grain. The fraction of the area of epitaxial growth increases with increasing Al content in bath. When the Al content reaches 0.28 wt%, a layer of a single variant (SV) crystal can grow epitaxially on the α-Fe grains having orientations distributed from <110> to <113> parallel to the normal direction of the sheet surface. The formation of a dense SV inhibition layer is the major reason for the drastic reductions in both the Al-pickup rate and the inhibition layer thickness at high Al content baths.

36 MATERIALS SCIENCE↗

Ultrashort pulse chirp measurement via transverse second-harmonic generation in strontium barium niobate crystal

Pulse compression in dispersive strontium barium niobate crystal with a random size and distribution of the anti-parallel orientated nonlinear domains is observed via transverse second harmonic generation. The dependence of the transverse width of the second harmonic trace along the propagation direction allows for the determination of the initial chirp and duration of pulses in the femtosecond regime. This technique permits a real-time analysis of the pulse evolution and facilitates fast in-situ correction of pulse chirp acquired in the propagation through an optical system.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Creation of large temperature anisotropies in a laboratory plasma

Ion temperature anisotropy in an expanding magnetized plasma is investigated using laser induced fluorescence. Parallel and perpendicular ion velocity distribution functions (IVDFs) were measured simultaneously with high spatial resolution in the expanding plasma. Large ion temperature anisotropies (T ⊥i /T ∥i ~ 10) are observed in a conical region at the periphery of the expanding plasma plume. A simple 2D Boris stepper model that incorporates the measured electric field structure is able to reproduce the gross features of the measured perpendicular IVDFs. Here, a Nyquist stability analysis of the measured IVDFs suggests that multiple instabilities with k ⊥ρi ~ 1 and k ||ρi ~ 0.2 are likely to be excited in these plasmas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

ALGORITHMS AND PROGRAMS FOR STRONG GRAVITATIONAL LENSING IN KERR SPACE-TIME INCLUDING POLARIZATION

Active galactic nuclei (AGNs) and quasars are important astrophysical objects to understand. Recently, microlensing observations have constrained the size of the quasar X-ray emission region to be of the order of 10 gravitational radii of the central supermassive black hole. For distances within a few gravitational radii, light paths are strongly bent by the strong gravity field of the central black hole. If the central black hole has nonzero angular momentum (spin), then a photon’s polarization plane will be rotated by the gravitational Faraday effect. The observed X-ray flux and polarization will then be influenced significantly by the strong gravity field near the source. Consequently, linear gravitational lensing theory is inadequate for such extreme circumstances. We present simple algorithms computing the strong lensing effects of Kerr black holes, including the effects on polarization. Our algorithms are realized in a program “KERTAP” in two versions: MATLAB and Python. The key ingredients of KERTAP are a graphic user interface, a backward ray-tracing algorithm, a polarization propagator dealing with gravitational Faraday rotation, and algorithms computing observables such as flux magnification and polarization angles. Our algorithms can be easily realized in other programming languages such as FORTRAN, C, and C++. The MATLAB version of KERTAP is parallelized using the MATLAB Parallel Computing Toolbox and the Distributed Computing Server. The Python code was sped up using Cython and supports full implementation of MPI using the “mpi4py” package. As an example, we investigate the inclination angle dependence of the observed polarization and the strong lensing magnification of AGN X-ray emission. We conclude that it is possible to perform complex numerical-relativity related computations using interpreted languages such as MATLAB and Python.

79 ASTRONOMY AND ASTROPHYSICS↗

Measurement of the Primary Beam of the Tianlai Cylindrical Antenna Using an Unmanned Aerial Vehicle

The Tianlai Cylinder Pathfinder Array consists of three adjacent cylindrical reflectors fixed on the ground, each 40 m long and 15 m wide, with the cylinder axis oriented along the North–South (N–S) direction. Dual linear polarization feeds are distributed along the focus line, parallel to the cylinder axis. Measurement of the primary beam profile of these cylindrical reflectors is difficult, as they are too large to be placed in an anechoic chamber. While the beam profile along the East–West (E–W) direction can be measured with the transit observations of bright astronomical radio sources, the beam profile along the N–S direction remains very uncertain. Here, we present a preliminary measurement of the beam profile of the Tianlai cylindrical antenna along both the N–S direction and E–W direction in the frequency range of 700–800 MHz, using a calibrator source carried by an unmanned aerial vehicle (UAV) flying in the far field. The beam profile of the Tianlai cylindrical antenna is determined from the analysis of the auto-correlation signals from the cylinder array correlator, taking into account the emitter antenna beam profile, itself measured with a dipole antenna on the ground. The accuracy of the UAV-based determination of the cylinder beam profiles is validated by comparing the results with the one derived from bright astronomical source transits, and with simulated beams.

Li, Jixia [Chinese Academy of Sciences (CAS), Beij↗

Phoebe: a high-performance framework for solving phonon and electron Boltzmann transport equations

Understanding the electrical and thermal transport properties of materials is critical to the design of electronics, sensors, and energy conversion devices. Computational modeling can accurately predict material properties but, in order to be reliable, requires accurate descriptions of electron and phonon states and their interactions. While first-principles methods are capable of describing the energy spectrum of each carrier, using them to compute transport properties is still a formidable task, both computationally demanding and memory intensive, requiring integration of fine microscopic scattering details for estimation of macroscopic transport properties. To address this challenge, we present Phoebe—a newly developed software package that includes the effects of electron–phonon, phonon–phonon, boundary, and isotope scattering in computations of electrical and thermal transport properties of materials with a variety of available methods and approximations. This open source C++ code combines MPI-OpenMP hybrid parallelization with GPU acceleration and distributed memory structures to manage computational cost, allowing Phoebe to effectively take advantage of contemporary computing infrastructures. We demonstrate that Phoebe accurately and efficiently predicts a wide range of transport properties, opening avenues for accelerated computational analysis of complex crystals.

36 MATERIALS SCIENCE↗

Interpretable machine learning study of the many-body localization transition in disordered quantum Ising spin chains

We apply support vector machine (SVM) to study the phase transition between many-body localized and thermal phases in a disordered quantum Ising chain in a transverse external field. The many-body eigenstate energy E is bounded by a bandwidth W = E max – E min . The transition takes place on a phase diagram spanned by the energy density ε = 2(E – E min )/W and the disorder strength δJ of the spin interaction uniformly distributed within [ – δJ, δJ], formally parallel to the mobility edge in Anderson localization. In our paper, we use the labeled probability density of eigenstate wave functions belonging to the deeply localized and thermal regimes at two different energy densities (ε's) as the training set, i.e., providing labeled data at four corners of the phase diagram. Then we employ the trained SVM to predict the whole phase diagram. The obtained phase boundary qualitatively agrees with previous work using entanglement entropy to characterize these two phases. We further analyze the decision function of the SVM to interpret its physical meaning and find that it is analogous to the inverse participation ratio in configuration space. Our findings demonstrate the ability of the SVM to capture potential quantities that may characterize the many-body localization phase transition.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Sawtooth-Control Mechanism using Toroidally Propagating Ion-Cyclotron-Resonance Waves in Tokamaks

The sawtooth control mechanism in plasmas employing off-axis toroidally propagating ion cyclotron resonance waves in tokamaks is reinvestigated. The radial drift excursion of energetic passing ions distributed asymmetrically in the velocity parallel to the magnetic field determines stability when the rational q=1 surface resides within a narrow region centered about the shifted fundamental cyclotron resonance.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗