Search NASA⌕ Search

SEARCH · Search NASA

Results for “parallel simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Deploy production sliding mesh capability with linear solver benchmarking (ECP Milestone Report, Ver. 1.0)

Wind applications require the ability to simulate rotating blades. To support this use-case, a novel design-order sliding mesh algorithm has been developed and deployed. The hybrid method combines the control volume finite element methodology (CVFEM) with concepts found within a discontinuous Galerkin (DG) finite element method (FEM) to manage a sliding mesh. The method has been demonstrated to be design-order for the tested polynomial basis (P=1 and P=2) and has been deployed to provide production simulation capability for a Vestas V27 (225 kW) wind turbine. Other stationary and canonical rotating flow simulations are also presented. As the majority of wind-energy applications are driving extensive usage of hybrid meshes, a foundational study that outlines near-wall numerical behavior for a variety of element topologies is presented. Results indicate that the proposed nonlinear stabilization operator (NSO) is an effective stabilization methodology to control Gibbs phenomena at large cell Peclet numbers. The study also provides practical mesh resolution guidelines for future analysis efforts. Application-driven performance and algorithmic improvements have been carried out to increase robustness of the scheme on hybrid production wind energy meshes. Specifically, the Kokkos-based Nalu Kernel construct outlined in the FY17/Q4 ExaWind milestone has been transitioned to the hybrid mesh regime. This code base is exercised within a full V27 production run. Simulation timings for parallel search and custom ghosting are presented. As the low-Mach application space requires implicit matrix solves, the cost of matrix reinitialization has been evaluated on a variety of production meshes. Results indicate that at low element counts, i.e., fewer than 100 million elements, matrix graph initialization and preconditioner setup times are small. However, as mesh sizes increase, e.g., 500 million elements, simulation time associated with "setup-up" costs can increase to nearly 50% of overall simulation time when using the full Tpetra solver stack and nearly 35% when using a mixed Tpetra- Hypre-based solver stack. The report also highlights the project achievement of surpassing the 1 billion element mesh scale for a production V27 hybrid mesh. A detailed timing breakdown is presented that again suggests work to be done in the setup events associated with the linear system. In order to mitigate these initialization costs, several application paths have been explored, all of which are designed to reduce the frequency of matrix reinitialization. Methods such as removing Jacobian entries on the dynamic matrix columns (in concert with increased inner equation iterations), and lagging of Jacobian entries have reduced setup times at the cost of numerical stability. Artificially increasing, or bloating, the matrix stencil to ensure that full Jacobians are included is developed with results suggesting that this methodology is useful in decreasing reinitialization events without loss of matrix contributions. With the above foundational advances in computational capability, the project is well positioned to begin scientific inquiry on a variety of wind-farm physics such as turbine/turbine wake interactions.

Domino, Stefan P.↗

Three-dimensional fluid simulations of a simple magnetized toroidal plasma

Three-dimensional fluid simulations are performed in a simple magnetized toroidal plasma, in which vertical and toroidal magnetic fields create helicoidal magnetic field lines that terminate on the torus vessel. The simulations are carried out in the three-dimensional flux tube that wraps around the torus and are able to describe both interchange and drift-wave dynamics. The presence of different turbulence regimes is pointed out; in particular, it is shown that turbulence can be quenched by either a sufficiently large plasma source, or a sufficiently small vertical field, or a sufficiently high parallel resistivity. The simulations considered herein reveal that interchange turbulence dominates over the drift-wave dynamics. Considering the experimental observations, we finally discuss the limitations of the present model.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Experimental Identification and validation of a crystal plasticity model for a low carbon steel on different length scales

Micro-macro approaches are of increasing importance for metal forming simulations and, accordingly, the number of new micro-macro models is increasing as well. Thus, there is a need for adequate identification and validation methods for such models. These methods can be based on experiments on the polycrystalline scale (macro scale), but the use of experiments on the individual single-crystal grain scale (micro scale) has been suggested as well. In this presentation, experiments on both scales and, in parallel, FEM-simulations are presented, in order to compare the results of both approaches. All specimens stem from a rolled sheet of the deep-drawing steel DC04. In addition to the usual macroscopic shear and tensile tests, microscopic indenter tests have been performed. From the micro-indentation tests, which have been applied to single grains of the polycrystalline DC04 steel sheet, various types of deformation data can be measured. Within this presentation we will focus on orientation changes induced by spherical-indentation in the region below the indent, which have been measured using micron-resolution 3D x-ray microscopy and simulated using FEM. In addition, the sensitivity of the calculated orientation changes with respect to {l_brace}110{r_brace} versus {l_brace}112{r_brace} slip planes is discussed.

36 MATERIALS SCIENCE↗

Experiments with Memory-to-Memory Coupling for End-to-End fusion Simulation Workflows

Scientific applications are striving to accurately simulate multiple interacting physical processes that comprise complex phenomena being modeled. Efficient and scalable parallel implementations of these coupled simulations present challenging interaction and coordination requirements, especially when the coupled physical processes are computationally heterogeneous and progress at different speeds. In this paper, we present the design, implementation and evaluation of a memory-to-memory coupling framework for coupled scientific simulations on high-performance parallel computing platforms. The framework is driven by the coupling requirements of the Center for Plasma Edge Simulation, and it provides simple coupling abstractions as well as efficient asynchronous (RDMA-based) memory-to-memory data transport mechanisms that complement existing parallel programming systems and data sharing frameworks. The framework enables flexible coupling behaviors that are asynchronous in time and space, and it supports dynamic coupling between heterogeneous simulation processes without enforcing any synchronization constraints. We evaluate the performance and scalability of the coupling framework using a specific coupling scenario, on the Jaguar Cray XT5 system at Oak Ridge National Laboratory.

99 GENERAL AND MISCELLANEOUS↗

Enhancing parallel quasi-static particle-in-cell simulations with a pipelining algorithm

A pipelining algorithm to overcome the limitation on scaling quasi-static particle-in-cell models of relativistic beams in plasmas to a very large number of processors is described. The pipelining algorithm uses multiple groups of processors and optimizes the job allocation on the processors in parallel computing. The algorithm is implemented on the quasi-static code QuickPIC and is shown to scale to over 10{sup 3} processors and increased the scale and speed by two orders of magnitude over the non-pipelined model. The new approach opens the door to performing full scale 3D simulations of future plasma wakefield accelerators or full lifetime models of beam interaction with electron clouds in circular accelerators such as the Large Hadron Collider (LHC) at CERN.

43 PARTICLE ACCELERATORS↗

A Pelvic Phantom for Modeling Internal Organ Motions

A pelvic phantom was developed for use in testing image-guided radiation therapy (IGRT) and adaptive applications in radiation therapy (ART) with simulating the anterior-posterior internal organ motions during prostate radiotherapy. Measurements could be done with an ionization chamber (IC) in the simulated prostate. The rectum was simulated by air-equivalent material (AEM). The volume superior to the IC placement was considered as the bladder. The extension of AEM volume could be varied. The vertical position of the IC placement could be shifted by {+-}1 cm to simulate the prostate motion parallel to the changes in bladder volume. The reality of the simulation was inspected. Three-millimeter-slice-increment computed tomography (CT) scans were taken for irradiation planning. The structure set was adapted to the phantom from a treated patient. Planning target volume was delineated according to the RTOG 0126 study. IMRT and 3D conformal radiation therapy (3D-CRT) plans were made. Prostate motion and rectum volume changes were simulated in the phantom. IC displacement was corrected by phantom shifting. The delivered dose was measured with IC in 7 cases using intensity-modulated radiation therapy (IMRT) and 3D-CRT fractions, and single square-shaped beams: anteroposterior (AP), posteroanterior (PA), and lateral (LAT). Variations from the calculated doses were slightly below 1% at IMRT and around 1% at 3D-CRT; below 4.5% at square AP beam; up to 9% at square PA beam; and around 0.5% at square LAT beam. Other authors have already shown that by using planning systems and ultrasonic and cone beam CT guidance, correction of organ motions in a real patient during prostate cancer IGRT does not have a significant dosimetric effect. The inspection of our phantom-as described here-ended with similar results. Our team suggested that our model is sufficiently realistic and can be used for IGRT and ART testing.

61 RADIATION PROTECTION AND DOSIMETRY↗

IAEA CRP on HTGR Uncertainties in Modeling: Assessment of Phase I Lattice to Core Model Uncertainties

Best-estimate plus uncertainty analysis of reactors is replacing the traditional conservative (stacked uncertainty) method for safety and licensing analysis. To facilitate uncertainty analysis applications, a comprehensive approach and methodology must be developed and applied. High temperature gas cooled reactors (HTGRs) have several features that require techniques not used in light-water reactor analysis (e.g., coated-particle design and large graphite quantities at high temperatures). The International Atomic Energy Agency has therefore launched the Coordinated Research Project on HTGR Uncertainty Analysis in Modeling to study uncertainty propagation in the HTGR analysis chain. The benchmark problem defined for the prismatic design is represented by the General Atomics Modular HTGR 350. The main focus of this report is the compilation and discussion of the results obtained for various permutations of Exercise I 2c and the use of the cross section data in Exercise II 1a of the prismatic benchmark, which is defined as the last and first steps of the lattice and core simulation phases, respectively. The report summarizes the Idaho National Laboratory (INL) best estimate results obtained for Exercise I 2a (fresh single-fuel block), Exercise I 2b (depleted single-fuel block), and Exercise I 2c (super cell) in addition to the first results of an investigation into the cross section generation effects for the super-cell problem. The two dimensional deterministic code known as the New ESC based Weighting Transport (NEWT) included in the Standardized Computer Analyses for Licensing Evaluation (SCALE) 6.1.2 package was used for the cross section evaluation, and the results obtained were compared to the three dimensional stochastic SCALE module KENO VI. The NEWT cross section libraries were generated for several permutations of the current benchmark super-cell geometry and were then provided as input to the Phase II core calculation of the stand alone neutronics Exercise II 1a. The steady state core calculations were simulated with the INL coupled-code system known as the Parallel and Highly Innovative Simulation for INL Code System (PHISICS) and the system thermal-hydraulics code known as the Reactor Excursion and Leak Analysis Program (RELAP) 5 3D using the nuclear data libraries previously generated with NEWT. It was observed that significant differences in terms of multiplication factor and neutron flux exist between the various permutations of the Phase I super-cell lattice calculations. The use of these cross section libraries only leads to minor changes in the Phase II core simulation results for fresh fuel but shows significantly larger discrepancies for spent fuel cores. Furthermore, large incongruities were found between the SCALE NEWT and KENO VI results for the super cells, and while some trends could be identified, a final conclusion on this issue could not yet be reached. This report will be revised in mid 2016 with more detailed analyses of the super-cell problems and their effects on the core models, using the latest version of SCALE (6.2). The super-cell models seem to show substantial improvements in terms of neutron flux as compared to single-block models, particularly at thermal energies.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Additive Manufactured Composite Phase-Change Material for Thermal Energy Storage Applications

Phase-change materials play a critical role in industrial energy storage applications to drive efficiency improvements, thermal energy management, and carbon emissions reductions. Recently, it has been shown that rapid solidification of alloys with metastable immiscibility in the liquid phase has the potential to form unique microstructures in which a low-melting phase is uniformly distributed in a high-melting matrix. This feature can be exploited using additive manufacturing to produce components with complex geometries containing such unique phase-change microstructures. Phase-field simulations utilizing high-performance computing were used to provide a detailed description of the evolution of the active phase during service in terms of their morphology and composition in different polycrystalline matrix grain morphologies that are typically produced during additive manufacturing. Phase field simulations were performed using, MEUMAPPS-SL (Microstructure Evolution Using Massively Parallel Phase-field Simulations – Solid Liquid) code that was developed in-house by the Oak Ridge National Laboratory. The simulations utilized the capabilities of the Kestrel supercomputer at the National Renewable Energy Laboratory. The simulation results were compared with experimental results generated at Siemens Energy, Inc. The results indicate that the kinetics of liquid spreading along grain boundaries is largely determined by the mobility of the triple line along the intersection of the grain boundary liquid and the grain boundary plane.

25 ENERGY STORAGE↗

Crossing the mesoscale no-man s land via parallel kinetic Monte Carlo.

The kinetic Monte Carlo method and its variants are powerful tools for modeling materials at the mesoscale, meaning at length and time scales in between the atomic and continuum. We have completed a 3 year LDRD project with the goal of developing a parallel kinetic Monte Carlo capability and applying it to materials modeling problems of interest to Sandia. In this report we give an overview of the methods and algorithms developed, and describe our new open-source code called SPPARKS, for Stochastic Parallel PARticle Kinetic Simulator. We also highlight the development of several Monte Carlo models in SPPARKS for specific materials modeling applications, including grain growth, bubble formation, diffusion in nanoporous materials, defect formation in erbium hydrides, and surface growth and evolution.

97 MATHEMATICS AND COMPUTING↗

Level-set Modeling Simulations of Chemical Vapor Infiltration for Ceramic Matrix Composites Manufacturing

Silicon-carbide (SiC) reinforced ceramic matrix composites (CMCs) are a key enabling technology to reduce fuel consumption and emissions of gas turbine engines. In one manufacturing approach, chemical vapor infiltration (CVI) is limited to only coating SiC fibers. The preform is then fabricated using a lay-up of basic plys or 2-D woven sheets composed of the precoated fibers. At the other extreme, CVI is used to completely densify a 3-D woven preform shaped almost like the gas turbine component itself. The latter approach is more suitable for highly engineered components which sit directly in the gas path of the engine, for example, a high pressure turbine blade. In this case, the geometry is necessarily complex for aerodynamic, stress, and lifing (multi-physics) requirements. Presently, optimizing the CVI-dominated manufacturing approach is largely by trial-and-error. In this work, a first-principles modeling of CVI is performed to realize optimization of SiC/SiC CMC manufacturing. The modeling is based on a level-set framework to describe the interface between the vapor and solid phases. A finite-difference numerical scheme using an immersed boundary method is developed for fixed, structured meshes. Massively parallel direct numerical simulations (DNS) of CVI through fiber-woven geometries are performed using one-step chemistry, and over a range of Thiele moduli. Illustrative applications of the resulting large DNS data sets are given, including the development of fiber-weave specific infiltration models and structure functions for mean-field (porous media) Computational Fluid Dynamics (CFD) simulations of CVI.

36 MATERIALS SCIENCE↗

Reduction of blob-filament radial propagation by parallel variation of flows: Analysis of a gyrokinetic simulation

Data from the XGC1 gyrokinetic simulation is analyzed to understand the three-dimensional spatial structure and the radial propagation of blob-filaments generated by quasisteady turbulence in the tokamak edge pedestal and scrape-off layer plasma. Spontaneous toroidal flows vary in the poloidal direction and shear the filaments within a flux surface resulting in a structure that varies in the parallel direction. Here, this parallel structure allows the curvature and grad-B induced polarization charge density to be shorted out via parallel electron motion. As a result, it is found that the blob-filament radial velocity is significantly reduced from estimates which neglect parallel electron kinetics, broadly consistent with experimental observations. Conditions for when this charge shorting effect tends to dominate blob dynamics are derived and compared with the simulation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Fast magnetic field annihilation driven by two laser pulses in underdense plasma

Fast magnetic annihilation is investigated by using 2.5-dimensional particle-in-cell simulations of two parallel ultra-short petawatt laser pulses co-propagating in underdense plasma. The magnetic field generated by the laser pulses annihilates in a current sheet formed between the pulses. Magnetic field energy is converted to an inductive longitudinal electric field, which efficiently accelerates the electrons of the current sheet. This new regime of collisionless relativistic magnetic field annihilation with a timescale of tens of femtoseconds can be extended to near-critical and overdense plasma with the ultra-high intensity femtosecond laser pulses.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

MARTINI-Compatible Coarse-Grained Model for the Mesoscale Simulation of Peptoids

Peptoids (poly-N-substituted glycines) are a class of synthetic polymers that are regioisomers of peptides (poly-C-substituted glycines), in which the point of side-chain connectivity is shifted from the backbone C to the N atom. Peptoids have found diverse applications as peptidomimetic drugs, protein mimetic polymers, surfactants, and catalysts. Computational modeling is valuable in the understanding and design of peptoid-based nanomaterials. In this work, we report the bottom-up parameterization of coarse-grained peptoid force fields based on the MARTINI peptide force field against all-atom peptoid simulation data. Our parameterization pipeline iteratively refits coarse-grained bonded interactions using iterative Boltzmann inversion and nonbonded interactions by matching the potential of mean force for chain extension. We assure good sampling of the amide bond cis/trans isomerizations in the all-atom simulation data using parallel bias metadynamics. We develop coarse-grained models for two representative peptoids—polysarcosine (poly(N-methyl glycine)) and poly(N-((4-bromophenyl)ethyl)glycine)—and show their structural and thermodynamic properties to be in excellent accord with all-atom calculations but up to 25-fold more efficient and compatible with MARTINI force fields. Here, this work establishes a new rigorously parameterized coarse-grained peptoid force field for the understanding and design of peptoid nanomaterials at length and time scales inaccessible to all-atom calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Dependence of Lamellar Eutectic Growth with Convection on Boundary Conditions and Geometric Confinement: A Phase-Field Lattice-Boltzmann Study

Simulating eutectic growth with convection is challenging because of the enormous computing demand resulting from the required domain size compared with the eutectic scale. In this study, a phase-field lattice-Boltzmann approach was employed to reproduce the eutectic growth with convection (both natural and forced). To enable and accelerate large-scale simulations, a parallel-adaptive mesh refinement algorithm was developed to combine with this numerical approach. The effects of the boundary conditions and the geometric confinement on the eutectic growth with convection were systematically investigated in the Al-Cu eutectic alloy. Results showed that both boundary conditions and the geometric confinement altered the eutectic evolution by affecting the distributions of the solute and velocity ahead of the eutectic solid/liquid interface. As the first attempt to explore the two factors on the eutectic growth with convection, our thorough investigation lays a foundation for modeling the coupled convection–solute eutectic evolution.

36 MATERIALS SCIENCE↗

Design and Interpretation of Colliding Pulse Injected Laser-Plasma Acceleration Experiments

The use of colliding laser pulses to control the injection of plasma electrons into the plasma wake of a laser-plasma accelerator is a promising approach to obtaining GeV scale electron bunches with reduced emittance and energy spread. Colliding Pulse Injection (CPI) experiments are being performed by groups around the world. We present recent particle-in-cell simulations, using the parallel VORPAL framework, of CPI for physical parameters relevant to ongoing experiments of the LOASIS program at LBNL. We perform parameter scans in order to optimize the quality of the bunch, and compare the results with experimental data. Effect of non-ideal gaussian pulses and laser self-focusing in the plasma channel on the trapped bunch are evaluated. For optimized parameters accessible in the experiment, a 20 pC electron beam can be accelerated to 300 MeV with percent level energy spread.

43 PARTICLE ACCELERATORS↗

A fast platform for simulating semi-flexible fiber suspensions applied to cell mechanics

We present a novel platform for the large-scale simulation of three-dimensional fibrous structures immersed in a Stokesian fluid and evolving under confinement or in free-space in three dimensions. One of the main motivations for this work is to study the dynamics of fiber assemblies within biological cells. For this, we also incorporate the key biophysical elements that determine the dynamics of these assemblies, which include the polymerization and depolymerization kinetics of fibers, their interactions with molecular motors and other objects, their flexibility, and hydrodynamic coupling. This work, to our knowledge, is the first technique to include many-body hydrodynamic interactions (HIs), and the resulting fluid flows, in cellular assemblies of flexible fibers. We use non-local slender body theory to compute the fluid–structure interactions of the fibers and a second-kind boundary integral formulation for other rigid bodies and the confining boundary. A kernel-independent implementation of the fast multipole method is utilized for efficient evaluation of HIs. The deformation of the fibers is described by nonlinear Euler–Bernoulli beam theory and their polymerization is modeled by the reparametrization of the dynamic equations in the appropriate non-Lagrangian frame. We use a pseudo-spectral representation of fiber positions and implicit time-stepping to resolve large fiber deformations, and to allow time-steps not excessively constrained by temporal stiffness or fiber–fiber interactions. The entire computational scheme is parallelized, which enables simulating assemblies of thousands of fibers. We use our method to investigate two important questions in the mechanics of cell division: (i) the effect of confinement on the hydrodynamic mobility of microtubule asters; and (ii) the dynamics of the positioning of mitotic spindle in complex cell geometries. Finally to demonstrate the general applicability of the method, we simulate the sedimentation of a cloud of semi-flexible fibers.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Accelerating Monte Carlo simulations of photon transport in a voxelized geometry using a massively parallel graphics processing unit

Purpose: It is a known fact that Monte Carlo simulations of radiation transport are computationally intensive and may require long computing times. The authors introduce a new paradigm for the acceleration of Monte Carlo simulations: The use of a graphics processing unit (GPU) as the main computing device instead of a central processing unit (CPU). Methods: A GPU-based Monte Carlo code that simulates photon transport in a voxelized geometry with the accurate physics models from PENELOPE has been developed using the CUDA programming model (NVIDIA Corporation, Santa Clara, CA). Results: An outline of the new code and a sample x-ray imaging simulation with an anthropomorphic phantom are presented. A remarkable 27-fold speed up factor was obtained using a GPU compared to a single core CPU. Conclusions: The reported results show that GPUs are currently a good alternative to CPUs for the simulation of radiation transport. Since the performance of GPUs is currently increasing at a faster pace than that of CPUs, the advantages of GPU-based software are likely to be more pronounced in the future.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Two-Level Convergence Theory for Multigrid Reduction in Time (MGRIT)

Here we develop a two-grid convergence theory for the parallel-in-time scheme known as multigrid reduction in time (MGRIT), as it is implemented in the open-source package [XBraid: Parallel Multigrid in Time, http://llnl.gov/casc/xbraid]. MGRIT is a scalable and multilevel approach to parallel-in-time simulations that nonintrusively uses existing time-stepping schemes, and in a specific two-level setting it is equivalent to the widely known parareal algorithm. The goal of this paper is twofold. First, we present a two-level MGRIT convergence analysis for linear problems where the spatial discretization matrix can be diagonalized, and then apply this analysis to our two basic model problems, the heat equation and the advection equation. One important assumption is that the coarse and fine time-grid propagators can be diagaonalized by the same set of eigenvectors, which is often the case when the same spatial discretization operator is used on the coarse and fine time grids. In many cases, the MGRIT algorithm is guaranteed to converge, and we demonstrate numerically that the theoretically predicted convergence rates are sharp in practice for our model problems. Second, we explore how the convergence of MGRIT compares to the stability of the chosen time-stepping scheme. In particular, we demonstrate that a stable time-stepping scheme does not necessarily imply convergence of MGRIT, although MGRIT with FCF-relaxation always converges for the diffusion dominated problems considered here.

97 MATHEMATICS AND COMPUTING↗