Search NASA⌕ Search

SEARCH · Search NASA

Results for “parallel simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Deploy production sliding mesh capability with linear solver benchmarking.

Wind applications require the ability to simulate rotating blades. To support this use-case, a novel design-order sliding mesh algorithm has been developed and deployed. The hybrid method combines the control volume finite element methodology (CVFEM) with concepts found within a discontinuous Galerkin (DG) finite element method (FEM) to manage a sliding mesh. The method has been demonstrated to be design-order for the tested polynomial basis (P=1 and P=2) and has been deployed to provide production simulation capability for a Vestas V27 (225 kW) wind turbine. Other stationary and canonical rotating ow simulations are also presented. As the majority of wind-energy applications are driving extensive usage of hybrid meshes, a foundational study that outlines near-wall numerical behavior for a variety of element topologies is presented. Results indicate that the proposed nonlinear stabilization operator (NSO) is an effective stabilization methodology to control Gibbs phenomena at large cell Peclet numbers. The study also provides practical mesh resolution guidelines for future analysis efforts. Application-driven performance and algorithmic improvements have been carried out to increase robustness of the scheme on hybrid production wind energy meshes. Specifically, the Kokkos-based Nalu Kernel construct outlined in the FY17/Q4 ExaWind milestone has been transitioned to the hybrid mesh regime. This code base is exercised within a full V27 production run. Simulation timings for parallel search and custom ghosting are presented. As the low-Mach application space requires implicit matrix solves, the cost of matrix reinitialization has been evaluated on a variety of production meshes. Results indicate that at low element counts, i.e., fewer than 100 million elements, matrix graph initialization and preconditioner setup times are small. However, as mesh sizes increase, e.g., 500 million elements, simulation time associated with \setup-up" costs can increase to nearly 50% of overall simulation time when using the full Tpetra solver stack and nearly 35% when using a mixed Tpetra- Hypre-based solver stack. The report also highlights the project achievement of surpassing the 1 billion element mesh scale for a production V27 hybrid mesh. A detailed timing breakdown is presented that again suggests work to be done in the setup events associated with the linear system. In order to mitigate these initialization costs, several application paths have been explored, all of which are designed to reduce the frequency of matrix reinitialization. Methods such as removing Jacobian entries on the dynamic matrix columns (in concert with increased inner equation iterations), and lagging of Jacobian entries have reduced setup times at the cost of numerical stability. Artificially increasing, or bloating, the matrix stencil to ensure that full Jacobians are included is developed with results suggesting that this methodology is useful in decreasing reinitialization events without loss of matrix contributions. With the above foundational advances in computational capability, the project is well positioned to begin scientific inquiry on a variety of wind-farm physics such as turbine/turbine wake interactions.

97 MATHEMATICS AND COMPUTING↗

Deploy production sliding mesh capability with linear solver benchmarking (ECP Milestone Report, Ver. 1.0)

Wind applications require the ability to simulate rotating blades. To support this use-case, a novel design-order sliding mesh algorithm has been developed and deployed. The hybrid method combines the control volume finite element methodology (CVFEM) with concepts found within a discontinuous Galerkin (DG) finite element method (FEM) to manage a sliding mesh. The method has been demonstrated to be design-order for the tested polynomial basis (P=1 and P=2) and has been deployed to provide production simulation capability for a Vestas V27 (225 kW) wind turbine. Other stationary and canonical rotating flow simulations are also presented. As the majority of wind-energy applications are driving extensive usage of hybrid meshes, a foundational study that outlines near-wall numerical behavior for a variety of element topologies is presented. Results indicate that the proposed nonlinear stabilization operator (NSO) is an effective stabilization methodology to control Gibbs phenomena at large cell Peclet numbers. The study also provides practical mesh resolution guidelines for future analysis efforts. Application-driven performance and algorithmic improvements have been carried out to increase robustness of the scheme on hybrid production wind energy meshes. Specifically, the Kokkos-based Nalu Kernel construct outlined in the FY17/Q4 ExaWind milestone has been transitioned to the hybrid mesh regime. This code base is exercised within a full V27 production run. Simulation timings for parallel search and custom ghosting are presented. As the low-Mach application space requires implicit matrix solves, the cost of matrix reinitialization has been evaluated on a variety of production meshes. Results indicate that at low element counts, i.e., fewer than 100 million elements, matrix graph initialization and preconditioner setup times are small. However, as mesh sizes increase, e.g., 500 million elements, simulation time associated with "setup-up" costs can increase to nearly 50% of overall simulation time when using the full Tpetra solver stack and nearly 35% when using a mixed Tpetra- Hypre-based solver stack. The report also highlights the project achievement of surpassing the 1 billion element mesh scale for a production V27 hybrid mesh. A detailed timing breakdown is presented that again suggests work to be done in the setup events associated with the linear system. In order to mitigate these initialization costs, several application paths have been explored, all of which are designed to reduce the frequency of matrix reinitialization. Methods such as removing Jacobian entries on the dynamic matrix columns (in concert with increased inner equation iterations), and lagging of Jacobian entries have reduced setup times at the cost of numerical stability. Artificially increasing, or bloating, the matrix stencil to ensure that full Jacobians are included is developed with results suggesting that this methodology is useful in decreasing reinitialization events without loss of matrix contributions. With the above foundational advances in computational capability, the project is well positioned to begin scientific inquiry on a variety of wind-farm physics such as turbine/turbine wake interactions.

Domino, Stefan P.↗

Three-dimensional fluid simulations of a simple magnetized toroidal plasma

Three-dimensional fluid simulations are performed in a simple magnetized toroidal plasma, in which vertical and toroidal magnetic fields create helicoidal magnetic field lines that terminate on the torus vessel. The simulations are carried out in the three-dimensional flux tube that wraps around the torus and are able to describe both interchange and drift-wave dynamics. The presence of different turbulence regimes is pointed out; in particular, it is shown that turbulence can be quenched by either a sufficiently large plasma source, or a sufficiently small vertical field, or a sufficiently high parallel resistivity. The simulations considered herein reveal that interchange turbulence dominates over the drift-wave dynamics. Considering the experimental observations, we finally discuss the limitations of the present model.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Experimental Identification and validation of a crystal plasticity model for a low carbon steel on different length scales

Micro-macro approaches are of increasing importance for metal forming simulations and, accordingly, the number of new micro-macro models is increasing as well. Thus, there is a need for adequate identification and validation methods for such models. These methods can be based on experiments on the polycrystalline scale (macro scale), but the use of experiments on the individual single-crystal grain scale (micro scale) has been suggested as well. In this presentation, experiments on both scales and, in parallel, FEM-simulations are presented, in order to compare the results of both approaches. All specimens stem from a rolled sheet of the deep-drawing steel DC04. In addition to the usual macroscopic shear and tensile tests, microscopic indenter tests have been performed. From the micro-indentation tests, which have been applied to single grains of the polycrystalline DC04 steel sheet, various types of deformation data can be measured. Within this presentation we will focus on orientation changes induced by spherical-indentation in the region below the indent, which have been measured using micron-resolution 3D x-ray microscopy and simulated using FEM. In addition, the sensitivity of the calculated orientation changes with respect to {l_brace}110{r_brace} versus {l_brace}112{r_brace} slip planes is discussed.

36 MATERIALS SCIENCE↗

Scheduling message processing for reducing rollback propagation

Traditional checkpointing and rollback recovery techniques for parallel systems have typically assumed the communication pattern is specified by program behavior. In this paper we exploit the property that the communication pattern can often be changed at run-time without affecting program correctness. A scheduling algorithm for message processing and its implementation for reducing rollback propagation are described. The algorithm incorporates a user-transparent prioritized scheme based upon the run-time communication and checkpointing history. Communication trace-driven simulation for several parallel programs written in the Chare Kernel language demonstrates that the probability of rollback propagation can be reduced at the cost of slight additional performance degradation.

Wang, Yi-Min↗

Optimal message log reclamation for independent checkpointing

Independent (uncoordinated) check pointing for parallel and distributed systems allows maximum process autonomy but suffers from possible domino effects and the associated storage space overhead for maintaining multiple checkpoints and message logs. In most research on check pointing and recovery, it was assumed that only the checkpoints and message logs older than the global recovery line can be discarded. It is shown how recovery line transformation and decomposition can be applied to the problem of efficiently identifying all discardable message logs, thereby achieving optimal garbage collection. Communication trace-driven simulation for several parallel programs is used to show the benefits of the proposed algorithm for message log reclamation.

Wang, Yi-Min↗

Optimal message log reclamation for independent checkpointing

Independent (uncoordinated) check pointing for parallel and distributed systems allows maximum process autonomy but suffers from possible domino effects and the associated storage space overhead for maintaining multiple checkpoints and message logs. In most research on check pointing and recovery, it was assumed that only the checkpoints and message logs older than the global recovery line can be discarded. It is shown how recovery line transformation and decomposition can be applied to the problem of efficiently identifying all discardable message logs, thereby achieving optimal garbage collection. Communication trace-driven simulation for several parallel programs is used to show the benefits of the proposed algorithm for message log reclamation.

Wang, Yi-Min↗

Experiments with Memory-to-Memory Coupling for End-to-End fusion Simulation Workflows

Scientific applications are striving to accurately simulate multiple interacting physical processes that comprise complex phenomena being modeled. Efficient and scalable parallel implementations of these coupled simulations present challenging interaction and coordination requirements, especially when the coupled physical processes are computationally heterogeneous and progress at different speeds. In this paper, we present the design, implementation and evaluation of a memory-to-memory coupling framework for coupled scientific simulations on high-performance parallel computing platforms. The framework is driven by the coupling requirements of the Center for Plasma Edge Simulation, and it provides simple coupling abstractions as well as efficient asynchronous (RDMA-based) memory-to-memory data transport mechanisms that complement existing parallel programming systems and data sharing frameworks. The framework enables flexible coupling behaviors that are asynchronous in time and space, and it supports dynamic coupling between heterogeneous simulation processes without enforcing any synchronization constraints. We evaluate the performance and scalability of the coupling framework using a specific coupling scenario, on the Jaguar Cray XT5 system at Oak Ridge National Laboratory.

99 GENERAL AND MISCELLANEOUS↗

Enhancing parallel quasi-static particle-in-cell simulations with a pipelining algorithm

A pipelining algorithm to overcome the limitation on scaling quasi-static particle-in-cell models of relativistic beams in plasmas to a very large number of processors is described. The pipelining algorithm uses multiple groups of processors and optimizes the job allocation on the processors in parallel computing. The algorithm is implemented on the quasi-static code QuickPIC and is shown to scale to over 10{sup 3} processors and increased the scale and speed by two orders of magnitude over the non-pipelined model. The new approach opens the door to performing full scale 3D simulations of future plasma wakefield accelerators or full lifetime models of beam interaction with electron clouds in circular accelerators such as the Large Hadron Collider (LHC) at CERN.

43 PARTICLE ACCELERATORS↗

Parallelism and pipelining in high-speed digital simulators

The attainment of high computing speed as measured by the computational throughput is seen as one of the most challenging requirements. It is noted that high speed is cardinal in several distinct classes of applications. These classes are then discussed; they comprise (1) the real-time simulation of dynamic systems , (2) distributed parameter systems, and (3) mixed lumped and distributed systems. From the 1950s on, the quest for high speed in digital simulators concentrated on overcoming the limitations imposed by the so-called von Neumann bottleneck. Two major architectural approaches have made ig possible to circumvent this bottleneck and attain high speeds. These are pipelining and parallelism. Supercomputers, peripheral array processors, and microcomputer networks are then discussed.

Karplus, W. J.↗

A Pelvic Phantom for Modeling Internal Organ Motions

A pelvic phantom was developed for use in testing image-guided radiation therapy (IGRT) and adaptive applications in radiation therapy (ART) with simulating the anterior-posterior internal organ motions during prostate radiotherapy. Measurements could be done with an ionization chamber (IC) in the simulated prostate. The rectum was simulated by air-equivalent material (AEM). The volume superior to the IC placement was considered as the bladder. The extension of AEM volume could be varied. The vertical position of the IC placement could be shifted by {+-}1 cm to simulate the prostate motion parallel to the changes in bladder volume. The reality of the simulation was inspected. Three-millimeter-slice-increment computed tomography (CT) scans were taken for irradiation planning. The structure set was adapted to the phantom from a treated patient. Planning target volume was delineated according to the RTOG 0126 study. IMRT and 3D conformal radiation therapy (3D-CRT) plans were made. Prostate motion and rectum volume changes were simulated in the phantom. IC displacement was corrected by phantom shifting. The delivered dose was measured with IC in 7 cases using intensity-modulated radiation therapy (IMRT) and 3D-CRT fractions, and single square-shaped beams: anteroposterior (AP), posteroanterior (PA), and lateral (LAT). Variations from the calculated doses were slightly below 1% at IMRT and around 1% at 3D-CRT; below 4.5% at square AP beam; up to 9% at square PA beam; and around 0.5% at square LAT beam. Other authors have already shown that by using planning systems and ultrasonic and cone beam CT guidance, correction of organ motions in a real patient during prostate cancer IGRT does not have a significant dosimetric effect. The inspection of our phantom-as described here-ended with similar results. Our team suggested that our model is sufficiently realistic and can be used for IGRT and ART testing.

61 RADIATION PROTECTION AND DOSIMETRY↗

IAEA CRP on HTGR Uncertainties in Modeling: Assessment of Phase I Lattice to Core Model Uncertainties

Best-estimate plus uncertainty analysis of reactors is replacing the traditional conservative (stacked uncertainty) method for safety and licensing analysis. To facilitate uncertainty analysis applications, a comprehensive approach and methodology must be developed and applied. High temperature gas cooled reactors (HTGRs) have several features that require techniques not used in light-water reactor analysis (e.g., coated-particle design and large graphite quantities at high temperatures). The International Atomic Energy Agency has therefore launched the Coordinated Research Project on HTGR Uncertainty Analysis in Modeling to study uncertainty propagation in the HTGR analysis chain. The benchmark problem defined for the prismatic design is represented by the General Atomics Modular HTGR 350. The main focus of this report is the compilation and discussion of the results obtained for various permutations of Exercise I 2c and the use of the cross section data in Exercise II 1a of the prismatic benchmark, which is defined as the last and first steps of the lattice and core simulation phases, respectively. The report summarizes the Idaho National Laboratory (INL) best estimate results obtained for Exercise I 2a (fresh single-fuel block), Exercise I 2b (depleted single-fuel block), and Exercise I 2c (super cell) in addition to the first results of an investigation into the cross section generation effects for the super-cell problem. The two dimensional deterministic code known as the New ESC based Weighting Transport (NEWT) included in the Standardized Computer Analyses for Licensing Evaluation (SCALE) 6.1.2 package was used for the cross section evaluation, and the results obtained were compared to the three dimensional stochastic SCALE module KENO VI. The NEWT cross section libraries were generated for several permutations of the current benchmark super-cell geometry and were then provided as input to the Phase II core calculation of the stand alone neutronics Exercise II 1a. The steady state core calculations were simulated with the INL coupled-code system known as the Parallel and Highly Innovative Simulation for INL Code System (PHISICS) and the system thermal-hydraulics code known as the Reactor Excursion and Leak Analysis Program (RELAP) 5 3D using the nuclear data libraries previously generated with NEWT. It was observed that significant differences in terms of multiplication factor and neutron flux exist between the various permutations of the Phase I super-cell lattice calculations. The use of these cross section libraries only leads to minor changes in the Phase II core simulation results for fresh fuel but shows significantly larger discrepancies for spent fuel cores. Furthermore, large incongruities were found between the SCALE NEWT and KENO VI results for the super cells, and while some trends could be identified, a final conclusion on this issue could not yet be reached. This report will be revised in mid 2016 with more detailed analyses of the super-cell problems and their effects on the core models, using the latest version of SCALE (6.2). The super-cell models seem to show substantial improvements in terms of neutron flux as compared to single-block models, particularly at thermal energies.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Additive Manufactured Composite Phase-Change Material for Thermal Energy Storage Applications

Phase-change materials play a critical role in industrial energy storage applications to drive efficiency improvements, thermal energy management, and carbon emissions reductions. Recently, it has been shown that rapid solidification of alloys with metastable immiscibility in the liquid phase has the potential to form unique microstructures in which a low-melting phase is uniformly distributed in a high-melting matrix. This feature can be exploited using additive manufacturing to produce components with complex geometries containing such unique phase-change microstructures. Phase-field simulations utilizing high-performance computing were used to provide a detailed description of the evolution of the active phase during service in terms of their morphology and composition in different polycrystalline matrix grain morphologies that are typically produced during additive manufacturing. Phase field simulations were performed using, MEUMAPPS-SL (Microstructure Evolution Using Massively Parallel Phase-field Simulations – Solid Liquid) code that was developed in-house by the Oak Ridge National Laboratory. The simulations utilized the capabilities of the Kestrel supercomputer at the National Renewable Energy Laboratory. The simulation results were compared with experimental results generated at Siemens Energy, Inc. The results indicate that the kinetics of liquid spreading along grain boundaries is largely determined by the mobility of the triple line along the intersection of the grain boundary liquid and the grain boundary plane.

25 ENERGY STORAGE↗

Crossing the mesoscale no-man s land via parallel kinetic Monte Carlo.

The kinetic Monte Carlo method and its variants are powerful tools for modeling materials at the mesoscale, meaning at length and time scales in between the atomic and continuum. We have completed a 3 year LDRD project with the goal of developing a parallel kinetic Monte Carlo capability and applying it to materials modeling problems of interest to Sandia. In this report we give an overview of the methods and algorithms developed, and describe our new open-source code called SPPARKS, for Stochastic Parallel PARticle Kinetic Simulator. We also highlight the development of several Monte Carlo models in SPPARKS for specific materials modeling applications, including grain growth, bubble formation, diffusion in nanoporous materials, defect formation in erbium hydrides, and surface growth and evolution.

97 MATHEMATICS AND COMPUTING↗

Level-set Modeling Simulations of Chemical Vapor Infiltration for Ceramic Matrix Composites Manufacturing

Silicon-carbide (SiC) reinforced ceramic matrix composites (CMCs) are a key enabling technology to reduce fuel consumption and emissions of gas turbine engines. In one manufacturing approach, chemical vapor infiltration (CVI) is limited to only coating SiC fibers. The preform is then fabricated using a lay-up of basic plys or 2-D woven sheets composed of the precoated fibers. At the other extreme, CVI is used to completely densify a 3-D woven preform shaped almost like the gas turbine component itself. The latter approach is more suitable for highly engineered components which sit directly in the gas path of the engine, for example, a high pressure turbine blade. In this case, the geometry is necessarily complex for aerodynamic, stress, and lifing (multi-physics) requirements. Presently, optimizing the CVI-dominated manufacturing approach is largely by trial-and-error. In this work, a first-principles modeling of CVI is performed to realize optimization of SiC/SiC CMC manufacturing. The modeling is based on a level-set framework to describe the interface between the vapor and solid phases. A finite-difference numerical scheme using an immersed boundary method is developed for fixed, structured meshes. Massively parallel direct numerical simulations (DNS) of CVI through fiber-woven geometries are performed using one-step chemistry, and over a range of Thiele moduli. Illustrative applications of the resulting large DNS data sets are given, including the development of fiber-weave specific infiltration models and structure functions for mean-field (porous media) Computational Fluid Dynamics (CFD) simulations of CVI.

36 MATERIALS SCIENCE↗

Reduction of blob-filament radial propagation by parallel variation of flows: Analysis of a gyrokinetic simulation

Data from the XGC1 gyrokinetic simulation is analyzed to understand the three-dimensional spatial structure and the radial propagation of blob-filaments generated by quasisteady turbulence in the tokamak edge pedestal and scrape-off layer plasma. Spontaneous toroidal flows vary in the poloidal direction and shear the filaments within a flux surface resulting in a structure that varies in the parallel direction. Here, this parallel structure allows the curvature and grad-B induced polarization charge density to be shorted out via parallel electron motion. As a result, it is found that the blob-filament radial velocity is significantly reduced from estimates which neglect parallel electron kinetics, broadly consistent with experimental observations. Conditions for when this charge shorting effect tends to dominate blob dynamics are derived and compared with the simulation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Fast magnetic field annihilation driven by two laser pulses in underdense plasma

Fast magnetic annihilation is investigated by using 2.5-dimensional particle-in-cell simulations of two parallel ultra-short petawatt laser pulses co-propagating in underdense plasma. The magnetic field generated by the laser pulses annihilates in a current sheet formed between the pulses. Magnetic field energy is converted to an inductive longitudinal electric field, which efficiently accelerates the electrons of the current sheet. This new regime of collisionless relativistic magnetic field annihilation with a timescale of tens of femtoseconds can be extended to near-critical and overdense plasma with the ultra-high intensity femtosecond laser pulses.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

MARTINI-Compatible Coarse-Grained Model for the Mesoscale Simulation of Peptoids

Peptoids (poly-N-substituted glycines) are a class of synthetic polymers that are regioisomers of peptides (poly-C-substituted glycines), in which the point of side-chain connectivity is shifted from the backbone C to the N atom. Peptoids have found diverse applications as peptidomimetic drugs, protein mimetic polymers, surfactants, and catalysts. Computational modeling is valuable in the understanding and design of peptoid-based nanomaterials. In this work, we report the bottom-up parameterization of coarse-grained peptoid force fields based on the MARTINI peptide force field against all-atom peptoid simulation data. Our parameterization pipeline iteratively refits coarse-grained bonded interactions using iterative Boltzmann inversion and nonbonded interactions by matching the potential of mean force for chain extension. We assure good sampling of the amide bond cis/trans isomerizations in the all-atom simulation data using parallel bias metadynamics. We develop coarse-grained models for two representative peptoids—polysarcosine (poly(N-methyl glycine)) and poly(N-((4-bromophenyl)ethyl)glycine)—and show their structural and thermodynamic properties to be in excellent accord with all-atom calculations but up to 25-fold more efficient and compatible with MARTINI force fields. Here, this work establishes a new rigorously parameterized coarse-grained peptoid force field for the understanding and design of peptoid nanomaterials at length and time scales inaccessible to all-atom calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗