Search NASA⌕ Search

SEARCH · Search NASA

Results for “parallel simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

First frontier field constraints on the cosmic star formation rate density AT z ~ 10—the impact of lensing shear on completeness of high-redshift galaxy samples

In this work, we search the complete Hubble Frontier Field data set of Abell 2744 and its parallel field for $z\sim 10$ sources to further refine the evolution of the cosmic star formation rate density (SFRD) between $z\sim 8$ and $z\sim 10$. We independently confirm two images of the recently discovered triply imaged $z\sim 9.8$ source by Zitrin et al. and set an upper limit for similar $z\sim 10$ galaxies with red colors of ${J}_{125}-{H}_{160}\gt 1.2$ in the parallel field of Abell 2744. We utilize extensive simulations to derive the effective selection volume of Lyman-break galaxies at $z\sim 10$, both in the lensed cluster field and in the adjacent parallel field. Particular care is taken to include position-dependent lensing shear to accurately account for the expected sizes and morphologies of highly magnified sources. We show that both source blending and shear reduce the completeness at a given observed magnitude in the cluster, particularly near the critical curves. These effects have a significant, but largely overlooked, impact on the detectability of high-redshift sources behind clusters, and substantially reduce the expected number of highly magnified sources. The detections and limits from both pointings result in an SFRD which is consistent within the uncertainties with previous estimates at $z\sim 10$ from blank fields. The combination of these new results with all other estimates is also consistent with a rapidly declining SFRD in the 170 Myr from $z\sim 8$ to $z\sim 10$ as predicted by cosmological simulations and dark-matter halo evolution in ΛCDM. Once biases introduced by magnification-dependent completeness are accounted for, the full six cluster and parallel Frontier Field program will be an extremely powerful new data set to probe the evolution of the galaxy population at $z\gt 8$ before the advent of the James Webb Space Telescope.

79 ASTRONOMY AND ASTROPHYSICS↗

Shattered pellet injection simulations with NIMROD

Optimal strategies for disruption mitigation benefit from the understanding of details both spatially and temporally. Beyond the assessment of the efficacy of a particular proposed Disruption Mitigation System (DMS), ITER's longevity will require accounting of both mitigated and unmitigated disruptions. Accurate models and validated simulations that detail multiple ITER scenarios with mitigated and unmitigated disruptions are essential for accurate estimates of load damage. The primary candidate for ITER's DMS is Shattered Pellet Injection (SPI); its efficacy must be evaluated within the next several years. To perform critical time dependent 3-D nonlinear simulations, we have developed a particle based SPI model in the NIMROD code coupled to its modified single fluid equations with impurity and radiation [Izzo, Nucl. Fusion 46(5), 541 (2006)]. SPI validation simulations of the thermal quench and comparisons to DIII-D impurity scan experiments [Shiraki et al., Phys. Plasmas 23(6), 062516 (2016)] are presented. We also present an initial ITER Q = 10 pure neon SPI simulation and compare it with the DIII-D SPI simulations. NIMROD SPI simulations demonstrate that the ablating fragment drives strong parallel flows that transport the impurities and governs the thermal quench. Analysis of SPI simulations shows that the mixed deuterium/neon SPI results in a more benign thermal quench due to the enhanced transport caused by the additional deuterium. These results suggest that an optimal pellet mixture exists for the SPI system.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Asynchronous In Situ Connected-Components Analysis for Complex Fluid flows, In: ISAV '16 Proceedings of the 2nd Workshop on In Situ Infrastructures for Enabling Extreme-scale Analysis and Visualization

The simulation of multiscale physics is an important challenge for scientific computing. For this class of problem, large three-dimensional simulations are performed to advance scientific inquiry. On massively parallel computing systems, the volume of data generated by such approaches can become a productivity bottleneck if the raw data generated from the simulation is analyzed in a post-processing step. To address this, we present a physics-based framework for in situ data reduction that is theoretically grounded in multiscale averaging theory. We show how task parallelism can be exploited to concurrently perform a variety of analysis tasks with data-dependent costs, including the generation of iso-surfaces, morphological analyses, and connected components analysis. All analyses are performed in parallel using distributed memory and use the same domain decomposition as the simulation. A task management framework is constructed to leverage available parallelism within a node for analysis. The capabilities of the framework are to launch asynchronous analysis threads, manage dependencies between different tasks, promote data locality and minimize the impact of data transfers. The framework is applied to analyze GPU-based simulations of two-fluid-phase flow in porous media, generating a set of averaged measures that represents the overall system behavior. We demonstrate how the approach can be applied to perform physically-consistent analysis over fluid sub-regions determined from connected components analysis. Simulations performed on Oak Ridge National Lab's Titan supercomputer are profiled to demonstrate the performance of the associated multi-threaded in situ analysis approach for typical production simulation of two-fluid-phase flow.

Computer Science↗

Advanced computations of multi-physics, multi-scale effects in beam dynamics

Current state-of-the-art beam dynamics simulations include multiple physical effects and multiple physical length and/or time scales. We present recent developments in Synergia2, an accelerator modeling framework designed for multi-physics, multi-scale simulations. We summarize recent several recent results in multi-physics beam dynamics, including simulations of three Fermilab accelerators: the Tevatron, the Main Injector and the Debuncher. Early accelerator simulations focused on single-particle dynamics. To a first approximation, the forces on the particles in an accelerator beam are dominated by the external fields due to magnets, RF cavities, etc., so the single-particle dynamics are the leading physical effects. Detailed simulations of accelerators must include collective effects such as the space-charge repulsion of the beam particles, the effects of wake fields in the beam pipe walls and beam-beam interactions in colliders. These simulations require the sort of massively parallel computers that have only become available in recent times. We give an overview of the accelerator framework Synergia2, which was designed to take advantage of the capabilities of modern computational resources and enable simulations of multiple physical effects. We also summarize some recent results utilizing Synergia2 and BeamBeam3d, a tool specialized for beam-beam simulations.

43 PARTICLE ACCELERATORS↗

Validation of single-fluid and two-fluid magnetohydrodynamic models of the helicity injected torus spheromak experiment with the NIMROD code

We present a comparison study of 3-D pressureless resistive MHD (rMHD) and 3-D presureless two-fluid MHD models of the Helicity Injected Torus with Steady Inductive helicity injection (HIT-SI). HIT-SI is a current drive experiment that uses two geometrically asymmetric helicity injectors to generate and sustain toroidal plasmas. The comparable size of the collisionless ion skin depth d{sub i} to the resistive skin depth predicates the importance of the Hall term for HIT-SI. The simulations are run with NIMROD, an initial-value, 3-D extended MHD code. The modeled plasma density and temperature are assumed uniform and constant. The helicity injectors are modeled as oscillating normal magnetic and parallel electric field boundary conditions. The simulations use parameters that closely match those of the experiment. The simulation output is compared to the formation time, plasma current, and internal and surface magnetic fields. Results of the study indicate 2fl-MHD shows quantitative agreement with the experiment while rMHD only captures the qualitative features. The validity of each model is assessed based on how accurately it reproduces the global quantities as well as the temporal and spatial dependence of the measured magnetic fields. 2fl-MHD produces the current amplification (I{sub tor}/I{sub inj}) and formation time τ{sub f} demonstrated by HIT-SI with similar internal magnetic fields. rMHD underestimates (I{sub tor}/I{sub inj}) and exhibits much a longer τ{sub f}. Biorthogonal decomposition (BD), a powerful mathematical tool for reducing large data sets, is employed to quantify how well the simulations reproduce the measured surface magnetic fields without resorting to a probe-by-probe comparison. BD shows that 2fl-MHD captures the dominant surface magnetic structures and the temporal behavior of these features better than rMHD.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

ANS MultiApps tutorial

The Multiphysics Object-Oriented Simulation Environment (MOOSE) [1] is an open-source, parallel finite element framework which provides the foundation formany advanced modeling and simulation tools developed under the Department of Energy’s (DOE’s) Nuclear Energy Advanced Modeling and Simulation (NEAMS) program [2] for the analysis of advanced reactors. The MOOSE framework provides the common foundational capability on which many NEAMS codes for reactor analysis are built. The MOOSE framework also includes several systems to assemble unique workflows and coupling amongMOOSE-based applications. In particular, the MultiApp and Transfer systems are widely used to assemble different MOOSE-based or MOOSE- wrapped physics applications together to perform loosely or tightly coupled multiphysics simulations. The National Reactor Innovation Center’s (NRIC’s) Virtual Test Bed (VTB) [3] hosts publicly available nuclear reactor multiphysics simulation examples which leverage MOOSE’s MultiApp system to meet the modeling needs of different reactor types. The flexibility and robustness of coupling provided by MOOSE permits rapid development of coupled physics models for a wide range of reactor types and events.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Performance Modeling of a Variable-Geometry Oscillating Surge Wave Energy Converter on a Raised Foundation: Preprint

This paper analyzes the power capture potential, structural loadings, and costs associated with an oscillating surge wave energy converter (OSWEC) operating on a raised foundation. The raised OSWEC offers opportunities for reduced installation costs, improved energy production, and greater flexibility of deployment when compared with bottom-fixed models. In this investigation, several different foundation geometries were simulated using WEC-Sim to estimate power capture and structural loads. In an effort to maximize power capture, several cases in which flat plates of varying size were attached to the top of the foundation, under and parallel with the OSWEC, were also simulated. These plates were found to enhance power capture by preventing the wave induced pressure from passing underneath the OSWEC, diverting this pressure towards the OSWEC instead. The OSWEC was simulated in the six Wave Energy Prize sea states, which were chosen as a representative sample of U.S. deployment sites. A first-order estimate of structural costs was calculated using the Wave Energy Prize ACE metric, with the foundation comprised predominantly of steel-reinforced concrete and the OSWEC comprised of A36 steel. Influence of foundation geometry on power capture, structural loadings, and ACE are topics of particular interest. This work has been inspired by advances in large scale additive manufacturing techniques that have the potential to dramatically reduce the cost of subsea foundations. These advancements may enable cost effective WEC systems to be deployed on raised foundations.

50 EE - Wind and Water Power Program - Water (EE-4↗

A Framework to Analyze the Performance of Load Balancing Schemes for Ensembles of Stochastic Simulations

Ensembles of simulations are employed to estimate the statistics of possible future states of a system, and are widely used in important applications such as climate change and biological modeling. Ensembles of runs can naturally be executed in parallel. However, when the CPU times of individual simulations vary considerably, a simple strategy of assigning an equal number of tasks per processor can lead to serious work imbalances and low parallel efficiency. This paper presents a new probabilistic framework to analyze the performance of dynamic load balancing algorithms for ensembles of simulations where many tasks are mapped onto each processor, and where the individual compute times vary considerably among tasks. Four load balancing strategies are discussed: most-dividing, all-redistribution, random-polling, and neighbor-redistribution. Simulation results with a stochastic budding yeast cell cycle model are consistent with the theoretical analysis. It is especially significant that there is a provable global decrease in load imbalance for the local rebalancing algorithms due to scalability concerns for the global rebalancing algorithms. The overall simulation time is reduced by up to 25 %, and the total processor idle time by 85 %.

ALGORITHMS↗

Pore-Scale Simulation of Intragranular Diffusion: Effects of Incomplete Mixing on Macroscopic Manifestations

Diffusive mass transfer into and out of intragranular micropores ("intragranular diffusion") plays an important role in the large-scale transport of some groundwater contaminants. We are interested in understanding the combined effect of pore-scale advection and intragranular diffusion on solute transport at the effective porous medium scale. To study this problem, we have developed a three-dimensional pore-scale model of fluid flow and solute transport that incorporates diffusion into and out of intragranular pore spaces. Our model is based on the Smoothed Particle Hydrodynamics (SPH) simulation method, which represents fluid and solid phases by a mesh-free particle discretization. In the pore spaces, fluid flow is simulated by discretizing the Navier-Stokes equations using the SPH approach. Solute transport is represented by advection, diffusion within the fluid phase, and diffusion between the fluid and solid phases. Our model is implemented on large-scale parallel computing hardware, allowing us to simulate millions of computational particles and represent fully three-dimensional systems of pores and grains with arbitrarily complex physical geometry. We have used this model system to perform numerical experiments using various model porous media systems, which allows us to draw comparisons between macroscopic measures computed from the pore-scale simulations (such as breakthrough curves) and those predicted by macroscopic formulations that assume complete mixing over the representative volume. In this paper we present results of 3D simulations of pore-scale flow and transport, including cases with and without intragranular diffusion, in two model porous media, one with randomly-packed uniform spherical grains and a second with randomly-packed spheres drawn from a binary grain size distribution. Breakthrough curves were computed from the 3D simulations at various transport distances. Comparable breakthrough curves were computed using 1D macroscopic models with parameters determined independently to the degree possible. Based on comparisons of the pore-scale and macroscopic model results, we draw two primary conclusions. First, non-Fickian behavior is persistent and ubiquitous at the scales considered, and most cases are better represented by a multi-rate mass transfer model even when there is no distinct secondary porosity (i.e., no intragranular diffusion). This suggests that diffusive mass transfer processes between preferential flow paths and relatively immobile zones within the primary porosity may have significant impact on transport, particular in low-concentration tails. Second, the application of mass transfer rate parameters based on an assumption of well-mixed concentrations at the pore-scale tend to overestimate the amount of mass transfer that occurs in heterogeneous pore geometries in which preferential flow leads to incomplete pore-scale lateral mixing.

Environmental Molecular Sciences Laboratory↗

Performance assessment modeling of a generic SNF/HLW repository in salt with coupled thermal-hydrologic effects - 15423

This paper describes advances in performance assessment modeling of deep geologic repositories facilitated by a massively parallel, high-performance computing (HPC) environment. Our new Generic Disposal System Analysis (GDSA) Framework utilizes the massively parallel PFLOTRAN multi-physics code to simulate repository performance in the presence of coupled thermal-hydrologic-chemical processes, linked to DAKOTA, an HPC uncertainty sampling and propagation code that provides nested parallelism for multi-realization performance assessment and sensitivity analysis. This enhanced performance assessment (PA) modeling capability is demonstrated with deterministic and probabilistic simulations of a generic repository for SNF and HLW in bedded salt host rock, by comparing repository performance between a case with heat-generating waste ('thermal' case) and a case without heat generation ('isothermal' case). The simulation results provide preliminary insights into the effect of multi-physics processes and thermal-hydrologic coupling on the long-term behavior of a reference-case salt repository. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

SU-C-207A-01: A Novel Maximum Likelihood Method for High-Resolution Proton Radiography/proton CT

Purpose: Multiple Coulomb scattering is the largest contributor to blurring in proton imaging. Here we tested a maximum likelihood least squares estimator (MLLSE) to improve the spatial resolution of proton radiography (pRad) and proton computed tomography (pCT). Methods: The object is discretized into voxels and the average relative stopping power through voxel columns defined from the source to the detector pixels is optimized such that it maximizes the likelihood of the proton energy loss. The length spent by individual protons in each column is calculated through an optimized cubic spline estimate. pRad images were first produced using Geant4 simulations. An anthropomorphic head phantom and the Catphan line-pair module for 3-D spatial resolution were studied and resulting images were analyzed. Both parallel and conical beam have been investigated for simulated pRad acquisition. Then, experimental data of a pediatric head phantom (CIRS) were acquired using a recently completed experimental pCT scanner. Specific filters were applied on proton angle and energy loss data to remove proton histories that underwent nuclear interactions. The MTF10% (lp/mm) was used to evaluate and compare spatial resolution. Results: Numerical simulations showed improvement in the pRad spatial resolution for the parallel (2.75 to 6.71 lp/cm) and conical beam (3.08 to 5.83 lp/cm) reconstructed with the MLLSE compared to averaging detector pixel signals. For full tomographic reconstruction, the improved pRad were used as input into a simultaneous algebraic reconstruction algorithm. The Catphan pCT reconstruction based on the MLLSE-enhanced projection showed spatial resolution improvement for the parallel (2.83 to 5.86 lp/cm) and conical beam (3.03 to 5.15 lp/cm). The anthropomorphic head pCT displayed important contrast gains in high-gradient regions. Experimental results also demonstrated significant improvement in spatial resolution of the pediatric head radiography. Conclusion: The proposed MLLSE shows promising potential to increase the spatial resolution (up to 244%) in proton imaging.

60 APPLIED LIFE SCIENCES↗

FLAME: A platform for high performance computing of complex systems, applied for three case studies

FLAME allows complex models to be automatically parallelised on High Performance Computing (HPC) grids enabling large number of agents to be simulated over short periods of time. Modellers are hindered by complexities of porting models on parallel platforms and time taken to run large simulations on a single machine, which FLAME overcomes. Three case studies from different disciplines were modelled using FLAME, and are presented along with their performance results on a grid.

97 MATHEMATICS AND COMPUTING↗

Benchmark Generation and Simulation at Extreme Scale

The path to extreme scale high-performance computing (HPC) poses several challenges related to power, performance, resilience, productivity, programmability, data movement, and data management. Investigating the performance of parallel applications at scale on future architectures and the performance impact of different architectural choices is an important component of HPC hardware/software co-design. Simulations using models of future HPC systems and communication traces from applications running on existing HPC systems can offer an insight into the performance of future architectures. This work targets technology developed for scalable application tracing of communication events. It focuses on extreme-scale simulation of HPC applications and their communication behavior via lightweight parallel discrete event simulation for performance estimation and evaluation. Instead of simply replaying a trace within a simulator, this work promotes the generation of a benchmark from traces. This benchmark is subsequently exposed to simulation using models to reflect the performance characteristics of future-generation HPC systems. This technique provides a number of benefits, such as eliminating the data intensive trace replay and enabling simulations at different scales. The presented work features novel software co-design aspects, combining the ScalaTrace tool to generate scalable trace files, the ScalaBenchGen tool to generate the benchmark, and the xSim tool to assess the benchmark characteristics within a simulator.

Lagadapati, Mahesh↗

Study of self-consistent particle flows in a plasma blob with particle-in-cell simulations

The self-consistent particle flows in a filamentary coherent structure along the magnetic field line in scrape-off layer (SOL) plasma (plasma blob) have been investigated by means of a three-dimensional electrostatic particle-in-cell simulation code. The presence of the spiral current system composed of the diamagnetic and parallel currents in a blob is confirmed by the particle simulation without any assumed sheath boundary models. Furthermore, the observation of the electron and ion parallel velocity distributions in a blob shows that those distributions are far from Maxwellian due to modification with the sheath formation and that the electron temperature on the higher potential side in a blob is higher than that on the lower potential side. Also, it is found that the ions on the higher potential side are accelerated more intensively along the magnetic field line than those on the lower potential side near the edge. This study indicates that particle simulations are able to provide an exact current closure to analysis of blob dynamics and will bring more accurate prediction of plasma transport in the SOL without any empirical assumptions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

MaLTESE: Large-Scale Simulation-Driven Machine Learning for Transient Driving Cycles

Optimal engine operation during a transient driving cycle is the key to achieving greater fuel economy, engine efficiency, and reduced emissions. In order to achieve continuously optimal engine operation, engine calibration methods use a combination of static correlations obtained from dynamometer tests for steady-state operating points and road and/or track performance data. As the parameter space of control variables, design variable constraints, and objective functions increases, the cost and duration for optimal calibration become prohibitively large. In order to reduce the number of dynamometer tests required for calibrating modern engines, a large-scale simulation-driven machine learning approach is presented in this work. A parallel, fast, robust, physics-based reduced-order engine simulator is used to obtain performance and emission characteristics of engines over a wide range of control parameters under various transient driving conditions (drive cycles). We scale the simulation up to 3,906 nodes of the Theta supercomputer at the Argonne Leadership Computing Facility to generate data required to train a machine learning model. The trained model is then used to predict various engine parameters of interest, and the results are compared with those predicted by the engine simulator. Our results show that a deepneural-network-based surrogate model achieves high accuracy: Pearson product-moment correlation values larger than 0.99 and mean absolute percentage error within 1.07% for various engine parameters such as exhaust temperature, exhaust pressure, nitric oxide, and engine torque. Once trained, the deep-neural-network-based surrogate model is fast for inference: it requires about 16 mu s for predicting the engine performance and emissions for a single design configuration compared with about 0.5 s per configuration with the engine simulator. Moreover, we demonstrate that transfer learning and retraining can be leveraged to incrementally retrain the surrogate model to cope with new configurations that fall outside the training data space.

deep learning↗

Numerical reproducibility for implicit Monte Carlo simulations

We describe and compare different approaches for achieving numerical reproducibility in photon Monte Carlo simulations. Reproducibility is desirable for code verification, testing, and debugging. Parallelism creates a unique problem for achieving reproducibility in Monte Carlo simulations because it changes the order in which values are summed. This is a numerical problem because double precision arithmetic is not associative. In [1], a way of eliminating this roundoff error using integer tallies was described. This approach successfully achieves reproducibility at the cost of lost accuracy by rounding double precision numbers to fewer significant digits. This integer approach, and other extended reproducibility techniques, are described and compared in this work. Increased precision alone is not enough to ensure reproducibility of photon Monte Carlo simulations. A non-arbitrary precision approaches required a varying degree of rounding to achieve reproducibility. For the problems investigated in this work double precision global accuracy was achievable by using 100 bits of precision or greater on all unordered sums which where subsequently rounded to double precision at the end of every time-step. (authors)

97 MATHEMATICS AND COMPUTING↗

A Comparison of Classical and Aggregation-Based Algebraic Multigrid Preconditioners for High-Fidelity Simulation of Wind Turbine Incompressible Flows

This paper presents a comparison of parallel strong scaling performance of classical and aggregation algebraic multigrid (AMG) preconditioners in the context of wind turbine simulations. Fluid motion is governed by the incompressible Navier--Stokes equations, discretized in space with control-volume finite elements and in time with an inexact projection scheme using an implicit integrator. A discontinuous-Galerkin sliding-mesh algorithm captures rotor motion. The momentum equations are solved with iterative Krylov methods, preconditioned by symmetric Gauss--Seidel (SGS) in Trilinos and $\ell_1$ SGS in hypre. The mass-continuity equation is solved with GMRES preconditioned by AMG and can account for the majority of simulation time. Reducing this continuity solve time is crucial. Wind turbine simulations present two unique challenges for AMG preconditioned solvers: the computational meshes include strongly anisotropic elements, and mesh motion requires matrix reinitialization and computation of preconditioners at each time step. Detailed timing profiles are presented and analyzed, and best practices are discussed for both classical and aggregation-based AMG. Results are presented for simulations of two different wind turbines with up to 6 billion grid points on two different computer architectures. For moving mesh problems that require linear-system reinitialization, the well-established strategy of amortizing preconditioner setup costs over a large number of time steps to reduce the solve time is no longer valid. Instead, results show that faster time to solution is achieved by reducing preconditioner setup costs at the expense of linear-system solve costs. Standard smoothed aggregation with Chebyshev relaxation was found to perform poorly when compared with classical AMG in terms of solve time and robustness. However, plain aggregation was comparable to classical AMG.

97 MATHEMATICS AND COMPUTING↗