Search NASA⌕ Search

SEARCH · Search NASA

Results for “parallel simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,567 records · Page 87

FLAME: A platform for high performance computing of complex systems, applied for three case studies

FLAME allows complex models to be automatically parallelised on High Performance Computing (HPC) grids enabling large number of agents to be simulated over short periods of time. Modellers are hindered by complexities of porting models on parallel platforms and time taken to run large simulations on a single machine, which FLAME overcomes. Three case studies from different disciplines were modelled using FLAME, and are presented along with their performance results on a grid.

97 MATHEMATICS AND COMPUTING↗

Identification and Study of Validation Level Test Cases for Computational Modeling of Non-Charring Ablators

Computational modeling of Thermal Protection System (TPS) materials, used for aerospace applications, provides numerous advantages in preliminary selection and design of a heatshield material and shape for atmospheric entry vehicles. However, to serve as a reliable tool for prediction of material thermal and ablative behavior, the modeling approach needs to be validated against real experimental and flight data, preferably at a range of applied conditions. The validation study is typically very complex as it requires reliable measured data not only for the material thermal response and surface recession, but also well characterized environmental conditions. The validation problem becomes even more complex when the material thermal response is dictated by multi-physics effects such as solid conduction, in-depth thermal decomposition, pyrolysis gas flow and chemical reactions. The multi-physics effects complicate not only the modeling effort, but also the experimental measurement for validation of various aspects of the highly coupled problem. In this study, an attempt is made to identify suitable experimental data that could serve as a source for validation of material thermal response modeling tools. To reduce the computational complexity, this study focuses only on non-charring ablators, where the material thermal response could be modeled with a single governing equation for solid conduction and the ablation is limited only to the surface of the material. With a well characterized and publicly available experimental data being sparse, the study is limited in presenting test cases for only three materials: camphor, graphite and FiberForm® in the sequence of increased modeling complexity. Graphite is a commonly used TPS material for aerospace applications, both for leading edges of high-speed vehicles and internal insulation of solid rocket motors. FiberForm® is a porous carbon pre-form used in preparation of the well known PICA material Tran et al. [1996]. Inclusion of camphor into the list is conditioned with the relative simplicity in modeling the material thermal and chemical response and the low-enthalpy flow environment. In addition, camphor has been used as a simple test material for study of flow transition behavior by Stock and Ginoux [1973] and assessment of a heatshield shape change at flight relevant conditions by Rotondi et al. [2022]. In this work, the identified experimental data was extracted from the public literature and test cases that yet have been published. As it was found from the review, not a single test case contains an exhaustive set of data that would validate every aspect of the material physics. However, in the data collected, various aspects of the material behavior can be still validated, such as surface and in-depth temperature, amount of recession and a shape change. The identified experimental data for each case is accompanied with a characterized flow environment and simulated boundary conditions predicted by a Data-Parallel Line Relaxation (DPLR) code Wright et al. [1998]. In addition, material thermal response numerical simulations in each test case are performed with Kentucky Aerothermodynamics and Thermal Response System (KATS-MR) Zibitsker et al. [2022] providing a comparative study and a sanity check for the proposed validation data. Sample results from the performed numerical study are shown below. Figure 1 shows distribution of surface heat flux and pressure values on a hemi-cylinder model made of FiberForm® and tested in HyMETS arc-jet facility. The results are shown for the high pressure condition among the two tests. Flow simulation was performed with DPLR code on a quarter of original geometry. In the figure, the quarter shape was mirrored across zx and xy planes to show the complete distribution. Figure 2 shows the material response results for the high pressure case (7500 Pa), simulated with KATS-MR and a comparison to the experimental data for the surface temperature and shape shape. The simulation was performed on a 2-D slice, extracted in the xy plane at the middle of the sample. Figure 3 shows the material response simulation for the low pressure case (3500 Pa) and a comparison to the experimental data for surface temperature and shape change.

ablation↗

Benchmark Generation and Simulation at Extreme Scale

The path to extreme scale high-performance computing (HPC) poses several challenges related to power, performance, resilience, productivity, programmability, data movement, and data management. Investigating the performance of parallel applications at scale on future architectures and the performance impact of different architectural choices is an important component of HPC hardware/software co-design. Simulations using models of future HPC systems and communication traces from applications running on existing HPC systems can offer an insight into the performance of future architectures. This work targets technology developed for scalable application tracing of communication events. It focuses on extreme-scale simulation of HPC applications and their communication behavior via lightweight parallel discrete event simulation for performance estimation and evaluation. Instead of simply replaying a trace within a simulator, this work promotes the generation of a benchmark from traces. This benchmark is subsequently exposed to simulation using models to reflect the performance characteristics of future-generation HPC systems. This technique provides a number of benefits, such as eliminating the data intensive trace replay and enabling simulations at different scales. The presented work features novel software co-design aspects, combining the ScalaTrace tool to generate scalable trace files, the ScalaBenchGen tool to generate the benchmark, and the xSim tool to assess the benchmark characteristics within a simulator.

Lagadapati, Mahesh↗

Study of self-consistent particle flows in a plasma blob with particle-in-cell simulations

The self-consistent particle flows in a filamentary coherent structure along the magnetic field line in scrape-off layer (SOL) plasma (plasma blob) have been investigated by means of a three-dimensional electrostatic particle-in-cell simulation code. The presence of the spiral current system composed of the diamagnetic and parallel currents in a blob is confirmed by the particle simulation without any assumed sheath boundary models. Furthermore, the observation of the electron and ion parallel velocity distributions in a blob shows that those distributions are far from Maxwellian due to modification with the sheath formation and that the electron temperature on the higher potential side in a blob is higher than that on the lower potential side. Also, it is found that the ions on the higher potential side are accelerated more intensively along the magnetic field line than those on the lower potential side near the edge. This study indicates that particle simulations are able to provide an exact current closure to analysis of blob dynamics and will bring more accurate prediction of plasma transport in the SOL without any empirical assumptions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

MaLTESE: Large-Scale Simulation-Driven Machine Learning for Transient Driving Cycles

Optimal engine operation during a transient driving cycle is the key to achieving greater fuel economy, engine efficiency, and reduced emissions. In order to achieve continuously optimal engine operation, engine calibration methods use a combination of static correlations obtained from dynamometer tests for steady-state operating points and road and/or track performance data. As the parameter space of control variables, design variable constraints, and objective functions increases, the cost and duration for optimal calibration become prohibitively large. In order to reduce the number of dynamometer tests required for calibrating modern engines, a large-scale simulation-driven machine learning approach is presented in this work. A parallel, fast, robust, physics-based reduced-order engine simulator is used to obtain performance and emission characteristics of engines over a wide range of control parameters under various transient driving conditions (drive cycles). We scale the simulation up to 3,906 nodes of the Theta supercomputer at the Argonne Leadership Computing Facility to generate data required to train a machine learning model. The trained model is then used to predict various engine parameters of interest, and the results are compared with those predicted by the engine simulator. Our results show that a deepneural-network-based surrogate model achieves high accuracy: Pearson product-moment correlation values larger than 0.99 and mean absolute percentage error within 1.07% for various engine parameters such as exhaust temperature, exhaust pressure, nitric oxide, and engine torque. Once trained, the deep-neural-network-based surrogate model is fast for inference: it requires about 16 mu s for predicting the engine performance and emissions for a single design configuration compared with about 0.5 s per configuration with the engine simulator. Moreover, we demonstrate that transfer learning and retraining can be leveraged to incrementally retrain the surrogate model to cope with new configurations that fall outside the training data space.

deep learning↗

Numerical reproducibility for implicit Monte Carlo simulations

We describe and compare different approaches for achieving numerical reproducibility in photon Monte Carlo simulations. Reproducibility is desirable for code verification, testing, and debugging. Parallelism creates a unique problem for achieving reproducibility in Monte Carlo simulations because it changes the order in which values are summed. This is a numerical problem because double precision arithmetic is not associative. In [1], a way of eliminating this roundoff error using integer tallies was described. This approach successfully achieves reproducibility at the cost of lost accuracy by rounding double precision numbers to fewer significant digits. This integer approach, and other extended reproducibility techniques, are described and compared in this work. Increased precision alone is not enough to ensure reproducibility of photon Monte Carlo simulations. A non-arbitrary precision approaches required a varying degree of rounding to achieve reproducibility. For the problems investigated in this work double precision global accuracy was achievable by using 100 bits of precision or greater on all unordered sums which where subsequently rounded to double precision at the end of every time-step. (authors)

97 MATHEMATICS AND COMPUTING↗

A Comparison of Classical and Aggregation-Based Algebraic Multigrid Preconditioners for High-Fidelity Simulation of Wind Turbine Incompressible Flows

This paper presents a comparison of parallel strong scaling performance of classical and aggregation algebraic multigrid (AMG) preconditioners in the context of wind turbine simulations. Fluid motion is governed by the incompressible Navier--Stokes equations, discretized in space with control-volume finite elements and in time with an inexact projection scheme using an implicit integrator. A discontinuous-Galerkin sliding-mesh algorithm captures rotor motion. The momentum equations are solved with iterative Krylov methods, preconditioned by symmetric Gauss--Seidel (SGS) in Trilinos and $\ell_1$ SGS in hypre. The mass-continuity equation is solved with GMRES preconditioned by AMG and can account for the majority of simulation time. Reducing this continuity solve time is crucial. Wind turbine simulations present two unique challenges for AMG preconditioned solvers: the computational meshes include strongly anisotropic elements, and mesh motion requires matrix reinitialization and computation of preconditioners at each time step. Detailed timing profiles are presented and analyzed, and best practices are discussed for both classical and aggregation-based AMG. Results are presented for simulations of two different wind turbines with up to 6 billion grid points on two different computer architectures. For moving mesh problems that require linear-system reinitialization, the well-established strategy of amortizing preconditioner setup costs over a large number of time steps to reduce the solve time is no longer valid. Instead, results show that faster time to solution is achieved by reducing preconditioner setup costs at the expense of linear-system solve costs. Standard smoothed aggregation with Chebyshev relaxation was found to perform poorly when compared with classical AMG in terms of solve time and robustness. However, plain aggregation was comparable to classical AMG.

97 MATHEMATICS AND COMPUTING↗

Supervised paralled-in-time algorithm for long-time Lagrangian simulations of stochastic dynamics: Application to hydrodynamics

Lagrangian particle methods based on detailed atomic and molecular and nanoscale systems. However, the maximum time step is limited by the smallest oscillation period of the fastest atomic motion, rendering long-time simulations very expensive. To resolve this bottleneck, we propose a supervised parallel-in-time algorithm for stochastic dynamics to accelerate long-time Lagrangian particle simulations. Our method is inspired by bottom-up coarse-graining projections that yield mean-field hydrodynamic behavior in the continuum limit.

Multiscale modeling, Lagrangian method, Parallel-i↗

Performance Modeling of a Variable-Geometry Oscillating Surge Wave Energy Converter on a Raised Foundation

This paper analyzes the power capture potential, structural loadings, and costs associated with an oscillating surge wave energy converter (OSWEC) operating on a raised foundation. The raised OSWEC offers opportunities for reduced installation costs, improved energy production, and greater flexibility of deployment when compared with fixed-bottom models. In this investigation, we simulated several different foundation geometries using WEC-Sim to estimate power capture and structural loads. In an effort to maximize power capture, several cases in which flat plates of varying size were attached to the top of the foundation, under and parallel with the OSWEC, were also simulated. These plates were found to enhance power capture by preventing the wave-induced pressure from passing underneath the OSWEC, diverting this pressure toward the OSWEC instead. The OSWEC was simulated in the six Wave Energy Prize sea states, which were chosen as a representative sample of U.S. deployment sites. A first-order estimate of structural costs was calculated using the Wave Energy Prize ACE metric, with the foundation comprised predominantly of steel-reinforced concrete and the OSWEC comprised of A36 steel. Influence of foundation geometry on power capture, structural loadings, and ACE are topics of particular interest. This work has been inspired by advances in large-scale additive manufacturing techniques that have the potential to dramatically reduce the cost of subsea foundations. These advancements may enable cost-effective WEC systems to be deployed on raised foundations.

cost↗

Chromatically corrected virtual image visual display

An in-line, three element, large diameter, optical display lens is disclosed which has a front convex-convex element, a central convex-concave element, and a rear convex-convex element. The lens, used in flight simulators, magnifies an image presented on a television monitor and, by causing light rays leaving the lens to be in essentially parallel paths, reduces eye strain of the simulator operator.

Kahlbaum, W. M., Jr.↗

Collisionless kinetic-fluid simulation of zonal flows in non-circular tokamaks

Fluid simulation of linear zonal flow damping is done with a closure model based on the collisionless gyrokinetics [Sugama et al., Phys. Plasmas 14, 022502 (2007)]. Simulation results of residual zonal flow for low radial wavenumbers are compared with theoretical formulas for circular and non-circular tokamaks. The effects of the elongation and the triangularity are shown to be properly treated in the closure model. Effects of initial parallel flows on zonal flow evolution are also clarified. An appropriate choice of the initial parallel flow gives a much higher residual level than the conventional result with no initial parallel flow. Besides, the zonal flow simulations are done with the E Multiplication-Sign B nonlinearity as initial sources, which is evaluated from linear gyrokinetic microinstabilities such as ion temperature gradient modes, trapped electron modes, and electron temperature gradient modes, in order to estimate efficiency of zonal flow generation by the source instabilities.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Accuracy of the electron transport in mcnp5 and its suitability for ionization chamber response simulations: A comparison with the egsnrc and penelope codes

Purpose: In this work, accuracy of the mcnp5 code in the electron transport calculations and its suitability for ionization chamber (IC) response simulations in photon beams are studied in comparison to egsnrc and penelope codes. Methods: The electron transport is studied by comparing the depth dose distributions in a water phantom subdivided into thin layers using incident energies (0.05, 0.1, 1, and 10 MeV) for the broad parallel electron beams. The IC response simulations are studied in water phantom in three dosimetric gas materials (air, argon, and methane based tissue equivalent gas) for photon beams ({sup 60}Co source, 6 MV linear medical accelerator, and mono-energetic 2 MeV photon source). Two optional electron transport models of mcnp5 are evaluated: the ITS-based electron energy indexing (mcnp5{sub ITS}) and the new detailed electron energy-loss straggling logic (mcnp5{sub new}). The electron substep length (ESTEP parameter) dependency in mcnp5 is investigated as well. Results: For the electron beam studies, large discrepancies (>3%) are observed between the mcnp5 dose distributions and the reference codes at 1 MeV and lower energies. The discrepancy is especially notable for 0.1 and 0.05 MeV electron beams. The boundary crossing artifacts, which are well known for the mcnp5{sub ITS}, are observed for the mcnp5{sub new} only at 0.1 and 0.05 MeV beam energies. If the excessive boundary crossing is eliminated by using single scoring cells, the mcnp5{sub ITS} provides dose distributions that agree better with the reference codes than mcnp5{sub new}. The mcnp5 dose estimates for the gas cavity agree within 1% with the reference codes, if the mcnp5{sub ITS} is applied or electron substep length is set adequately for the gas in the cavity using the mcnp5{sub new}. The mcnp5{sub new} results are found highly dependent on the chosen electron substep length and might lead up to 15% underestimation of the absorbed dose. Conclusions: Since the mcnp5 electron transport calculations are not accurate at all energies and in every medium by general clinical standards, caution is needed, if mcnp5 is used with the current electron transport models for dosimetric applications.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Computations of Boiling in Microgravity

The absence (or reduction) of gravity, can lead to major changes in boiling heat transfer. On Earth, convection has a major effect on the heat distribution ahead of an evaporation front, and buoyancy determines the motion of the growing bubbles. In microgravity, convection and buoyancy are absent or greatly reduced and the dynamics of the growing vapor bubbles can change in a fundamental way. In particular, the lack of redistribution of heat can lead to a large superheat and explosive growth of bubbles once they form. While considerable efforts have been devoted to examining boiling experimentally, including the effect of microgravity, theoretical and computational work have been limited. Here, the growth of boiling bubbles is studied by direct numerical simulations where the flow field is fully resolved and the effects of inertia, viscosity, surface deformation, heat conduction and convection, as well as the phase change, are fully accounted for. Boiling involves both fluid flow and heat transfer and thus requires the solution of the Navier-Stokes and the energy equations. The numerical method is based on writing one set of governing transport equations which is valid in both the liquid and vapor phases. This local, single-field formulation incorporates the effect of the interface in the governing equations as source terms acting only at the interface. These sources account for surface tension and latent heat in the equations for conservation of momentum and energy as well as mass transfer across the interface due to phase change. The single-field formulation naturally incorporates the correct mass, momentum and energy balances across the interface. Integration of the conservation equations across the interface directly yields the jump conditions derived in the local instant formulation for two-phase systems. In the numerical implementation, the conservation equations for the whole computational domain (both vapor and liquid) are solved using a stationary grid and the phase boundary is followed by a moving unstructured two-dimensional grid. While two-dimensional simulations have been used for preliminary studies and to examine the resolution requirement, the focus is on fully three-dimensional simulations. The numerical methodology, including the parallelization and grid refinement strategy is discussed, and preliminary results shown. For buoyancy driven flow, the heat transfer is in good agreement with experimental correlations. The changes when gravity is turned off and/or fluid shear is added are discussed, as well as the difference between simulations of a layer freely releasing bubbles versus simulations using only one wavelength initial perturbation. Figure 1 shows the early stages of the formation of a three-dimensional bubble from a thin vapor layer. The boundary conditions are periodic in the x and y direction, the bottom is a hot and the top allows a free outflow. The jagged edge of the surface close to the bottom of the computational domain is due to some of the surface elements being on the other side of the domain and some elements not plotted by our plotting routine. In the second figure, we show the temperature distribution through two perpendicular planes.

Tryggvason, G.↗

Mathematical model partitioning and packing for parallel computer calculation

This paper deals with the development of multiprocessor simulations from a serial set of ordinary differential equations describing a physical system. The identification of computational parallelism within the model equations is discussed. A technique is presented for identifying this parallelism and for partitioning the equations for parallel solution on a multiprocessor. Next, an algorithm which packs the equations into a minimum number of processors is described. The results of applying the packing algorithm to a turboshaft engine model are presented.

Arpasi, Dale J.↗

Parallel Anisotropic Unstructured Grid Adaptation

Computational Fluid Dynamics (CFD) has become critical to the design and analysis of aerospace vehicles. Parallel grid adaptation that resolves multiple scales with anisotropy is identified as one of the challenges in the CFD Vision 2030 Study to increase the capacity and capability of CFD simulation. The Study also cautions that computer architectures are undergoing a radical change and dramatic increases in algorithm concurrency will be required to exploit full performance. This paper reviews four different methods to parallel anisotropic grid generation. They cover both ends of the spectrum: (i) using existing state-of-the-art software optimized for a single core and modifying it for parallel platforms and (ii) designing and implementing scalable software with incomplete, but rapidly maturating functionality. A brief overview for each grid adaptation system is presented in the context of a telescopic approach for multilevel concurrency. These methods employ different approaches to enable parallel execution, which provides a unique opportunity to illustrate the relative behavior of each approach. Qualitative and quantitative metric evaluations are used to draw lessons for future developments in this critical area for parallel CFD simulation.

Tsolakis, Christos↗

3D Multistage Simulation of Each Component of the GE90 Turbofan Engine

A 3D multistage simulation of each component of the GE90 Turbofan engine has been made. This includes 49 blade rows. A coupled simulation of all blade rows will be made very soon. The simulation is running using two levels of parallelism. The first level is on a blade row basis with information shared using files. The second level is using a grid domain decomposition with information shared using MPI. Timings will be shown for running on the SP2, an SGI Origin and a distributed system of HP workstations. On the HP workstations, the CHIMP version of MPI is used, with queuing supplied by LSF (Load Sharing Facility). A script-based control system is used to ensure reliability. An MPEG movie illustrating the flow simulation of the engine has been created using PV3, a parallel visualization library created by Bob Haimes of MIT. PVM is used to create a virtual machine from 10 HP workstations and display on an SGI workstation. A representative component simulation will be compared to rig data to demonstrate its usefulness in turbomachinery design and analysis.

Turner, Mark↗

Assembling Multiphysics Nuclear Reactor Simulations Using the MOOSE Framework

The Multiphysics Object Oriented Simulation Environment (MOOSE) [1] is an open-source, parallel finite element framework which provides the foundation for many advanced modeling and simulation tools developed under the Department of Energy (DOE) Nuclear Energy Advanced Modeling and Simulation (NEAMS) Program [2] for the analysis of advanced reactors. The MOOSE framework provides the common foundational capability on which many NEAMS codes for reactor analysis are built. The MOOSE framework also includes several systems to assemble unique workflows and couplingamong MOOSE-based applications. In particular, the MultiApp and Transfer Systems are widely used to assemble different MOOSE-based or MOOSE-wrapped physics applications together to perform loosely or tightly coupled multiphysics simulations. The National Reactor Innovation Center (NRIC) Virtual Test Bed (VTB) [3] hosts publicly available nuclear reactor multiphysics simulation examples which leverage MOOSE’s MultiApp System to meet the modeling needs of different reactor types. The flexibility and robustness of coupling provided by MOOSE permits rapid development of coupled physics models for a wide range of reactor types and events

22 GENERAL STUDIES OF NUCLEAR REACTORS↗