Search NASA⌕ Search

SEARCH · Search NASA

Results for “parallel simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,405 records · Page 78

Direct Numerical Simulation of Hypersonic Turbulent Boundary Layer Flow using SPARC: Initial Evaluation

This report documents the initial testing of the Sandia Parallel Aerodynamics and Reentry Code (SPARC) to directly simulate hypersonic, turbulent boundary layer flow over a sharp 7- degree half-angle cone. This type of computation involves a tremendously large range of scales both in time and space, requiring a large number of grid cells and the efficient utilization of a large pool of resources. The goal of the simulation is to mimic and verify a wind tunnel experiment that seeks to measure the turbulent surface pressure fluctuations. These data are necessary for building a model to predict random vibration loading in the reentry flight environment. A low-dissipation flux scheme in SPARC is used on a 2.7 billion cell mesh to capture the turbulent fluctuations in the boundary layer flow. The grid is divided into 115200 partitions and simulated using the Knight's Landings (KNL) partition of the Trinity system. The parallel performance of SPARC is explored on the Trinity system, as well as some of the other new architectures. Extracting data from the simulation shows good agreement with the experiment as well as a colleague's simulation. The data provide a guide for which a new model can be built for better prediction of the reentry random vibration loads.

42 ENGINEERING↗

Thermal-mechanical modeling of deep borehole disposal of high-level radioactive waste.

Disposal of high-level radioactive waste, including spent nuclear fuel, in deep (3 to 5 km) boreholes is a potential option for safely isolating these wastes from the surface and near-surface environment. Existing drilling technology permits reliable and cost-effective construction of such deep boreholes. Conditions favorable for deep borehole disposal in crystalline basement rocks, including low permeability, high salinity, and geochemically reducing conditions, exist at depth in many locations, particularly in geologically stable continental regions. Isolation of waste depends, in part, on the effectiveness of borehole seals and potential alteration of permeability in the disturbed host rock surrounding the borehole. Coupled thermal-mechanical-hydrologic processes induced by heat from the radioactive waste may impact the disturbed zone near the borehole and borehole wall stability. Numerical simulations of the coupled thermal-mechanical response in the host rock surrounding the borehole were conducted with three software codes or combinations of software codes. Software codes used in the simulations were FEHM, JAS3D, Aria, and Adagio. Simulations were conducted for disposal of spent nuclear fuel assemblies and for the higher heat output of vitrified waste from the reprocessing of fuel. Simulations were also conducted for both isotropic and anisotropic ambient horizontal stress in the host rock. Physical, thermal, and mechanical properties representative of granite host rock at a depth of 4 km were used in the models. Simulation results indicate peak temperature increases at the borehole wall of about 30 C and 180 C for disposal of fuel assemblies and vitrified waste, respectively. Peak temperatures near the borehole occur within about 10 years and decline rapidly within a few hundred years and with distance. The host rock near the borehole is placed under additional compression. Peak mechanical stress is increased by about 15 MPa (above the assumed ambient isotropic stress of 100 MPa) at the borehole wall for the disposal of fuel assemblies and by about 90 MPa for vitrified waste. Simulated peak volumetric strain at the borehole wall is about 420 and 2600 microstrain for the disposal of fuel assemblies and vitrified waste, respectively. Stress and volumetric strain decline rapidly with distance from the borehole and with time. Simulated peak stress at and parallel to the borehole wall for the disposal of vitrified waste with anisotropic ambient horizontal stress is about 440 MPa, which likely exceeds the compressive strength of granite if unconfined by fluid pressure within the borehole. The relatively small simulated displacements and volumetric strain near the borehole suggest that software codes using a nondeforming grid provide an adequate approximation of mechanical deformation in the coupled thermal-mechanical model. Additional modeling is planned to incorporate the effects of hydrologic processes coupled to thermal transport and mechanical deformation in the host rock near the heated borehole.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

QTENSOR

QTensor is a quantum circuit simulator designed to run efficiently in parallel mode on large supercomputers. It is based on the tensor network representation of quantum circuits. The simulator is flexible and agnostic to both the connectivity map of the quantum device and the types of gates used in the circuit.

Alekseev, Yury↗

Parareal in Time for Dynamic Simulations of Power Systems

In recent years, there have been significant developments in parallel algorithms and high performance parallel computing platforms. Parareal in time algorithm has become popular for long transient simulations (e.g., molecular dynamics, fusion, reacting flows). Parareal is a parallel algorithm which divides the time interval into sub-intervals and solves them concurrently. This paper investigates the applicability of the parareal algorithm to power system dynamic simulations. Preliminary results on the application of parareal for multi-machine power systems are reported in this paper. Two widely used test systems, WECC 3-generator 9-bus system, New England 10-generator 39- bus system, is used to explore the effectiveness of the parareal. Severe 3 phase bus faults are simulated using both the classical and detailed models of multi-machine power systems. Actual Speedup of 5-7 times is observed assuming ideal parallelization. It has been observed that the speedup factors of the order of 20 can be achieved by using fast coarse approximations of power system models. Dependency of parareal convergence on fault duration and location has been observed.

Gurrala, Gurunath↗

PipeSight: A High-Performance Computing Platform for Pipeline Integrity Management

The Phase I feasibility study completed as part of this project has led to a number of innovative technologies being developed and has laid the foundation for a successful Phase II effort to commercialize a platform for managing the integrity of pipelines for the damage mechanisms of the new, hybrid-energy based economy. To ground the development efforts and direction of the project, an extensive market research and customer discovery effort was undertaken early in Phase I. Through this effort, a number of pipeline owners and operators were interviewed, and the following key findings were discovered about the pipeline industry: • Small pipeline operators do not have the central engineering groups necessary to perform their own independent analysis of inspection data, but instead rely on summarized tally sheets provided to them by inspection service providers. • The time it takes to go from an inspection to a completed engineering assessment, even for small segments of pipeline, can take anywhere from 30-120 days. During this delay, critical threats can (and have been known to) cause failures. • Uncertainty is often not accounted for in the assessment of pipeline integrity. The tally sheets provided by third-party service providers are almost always deterministic in nature, identifying threats that present a concern only to the current (not the future) integrity of the pipeline. • It is uncommon to apply the latest technologies to perform advanced assessments of damaged pipelines. There is a desire to use more advanced analysis capabilities to assess threats. Many pipeline operators indicated that they would often excavate a pipeline to perform an inspection and find that the damage was not as bad as they anticipated, thus using limited resources unnecessarily. Companies are not consistent in their use of inspection data to determine corrosion rates, and those that do only calculate deterministic corrosion rates. • The industry has prominently relied on time-based inspections but has recently started to transition to risk-based inspections. However, there appears to be no uniform guidance on how to do so while properly accounting for all sources of uncertainty. • Companies are not storing inspection data in a manner that allows for the ready determination of temporal trends. • Predictive maintenance principles and practices are beginning to be used by early adopters • Some pipelines are being re-purposed to transport different process fluids than they were designed for, e.g., H 2 and CO 2 rich process streams to serve the new hybrid-energy based economy, which are presenting new integrity concerns for the existing pipeline network that crisscrosses the United States. As a result of these discoveries, we were able to target the development efforts in Phase I to best serve the needs of the industry. In Phase I, we developed a way to correlate multiple large-scale scans of the pipeline to determine a probabilistic corrosion rate that accounts for all sources of error and uncertainty in the inspection process. This probabilistic corrosion rate can be used to predict the future thickness distribution of the pipe wall. We demonstrate how this analysis may be performed in an analytical fashion and has been implemented in such a manner that it can be readily distributed using GPU computing through integration of the Kokkos programming model. We also make a very novel extension of the analytical corrosion rate model to Bayesian Networks (an explainable AI technique) that can account for non-parametric distributions of corrosion rates. With the predictions made above for the probabilistic corrosion rate and corresponding future distribution of the pipe wall thickness, we can assess the integrity of the pipeline through the use of a probabilistic engineering assessment. We developed a novel screening data analysis approach that can rapidly identify ‘hotspots’ (local thin areas) where the integrity of the pipeline is a concern. Once more, we implemented this screening approach in C++ to leverage GPU computing via the Kokkos programming model. After the critical hotspots are identified, we developed a program that can automatically generate an advanced finite element model of the damaged regions. Since the number of damaged regions that require advanced analysis can number in the thousands, we integrated an open-source container-native workflow engine for orchestrating parallel jobs on the cloud. Initially, these advanced numerical models were only designed to account for loading due to internal pressure. However, in a slight pivot from the initial Phase I proposal, we developed a complete pipe stress analysis program (called Simflex) which can simulate the complete pipeline and its response to thermal expansion, pressure, thermal bowing, weight, wind, earthquake, support displacement, support friction and external forces. This pipe stress analysis program was written generically, to handle any piping system, but contains the features needed to model long pipelines (i.e., it incorporates a model for soil mechanics and can account for the nonlinear boundary conditions necessary to simulate long underground pipelines). This pipe stress analysis program can simulate any segment of the pipeline (simple or complex) under any set of conditions and loads, to determine the supplemental loads (axial forces and bending moments) at the location of damage. This enables the most accurate state of stress to be accounted for in the pipeline, which can prove critical when evaluating the integrity of a damaged region. In the process of developing the technologies to perform the integrity assessment of the pipeline, we also extended one of the industry standard approaches for performing the assessment of local thin areas that extend more in the circumferential direction than the longitudinal direction of the pipeline. This approach was presented to the API 579-1/AS ME FFS-1 steering committee in November 2021 for consideration in the next edition of the industry standard for Fitness-For-Service (expected to be released in 2023). To help pipeline operators make decisions with the results on any integrity assessment, we developed a new approach to the life-cycle management of pipelines which uses a Bayesian Decision Network. The network is designed to help pipeline operators plan and prioritize inspection activities and ultimately make smarter, more cost-effective decisions. The Bayesian approach accounts for all sources of uncertainty and carries them through to the final optimal decisions, providing a probabilistic framework for optimizing inspection intervals. The proof-of-concept networks developed in the feasibility study are complete, verified, and are focused on a subset of the pipeline. To expand this novel approach to the scale necessary for an entire network of pipelines in Phase II, we will leverage the DOE-funded Bengi solver for industrial-scale decision making with Bayesian Networks [22]. Once implemented, we will be able to provide the pipeline industry with a much-needed tool for optimal inspection planning using truly explainable artificial intelligence (XAI). To handle all of these advanced capabilities into a cloud-based platform, the architecture of the Equity Engineering Cloud (EEC) was extended to include Argo Workflows, a framework capable of distributing and managing a massive number of jobs that consume their own resources, such that thousands of serial finite element simulations can be run in parallel. As part of this substantial undertaking, we also integrated Argo Continuous Delivery (CD) into the EEC, to aid with the rapid prototyping and iterations that will be imperative to the success of the PipeSight platform’s Agile development process in Phase II. As part of the pipe stress analysis program, we also developed a custom visualizer that leverages the DOE-funded VTK visualization library. We added custom contouring capabilities and a means for interacting visually with both the inputs and outputs of the pipe stress analysis program. We also developed routines for automating the post-processing of the finite element simulations to determine if any failure criteria are met and to visualize the deformations, stresses and strains in ParaView using the exodus II file format (a subset of netCDF).

24 POWER TRANSMISSION AND DISTRIBUTION↗

Direct comparison of elastic incoherent neutron scattering experiments with molecular dynamics simulations of DMPC phase transitions

Neutron scattering techniques have been employed to investigate 1,2-dimyristoyl-sn-glycero-3- phosphocholine (DMPC) membranes in the form of multilamellar vesicles (MLVs) and deposited, stacked multilamellar-bilayers (MLBs), covering transitions from the gel to the liquid phase. Neutron diffraction was used to characterise the samples in terms of transition temperatures, whereas elastic incoherent neutron scattering (EINS) demonstrates that the dynamics on the sub-macromolecular length-scale and pico- to nano-second time-scale are correlated with the structural transitions through a discontinuity in the observed elastic intensities and the derived mean square displacements. Molecular dynamics simulations have been performed in parallel focussing on the length-, time- and temperature-scales of the neutron experiments. They correctly reproduce the structural features of the main gel-liquid phase transition. Particular emphasis is placed on the dynamical amplitudes derived from experiment and simulations. Two methods are used to analyse the experimental data and mean square displacements. They agree within a factor of 2 irrespective of the probed time-scale, i.e. the instrument utilized. Mean square displacements computed from simulations show a comparable level of agreement with the experimental values, albeit, the best match with the two methods varies for the two instruments. Consequently, experiments and simulations together give a consistent picture of the structural and dynamical aspects of the main lipid transition and provide a basis for future, theoretical modelling of dynamics and phase behaviour in membranes. The need for more detailed analytical models is pointed out by the remaining variation of the dynamical amplitudes derived in two different ways from experiments on the one hand and simulations on the other.

Aoun, Bachir↗

The 2nd Symposium on the Frontiers of Massively Parallel Computations

Programming languages, computer graphics, neural networks, massively parallel computers, SIMD architecture, algorithms, digital terrain models, sort computation, simulation of charged particle transport on the massively parallel processor and image processing are among the topics discussed.

Mills, Ronnie↗

The proton cyclotron instability and the anisotropy/B inverse correlation

Spacecraft observations in the strongly compressed subsolar magnetosheath show an inverse correlation between the proton temperature anistrophy (T(sub perpendicular to p)/T(sub parallel to p) greater than 1 where perpendicular to and parallel to denote directions perpendicular and parallel to the background magnetic field) and the parallel proton beta (beta(sub parallel to p). This manuscript uses one-dimensional hybrid simulations of the proton cyclotron anisotropy instability in homogeneous electron-proton plasmas to study this correlation which may represent a limited closure relation for fluid theories of anisotropic space plasmas. The emphasis is on driven simulation which increase the temperature anisotropy by periodically reducing the magnetic-field-aligned velocities of the protons. The late-time states from ensembles of both initial value and driven simulations yield very similar expressions for the proton anisotropy/beta(sub parallel to P) inverse correlation, and provide a basis for explaining differences between sheath observations from different spacecraft. The driven simulations also yield expressions for the maximum instability growth rate and the fluctuating field energy as functions of beta (sub parallel to p) and a parameter characterizing the anisotropy driver.

Gary, S. Peter↗

Electron‐Scale Reconnection in Three‐Dimensional Shock Turbulence

Abstract Magnetic reconnection has been observed in the transition region of quasi‐parallel shocks. In this work, the particle‐in‐cell method is used to simulate three‐dimensional reconnection in a quasi‐parallel shock. The shock transition region is turbulent, leading to the formation of reconnecting current sheets with various orientations. Two reconnection sites with weak and strong guide fields are studied, and it is shown that reconnection is fast and transient. Reconnection sites are characterized using diagnostics including electron flows and magnetic flux transport. In contrast to two‐dimensional simulations, weak guide field reconnection is realized. Furthermore, the current sheets in these events form in a direction almost perpendicular to those found in two‐dimensional simulations, where the reconnection geometry is constrained.

58 GEOSCIENCES↗

Graphics processing unit accelerated three-dimensional model for the simulation of pulsed low-temperature plasmas

A 3-dimensional particle-in-cell/Monte Carlo collision simulation that is fully implemented on a graphics processing unit (GPU) is described and used to determine low-temperature plasma characteristics at high reduced electric field, E/n, in nitrogen gas. Details of implementation on the GPU using the NVIDIA Compute Unified Device Architecture framework are discussed with respect to efficient code execution. The software is capable of tracking around 10 × 10{sup 6} particles with dynamic weighting and a total mesh size larger than 10{sup 8} cells. Verification of the simulation is performed by comparing the electron energy distribution function and plasma transport parameters to known Boltzmann Equation (BE) solvers. Under the assumption of a uniform electric field and neglecting the build-up of positive ion space charge, the simulation agrees well with the BE solvers. The model is utilized to calculate plasma characteristics of a pulsed, parallel plate discharge. A photoionization model provides the simulation with additional electrons after the initial seeded electron density has drifted towards the anode. Comparison of the performance benefits between the GPU-implementation versus a CPU-implementation is considered, and a speed-up factor of 13 for a 3D relaxation Poisson solver is obtained. Furthermore, a factor 60 speed-up is realized for parallelization of the electron processes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Demonstration of Advanced Experimental and Theoretical Characterization of Hydrogen Dynamics and Associated Behavior in Advanced Reactors

Advanced materials development, manufacturing, and modeling capabilities for innovative reactor designs support nuclear security and mission-focused science through enhanced technology for safer and more efficient and secure production of nuclear energy. The research in this project has established: 1) a state-of-the-art neutron-based hydrogen mapping and cross-section measurement capability as well as detailed crystallographic characterization of hydrogen atoms at LANSCE, and 2) a multi-physics framework for simulating behavior of moderator materials and other material performance in advanced nuclear reactors. Through the course of this project, we successfully developed and demonstrated measurement techniques for hydrogen distribution and atomistic-scale behavior of hydrogen atoms using pulsed neutron techniques. In parallel, advanced multi-physics simulation tools to predict the behavior of hydrogen atoms, e.g. in a moderator for a nuclear reactor, through materials performance, neutron transport, and thermal mechanical behavior were enhanced. Multi-discipline areas across the laboratory were involved in the project as the integration of improved experimental capabilities with enhanced modeling and simulation through MST, NEN, SIGMA, and XCP division subject matter experts.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Many-Task Applications in the Integrated Plasma Simulator

This paper discusses the Integrated Plasma Simulator (IPS), a framework for coupled multiphysics simulation of fusion plasmas, in the context of many-task computing. The IPS supports multiple levels of parallelism: individual computational tasks can be parallel, components can launch multiple tasks concurrently, tasks from multiple components can be executed concurrently within a simulation, and multiple simulations can be run simultaneously. Each level of parallelism is constructed on top of the many-task computing capabilities implemented in the IPS, the foundation for the parallelism presented at the multiple simulation level. We show that a modest number of simultaneous simulations, with appropriately sized resource allocations, can provide a better trade-off between resource utilization and overall execution time than if they are run as separate jobs. This approach is highly beneficial for situations in which individual simulation tasks may differ significantly in parallel scalability, as is the case in many scientific communities where coupled simulations rely substantially on legacy code.

99 GENERAL AND MISCELLANEOUS↗

Towards a unified framework for coarse-graining particle-based simulations.

Different coarse-graining techniques for soft matter systems have been developed in recent years, however it is often very demanding to find the method most suitable for the problem studied. For this reason we began to develop the VOTCA toolkit to allow for easy comparison of different methods. We have incorporated 6 different techniques into the package and implemented a powerful and parallel analysis framework plus multiple simulation back-ends. We will discuss the specifics of the package by means of various studies, which have been performed with the toolkit and highlight problems we encountered along the way.

74 ATOMIC AND MOLECULAR PHYSICS↗

Advances in Multi-Physics Modeling for Parallel Finite Element Code Suite ACE3P

SLAC developed ACE3P code suite is a comprehensive set of parallel finite-element codes for multi-physics modeling of particle accelerators. Running on massively parallel computer platforms for high fidelity and high accuracy simulation, ACE3P enables rapid virtual prototyping of accelerator and RF component design, optimization and analysis. Furthermore, recent advances of ACE3P have been focused on the implementation of advanced numerical algorithms, enhancement of multi-physics capabilities, and improvement of code performance on state-of-the-art high performance computing (HPC) platforms for large-scale RF modeling in accelerator applications and beyond. In this paper, we will present a nonlinear electromagnetic (EM) eigensolver for damping calculation of resonant modes for cavities coupled with waveguides, the thermal solver for accurate evaluation of heat loads in superconducting RF (SRF) cavity power coupler, the elastic solver for investigation of SRF cavity cryomodule (CM) bowing due to thermal effect, the frequency domain mechanical solver for studying SRF cavity mechanical oscillation modes, the particle tracking code for dark current simulation in SRF CM using a hybrid MPI+OpenMP parallel programing model, the time domain solver for high fidelity modeling of EM wave propagation for medical device in human body.

97 MATHEMATICS AND COMPUTING↗

DSIM: A distributed simulator

Discrete event-driven simulation makes it possible to model a computer system in detail. However, such simulation models can require a significant time to execute. This is especially true when modeling large parallel or distributed systems containing many processors and a complex communication network. One solution is to distribute the simulation over several processors. If enough parallelism is achieved, large simulation models can be efficiently executed. This study proposes a distributed simulator called DSIM which can run on various architectures. A simulated test environment is used to verify and characterize the performance of DSIM. The results of the experiments indicate that speedup is application-dependent and, in DSIM's case, is also dependent on how the simulation model is distributed among the processors. Furthermore, the experiments reveal that the communication overhead of ethernet-based distributed systems makes it difficult to achieve reasonable speedup unless the simulation model is computation bound.

Goswami, Kumar K.↗

Rapid Prediction of Unsteady Three-Dimensional Viscous Flows in Turbopump Geometries

A program is underway to improve the efficiency of a three-dimensional Navier-Stokes code and generalize it for nozzle and turbopump geometries. Code modifications will include the implementation of parallel processing software, incorporating new physical models and generalizing the multi-block capability to allow the simultaneous simulation of nozzle and turbopump configurations. The current report contains details of code modifications, numerical results of several flow simulations and the status of the parallelization effort.

Dorney, Daniel J.↗

A Study of Turbulence-Driven Inward Momentum Flux & Construction of a Difference Scheme for Fokker-Planck-Landau Operator

Momentum transport driven by microinstability is studied via analytic theories, gyrokinetic simulations, and experimental data analysis. A scenario for rotation profile evolution is constructed based on experimental observation that parallel flow initiates at edge region and penetrates into core region of tokamak [1]. In particular, turbulent diffusion and inward convective pinch are studied according to this scenario. For study of convective momentum pinch, toroidal ion temperature gradient mode near marginal stability is examined in kinetic limit. It is found from quasilinear estimation that the inward turbulent equipartition momentum pinch remains as the most robust part of pinch. In addition, it is found that ion temperature gradient driven momentum pinch is inward for typical parameters, while ion density gradient driven momentum pinch is outward. It is shown by theoretical formulas and experimental data analysis that momentum pinch velocity is sensitive to the electron to ion temperature ratio. For study of diffusive momentum transport, parallel shear flow instability is studied in fluid limit. Diffusion coefficient using mixing length estimate from nonlocal theory reveals that it has a strong dependence on the parallel flow shear and is mainly carried by fluctuations in short wavelength regime. Gyrokinetic simulation of collisionless parallel shear flow instability shows that the analytic prediction of diffusion coefficient is comparable to numerical values in the linear phase of the simulations. In the nonlinear phase, fluctuation energy gets transferred to the long wavelength regime. A two-dimensional, uniform velocity-grid based solver for the nonlinear Fokker-Planck-Landau (FPL) collision operator has been developed in the limit of strong magnetic field. The conservative and entropy increasing semidiscretized numerical scheme for the isotropic FPL equation by C. Buet et al. (2002) has been extended to 2D velocity space. A Picard fixed point method is used for semi-implicit time advance. One time evaluation of interpolation coefficients for probability distribution function is introduced so that numerical equilibrium is achieved with Maxwellian. However, positivity property is sacrificed at the saving of computational costs. In addition, a highly practical method is suggested to apply the velocity-grid based collision solver to particle-in-cell code.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Parallel Multi-Step/Multi-Rate Integration of Two-Time Scale Dynamic Systems

Increasing demands on the fidelity of simulations for real-time and high-fidelity simulations are stressing the capacity of modern processors. New integration techniques are required that provide maximum efficiency for systems that are parallelizable. However many current techniques make assumptions that are at odds with non-cascadable systems. A new serial multi-step/multi-rate integration algorithm for dual-timescale continuous state systems is presented which applies to these systems, and is extended to a parallel multi-step/multi-rate algorithm. The superior performance of both algorithms is demonstrated through a representative example.

dynamics↗