Search NASA⌕ Search

SEARCH · Search NASA

Results for “parallel simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,405 records · Page 78

EGS Reservoir Modeling for Developing Geothermal District Heating at Cornell University

Cornell University is pursuing development of an enhanced geothermal system (EGS) for providing heating to its main campus in Upstate New York. A ~10,000 ft (~3 km) deep vertical observation well ('CUBO') was drilled in 2022 to characterize the subsurface using wellbore logging, borehole imaging, fluid sampling, mini-frac tests, coring and drill cutting analysis. Down-hole temperatures measured at 3 km depth are about 80 degrees C, sufficiently high for direct-use heating. The well drilled through generally low porosity and low permeability Paleozoic sedimentary formations and into metamorphic basement rock, encountered at about 9,400 ft depth. Leveraging subsurface data obtained through CUBO, we investigated technical feasibility and design requirements of a doublet well system with horizontal laterals connected to a fracture network created through hydraulic fracturing. The EGS reservoir is sized to provide a nominal heat output in the range 5 to 10 MWth of continuous heating over a 15 year-lifetime with limited thermal drawdown. We applied the Gringarten Multiple parallel fracture model, the Cornell Discrete Fracture Simulator FOXFEM and the commercial simulator ResFrac to estimate required heat transfer area and design a potential hydraulic stimulation treatment. Reservoir simulations indicate that, depending on fluid flow rate and injection temperature, 2 to 3 km2 of effective fracture heat transfer area is required to supply the target heat output of 5 to 10 MWth over 15 years.

district heating↗

BioXyce : an engineering platform for the study of cellular systems.

Researchers use constructs from the field of electrical engineering for the modeling and analysis of biological systems, but few exploit parallels between electrical and biological circuits for simulation purposes. The authors discuss the development of BioXyce, a circuit-based biological simulation platform that uses Xyce, a large-scale electrical circuit simulator, as its simulation engine. BioXyce is capable of simulating whole-cell and multicellular systems. Simulation results for the central metabolism in Escherichia coli K12 and cellular differentiation in Drosophila sp. are presented.

59 BASIC BIOLOGICAL SCIENCES↗

Unorthodox parallelization for Bayesian quantum state estimation

Quantum state tomography (QST) allows for the reconstruction of quantum states through measurements and some inference technique under the assumption of repeated state preparations. Bayesian inference provides a promising platform to achieve both efficient QST and accurate uncertainty quantification, yet is generally plagued by the computational limitations associated with long Markov chains. In this work, we present a novel Bayesian QST approach that leverages modern distributed parallel computer architectures to efficiently sample a D-dimensional Hilbert space. Using a parallelized preconditioned Crank–Nicholson Metropolis–Hastings algorithm, we demonstrate our approach on simulated data and experimental results from IBM Quantum systems up to four qubits, showing significant speedups through parallelization. Although highly unorthodox in pooling independent Markov chains, our method proves remarkably practical, with validation ex post facto via diagnostics like the intrachain autocorrelation time. We conclude by discussing scalability to higher-dimensional systems, offering a path toward efficient and accurate Bayesian characterization of large quantum systems.

Bayesian inference↗

PUMIPic: A mesh-based approach to unstructured mesh Particle-In-Cell on GPUs

Unstructured mesh particle-in-cell, PIC, simulations executing on the current and next generation of massively parallel systems require new methods for both the mesh and particles to achieve performance and scalability on GPUs. The traditional approach to implementing PIC simulations defines data structures and algorithms in terms of particles with a full copy of the unstructured mesh on every process. To effectively scale the unstructured mesh and particles, mesh-based PIC uses the unstructured mesh as the predominant data structure with the particles stored in terms of the mesh entities. Here, this paper details the PUMIPic library, a framework for developing efficient and performance-portable mesh-based PIC simulations on GPU systems. A pseudo physics simulation based on a five-dimensional gyro-kinetic code for modeling plasma physics is used to examine the performance of PUMIPic. Scaling studies of the unstructured mesh partition and number of particles are performed up to 4096 nodes of the Summit system at Oak Ridge National Laboratory. The studies show that mesh-based PIC can utilize a partitioned mesh and maintain scaling up to system limitations.

97 MATHEMATICS AND COMPUTING↗

Transport of cosmic-ray protons in intermittent heliospheric turbulence: Model and simulations

The transport of charged energetic particles in the presence of strong intermittent heliospheric turbulence is computationally analyzed based on known properties of the interplanetary magnetic field and solar wind plasma at 1 astronomical unit. The turbulence is assumed to be static, composite, and quasi-three-dimensional with a varying energy distribution between a one-dimensional Alfvénic (slab) and a structured two-dimensional component. The spatial fluctuations of the turbulent magnetic field are modeled either as homogeneous with a Gaussian probability distribution function (PDF), or as intermittent on large and small scales with a q-Gaussian PDF. Simulations showed that energetic particle diffusion coefficients both parallel and perpendicular to the background magnetic field are significantly affected by intermittency in the turbulence. This effect is especially strong for parallel transport where for large-scale intermittency results show an extended phase of subdiffusive parallel transport during which cross-field transport diffusion dominates. The effects of intermittency are found to depend on particle rigidity and the fraction of slab energy in the turbulence, yielding a perpendicular to parallel mean free path ratio close to 1 for large-scale intermittency. Investigation of higher order transport moments (kurtosis) indicates that non-Gaussian statistical properties of the intermittent turbulent magnetic field are present in the parallel transport, especially for low rigidity particles at all times.

79 ASTRONOMY AND ASTROPHYSICS↗

SimpleSSD: Modeling Solid State Drives for Holistic System Simulation

Existing solid state drive (SSD) simulators unfortunately lack hardware and/or software architecture models. Consequently, they are far from capturing the critical features of contemporary SSD devices. More importantly, while the performance of modern systems that adopt SSDs can vary based on their numerous internal design parameters and storage-level configurations, a full system simulation with traditional SSD models often requires unreasonably long runtimes and excessive computational resources. In this work, we propose SimpleSSD, a high-fidelity simulator that models all detailed characteristics of hardware and software, while simplifying the nondescript features of storage internals. In contrast to existing SSD simulators, SimpleSSD can easily be integrated into publicly-available full system simulators. Here, in addition, it can accommodate a complete storage stack and evaluate the performance of SSDs along with diverse memory technologies and microarchitectures. Thus, it facilitates simulations that explore the full design space at different levels of system abstraction.

97 MATHEMATICS AND COMPUTING↗

The Integrated Plasma Simulator: A Flexible Python Framework for Coupled Multiphysics Simulation

High-fidelity coupled multiphysics simulations are an increasingly important aspect of computational science. In many domains, however, there has been very limited experience with simulations of this sort, therefore research in coupled multiphysics often requires computational frameworks with significant flexibility to respond to the changing directions of the physics and mathematics. This paper presents the Integrated Plasma Simulator (IPS), a framework designed for loosely coupled simulations of fusion plasmas. The IPS provides users with a simple component architecture into which a wide range of existing plasma physics codes can be inserted as components. Simulations can take advantage of multiple levels of parallelism supported in the IPS, and can be controlled by a high-level ``driver'' component, or by other coordination mechanisms, such as an asynchronous event service. We describe the requirements and design of the framework, and how they were implemented in the Python language. We also illustrate the flexibility of the framework by providing examples of different types of simulations that utilize various features of the IPS.

99 GENERAL AND MISCELLANEOUS↗

Simulated Fuel Economy and Emissions Performance during City and Interstate Driving for a Heavy-Duty Hybrid Truck

We compare simulated fuel economy and emissions for both conventional and hybrid class 8 heavy-duty diesel trucks operating over multiple urban and highway driving cycles. Both light and heavy freight loads were considered, and all simulations included full aftertreatment for NOx and particulate emissions controls. The aftertreatment components included a diesel oxidation catalyst (DOC), urea-selective catalytic NOx reduction (SCR), and a catalyzed diesel particulate filter (DPF). Our simulated hybrid powertrain was configured with a pre-transmission parallel drive, with a single electric motor between the clutch and gearbox. A conventional HD truck with equivalent diesel engine and aftertreatment was also simulated for comparison. Our results indicate that hybridization can significantly increase HD fuel economy and improve emissions control in city driving. However, there is less potential hybridization benefit for HD highway driving. A major factor behind the reduced hybridization benefit for highway driving is that there are fewer opportunities to utilize regenerative breaking. Our aftertreatment simulations indicate that opportunities for passive DPF regeneration are much greater for both hybrid and conventional trucks during highway driving due to higher sustained exhaust temperatures. When passive DPF regeneration is extensively utilized, the fuel penalty for particulate control is virtually eliminated, except for the 0.4%-0.9% fuel penalty associated with the slightly higher exhaust backpressure.

Daw, C. Stuart↗

Scalable Implicit Solvers with Dynamic Mesh Adaptation for a Relativistic Drift-Kinetic Fokker–Planck–Boltzmann Model

In this work we consider a relativistic drift-kinetic model for runaway electrons along with a Fokker–Planck operator for small-angle Coulomb collisions, a radiation damping operator, and a secondary knock-on (Boltzmann) collision source. Here, we develop a new scalable fully implicit solver utilizing finite volume and conservative finite difference schemes and dynamic mesh adaptivity. A new data management framework in the PETSc library based on the p4est library is developed to enable simulations with dynamic adaptive mesh refinement (AMR), distributed memory parallelization, and dynamic load balancing of computational work. This framework and the runaway electron solver building on the framework are able to dynamically capture both bulk Maxwellian at the low-energy region and a runaway tail at the high-energy region. To effectively capture features via the AMR algorithm, a new AMR indicator prediction strategy is proposed that is performed alongside the implicit time evolution of the solution. This strategy is complemented by the introduction of computationally cheap feature-based AMR indicators that are analyzed theoretically. Numerical results quantify the advantages of the prediction strategy in better capturing features compared with nonpredictive strategies; and we demonstrate trade-offs regarding computational costs. The robustness with respect to model parameters, algorithmic scalability, and parallel scalability are demonstrated through several benchmark problems including manufactured solutions and solutions of different physics models. We focus on demonstrating the advantages of using implicit time stepping and AMR for runaway electron simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

penORNL: a parallel Monte Carlo photon and electron transport package using PENELOPE

The parallel Monte Carlo photon and electron transport code package penORNL was developed at Oak Ridge National Laboratory to enable advanced scanning electron microscope (SEM) simulations on high-performance computing systems. This paper discusses the implementations, capabilities and parallel performance of the new code package. penORNL uses PENELOPE for its physics calculations and provides all available PENELOPE features to the users, as well as some new features including source definitions specifically developed for SEM simulations, a pulse-height tally capability for detailed simulations of gamma and x-ray detectors, and a modified interaction forcing mechanism to enable accurate energy deposition calculations. The parallel performance of penORNL was extensively tested with several model problems, and very good linear parallel scaling was observed with up to 512 processors. penORNL, along with its new features, will be available for SEM simulations upon completion of the new pulse-height tally implementation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Performance portability study for massively parallel computational fluid dynamics application on scalable heterogeneous architectures

Patient-specific hemodynamic simulations have the possibility to greatly improve both the diagnosis and treatment of a variety of vascular diseases. Portability will enable wider adoption of computational fluid dynamics (CFD) applications in the biomedical research community and targeting to platforms ideally suited to different vascular regions. Here, we introduce a case study in performance portability that assesses (1) the ease of porting an MPI application optimized for one specific architecture to new platforms using variants of hybrid MPI+X programming models; (2) performance portability seen when simulating blood flow in three different vascular regions on diverse heterogeneous architectures; (3) model-based performance prediction for future architectures; and (4) performance scaling of the hybrid MPI+X programming on parallel heterogeneous systems. We report on the lessons learned in porting HARVEY, a massively parallel CFD application, from traditional multicore CPUs to diverse heterogeneous architectures ranging from NVIDIA/AMD GPUs to Intel MICs and Altera FPGAs.

97 MATHEMATICS AND COMPUTING↗

Phase-field-crystal study of grain boundary premelting and shearing in bcc iron

Here, we use the phase-field-crystal (PFC) method to investigate the equilibrium premelting and nonequilibrium shearing behaviors of [001] symmetric tilt grain boundaries (GBs) at high homologous temperature over the complete range of misorientation 0 < θ < 90° in classical models of bcc Fe. We characterize the dependence of the premelted layer width W as a function of temperature and misorientation. In addition, we compute the thermodynamic disjoining potential whose derivative with respect to W represents the structural force between crystal-melt interfaces due to the spatial overlap of density waves. The disjoining potential is also computed by molecular dynamics (MD) simulations, for quantitative comparison with PFC simulations, and coarse-grained amplitude equations (AE) derived from PFC that provide additional analytical insights. We find that, for GBs over an intermediate range of misorientation (θ min < θ < θ max ), W diverges as the melting temperature is approached from below, corresponding to a purely repulsive disjoining potential, while for GBs outside this range (θ < θ min or θ max < θ < 90°) W remains finite at the melting point. In the latter case, W corresponds to a shallow attractive minimum of the disjoining potential. The misorientation range where W diverges predicted by PFC simulations is much smaller than the range predicted by MD simulations when the small dimensionless parameter ε of the PFC model is matched to liquid structure factor properties. However, it agrees well with MD simulations with a lower ε value chosen to match the ratio of bulk modulus and solid-liquid interfacial free energy, consistent with the amplitude-equation prediction that θ min and 90° – θ max scale as ~ ε 1/2 . The incorporation of thermal fluctuations in PFC is found to have a negligible effect on this range. In response to a shear stress parallel to the GB plane, GBs in PFC simulations exhibit coupled motion normal to this plane or sliding. Furthermore, the coupling factor exhibits a discontinuous change as a function of θ that reflects a transition between two coupling modes.

36 MATERIALS SCIENCE↗

FIRE HOSE INSTABILITY DRIVEN BY ALPHA PARTICLE TEMPERATURE ANISOTROPY

We investigate properties of a solar wind-like plasma, including a secondary alpha particle population exhibiting a parallel temperature anisotropy with respect to the background magnetic field, using linear and quasi-linear predictions and by means of one-dimensional hybrid simulations. We show that anisotropic alpha particles can drive a parallel fire hose instability analogous to that generated by protons, but that, remarkably, can also be triggered when the parallel plasma beta of alpha particles is below unity. The wave activity generated by the alpha anisotropy affects the evolution of the more abundant protons, leading to their anisotropic heating. When both ion species have sufficient parallel anisotropies, both of them can drive the instability, and we observe the generation of two distinct peaks in the spectra of the fluctuations, with longer wavelengths associated to alphas and shorter ones to protons. If a non-zero relative drift is present, the unstable modes propagate preferentially in the direction of the drift associated with the unstable species. The generated waves scatter particles and reduce their temperature anisotropy to a marginally stable state, and, moreover, they significantly reduce the relative drift between the two ion populations. The coexistence of modes excited by both species leads to saturation of the plasma in distinct regions of the beta/anisotropy parameter space for protons and alpha particles, in good agreement with in situ solar wind observations. Our results confirm that fire hose instabilities are likely at work in the solar wind and limit the anisotropy of different ion species in the plasma.

79 ASTRONOMY AND ASTROPHYSICS↗

FROSch Preconditioners for Land Ice Simulations of Greenland and Antarctica

Numerical simulations of Greenland and Antarctic ice sheets involve the solution of large-scale highly nonlinear systems of equations on complex shallow geometries. This work is concerned with the construction of Schwarz preconditioners for the solution of the associated tangent problems, which are challenging for solvers mainly because of the strong anisotropy of the meshes and wildly changing boundary conditions that can lead to poorly constrained problems on large portions of the domain. In this study, two-level generalized Dryja--Smith--Widlund (GDSW)--type Schwarz preconditioners are applied to different land ice problems, i.e., a velocity problem, a temperature problem, as well as the coupling of the former two problems. We employ the message passing interface (MPI)--parallel implementation of multilevel Schwarz preconditioners provided by the package FROSch (fast and robust Schwarz) from the Trilinos library. The strength of the proposed preconditioner is that it yields out-of-the-box scalable and robust preconditioners for the single physics problems. To the best of our knowledge, this is the first time two-level Schwarz preconditioners have been applied to the ice sheet problem and a scalable preconditioner has been used for the coupled problem. The preconditioner for the coupled problem differs from previous monolithic GDSW preconditioners in the sense that decoupled extension operators are used to compute the values in the interior of the subdomains. Additionally, several approaches for improving the performance, such as reuse strategies and shared memory OpenMP parallelization, are explored. In our numerical study we target both uniform meshes of varying resolution for the Antarctic ice sheet as well as nonuniform meshes for the Greenland ice sheet. We present several weak and strong scaling studies confirming the robustness of the approach and the parallel scalability of the FROSch implementation. Among the highlights of the numerical results are a weak scaling study for up to 32,K processor cores (8,K MPI ranks and 4 OpenMP threads) and 566,M degrees of freedom for the velocity problem as well as a strong scaling study for up to 4,K processor cores (and MPI ranks) and 68,M degrees of freedom for the coupled problem.

97 MATHEMATICS AND COMPUTING↗

FROSch Preconditioners for Land Ice Simulations of Greenland and Antarctica

Numerical simulations of Greenland and Antarctic ice sheets involve the solution of large-scale highly nonlinear systems of equations on complex shallow geometries. This work is concerned with the construction of Schwarz preconditioners for the solution of the associated tangent problems, which are challenging for solvers mainly because of the strong anisotropy of the meshes and wildly changing boundary conditions that can lead to poorly constrained problems on large portions of the domain. Here, two-level GDSW (Generalized Dryja–Smith–Widlund) type Schwarz preconditioners are applied to different land ice problems, i.e., a velocity problem, a temperature problem, as well as the coupling of the former two problems. We employ the MPI-parallel implementation of multi-level Schwarz preconditioners provided by the package FROSch (Fast and Robust Schwarz)from the Trilinos library. The strength of the proposed preconditioner is that it yields out-of-the-box scalable and robust preconditioners for the single physics problems. To our knowledge, this is the first time two-level Schwarz preconditioners are applied to the ice sheet problem and a scalable preconditioner has been used for the coupled problem. The pre-conditioner for the coupled problem differs from previous monolithic GDSW preconditioners in the sense that decoupled extension operators are used to compute the values in the interior of the sub-domains. Several approaches for improving the performance, such as reuse strategies and shared memory OpenMP parallelization, are explored as well. In our numerical study we target both uniform meshes of varying resolution for the Antarctic ice sheet as well as non uniform meshes for the Greenland ice sheet are considered. We present several weak and strong scaling studies confirming the robustness of the approach and the parallel scalability of the FROSch implementation. Among the highlights of the numerical results are a weak scaling study for up to 32 K processor cores (8 K MPI-ranks and 4 OpenMP threads) and 566 M degrees of freedom for the velocity problem as well as a strong scaling study for up to 4 K processor cores (and MPI-ranks) and 68 M degrees of freedom for the coupled problem.

58 GEOSCIENCES↗

Monte Carlo calculations of electron beam quality conversion factors for several ion chamber types

Purpose: To provide a comprehensive investigation of electron beam reference dosimetry using Monte Carlo simulations of the response of 10 plane-parallel and 18 cylindrical ion chamber types. Specific emphasis is placed on the determination of the optimal shift of the chambers’ effective point of measurement (EPOM) and beam quality conversion factors. Methods: The EGSnrc system is used for calculations of the absorbed dose to gas in ion chamber models and the absorbed dose to water as a function of depth in a water phantom on which cobalt-60 and several electron beam source models are incident. The optimal EPOM shifts of the ion chambers are determined by comparing calculations of R{sub 50} converted from I{sub 50} (calculated using ion chamber simulations in phantom) to R{sub 50} calculated using simulations of the absorbed dose to water vs depth in water. Beam quality conversion factors are determined as the calculated ratio of the absorbed dose to water to the absorbed dose to air in the ion chamber at the reference depth in a cobalt-60 beam to that in electron beams. Results: For most plane-parallel chambers, the optimal EPOM shift is inside of the active cavity but different from the shift determined with water-equivalent scaling of the front window of the chamber. These optimal shifts for plane-parallel chambers also reduce the scatter of beam quality conversion factors, k{sub Q}, as a function of R{sub 50}. The optimal shift of cylindrical chambers is found to be less than the 0.5 r{sub cav} recommended by current dosimetry protocols. In most cases, the values of the optimal shift are close to 0.3 r{sub cav}. Values of k{sub ecal} are calculated and compared to those from the TG-51 protocol and differences are explained using accurate individual correction factors for a subset of ion chambers investigated. High-precision fits to beam quality conversion factors normalized to unity in a beam with R{sub 50} = 7.5 cm (k{sub Q}{sup ′}) are provided. These factors avoid the use of gradient correction factors as used in the TG-51 protocol although a chamber dependent optimal shift in the EPOM is required when using plane-parallel chambers while no shift is needed with cylindrical chambers. The sensitivity of these results to parameters used to model the ion chambers is discussed and the uncertainty related to the practical use of these results is evaluated. Conclusions: These results will prove useful as electron beam reference dosimetry protocols are being updated. The analysis of this work indicates that cylindrical ion chambers may be appropriate for use in low-energy electron beams but measurements are required to characterize their use in these beams.

07 ISOTOPE AND RADIATION SOURCES↗

ParaDyn Implementation in the US Navy's DYSMAS Simulation System: FY08 Progress Report

The goal of this project is to increase the computational efficiency and capacity of the Navy's DYSMAS simulation system for full ship shock response to underwater explosion. Specifically, this project initiates migration to a parallel processing capability for the structural portion of the overall fluid-structure interaction model. The capstone objective for the first phase is to demonstrate operation of the DYSMAS simulation engine with a production model on a Naval Surface Warfare Center (IHD) parallel platform using the ParaDyn code for parallel processing of the structural dynamics. This year saw a successful launch to integrate ParaDyn, the high-parallel structural dynamics code from Lawrence Livermore National Laboratory (LLNL), into the DYSMAS system for simulating the response of ship structures to underwater explosion (UNDEX). The current LLNL version of DYNA3D, representing ten years of general development beyond the source branch used to initiate DYNA-N customization for DYSMAS, was first connected to the GEMINI flow code through DYSMAS Standard Coupler Interface (SCI). This permitted an early 'sanity check' by Naval Surface Warfare Center, Indian Head Division (NSWC-IHD) personnel that equivalent results were generated for their standard UNDEX test problems, thus ensuring the Verification & Validation pedigree they have developed remains intact. The ParaDyn code was then joined to the SCI in a manner requiring no changes to GEMINI. Three NSWC-IHD engineers were twice hosted at LLNL to become familiar with LLNL computer systems, the execution of the prototype software system, and to begin assessment of its accuracy and performance. Scaling data for the flow solver GEMINI was attained up to a one billion cell, 1000 processor run. The NSWC-IHD engineers were granted privileges to continue their evaluations through remote connections to LLNL's Open Computing Facility. Finally, the prototype changes were integrated into the mainline ParaDyn source repository and issued as part of its Version 8.1 beta release. This source was transmitted to NSWC-IHD and in collaboration with LLNL personnel the entire ParaDyn software suite successfully installed and demonstrated on its new SGI Altix machine. The ability of even minor numbers of processors for the structural dynamics to impact overall time-to-solution for DYSMAS has been demonstrated. Assessments of combined parallel efficiencies are beginning to highlight areas for further DYSMAS optimizations.

42 ENGINEERING↗