Search NASA⌕ Search

Engineering topics

Dolence, Joshua C.

Publications and source records attributed to Dolence, Joshua C..

At least 19 records

Singularity-EOS: Performance Portable Equations of State and Mixed Cell Closures

We present Singularity-EOS, a new performance-portable library for equations of state and related capabilities. Singularity-EOS provides a large set of analytic equations of state, such as the Gruneisen equation of state, and tabulated equation of state data under a unified interface. It also provides support capabilities around these equations of state, such as Python wrappers, solvers for finding pressure-temperature equilibrium between multiple equations of state, and a unique modifier framework, allowing the user to transform a base equation of state, for example by shifting or scaling the specific internal energy. All capabilities are performance portable, meaning they compile and run on both CPU and GPU for a wide variety of architectures.

97 MATHEMATICS AND COMPUTING↗

A Shock Stabilization of the HLLC Riemann Solver for the Carbuncle Instability

The HLLC approximate Riemann solver improves upon the HLL Riemann solver by resolving contact discontinuities. This is a particularly desirable property for multi-material codes in which problems usually contain material interfaces. However, the HLLC solver is known to suffer from the carbuncle phenomenon, a numerical instability most apparent at grid-aligned shocks in multi-dimensional simulations. Many problems of interest, including high energy-density physics applications, require the accurate resolution of both material interfaces and hydrodynamic shocks. A variety of methods have been developed to cure this instability, with varying degrees of complexity. The objective of this work is to describe a simple approach to modify the HLLC Riemann solver and prevent the carbuncle instability. Here, the method is then demonstrated for assorted two-dimensional test problems known to exhibit the shock instability. The performance of the new solver is compared with that of the standard HLL and HLLC Riemann solvers.

97 MATHEMATICS AND COMPUTING↗

Parthenon—a performance portable block-structured adaptive mesh refinement framework

On the path to exascale the landscape of computer device architectures and corresponding programming models has become much more diverse. While various low-level performance portable programming models are available, support at the application level lacks behind. To address this issue, we present the performance portable block-structured adaptive mesh refinement (AMR) framework Parthenon, derived from the well-tested and widely used Athena++ astrophysical magnetohydrodynamics code, but generalized to serve as the foundation for a variety of downstream multi-physics codes. Parthenon adopts the Kokkos programming model, and provides various levels of abstractions from multidimensional variables, to packages defining and separating components, to launching of parallel compute kernels. Parthenon allocates all data in device memory to reduce data movement, supports the logical packing of variables and mesh blocks to reduce kernel launch overhead, and employs one-sided, asynchronous MPI calls to reduce communication overhead in multi-node simulations. Using a hydrodynamics miniapp, we demonstrate weak and strong scaling on various architectures including AMD and NVIDIA GPUs, Intel and AMD x86 CPUs, IBM Power9 CPUs, as well as Fujitsu A64FX CPUs. At the largest scale on Frontier (the first TOP500 exascale machine), the miniapp reaches a total of 1.7 × 10 13 zone-cycles/s on 9216 nodes (73,728 logical GPUs) at [Formula: see text] weak scaling parallel efficiency (starting from a single node). In combination with being an open, collaborative project, this makes Parthenon an ideal framework to target exascale simulations in which the downstream developers can focus on their specific application rather than on the complexity of handling massively-parallel, device-accelerated AMR.

97 MATHEMATICS AND COMPUTING↗

Spiner: Performance Portable Routines for Generic, Tabulated, Multi-Dimensional Data

We present Spiner, a new, performance-portable library for working with tabulated data. Spiner provides efficient routines for multi-dimensional interpolation and indexing on both CPUs and GPUs—as well as more exotic hardware—including interwoven interpolation and indexing access patterns, as needed for radiation transport. Importantly, Spiner defines a data format, based on HDF5, that couples the tabulated data to the information required to interpolate it, which Spiner can read and move to GPU.

97 MATHEMATICS AND COMPUTING↗

Computational Astrophysics in the Era of Technological Heterogeneity [Slides]

The HPC landscape is changing and we’re headed toward an era where compute specialization will be prevalent. There are opportunities for co-design that can influence this future. Technological heterogeneity will be a major challenge unless we shift our approach to developing the computational tools for astrophysics. Parthenon provides convenient functionality and a bright future for block structured AMR applications. Phoebus is a new (soon-to-be) open source code for relativistic astro that promises excellent performance, portability, and unique physics capabilities.

79 ASTRONOMY AND ASTROPHYSICS↗

iharm3D: Vectorized General Relativistic Magnetohydrodynamics

iharm3D is an open-source C code for simulating black hole accretion systems in arbitrary stationary spacetimes using ideal general-relativistic magnetohydrodynamics (GRMHD). It is an implementation of the HARM (“High Accuracy Relativistic Magnetohydrodynamics”) algorithm outlined in Gammie et al. (2003) with updates as outlined in McKinney & Gammie (2004) and Noble et al. (2006). The code is most directly derived from Ryan et al. (2015) but with radiative transfer portions removed. HARM is a conservative finite-volume scheme for solving the equations of ideal GRMHD, a hyperbolic system of partial differential equations, on a logically Cartesian mesh in arbitrary coordinates.

79 ASTRONOMY AND ASTROPHYSICS↗

The Ristra Project: FY20/21 Milestone Report

The ASC Advanced Technology Development and Mitigation (ATDM) sub-program was established in 2014 to develop new simulation tools operating on exascale-class computers to serve NNSA (see Appendix B). Over the course of ATDM, LANL management have set a strategy for exascale-class application codes that follows two supportive and mutually risk-mitigating paths: evolution for established production integrated design codes (IDCs) – with a strong pedigree within the user community – based upon existing programming paradigms(MPI+X); and a new start ATDM project, Ristra, a high-risk/high-reward push for a next-generation multi-physics, multi-scale simulation toolkit based on emerging advanced programming systems(with an initial focus on data-flow task-based models exemplified by Legion). The role of Ristra as the high-risk/high-reward path for LANL’s codes was fully consistent with the goals of ATDM as described in Appendix B, in particular its emphasis on evolving ASC capabilities through novel computing programming models and computing technologies.

97 MATHEMATICS AND COMPUTING↗

Full Transport General Relativistic Radiation Magnetohydrodynamics for Nucleosynthesis in Collapsars

We model a compact black hole-accretion disk system in the collapsar scenario with full transport, frequency dependent, general relativistic radiation magnetohydrodynamics. We examine whether or not winds from a collapsar disk can undergo rapid neutron capture (r-process) nucleosynthesis and significantly contribute to solar r-process abundances. We find the inclusion of accurate transport has significant effects on outflows, raising the electron fraction above ${Y}_{{\rm{e}}}\sim 0.3$ and preventing third-peak r-process material from being synthesized. We analyze the time evolution of neutrino processes and electron fraction in the disk and present a simple one-dimensional model for the vertical structure that emerges. Finally, we compare our simulation to semi-analytic expectations and argue that accurate neutrino transport and realistic initial and boundary conditions are required to capture the dynamics and nucleosynthetic outcome of a collapsar.

79 ASTRONOMY AND ASTROPHYSICS↗

MOCMC: Method of Characteristics Moment Closure, a Numerical Method for Covariant Radiation Magnetohydrodynamics

In this work, we present a conservative numerical method for radiation magnetohydrodynamics with frequency-dependent full transport in stationary spacetimes. This method is stable and accurate for both large and small optical depths and radiation pressures. The radiation stress–energy tensor is evolved in flux-conservative form, and closed with a swarm of samples that each transport a multigroup representation of the invariant specific intensity along a null geodesic. In each zone, the enclosed samples are used to efficiently construct a Delaunay triangulation of the unit sphere in the comoving frame, which in turn is used to calculate the Eddington tensor, average source terms, and adaptively refine the sample swarm. Furthermore, radiation four-forces are evaluated in the moment sector in a semi-implicit fashion. The radiative transfer equation is solved in invariant form deterministically for each sample. Since each sample carries a discrete representation of the full spectrum, the cost of evaluating the transport operator is independent of the number of frequency groups, representing a significant reduction of algorithmic complexity for transport in frequency-dependent problems. The major approximation we make in this work is performing scattering in an angle-averaged way. Local adaptivity in samples also makes this scheme more amenable to nonuniform meshes than a traditional Monte Carlo method. We describe the method and present results on a suite of test problems. We find that Method of Characteristics Moment Closure converges at least as ~N -1 , rather than the canonical Monte Carlo N -1/2 , where N is the number of samples per zone.

79 ASTRONOMY AND ASTROPHYSICS↗

Nucleosynthesis Probes of Cosmic Explosions [Slides]

GW170817 demonstrated the potential of GW+EM observations of NS mergers: most direct observation of r-process production to date. But what can we really learn from the observations. Getting from the observations to constraining properties of the merger ejecta requires multiple aspects of simulation (merger, disk calculations, and radiation flow) and physics (atomic, nuclear cross-section, dense nuclear matter, neutrino, …). Can we maximize what we can do with observations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A comparison of explosion energies for simulated and observed core-collapse supernovae

ABSTRACT There are now 20 multidimensional core-collapse supernova (CCSN) simulations that explode. However, these simulations have explosion energies that are a few times 1050 erg, not 1051 erg. In this manuscript, we compare the inferred explosion energies of these simulations and observations of 40 SN IIP. Assuming a lognormal distribution, the mean explosion energy for these observations is $\mu _{\rm obs} = -0.23^{+0.08}_{-0.12}$ ($\log _{10}(E/10^{51}\, {\rm erg})$) and the width is $\sigma _{\rm obs} = 0.52^{+0.09}_{-0.08}$. Only three CCSN codes have sufficient simulations to compare with observations: CHIMERA, CoCoNuT-FMT, and FORNAX. Currently, FORNAX has the largest sample of simulations. The two-dimensional FORNAX simulations show a correlation between explosion energy and progenitor mass, ranging from linear to quadratic, Esim ∝ M1 − 2; this correlation is consistent with inferences from observations. In addition, we infer the ratio of the observed-to-simulated explosion energies, Δ = log10(Eobs/Esim). For the CHIMERA set, Δ = 0.25 ± 0.07; for CoCoNuT-FMT, Δ = 0.49 ± 0.07; for FORNAX2D, Δ = 0.62 ± 0.06, and for FORNAX3D, Δ = 0.85 ± 0.07. On average, the simulations are less energetic than inferred energies from observations (Δ ≈ 0.6), but we also note that the variation among the simulations [max(Δ) − min(Δ) ≈ 0.6] is as large as this average offset. This suggests that further improvements to the simulations could resolve the discrepancy. Furthermore, both the simulations and observations are heavily biased. In this preliminary comparison, we model these biases, but to more reliably compare the explosion energies, we recommend strategies to unbias both the simulations and observations.

79 ASTRONOMY AND ASTROPHYSICS↗

Full transport model of GW170817-like disk produces a blue kilonova

The 2017 detection of the inspiral and merger of two neutron stars in gravitational waves and gamma rays was accompanied by a quickly reddening transient. Such a transient was predicted to occur following a rapid neutron capture (r-process) nucleosynthesis event, which synthesizes neutron-rich, radioactive nuclei and can take place in both dynamical ejecta and in the wind driven off the accretion torus formed after a neutron star merger. In this study, we present the first three-dimensional general relativistic, full transport neutrino radiation magnetohydrodynamics simulations of the black hole-accretion disk-wind system produced by the GW170817 merger. We show that the small but non-negligible optical depths lead to neutrino transport globally coupling the disk electron fraction, which we capture by solving the transport equation with a Monte Carlo method. The resulting absorption drives up the electron fraction in a structured, continuous outflow, with electron fraction as high as Y e ~ 0.4 in the extreme polar region. Finally, we show via nuclear reaction network and radiative transfer calculations that nucleosynthesis in the disk wind will produce a blue kilonova.

79 ASTRONOMY AND ASTROPHYSICS↗