SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This dataset accompanies the publication "GenASiS: General Astrophysical Simulation System. II. Self-gravitating Baryonic Matter." This dataset contains simulation outputs from GenASiS for the test problems described in that publication.
This dataset accompanies the publication "GenASiS: General Astrophysical Simulation System. II. Self-gravitating Baryonic Matter." This dataset contains simulation outputs from GenASiS described in the Appendix of that publication.
GenASiS (General Astrophysical Simulation System) is a code being developed initially and primarily, though not exclusively, for the simulation of core-collapse supernovae on the world's leading capability supercomputers. This paper---the second in a series---documents capabilities for Newtonian self-gravitating fluid dynamics, including tabulated microphysical equations of state treating nuclei and nuclear matter (`baryonic matter'). Computation of the gravitational potential of a spheroid, and simulation of the gravitational collapse of dust and of an ideal fluid, provide tests of self-gravitation against known solutions. In multidimensional computations of the adiabatic collapse, bounce, and explosion of spherically symmetric pre-supernova progenitors---which we propose become a standard benchmark for code comparisons---we find that the explosions are prompt and remain spherically symmetric (as expected), with an average shock expansion speed and total kinetic energy that are inversely correlated with the progenitor mass at the onset of collapse and the compactness parameter.
We add an ensemble of nuclei to the equation of state for homogeneous nucleonic matter to generate a new set of models suitable for astrophysical simulations of core-collapse supernovae and neutron star mergers. We implement empirical constraints from (i) nuclear mass measurements, (ii) proton-proton scattering phase shifts, and (iii) neutron star observations. Our model is also guided by microscopic many-body theory calculations based on realistic nuclear forces, including the zero-temperature neutron matter equation of state from quantum Monte Carlo simulations and thermal contributions to the free energy from finite-temperature many-body perturbation theory. We ensure that the parameters of our model can be varied while preserving thermodynamic consistency and the connection to experimental or observational data, thus providing a probability distribution of the astrophysical hot and dense matter equation of state. Furthermore, we compare our results with those obtained from other available equations of state. While our probability distributions indeed represent a large number of possible equations of state, we cannot yet claim to have fully explored all of the uncertainties, especially with regard to the structure of nuclei in the hot and dense medium.
We present efforts at improving the performance of FLASH, a multi-scale, multi-physics simulation code principally for astrophysical applications, by using huge pages on Ookami, an HPE Apollo 80 A64FX platform. FLASH is written principally in modern Fortran and makes use of the PARAMESH library to manage a block-structured adaptive mesh. We explored options for enabling the use of huge pages with several compilers, but we were only able to successfully use huge pages when compiling with the Fujitsu compiler. As a result, the use of huge pages substantially reduced the number of translation lookaside buffer misses, but overall performance gains were marginal.
Abstract We present an extension of the massively parallel, GPU native, astrophysical hydrodynamics code Cholla to magnetohydrodynamics (MHD). Cholla solves the ideal MHD equations in their Eulerian form on a static Cartesian mesh utilizing the Van Leer + constrained transport integrator, the HLLD Riemann solver, and reconstruction methods at second and third order. Cholla’s MHD module can perform ≈260 million cell updates per GPU-second on an NVIDIA A100 while using the HLLD Riemann solver and second order reconstruction. The inherently parallel nature of GPUs combined with increased memory in new hardware allows Cholla’s MHD module to perform simulations with resolutions ∼500 3 cells on a single high-end GPU (e.g., an NVIDIA A100 with 80 GB of memory). We employ GPU direct Message Passing Interface to attain excellent weak scaling on the exascale supercomputer Frontier, while using 74,088 GPUs and simulating a total grid size of over 7.2 trillion cells. A suite of test problems highlights the accuracy of Cholla’s MHD module and demonstrates that zero magnetic divergence in solutions is maintained to round off error. We also present new testing and CI tools using GoogleTest, GitHub Actions, and Jenkins that have made development more robust and accurate and ensure reliability in the future.
High-order Godunov methods for gas dynamics have become a standard tool for simulating different classes of astrophysical flows. Their accuracy is mostly determined by the spatial interpolant used to reconstruct the pair of Riemann states at cell interfaces and by the Riemann solver that computes the interface fluxes. In most Godunov-type methods, these two steps can be treated independently, so that many different schemes can in principle be built from the same numerical framework. Because astrophysical simulations often test out the limits of what is feasible with the computational resources available, it is essential to find the scheme that produces the numerical solution with the desired accuracy at the lowest computational cost. However, establishing the best combination of numerical options in a Godunov-type method to be used for simulating a complex hydrodynamic problem is a nontrivial task. In fact, formally more accurate schemes do not always outperform simpler and more diffusive methods, especially if sharp gradients are present in the flow. For this work, we used our fully compressible Seven-League Hydro (SLH) code to test the accuracy of six reconstruction methods and three approximate Riemann solvers on two- and three-dimensional (2D and 3D) problems involving subsonic flows only. We considered Mach numbers in the range from 10 −3 to 10 −1 , which are characteristic of many stellar and geophysical flows. In particular, we considered a well-posed, 2D, Kelvin–Helmholtz instability problem and a 3D turbulent convection zone that excites internal gravity waves in an overlying stable layer. Although the different combinations of numerical methods converge to the same solution with increasing grid resolution for most of the quantities analyzed here, we find that (i) there is a spread of almost four orders of magnitude in computational cost per fixed accuracy between the methods tested in this study, with the most performant method being a combination of a low-dissipation Riemann solver and a sextic reconstruction scheme; (ii) the low-dissipation solver always outperforms conventional Riemann solvers on a fixed grid when the reconstruction scheme is kept the same; (iii) in simulations of turbulent flows, increasing the order of spatial reconstruction reduces the characteristic dissipation length scale achieved on a given grid even if the overall scheme is only second order accurate; (iv) reconstruction methods based on slope-limiting techniques tend to generate artificial, high-frequency acoustic waves during the evolution of the flow; and (v) unlimited reconstruction methods introduce oscillations in the thermal stratification near the convective boundary, where the entropy gradient is steep.
Turbulence is a key process in many fields of astrophysics. Advances in numerical simulations of fluids over the last several decades have revolutionized our understanding of turbulence and related processes such as star formation and cosmic ray propagation. However, data from numerical simulations of astrophysical turbulence are often not made public. We introduce a new simulation-oriented database for the astronomical community: the Catalogue for Astrophysical Turbulence Simulations (CATS), located at www.mhdturbulence.com. CATS includes magnetohydrodynamic (MHD) turbulent box simulation data products generated by the public codes athena++, arepo, enzo, and flash. CATS also includes several synthetic observational data sets, such as turbulent HI data cubes. We also include measured power spectra and three-point correlation functions from some of these data. We discuss the importance of open-source statistical and visualization tools for the analysis of turbulence simulations such as those found in CATS.
Modern astrophysical simulation codes employ a variety of numerical algorithms capable of achieving higher-order accuracy in both space and time. Albeit they succeed in achieving an effective higher spatial resolution and in suppressing the numerical damping of waves, to our knowledge, all current astrophysical simulations invoking self-gravity are limited to second-order accuracy in space. If we can devise an algorithm to evaluate self-gravity with a higher-order spatial accuracy, we can better the evaluation of the gravitational acceleration and gravitational energy release which dictate the evolution of many astrophysical systems. Herein, we present a numerical algorithm for self-gravitating hydrodynamics capable of achieving fourth-order accuracy for a given density distribution on a Cartesian uniform grid. First, we derive the cell-averaged gravitational potential at fourth-order accuracy from the cell-averaged density by solving the Poisson equation. Next, we obtain the cell average of the product of the density and gravitational acceleration, which differs from the cell-averaged density multiplied by the cell-averaged gravitational acceleration. We then show the verification of the algorithm by applying it to critical test problems: (1) maintaining equilibria of self-gravitating slabs, even upon advection, (2) evolving a polytropic sphere with a massive power-law envelope, and (3) conservation of specific entropy during the propagation of a sound wave.
Modern astrophysical simulation codes employ a variety of numerical algorithms capable of achieving higher-order accuracy in both space and time. Albeit they succeed in achieving an effective higher spatial resolution and in suppressing the numerical damping of waves, to our knowledge, all current astrophysical simulations invoking self-gravity are limited to second-order accuracy in space. If we can devise an algorithm to evaluate self-gravity with a higher-order spatial accuracy, we can better the evaluation of the gravitational acceleration and gravitational energy release which dictate the evolution of many astrophysical systems. Herein, we present a numerical algorithm for self-gravitating hydrodynamics capable of achieving fourth order accuracy for a given density distribution on a Cartesian uniform grid. First, we derive the cell-averaged gravitational potential at fourth-order accuracy from the cell-averaged density by solving the Poisson equation. Next, we obtain the cell average of the product of the density and gravitational acceleration, which differs from the cell-averaged density multiplied by the cell-averaged gravitational acceleration. We then show the verification of the algorithm by applying it to critical test problems: (1) maintaining equilibria of self-gravitating slabs, even upon advection, (2) evolving a polytropic sphere with a massive power-law envelope, and (3) conservation of specific entropy during the propagation of a sound wave.
Nyx is a highly parallel, adaptive mesh, finite-volume N-body compressible hydrodynamics solver for cosmological simulations. It has been used to simulate different cosmological scenarios with a recent focus on the intergalactic medium and Lyman alpha forest. Together, Nyx, the compressible astrophysical simulation code, Castro, and the low Mach number code MAESTROeX, make up the AMReX-Astrophysics Suite of open-source, adaptive mesh, performance-portable astrophysical simulation codes. Other examples of cosmological simulation research codes include Enzo, Enzo-P/Cello, RAMSES, ART, FLASH, Cholla, as well as Gadget, Gasoline, Arepo, Gizmo, and SWIFT.
Neutron star mergers are an important source of information for nuclear physics. Except for black holes, neutron stars are the densest macroscopic objects known to exist in the Universe. They provide us with a remarkable laboratory to study the poorly understood high-density states of matter, complementing the study of heavy nuclei performed by nuclear physics experiments on Earth. Collisions of neutron stars are of particular interest. They are among the most energetic events observable in the Universe, powering a broad range of signals across the electromagnetic spectrum as well as gravitational wave signals. These signals contain important information about the properties of extremely dense matter. Colliding neutron stars additionally eject large amounts of neutron-rich material into the surrounding interstellar medium -- material that then undergoes rapid neutron-capture (r-process) nucleosynthesis, the mechanism thought to be responsible for the production of about half of the heavy nuclei. In order to understand current and future observations of neutron star mergers, we need reliable models for the signals that they power. An important component in the construction of such models are numerical simulations of colliding neutron stars. These simulations are costly, running for multiple months on supercomputers, and require the inclusion of complex physics (general relativity, magnetohydrodynamics, neutrino physics, nuclear reactions). In this document, we describe the development of new methods for the treatment of neutrinos in merger simulations, as well as the first simulations capable of evolving the equations of neutrino radiation transport directly and their impact on our understanding of neutron star mergers and more broadly in nuclear astrophysics. We also discuss additional work performed in the study of nucleosynthesis and neutrino physics in neutron star mergers as part of Early Career Award DE-SC0020435.
The ExaStar project aims to deliver an efficient, versatile, and portable software ecosystem for multi-physics astrophysics simulations run on exascale machines. The code suite is a component-based multi-physics toolkit, built on the capabilities of current simulation codes (in particular Flash-X and Castro), and based on the massively parallel adaptive mesh refinement framework AMReX. It includes modules for hydrodynamics, advanced radiation transport, thermonuclear kinetics, and nuclear microphysics. The code will reach exascale efficiency by building upon current multi- and many-core packages integrated into an orchestration system that uses a combination of configuration tools, code translators, and a domain-specific asynchronous runtime to manage performance across a range of platform architectures. The target science includes multi-physics simulations of astrophysical explosions (such as supernovae and neutron star mergers) to understand the cosmic origin of the elements and the fundamental physics of matter and neutrinos under extreme conditions.
Zernike polynomials serve as an orthogonal basis on the unit disc, and have proven to be effective in optics simulations, astrophysics, and more recently in plasma simulations. Unlike Bessel functions, Zernike polynomials are inherently finite and smooth at the disc center (r=0), ensuring continuous differentiability along the axis. This property makes them particularly suitable for simulations, requiring no additional handling at the origin. We developed ZERNIPAX, an open-source Python package capable of utilizing CPU/GPUs, leveraging Google's JAX package and available on GitHub as well as the Python software repository PyPI. Furthermore, our implementation of the recursion relation between Jacobi polynomials significantly improves computation time compared to alternative methods by use of parallel computing while still performing more accurately for high-mode numbers.
In this work, we present a suite of high-resolution cosmological zoom-in simulations to z = 4 of a 10 12 M⊙ halo at z = 0, obtained using seven contemporary astrophysical simulation codes (Art-I, Enzo, Ramses, Changa, Gadget-3, Gear, and Gizmo) widely used in the numerical galaxy formation community. The physics prescriptions for gas cooling and heating and star formation are the same as the ones used in our previous Assembling Galaxies of Resolved Anatomy (AGORA) disk comparison but now account for the effects of cosmological processes such as the expansion of the universe, intergalactic gas inflow, and the cosmic ultraviolet background radiation emitted by massive stars and quasars. In this work, we introduce the most careful comparison yet of galaxy formation simulations run by different code groups, together with a series of four calibration steps each of which is designed to reduce the number of tunable simulation parameters adopted in the final run. In the first two steps, we methodically calibrate the gas physics, such as cooling and heating, in simulations without star formation. In the third step, we seek agreement on the total stellar mass produced with the common star formation prescription used in the AGORA disk comparison, in stellar-feedback-free simulations. In the last calibration step, we activate stellar feedback, where each code group is asked to set the feedback prescription to as close to the most widely used one in its code community as possible, while aiming for convergence in the stellar mass at z = 4 to the values predicted by semiempirical models. After all the participating code groups successfully complete the calibration steps, we achieve a suite of cosmological simulations with similar mass assembly histories down to z = 4. With numerical accuracy that resolves the internal structure of a target halo (≲100 physical pc at z = 4), we find that the codes overall agree well with one another, e.g., in gas and stellar properties, but also show differences, e.g., in circumgalactic medium (CGM) properties. We argue that, if adequately tested in accordance with our proposed calibration steps and common parameters, high-resolution cosmological zoom-in simulations can have robust and reproducible results. New code groups are invited to join and enrich this comparison by generating equivalent models or to test the code's compatibility on their own, by adopting the common initial conditions, the common easy-to-implement physics package, and the proposed calibration steps. Further analyses of the zoom-in simulations presented here will be presented in forthcoming reports from the AGORA Collaboration, including studies of the CGM, simulations by additional codes, and results at lower redshift.
General relativistic magnetohydrodynamic (GRMHD) simulations have revolutionized our understanding of black hole accretion. Here, we present a GPU-accelerated GRMHD code H-AMR with multifaceted optimizations that, collectively, accelerate computation by 2–5 orders of magnitude for a wide range of applications. First, it introduces a spherical grid with 3D adaptive mesh refinement that operates in each of the three dimensions independently. This allows us to circumvent the Courant condition near the polar singularity, which otherwise cripples high-resolution computational performance. Second, we demonstrate that local adaptive time stepping on a logarithmic spherical-polar grid accelerates computation by a factor of ≲10 compared to traditional hierarchical time-stepping approaches. Jointly, these unique features lead to an effective speed of ~10 9 zone cycles per second per node on 5400 NVIDIA V100 GPUs (i.e., 900 nodes of the OLCF Summit supercomputer). We illustrate H-AMR's computational performance by presenting the first GRMHD simulation of a tilted thin accretion disk threaded by a toroidal magnetic field around a rapidly spinning black hole. With an effective resolution of 13,440 × 4608 × 8092 cells and a total of ≲22 billion cells and ~0.65 × 10 8 time steps, it is among the largest astrophysical simulations ever performed. We find that frame dragging by the black hole tears up the disk into two independently precessing subdisks. The innermost subdisk rotation axis intermittently aligns with the black hole spin, demonstrating for the first time that such long-sought alignment is possible in the absence of large-scale poloidal magnetic fields.
We analyze and compare the satellite halo populations at z ~ 2 in the high-resolution cosmological zoom-in simulations of a 10 12 M ⊙ target halo (z = 0 mass) carried out on eight widely used astrophysical simulation codes (Art-I, Enzo, Ramses, Changa, Gadget-3, Gear, Arepo-t, and Gizmo) for the AGORA High-resolution Galaxy Simulations Comparison Project. We use slightly different redshift epochs near z = 2 for each code (hereafter "z ~ 2") at which the eight simulations are in the same stage in the target halo's merger history. After identifying the matched pairs of halos between the CosmoRun simulations and the DMO simulations, we discover that each CosmoRun halo tends to be less massive than its DMO counterpart. When we consider only the halos containing stellar particles at z ~ 2, the number of satellite galaxies is significantly fewer than that of dark matter halos in all participating AGORA simulations and is comparable to the number of present-day satellites near the Milky Way or M31. The so-called "missing satellite problem" is fully resolved across all participating codes simply by implementing the common baryonic physics adopted in AGORA and the stellar feedback prescription commonly used in each code, with sufficient numerical resolution (≲100 proper pc at z = 2). We also compare other properties such as the stellar mass–halo mass relation and the mass–metallicity relation. Our work highlights the value of comparison studies such as AGORA, where outstanding problems in galaxy formation theory are studied simultaneously on multiple numerical platforms.
We generate three families of extended covariant density functionals of nuclear matter that have varying slope of symmetry energy and skewness at nuclear saturation density, but otherwise share the same basic parameters (symmetry energy, compressibility, saturation parameters, etc.) with the standard DDME2, DD2, and MPE functionals. Tables of the parameters of these new density functionals are given, which can be straightforwardly used in DDME2, DD2, and MPE parameterization-based codes. Furthermore, we provide tables of a large number of equations of state (81 for each family) that can be used in astrophysical simulations to assess the impact of variations of the not-well-known slope of symmetry energy and skewness of nuclear systems on the astrophysics of compact objects. We also provide tables of computed integral parameters (mass, radius, and tidal deformability) that can be used, e.g., for modeling gravitational waveforms. Finally, for the extended DDME2-based parameterization, we implement a first-order phase transition to quark matter to obtain a family of equations of state that accommodates a phase transition to quark matter. Analogous tables of the equations of state and integral parameters are provided for this case as well.