Search NASA⌕ Search

SEARCH · Search NASA

Results for “SCALE Code System”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

GFiRe—Gauge Field integrator for Reheating

We present a new numerical algorithm and code, GFiRe, for solving the nonlinear evolution of Abelian gauge fields coupled to complex scalar fields in homogeneous and isotropic spacetimes. We adopt a hybrid approach to solving the system: the spatial derivatives are discretized using standard Lattice Gauge Field Theory techniques, whereas the time evolution of the fields and scale factor is implemented with explicit, composite, symplectic integrators. An important property of our compound algorithm is that the discretized Gauss constraint is respected exactly, regardless of the order of the symplectic integrator. This remains true even when the background expansion is computed “self-consistently”; that is, when the expansion history is computed using spatial averaged components of the energy momentum tensor in the simulation volume. Hence, our code can also be used in cases where the fields dominate the energy density of the universe, for example, during reheating after inflation. We test the algorithm in scenarios of reheating where the inflaton is a complex scalar field with a potential ∝(2|Φ| 2 - v 2 ) 2 and is coupled to an Abelian gauge field. Tracing the evolution of the system through complex dynamics (including resonant excitation of fields, backreaction, formation of solitons, and changes in the equation of state) in a self-consistently expanding universe, we find the energy conservation violation (<10 -4 ) to be very stable and the Gauss constraint violation (<10 -6 ) to be dominated by differencing noise.

79 ASTRONOMY AND ASTROPHYSICS↗

An OpenMP GPU-offload implementation of a non-equilibrium solidification cellular automata model for additive manufacturing

Here, in this paper, performance strategies on GPU-based HPC platforms of a cellular automata (CA) simulation code for non-equilibrium solidification, including nucleation, grain growth, solute partitioning and transport for the metal additive manufacturing (AM) process are investigated using OpenMP 4.5. To accurately report the speed-up for multicore CPUs and GPUs, a rigorous performance analysis employed optimizations appropriate for both CPU-only code (baseline) and GPU offload codes for an isothermal test problem. The performance results on Summit at the Oak Ridge Leadership Computing Facility indicate that using a precomputed list of interface cells significantly decreased the wall-clock time on GPUs. The speedup due to GPU acceleration was evaluated for a full Summit node and measured to be 1.8X when comparing a 6 MPI tasks run with 6 GPUs versus 36 MPI tasks on the CPU only. That speed-up was found to be 7.9X when comparing 6 MPI tasks with 6 GPUs versus the 6 MPI tasks running on the CPU only. Performance measurements showed that system total time is almost constant for runs with more than 96 MPI tasks (or GPUs), indicating that the GPU-accelerated code showed an excellent weak scaling performance. Finally, a rapid directional solidification problem was considered to demonstrate the CA code capability on Summit. It was found that a mesh size of at least 0.05 μm is recommended for the AM-like simulations in order to obtain accurate elongated grain microstructure and elongated subgrain features, which are in qualitative good agreement with experimental data. The results presented in this study indicate that the performance strategies on GPU-based HPC platforms for the CA code are appropriate for novel HPC exascale platforms.

36 MATERIALS SCIENCE↗

Identifying candidate structured RNAs in CRISPR operons

Noncoding RNAs with secondary structures play important roles in CRISPR-Cas systems. Many of these structures likely remain undiscovered. We used a large-scale comparative genomics approach to predict 156 novel candidate structured RNAs from 36,111 CRISPR-Cas systems. A number of these were found to overlap with coding genes, including palindromic candidates that overlapped with a variety of Cas genes in type I and III systems. Among these 156 candidates, we identified 46 new models of CRISPR direct repeats and 1 tracrRNA. This tracrRNA model occasionally overlapped with predicted cas9 coding regions, emphasizing the importance of expanding our search windows for novel structure RNAs in coding regions. We also demonstrated that the antirepeat sequence in this tracrRNA model can be used to accurately assign thousands of predicted CRISPR arrays to type II-C systems. This study highlights the importance of unbiased identification of candidate structured RNAs across CRISPR-Cas systems.

59 BASIC BIOLOGICAL SCIENCES↗

Quantum Dynamics at Scale: Ultrafast Control of Emergent Functional Materials

Confluence of extreme-scale quantum dynamics simulations (i.e. quantum@scale) and cutting-edge x-ray free-electron laser experiments are revolutionizing materials science. An archetypal example is the exciting concept of using picosecond light pulses to control emergent material properties on demand in atomically-thin layered materials. This paper describes efforts to scale our quantum molecular dynamics engine toward the United States' first exaflop/s computer, under an Aurora Early Science Program project named "Metascalable layered material genome". Key algorithmic and computing techniques incorporated are: (1) globally-scalable and locally-fast solvers within a linear-scaling divide-conquer-recombine algorithmic framework; (2) algebraic `BLASification' of computational kernels; and (3) data alignment and loop restructuring, along with register and cache blocking, for enhanced vectorization and efficient memory access. The resulting weak-scaling parallel efficiency was 0.93 on 131,072 Intel Xeon Phi cores for a 56.6 million atom (or 169 million valence-electron) system, whereas the various code transformations achieved 5-fold speedup. The optimized simulation engine allowed us for the first time to establish a significant effect of substrate on the dynamics of layered material upon electronic excitation.

Algebraic BLASification↗

Electric Grid Simulator For Human Factor Research

The developed code simulates real-time monitor and control for west area of IEEE 118-bus system. The 24-hour load profile for each bus is derived by scaling the system’s rated load in the PSSE sav file according to the California Independent System Operator’s Day-ahead load forecast for May 1, 2024. This simulator performs several critical functions: (1) Calculating time-series power flow every 4 seconds; (2) Updating and dispatching AGC signals every minute; (3) Conducting N-1 contingency analysis every 5 minutes. Additionally, the simulator can trip lines and subsequently update and dispatch AGC signals, running power flow analysis after each tripping event.

Huang, Jianqiao [Idaho National Laboratory (INL), ↗

Tech-X contributions to the Center for Tokamak Transients (CTTS) Scientific Discovery through Advanced Computing (SciDAC) project (Final Report)

The Center for Tokamak Transients Simulations (CTTS) consists of computational plasma physicists, computer scientists, and applied mathematicians who are together developing and applying simulation software to improve our understanding of and ability to predict and control transient events in tokamak discharges, particularly those that lead to violent disruptions. We have major simulation activities concerning disruptions that are caused by violating ideal MHD stability criteria, vertical displacement events, resistive wall modes, and tearing modes. We are performing comprehensive modeling of disruption mitigation techniques, particularly by shattered pellet injection (SPI). The Center is built around two mature extended MHD codes: NIMROD and M3D-C1. These codes are being extended in a number of ways as required by the demands of disruption modeling, and are being optimized to work well for larger problem size and modern computer architectures as required to model tokamak plasmas with realistic parameters over the required timescales. The codes will be coupled to the FronTier code for state-of-the-art modeling of SPI. Validation with experimental data on DIII-D, NSTX, and JET is being facilitated by rigorous uncertainty quantification (UQ). The high-level objectives of the center are to: (1) Develop better understanding and improved predictive capability of when crossing a linear stability boundary will likely lead to a disruption, (2) Provide a tool for calculating vessel forces, both axisymmetric and non-axisymmetric, for worst case VDE and other disruptions in tokamaks, (3) Develop increased understanding and improved predictive capability for locked mode disruptions and how best to avoid them, (4) Develop, verify, and validate 3D models for disruption mitigation by shattered pellets that can be used to design and optimize a system for future tokamaks, and (5) Increase the efficiency and scalability of the M3D-C1 and NIMROD codes so that they can model disruptions in ITER scale devices using the most powerful DOE HPC hardware, and (6) Demonstrate code-coupling via FronTier coupling with NIMROD and M3D-C1 and by interfacing these codes within a WDM framework.

97 MATHEMATICS AND COMPUTING↗

StreamGen: Connecting Populations of Streams and Shells to Their Host Galaxies

In this work, we study how the abundance and dynamics of populations of disrupting satellite galaxies change systematically as a function of host galaxy properties. We apply a theoretical model of the phase-mixing process to classify intact satellite galaxies and stellar streamlike and shell-like debris in ∼1500 Milky Way–mass systems generated by a semi-analytic galaxy formation code, SatGen. In particular, we test the effect of host galaxy halo mass, disk mass, ratio of disk scale height to length, and stellar feedback model on disrupting satellite populations. We find that the counts of tidal debris are consistent across all host galaxy models, within a given host mass range, and that all models can have streamlike debris on low-energy orbits, consistent with that observed around the Milky Way. However, we find a preference for streamlike debris on lower-energy orbits in models with a thicker (lower-density) host disk or on higher-energy orbits in models with a more massive host disk. Importantly, we observe significant halo-to-halo variance across all models. These results highlight the importance of simulating and observing large samples of Milky Way–mass galaxies and accounting for variations in host properties when using disrupting satellites in studies of near-field cosmology.

dark matter↗

HEP Software Foundation Community White Paper Working Group - Data Processing Frameworks

Data processing frameworks are an essential part of HEP experiments' software stacks. Frameworks provide a means by which code developers can undertake the essential tasks of physics data processing, accessing relevant inputs and storing their outputs, in a coherent way without needing to know the details of other domains. Frameworks provide essential core services for developers and help deliver a configurable working application to the experiments' production systems. Modern HEP processing frameworks are in the process of adapting to a new computing landscape dominated by parallel processing and heterogeneity, which pose many questions regarding enhanced functionality and scaling that must be faced without compromising the maintainability of the code. In this paper we identify a program of work that can help further clarify the key concepts of frameworks for HEP and then spawn R&D activities that can focus the community's efforts in the most efficient manner to address the challenges of the upcoming experimental program.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Analysis of SCALE Criticality and Sensitivity Calculations for Reflected HEU Cylinders [Slides]

The SCALE code package offers multiple nuclear data libraries supporting Monte Carlo transport, with sensitivity and uncertainty methods derived from MC transport solutions. Several libraries are multigroup, which introduce bias differing by system. Previous work has shown poor S/U results in several reflector materials: ICSBEP benchmark HMF-084 was selected to analyze biases and S/U method applicability to a variety of reflectors. Prior and ongoing work found inaccuracies in CSAS and TSUNAMI results, which were further investigated utilizing the HEU-MET-FAST-084 ICSBEP critical benchmark, chosen for its geometrical simplicity and variety of reflector materials. Perturbation of reflector thickness across various reflector materials allowed for an assortment of materials is to be tested swiftly for each sequence and method. Observation was an increasing bias of MG $k_{eff}$ relative to CE, in both direction and magnitude. IFP produced extremely reliable results. >85% of CLUTCH cases were found satisfactory.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

SPARC-X: Quantum simulations at extreme scale - reactive dynamics from first principles

We have developed the massively parallel electronic structure code SPARC-X: a computational framework for performing Kohn-Sham Density Functional Theory (DFT) calculations that can scale linearly with the number of atoms in the system, while being able to leverage petascale and emerging exascale parallel computers to study chemical phenomena at unprecedented length and time scales. SPARC-X exploits a recent breakthrough in electronic structure methodologies: systematically improvable, strictly local, orthonormal, discontinuous real-space bases that efficiently and systematically capture the local chemistry of the system. With further adaptation using new machine-learning techniques and the use of the massively parallel Spectral Quadrature (SQ) electronic structure method, the algorithmic complexity and prefactor associated with DFT calculations involving semilocal as well as hybrid functionals are dramatically reduced. Using petascale computational resources, SPARC-X enables quantum mechanical simulations at length and time scales previously accessible only by empirical approaches, e.g., 1,000,000 atoms for a few picoseconds using semilocal functionals or 1,000 atoms for a few picoseconds using hybrid functionals. Using exascale resources, the sizes and times targeted are two orders of magnitude larger. Such a capability has applications in a wide variety of chemical sciences, including reactive interfaces where large length- and/or long time-scales are needed and traditional force fields fail. This is particularly important in dynamic catalysis, where bond breaking and formation must be understood in detail. We developed, tested, and employed the SPARC-X framework to understand the photocatalytic properties of TiO 2 nanoparticles, revealing finite size effects that cannot be captured with standard model systems or functionals. This integrated development and application strategy ensures that SPARC-X remains a robust, efficient, and scalable software package for quantum simulations on current petascale and emerging exascale computing resources.

97 MATHEMATICS AND COMPUTING↗

An Extension of the Athena++ Code Framework for Radiation-magnetohydrodynamics in General Relativity Using a Finite-solid-angle Discretization

We extend the general-relativistic magnetohydrodynamics (GRMHD) capabilities of Athena++ to incorporate radiation. The intensity field in each finite-volume cell is discretized in angle, with explicit transport in both space and angle properly accounting for the effects of gravity on null geodesics, and with matter and radiation coupled in a locally implicit fashion. Here we describe the numerical procedure in detail, verifying its correctness with a suite of tests. Motivated in particular by black hole accretion in the high-accretion-rate, thin-disk regime, we demonstrate the application of the method to this problem. With excellent scaling on flagship computing clusters, the port of the algorithm to the GPU-enabled AthenaK code now allows the simulation of many previously intractable radiation-GRMHD systems.

79 ASTRONOMY AND ASTROPHYSICS↗

Microscale Mechanical‐Chemical Modeling of Granular Salt: Insights for Creep

Abstract Microscale numerical modeling is potentially an effective approach for understanding salt creep, but it is quite challenging because natural salt grain boundaries can have complex and evolving geometry, and because contacts between these deformable salt mineral grains are dynamic as a result of compaction, chemical reaction, fluid flow, and heat transfer. In this study, we have overcome these challenges and developed a new microscale mechanical‐chemical (MC) model to analyze creep of salt at the microscale, accounting for coupled deformation, dynamic contacts, and chemical reaction in granular systems with realistic geometric representations. The MC model was realized by linking a new microscale mechanical code based on the numerical manifold method (NMM) to a reactive transport code named Crunch. We simulated the processes of reorganization of the salt grains, microfracturing, and pressure solution that contribute to creep at larger scales. Based on this first quantitative microscale model, we found that sharp corners of mineral grains can dominate the contact dynamics, microfracturing, and pressure solution when salt is compacted, thus governing the structural changes and porosity loss of the system. We found that pressure solution, which preferentially dissolves sharp corners and edges, can lead to relatively high porosity loss in the system, thus playing an important role in the creep of salt. Our analysis shows that the dynamic changes of salt granular systems involving grain relocation and pressure solution can occur repeatedly and continuously, thus contributing to longer‐term creep of salt at larger scales.

58 GEOSCIENCES↗

MFIX-Exa: Performance prediction of multiphase energy conversion devices

MFIX-Exa targets the high-fidelity CFD-DEM model in which particles are unresolved by the fluid grid (typically using a fluid mesh approximately twice the particle diameter) but discrete particle dynamics including collisions are resolved with a simple linear-spring dashpot model. The fluid field is solved with a modern low Mach number formation of a cell-centered, nodal-pressure approximate projection method using a Godunov scheme . Physics capabilities include: complex geometries via embedded boundaries (EBs), open and closed system ideal gas equations of state, species transport and heterogeneous chemi- cal reactions. MFIX-Exa is built on the AMReX software framework, the ECP Block-Structured Adaptive Mesh Refinement (AMR) Co-Design Center, which allows the code to be portable and performant.Further integration into the ECP ecosystem includes HYPRE linear solvers and Ascent for in situ visualization. Current project efforts focus on scaling up realistic simulations to the KPP of the challenge problem: NETs 50kW chemical looping reactor, shakedown and scaling on JSLE and OLCF TDS systems and reaching for any remaining performance improvements.

Musser, Jordan↗

GPU-enabled extreme-scale turbulence simulations: Fourier pseudo-spectral algorithms at the exascale using OpenMP offloading

Fourier pseudo-spectral methods for nonlinear partial differential equations are of wide interest in many areas of advanced computational science, including direct numerical simulation of three-dimensional (3-D) turbulence governed by the Navier-Stokes equations in fluid dynamics. This paper presents a new capability for simulating turbulence at a new record resolution up to 35 trillion grid points, on the world's first exascale computer, Frontier, comprising AMD MI250x GPUs with HPE's Slingshot interconnect and operated by the US Department of Energy's Oak Ridge Leadership Computing Facility (OLCF). Key programming strategies designed to take maximum advantage of the machine architecture involve performing almost all computations on the GPU which has the same memory capacity as the CPU, performing all-to-all communication among sets of parallel processes directly on the GPU, and targeting GPUs efficiently using OpenMP offloading for intensive number-crunching including 1-D Fast Fourier Transforms (FFT) performed using AMD ROCm library calls. With 99% of computing power on Frontier being on the GPU, leaving the CPU idle leads to a net performance gain via avoiding the overhead of data movement between host and device except when needed for some I/O purposes. Memory footprint including the size of communication buffers for MPI_ALLTOALL is managed carefully to maximize the largest problem size possible for a given node count. Detailed performance data including separate contributions from different categories of operations to the elapsed wall time per step are reported for five grid resolutions, from 2048 3 on a single node to 32768 3 on 4096 or 8192 nodes out of 9408 on the system. Both 1D and 2D domain decompositions which divide a 3D periodic domain into slabs and pencils respectively are implemented. The present code suite (labeled by the acronym GESTS, GPUs for Extreme Scale Turbulence Simulations) achieves a figure of merit (in grid points per second) exceeding goals set in the Center for Accelerated Application Readiness (CAAR) program for Frontier. The performance attained is highly favorable in both weak scaling and strong scaling, with notable departures only for 2048 3 where communication is entirely intra-node, and for 32768 3 , where a challenge due to small message sizes does arise. Communication performance is addressed further using a lightweight test code that performs all-to-all communication in a manner matching the full turbulence simulation code. Performance at large problem sizes is affected by both small message size due to high node counts as well as dragonfly network topology features on the machine, but is consistent with official expectations of sustained performance on Frontier. Overall, although not perfect, the scalability achieved at the extreme problem size of 32768 3 (and up to 8192 nodes — which corresponds to hardware rated at just under 1 exaflop/sec of theoretical peak computational performance) is arguably better than the scalability observed using prior state-of-the-art algorithms on Frontier's predecessor machine (Summit) at OLCF. New science results for the study of intermittency in turbulence enabled by this code and its extensions are to be reported separately in the near future.

3D fast Fourier transform↗

Similarity of the coupled equations for RF waves in a tokamak

Here, a similarity relation between RF wave systems in tokamaks is found theoretically by investigating scaling conditions of plasma density and temperature, tokamak size and background magnetic fields, and RF wave frequency and power. The scaling conditions simultaneously satisfy Maxwell's equations, the Grad-Shafranov equation, and the Fokker-Planck equation. The consistency of the scaling with transport equations is examined by several empirical and theoretical scalings for confinement time. The similarity discussed in this paper is useful to explore the possibility of the test system for RF wave experiments and verify the coupled numerical codes for the wave modeling.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Scalable Reactive Molecular Dynamics Simulations for Computational Synthesis

Reactive molecular dynamics (MD) simulation is a powerful research tool for describing chemical reactions. We eliminate the speed-limiting charge iteration in MD with a novel extended-Lagrangian scheme. The extended-Lagrangian reactive MD (XRMD) code drastically improves energy conservation while substantially reducing time-to-solution. Furthermore, we introduce a new polarizable charge equilibration (PQEq) model to accurately predict atomic charges and polarization. The XRMD code based on hybrid message passing+multithreading achieves a weak-scaling parallel efficiency of 0.977 on 786 432 IBM Blue Gene/Q cores for a 67.6 billion-atom system. The performance is portable to the second-generation Intel Xeon Phi, Knights Landing. Blue Gene/Q simulations for the computational synthesis of materials via novel exfoliation mechanisms for synthesizing atomically thin transition metal dichalcogenide layers will dominate nanomaterials science in this century.

Simulation, Modeling, Performance, and Visualizati↗

Development and Validation of SAM Multi-dimensional Flow Model for Thermal Mixing and Stratification Modeling

Thermal mixing and stratification in large pools or enclosures are very important phenomena that are critical to nuclear reactor safety. Because of the wide ranges of time and length scales associated with such phenomena, accurate modeling and simulation of thermal mixing and stratification remain as the key unresolved, challenging problems for reactor transient analyses. In traditional system analysis codes, simplified zero-dimensional (0-D) models are widely used for their high numerical efficiency, but they generally suffer from very limited prediction accuracies or range of applicability. Like traditional system analysis codes, the current version of the SAM code has implemented such simplified 0-D and one-dimensional mixing models. On the other hand, high-resolution Computational Fluid Dynamics (CFD) tools are often used to model complex thermal mixing and stratification phenomena. They are, however, generally numerically expensive, and they require large amounts of computational resources. It is therefore desirable to implement advanced and efficient thermal mixing and stratification modeling capabilities embedded in a system analysis code. This approach will improve the accuracy of reactor safety analyses when thermal mixing and stratification are involved, and also avoid using the large computational resources needed for high-resolution CFD analysis. Currently, with the support of the U.S. DOE Office of Nuclear Energy’s Nuclear Energy Advanced Modeling and Simulation program, an effort has been launched to develop and implement a multi-dimensional flow model in the system analysis code SAM, and demonstrate its applications to model thermal mixing and stratification phenomena in large enclosures. The main outcomes of this research and development activity are summarized in this report, which presents an attempt to include a built-in advanced multi-dimensional flow model in a system analysis code with the focus on overcoming the simulation challenges of thermal mixing and stratification phenomena. In this report, we start with the introduction of existing SAM code capabilities to simulate thermal mixing and stratification phenomena, which is followed by a short summary of the multi-dimensional model implemented in the SAM code, including both the physical model and the Finite Element Method code implementation. In this study, two options were implemented in the SAM code to model turbulent flows: a relatively simple built-in turbulence model and an interface to accept externally computed turbulent viscosities (e.g., from a high- resolution CFD simulation). Code validation studies on this newly added capability were then carried out to compare SAM simulation results with experimental data from the SUPERCAVNA facility, which was designed to study the complex flow recirculation and thermal stratification phenomena relevant to sodium fast reactor designs. In this study, one transient and two steady-state test cases were used for code validation. Different approaches have been used to model the complex turbulence flow fields in the SUPERCAVNA facility. A highly simplified zero-equation turbulence model was first used, but it was determined that it is too simple to capture the complex turbulence flow fields in these test cases. Subsequently, the code validation continued with the use of turbulent viscosity data from high-resolution STAR-CCM+ CFD simulations to improve the accuracy of the results. Using this approach, the SAM simulation results showed very good agreement with both the SUPERCAVNA experimental data and STAR-CCM+ simulation results. In this report, we demonstrate the development, implementation, and successful validation of a multi-dimensional flow model in the SAM code, which aims to improve the simulation accuracy for complex thermal mixing and stratification phenomena. Lessons have also been learned, including that in cases where the flow fields are not well predicted by the zero-equation model, the iinput of turbulent viscosities from an external source can enhance the overall predictive capabilities needed to accurately capture complex thermal-hydraulic phenomena. Therefore, future research will be needed to further improve the code’s capabilities, such as by developing a more efficient and robust approach to capture the turbulence effects in the SAM code.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Modelling low Mach number stellar hydrodynamics with MAESTROeX

Modelling long-time convective flows in the interiors of stars is extremely challenging using conventional compressible hydrodynamics codes due to the acoustic timestep limitation. Many of these flows are in the low Mach number regime, which allows us to exploit the relationship between acoustic and advective time scales to develop a more computationally efficient approach. MAESTROeX is an open source low Mach number stellar hydrodynamics code that allows much larger timesteps to be taken, therefore enabling systems to be modelled for much longer periods of time. This is particularly important for the problem of convection in the cores of rotating massive stars prior to core collapse. To fully capture the dynamics, it is necessary to model these systems in three dimensions at high resolution over many rotational periods. We present an overview of MAESTROeX's current capabilities, describe ongoing work to incorporate the effects of rotation and discuss how we are optimising the code to run on GPUs.

Harpole, A.↗