Search NASA⌕ Search

SEARCH · Search NASA

Results for “grid size”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Reynolds number dependence of Lagrangian dispersion in direct numerical simulations of anisotropic magnetohydrodynamic turbulence

Large-scale magnetic fields thread through the electrically conducting matter of the interplanetary and interstellar medium, stellar interiors and other astrophysical plasmas, producing anisotropic flows with regions of high-Reynolds-number turbulence. It is common to encounter turbulent flows structured by a magnetic field with a strength approximately equal to the root-mean-square magnetic fluctuations. In this work, direct numerical simulations of anisotropic magnetohydrodynamic (MHD) turbulence influenced by such a magnetic field are conducted for a series of cases that have identical resolution, and increasing grid sizes up to $2048^3$ . The result is a series of closely comparable simulations at Reynolds numbers ranging from 1400 up to 21 000. We investigate the influence of the Reynolds number from the Lagrangian viewpoint by tracking fluid particles and calculating single-particle and two-particle statistics. The influence of Alfvénic fluctuations and the fundamental anisotropy on the MHD turbulence in these statistics is discussed. Single-particle diffusion curves exhibit mildly superdiffusive behaviours that differ in the direction aligned with the magnetic field and the direction perpendicular to it. Competing alignment processes affect the dispersion of particle pairs, in particular at the beginning of the inertial subrange of time scales. Scalings for relative dispersion, which become clearer in the inertial subrange for a larger Reynolds number, can be observed that are steeper than indicated by the Richardson prediction.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The Effect of Surface Heating Heterogeneity on Boundary Layer Height and Its Dependence on Background Wind Speed

The planetary boundary layer height (PBLH) is a fundamental variable of the planetary boundary layer (PBL). The effect of surface heterogeneity is challenging in the PBL parameterization for numerical weather and climate models. Here we use large eddy simulation data to investigate the impact of surface heating heterogeneity on the PBLH spatial variations and mean values over a domain of typical mesoscale model grid size. It is found that this impact depends on background wind condition. Variance decomposition and Fourier spectra both reveal that for the fully developed sheared convective PBL, surface heterogeneity contributes little to the spatial variation of PBLH, except for the case with heterogeneity scale of 14.4 km. This suggests that surface heterogeneity with length scales less than ~10 km, which is typical for mesoscale modeling, does not induce significant subgrid spatial variation of PBLH. The domain-averaged PBLH is found to generally increase as surface heterogeneity scale decreases, until reaching the scale on the order of PBLH. The findings can be used to inform the parameterization development of PBL processes over heterogeneous surface.

54 ENVIRONMENTAL SCIENCES↗

DFT-based QM/MM with Particle-Mesh Ewald for Direct, Long-Range Electrostatic Embedding

In this work, we present a DFT-based, QM/MM implementation with long-range electrostatic embedding achieved by direct real-space integration of the particle mesh Ewald (PME) computed electrostatic potential. The key transformation is the interpolation of the electrostatic potential from the PME grid to the DFT quadrature grid, from which integrals are easily evaluated utilizing standard DFT machinery. We provide benchmarks of the numerical accuracy with choice of grid size and real-space corrections, and demonstrate that good convergence is achieved while introducing nominal computational overhead. Furthermore, the approach requires only small modification to existing software packages, as is demonstrated with our implementation in the OpenMM and Psi 4 software. After presenting convergence benchmarks, we evaluate the importance of long-range electrostatic embedding in three solute/solvent systems modeled with QM/MM. Water and BMIM/BF 4 ionic liquid were considered as "simple" and "complex" solvents respectively, with water and p-phenylenediamine (PPD) solute molecules treated at QM level of theory. While electrostatic embedding with standard real-space truncation may introduce negligible error for simple systems such as water solute in water solvent, errors become more significant when QM/MM is applied to complex solvents such as ionic liquids. An extreme example is the electrostatic embedding energy for oxidized PPD in BMIM/BF 4 for which real-space truncation produces severe error even at 2-3 nm cutoff distances. This latter example illustrates that utilization of QM/MM to compute redox potentials within concentrated electrolytes/ionic media requires carefully chosen long-range electrostatic embedding algorithms, with our presented algorithm providing a general and robust approach.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Flame acceleration and transition to detonation in a pre-/main-chamber combustion system

Numerical simulations are performed to study the mechanism of deflagration to detonation transition (DDT) in a pre-/main-chamber combustion system with a stoichiometric ethylene–oxygen mixture. A Godunov algorithm, fifth-order in space, and third-order in time, is used to solve the fully compressible Navier–Stokes equations on a dynamically adapting mesh. A single-step, calibrated chemical diffusive model described by Arrhenius kinetics is used for energy release and conservation between the fuel and the product. The two-dimensional simulation shows that a laminar flame grows in the pre-chamber and then develops into a jet flame as it passes through the orifice. A strong shock forms immediately ahead of the flame, reflecting off the walls and interacting with the flame front. The shock–flame interactions are crucial for the development of flame instabilities, which trigger the subsequent flame development. The DDT arises due to a shock-focusing mechanism, where multiple shocks collide at the flame front. A chemical explosive mode analysis (CEMA) criterion is developed to study the DDT ignition mode. Preliminary one-dimensional computations for a laminar propagating flame, a fast flame deflagration, and a Chapman–Jouguet detonation are conducted to demonstrate the validity of CEMA on the chemical-diffusive model, as well as to determine the proper conditioning value for CEMA diagnostic. The two-dimensional analysis with CEMA indicates that the DDT initiated by the shock-focusing mechanism can form a strong thermal expansion region at the flame front that features large positive eigenvalues for the chemical explosive mode and dominance of the local autoignition mode. Thus, the CEMA criterion proposed in this study provides a robust diagnostic for identifying autoignition-supported DDT, of which the emergence of excessive local autoignition mode is found to be a precursor. The effect of grid size, initial temperature, and orifice size are then evaluated, and results show that although the close-chamber DDT is highly stochastic, the detonation initiation mechanism remains robust.

42 ENGINEERING↗

Theory for transport in magnetized plasmas

We present a two fluid model for anomalous thermal, particle and momentum transport which has been derived from kinetic theory using a small parameter ε~10-2. This small parameter can come from either the ratio of wave frequency to cyclotron frequency or the ratio of potential to thermal energies. This fluid model is strongly nonlinear and has an exact closure within the accuracy ε. It can be used to simulate the full radius of a tokamak including internal and edge transport barriers at the same time without introducing any local assumptions for physics model or grid size. It involves a full transport matrix, thus giving possibility for both density and heat pinches. The model can be derived from the Vlasov equation, adding also close collisions and includes particle pinches of the type found in the magnetosphere and in the Massachusetts Institute of Technology elevated dipole machine. Pinches are also in agreement for the heat pinch experiments on Doublet III D including simultaneous particle and heat pinches. For tokamaks it gives the right scaling of confinement time versus heating power. Finally, we have also recovered the Turbulent Equipartition result that the density scales as inverse safety factor q in typical simulations. Thus this model is both fundamental and of high practical use.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Importance of nonuniform Brillouin zone sampling for ab initio Bethe-Salpeter equation calculations of exciton binding energies in crystalline solids

Excitons are prevalent in semiconductors and insulators, and their binding energies are critical for optoelectronic applications. The state-of-the-art method for first-principles calculations of excitons in extended systems is the ab initio GW-Bethe-Salpeter equation (BSE) approach, which can require a fine sampling of reciprocal space to accurately resolve solid-state exciton properties. Here, in this study, we show, for a range of semiconductors and insulators, that the commonly employed approach of uniformly sampling the Brillouin zone can lead to underconverged exciton binding energies, as impractical grid sizes are required to achieve adequate convergence. We further show that nonuniform sampling of the Brillouin zone, focused on the region of reciprocal space where the exciton wave function resides, enables efficient rapid numerical convergence of exciton binding energies at a given level of theory. We propose a well-defined convergence procedure, which can be carried out at relatively low computational cost and which in some cases leads to a correction of previous best theoretical estimates by almost a factor of 2, qualitatively changing the predicted exciton physics. These results call for the adoption of nonuniform sampling methods for ab initio GW-BSE calculations and for revisiting previously computed values for exciton binding energies of many systems.

36 MATERIALS SCIENCE↗

Quantum Simulation of the First-Quantized Pauli-Fierz Hamiltonian

We provide an explicit recursive divide-and-conquer approach for simulating quantum dynamics and derive a discrete first-quantized nonrelativistic QED Hamiltonian based on the many-particle Pauli-Fierz Hamiltonian. We apply this recursive divide-and-conquer algorithm to this Hamiltonian and compare it to a concrete simulation algorithm that uses qubitization. Our divide-and-conquer algorithm, using lowest-order Trotterization, scales for fixed grid spacing as O ~ ( Λ N 2 η 2 t 2 / ϵ ) for grid size N , η particles, simulation time t , field cutoff Λ , and error ϵ . Our qubitization algorithm scales as O ~ ( N ( η + N ) ( η + Λ 2 ) t log ( 1 / ϵ ) ) . This shows that even a naive partitioning and low-order splitting formula can yield, through our divide-and-conquer formalism, superior scaling to qubitization for large Λ . We compare the relative costs of these two algorithms on systems that are relevant for applications such as the spontaneous emission of photons and the photoionization of electrons. We observe that for different parameter regimes, one method can be favored over the other. Finally, we give new algorithmic and circuit-level techniques for gate optimization, including a new way of implementing a group of multicontrolled- X gates that can be used for better analysis of circuit cost. Published by the American Physical Society 2024

Mukhopadhyay, Priyanka (ORCID:0000000164639100)↗

Modeling pre-Exascale AMR Parallel I/O Workloads via Proxy Applications

The present work investigates the modeling of preexascale input/output (I/O) workloads of Adaptive Mesh Refinement (AMR) simulations through a simple proxy application. We collect data from the AMReX Castro framework running on the Summit supercomputer for a wide range of scales and mesh partitions for the hydrodynamic Sedov case as a baseline to provide sufficient coverage to the formulated proxy model. The non-linear analysis data production rates are quantified as a function of a set of input parameters such as output frequency, grid size, number of levels, and the Courant-Friedrichs-Lewy (CFL) condition number for each rank, mesh level and simulation time step. Linear regression is then applied to formulate a simple analytical model which allows to translate AMReX inputs into MACSio proxy I/O application parameters, resulting in a simple “kernel” approximation for data production at each time step. Results show that MACSio can simulate actual AMReX nonlinear “static” I/O workloads to a certain degree of confidence on the Summit supercomputer using the present methodology. The goal is to provide an initial level of understanding of AMR I/O workloads via lightweight proxy applications models to facilitate autotune data management strategies in anticipation of exascale systems.

Godoy, William↗

Climate-invariant machine learning

Projecting climate change is a generalization problem: We extrapolate the recent past using physical models across past, present, and future climates. Current climate models require representations of processes that occur at scales smaller than model grid size, which have been the main source of model projection uncertainty. Recent machine learning (ML) algorithms hold promise to improve such process representations but tend to extrapolate poorly to climate regimes that they were not trained on. To get the best of the physical and statistical worlds, we propose a framework, termed “climate-invariant” ML, incorporating knowledge of climate processes into ML algorithms, and show that it can maintain high offline accuracy across a wide range of climate conditions and configurations in three distinct atmospheric models. Our results suggest that explicitly incorporating physical knowledge into data-driven models of Earth system processes can improve their consistency, data efficiency, and generalizability across climate regimes.

54 ENVIRONMENTAL SCIENCES↗

Performance-Portable GPU Acceleration of the EFIT Tokamak Plasma Equilibrium Reconstruction Code

This paper presents the steps followed to GPU-offload parts of the core solver of EFIT-AI, an equilibrium reconstruction code suitable for tokamak experiments and burning plasmas. For this work, we will focus on the fitting procedure that consists of a Grad–Shafranov (GS) equation inverse solver that calculates equilibrium reconstructions on a grid. We will show profiling results of the original code (CPU-baseline), as well as the directives used to GPU-offload the most time-consuming function, initially to compare OpenACC and OpenMP on NVIDIA and AMD GPUs and later on to assess OpenMP performance portability on NVIDIA, AMD and Intel GPUs. We will make a performance comparison for different spatial grid sizes and show the speedup achieved on NVIDIA A100 (Perlmutter-NERSC), AMD MI250X (Frontier-OLCF) and Intel PVC GPUs (Sunspot-ALCF). Finally, we will draw some conclusions and recommendations to achieve high-performance portability for an equilibrium reconstruction code on the new HPC architectures

GPU↗

Modeled Hourly Tidal Current Velocities, Directions, and Heights from May 1 - September 1, 2005 at Two Points Near East Forelands and Tyonek in Cook Inlet, Alaska

This dataset includes modeled tidal current velocities, direction and depth at two locations in East and North Forelands (60.716, -151.434 and 61.024, -151.157) near Nikiski and Tyonek, respectively, in Cook Inlet, Alaska. Data from two grid cells were provided by the Pacific Northwest National Laboratory based on a tidal hydrodynamic model that characterized the tidal stream resources in Cook Inlet for a period from May 1 to September 1, 2005 (Wang and Yang 2020). The model grid size had a horizontal spatial resolution of 100 m at East Forelands and 200 m at Tyonek; mean sea level (MSL) depth was 47.9 m and 23.7 m at each respective site, and there were 10 depth bins that ranged in size with the tide from 4.3-5.2 m and 1.9-2.8 m, respectively (Wang and Yang 2020).

16 TIDAL AND WAVE POWER↗

Performance Analysis of PIConGPU: Particle-in-Cell on GPUs using NVIDIA’s NSight Systems and NSight Compute

PIConGPU, Particle In Cell on GPUs, is an open source simulations framework for plasma and laser-plasma physics used to develop advanced particle accelerators for radiation therapy of cancer, high energy physics and photon science. While PIConGPU has been optimized for at least 5 years to run well on NVIDIA GPU-based clusters, there has been limited exploration by the development team of potential scalability bottlenecks using recently updated and new tools including NVIDIA’s NVProf tool and the brand-new NVIDIA NSight Suite (Systems and Compute) tools. PIConGPU is a highly optimized application that runs production jobs at scale on a system Oak Ridge Leadership Facility’s (OLCF) Summit supercomputer (using the full machine at 4600 nodes; at 98% of GPU utilization on all ~28000 NVIDIA Volta GPUs). PIConGPU has been selected as one of the the eight applications for OLCF’s coveted Center for Accelerated Application Readiness (CAAR) program aimed at the facility’s Frontier supercomputer (OLCF’s first exascale system to launch in 2021), to partner with our vendors (primary vendors: AMD and Cray/HPE) ensuring that Frontier will be able to perform large-scale science when it opens to users in 2022. To this effect, performance engineers on the PIConGPU team wanted to dive deep into the application to understand at the finest granularity, which portions of the code could be further optimized to exploit the hardware on Summit at it’s maximum potential and also to elucidate which key kernels should be tracked and optimized for the CAAR effort to port this code to Frontier. Any bottlenecks that are observed via performance profiling on Summit are likely to also impact scalability on the Frontier-dev system and the Frontier Early Access (EA) system. Additionally, the engineers wanted to take a closer look at the newest NVIDIA profiling tools which allows us to identify the most useful features on these tools and will provide an opportunity to compare it to new AMD and Cray’s performance analysis tool releases and provide feedback to our vendor partners on what features are most important and mission critical for CAAR efforts. The primary goal of this report is to focus on the evaluation of PIConGPU’s most time-intensive kernels using NVProf and NSight Suite. Three kernels, Current Deposition (also known as Compute Current), Particle Push (Move and Mark), and Shift Particles are known to be some of the most time-consuming kernels in PIConGPU. The Current xi Deposition kernel and Particle Push kernel both set up the particle attributes for running any physics simulation with PIConGPU, so it is crucial to improve the performance of these two kernels. In this report, we measure single GPU metrics for the three kernels, offer high level takeaways from the conducted analysis, and compare the profiling data from NSight Compute to that of NVProf. This analysis was performed using a grid size of 240 x 272 x 224, and 10 time steps with the Mid-November Figure of Merit (FOM) run setup. The Traveling Wave Electron Acceleration (TWEAC) science case used in this run is a representative science case for PIConGPU. This execution can also be used for baseline analysis on AMD MI50/ MI60 systems. As of the time of writing, the PIConGPU application has limited use for features of NSight Systems, so this report will mainly focus on insights garnered from NSight Compute. For this analysis, we run the “full” metric set available in NSight Compute version 2020.1.2 and use NSight Systems version 2020.3.1 to generate the application timeline.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Feasibility of Using Fourier Neural Operators for 3D Elastic Seismic Simulations

Seismic simulations in three-dimensional (3D) Earth models are important in many of the seismological applications related to our lab’s mission, however, accurate high-fidelity simulations are computationally costly. We investigated the capabilities of the newly developed Fourier Neural Operator (FNO) to solve the 3D elastic wave equations for seismic simulations. We generated simulation data for training the FNO model, and analyzed its performance on various test cases, such as the performance with different number of training data, different resolutions, and on more canonical structures. We found the FNO model can reproduce 3D seismic simulations with high accuracy and ~169 times faster on a small spatial grid size of 16 x 16 x16. When applied on higher resolution data, we found that transfer learning with fine-tuning on a small amount of data achieves reasonable results. This feasibility study showed promising results for using FNO’s for 3D seismic simulations and represents the foundation of further research to develop this into a more mature approach for different seismological applications. The potential impact of this project will provide techniques for large-scale or real-time applications of solving PEDs in support of national lab’s programs.

58 GEOSCIENCES↗

Characterizing Artificial Viscosity Parameters with Approximate Symmetries

We are often faced with trying to capture the physics of compressible shocks, which are governed by the Euler equations. However, Euler shocks are formally discontinuous at the shock front (translating to a step-function behavior of rel evant flow variables). This poses a practical problem for codes with finite-sized grid elements. As a result, one must make a concession in simulating the be havior of shocks within a discrete framework. In particular, we must blur, or ‘regularize’ Euler shocks so that they may be captured on a finite grid.

97 MATHEMATICS AND COMPUTING↗

CalderaCast User Manual Version 1.0

CalderaCast is a user-friendly web-based tool for electrical-load forecast, providing stakeholders with a fully customizable decision-support framework that estimates the likely power draw from a possible future electric-vehicle (EV) charging station at a given location on a given day along an alternative fuel corridor (AFC). These EV charging profiles are accurately modeled in CalderaCast using the Caldera software framework developed by Idaho National Laboratories (INL), reflecting the realistic charging levels observed in actual charge events. This tool was developed as part of the National Electric Vehicle Infrastructure (NEVI) program, which is quickly generating substantial interest from would-be charging station operators (CSO), large and small electric utilities, and state transportation planners, some of whom had not seriously considered EV charging previously. All these entities—with or without background in EV infrastructure—must estimate the electricity load that a proposed charging station will generate. This load forecast is critically important for a utility to properly assess the capacity of their distribution network to support the proposed station or properly size grid upgrades for potential load growth due to future EV adoption, vehicle technology improvements, or station growth. This document describes each aspect of the CalderaCast tool and provides guidance to users who are interested in utilizing the tool for their work.

24 - POWER TRANSMISSION AND DISTRIBUTION↗

Cholla-MHD: An Exascale-capable Magnetohydrodynamic Extension to the Cholla Astrophysical Simulation Code

Abstract We present an extension of the massively parallel, GPU native, astrophysical hydrodynamics code Cholla to magnetohydrodynamics (MHD). Cholla solves the ideal MHD equations in their Eulerian form on a static Cartesian mesh utilizing the Van Leer + constrained transport integrator, the HLLD Riemann solver, and reconstruction methods at second and third order. Cholla’s MHD module can perform ≈260 million cell updates per GPU-second on an NVIDIA A100 while using the HLLD Riemann solver and second order reconstruction. The inherently parallel nature of GPUs combined with increased memory in new hardware allows Cholla’s MHD module to perform simulations with resolutions ∼500 3 cells on a single high-end GPU (e.g., an NVIDIA A100 with 80 GB of memory). We employ GPU direct Message Passing Interface to attain excellent weak scaling on the exascale supercomputer Frontier, while using 74,088 GPUs and simulating a total grid size of over 7.2 trillion cells. A suite of test problems highlights the accuracy of Cholla’s MHD module and demonstrates that zero magnetic divergence in solutions is maintained to round off error. We also present new testing and CI tools using GoogleTest, GitHub Actions, and Jenkins that have made development more robust and accurate and ensure reliability in the future.

Astronomy & Astrophysics↗

Evaluating wind profiles in a numerical weather prediction model with Doppler lidar

We use Doppler lidar wind profiles from six locations around the globe to evaluate the wind profile forecasts in the boundary layer generated by the operational global Integrated Forecast System (IFS) from the European Centre for Medium-range Weather Forecasts (ECMWF). The six locations selected cover a variety of surfaces with different characteristics (rural, marine, mountainous urban, and coastal urban). We first validated the Doppler lidar observations at four locations by comparison with co-located radiosonde profiles to ensure that the Doppler lidar observations were of sufficient quality. The two observation types agree well, with the mean absolute error (MAE) in wind speed almost always less than 1 m s –1 . Large deviations in the wind direction were usually only seen for low wind speeds and are due to the wind direction uncertainty increasing rapidly as the wind speed tends to zero. Time–height composites of the wind evaluation with 1 h resolution were generated, and evaluation of the model winds showed that the IFS model performs best over marine and coastal locations, where the mean absolute wind vector error was usually less than 3 m s –1 at all heights within the boundary layer. Larger errors were seen in locations where the surface was more complex, especially in the wind direction. For example, in Granada, which is near a high mountain range, the IFS model failed to capture a commonly occurring mountain breeze, which is highly dependent on the sub-grid-size terrain features that are not resolved by the model. The uncertainty in the wind forecasts increased with forecast lead time, but no increase in the bias was seen. At one location, we conditionally performed the wind evaluation based on the presence or absence of a low-level jet diagnosed from the Doppler lidar observations. The model was able to reproduce the presence of the low-level jet, but the wind speed maximum was about 2 m s –1 lower than observed. This is attributed to the effective vertical resolution of the model being too coarse to create the strong gradients in wind speed observed. Our results show that Doppler lidar is a suitable instrument for evaluating the boundary layer wind profiles in atmospheric models.

54 ENVIRONMENTAL SCIENCES↗

Comparison of a two-dimensional shock impingement computation with experiment

Results of computations of two-dimensional viscous blunt-body flowfields with an impinging shock wave, with a time-dependent finite-difference method employed to solve the complete set of Navier-Stokes equations, are compared with experimental results. The experimental results were obtained in a 20-inch hypersonic tunnel with a planar shock impinging on the cylindrical leading edge of a fin, hence with the shock parallel to the centerline of the leading edge, so that type III and type IV interference patterns were generated. Close agreement is found. The overall effects of smoothing and grid size on the calculations are determined. A 31 x 51 mesh is adequate for wall pressure values (except in peaked regions).

Tannehill, J. C.↗