Search NASA⌕ Search

SEARCH · Search NASA

Results for “convection simulation parallel computation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Heat Transfer and Pressure Loss of Additively Manufactured Internal Cooling Channels With Various Shapes

Abstract Additive manufacturing (AM) provides the ability to fabricate highly customized internal cooling passages that are relevant to gas turbine components. This experimental study examines the pressure loss and heat transfer performance of a range of fundamental channel shapes that were produced using direct metal laser sintering. Circular, hexagonal, pentagonal, elliptical, diamond, square, rectangular, trapezoidal, and triangular channel cross sections were investigated. To maintain the same convective surface area between shapes, the wetted perimeters of the channel cross sections were kept constant. Parallel computational fluid dynamic simulations were performed to understand the relationships in cooling performance between several channel shapes. Several characteristic length scales were evaluated to scale the pressure loss and heat transfer measurements. Among the channel shapes investigated, the diamond channel showed the lowest Nusselt number and friction factor. The pentagon exhibited a similar Nusselt number as the circular channel despite having a lower friction factor. There was no difference in scaling the friction factor or Nusselt number results of the different channel shapes between using the square root of cross-sectional area compared to hydraulic diameter as the characteristic length scale

Engineering↗

Unprecedented cloud resolution in a GPU-enabled full-physics atmospheric climate simulation on OLCF’s summit supercomputer

Clouds represent a key uncertainty in future climate projection. While explicit cloud resolution remains beyond our computational grasp for global climate, we can incorporate important cloud effects through a computational middle ground called the Multi-scale Modeling Framework (MMF), also known as Super Parameterization. This algorithmic approach embeds high-resolution Cloud Resolving Models (CRMs) to represent moist convective processes within each grid column in a Global Climate Model (GCM). The MMF code requires no parallel data transfers and provides a self-contained target for acceleration. This study investigates the performance of the Energy Exascale Earth System Model-MMF (E3SM-MMF) code on the OLCF Summit supercomputer at an unprecedented scale of simulation. Hundreds of kernels in the roughly 10K lines of code in the E3SM-MMF CRM were ported to GPUs with OpenACC directives. A high-resolution benchmark using 4600 nodes on Summit demonstrates the computational capability of the GPU-enabled E3SM-MMF code in a full physics climate simulation.

58 GEOSCIENCES↗

Dynamics in a stellar convective layer and at its boundary: Comparison of five 3D hydrodynamics codes

Our ability to predict the structure and evolution of stars is in part limited by complex, 3D hydrodynamic processes such as convective boundary mixing. Hydrodynamic simulations help us understand the dynamics of stellar convection and convective boundaries. However, the codes used to compute such simulations are usually tested on extremely simple problems and the reliability and reproducibility of their predictions for turbulent flows is unclear. We define a test problem involving turbulent convection in a plane-parallel box, which leads to mass entrainment from, and internal-wave generation in, a stably stratified layer. We compare the outputs from the codes FLASH, MUSIC, PPMSTAR, PROMPI, and SLH, which have been widely employed to study hydrodynamic problems in stellar interiors. The convection is dominated by the largest scales that fit into the simulation box. All time-averaged profiles of velocity components, fluctuation amplitudes, and fluxes of enthalpy and kinetic energy are within ≲3σ of the mean of all simulations on a given grid (128 3 and 256 3 grid cells), where σ describes the statistical variation due to the flow’s time dependence. They also agree well with a 512 3 reference run. The 128 3 and 256 3 simulations agree within 9% and 4%, respectively, on the total mass entrained into the convective layer. The entrainment rate appears to be set by the amount of energy that can be converted to work in our setup and details of the small-scale flows in the boundary layer seem to be largely irrelevant. Our results lend credence to hydrodynamic simulations of flows in stellar interiors. We provide in electronic form all outputs of our simulations as well as all information needed to reproduce or extend our study.

79 ASTRONOMY AND ASTROPHYSICS↗

A numerical solver for investigating the space charge effect on the electric field in liquid argon time projection chambers

This paper reports the development of a numerical solver aimed to simulate the interaction between the space charge (i.e. ions) distribution and the electric field in liquid argon time projection chamber (LArTPC) detectors. The ion transport equation is solved by a time-accurate, cell-centered finite volume method and the electric potential equation by a continuous finite element method. The electric potential equation updates the electric field which provides the drift velocity to the ion transport equation. The ion transport equation updates the space charge density distribution which appears as the source term in the electric potential equation. The interaction between the space charge distribution and the electric field is numerically simulated within each physical time step. The convective velocity in the ion transport equation can include the background flow velocity in addition to the electric drift velocity. The numerical solver has been parallelized using the Message Passing Interface (MPI) library. Numerical tests show and verify the capability and accuracy of the current numerical solver. It is planned that the developed numerical solver, together with a Computational Fluid Dynamics (CFD) package which provides the flow velocity field, can be used to investigate the space charge effect on the electric field in large-scale particle detectors.

42 ENGINEERING↗

Towards multiscale modeling of ocean surface turbulent mixing using coupled MPAS-Ocean v6.3 and PALM v5.0

A multiscale modeling approach for studying the ocean surface turbulent mixing is explored by coupling an ocean general circulation model (GCM) MPAS-Ocean with the Parallelized Large Eddy Simulation Model (PALM). The coupling approach is similar to the superparameterization approach that has been used to represent the effects of deep convection in atmospheric GCMs. However, the focus of this multiscale modeling approach is on the small-scale turbulent mixing and their interactions with the larger-scale processes in the ocean, so that a more flexible coupling strategy is used. To reduce the computational cost, a customized version of PALM is ported on the general-purpose graphics processing unit (GPU) with OpenACC, achieving 10–16 times overall speedup as compared to running on a single CPU. Even with the GPU-acceleration technique, a superparameterization-like approach to represent the ocean surface turbulent mixing in GCMs using embedded high fidelity and three-dimensional large eddy simulations (LESs) over the global ocean is still computationally intensive and infeasible for long simulations. However, running PALM regionally on selected MPAS-Ocean grid cells is shown to be a promising approach moving forward. The flexible coupling between MPAS-Ocean and PALM allows further exploration of the interactions between the ocean surface turbulent mixing and larger-scale processes, as well as future development and improvement of ocean surface turbulent mixing parameterizations for GCMs.

54 ENVIRONMENTAL SCIENCES↗

A phase-shift-periodic parallel boundary condition for low-magnetic-shear scenarios

Abstract We formulate a generalized periodic boundary condition as a limit of the standard twist-and-shift parallel boundary condition that is suitable for simulations of plasmas with low magnetic shear. This is done by applying a phase shift in the binormal direction when crossing the parallel boundary. While this phase shift can be set to zero without loss of generality in the local flux-tube limit when employing the twist-and-shift boundary condition, we show that this is not the most general case when employing periodic parallel boundaries, and may not even be the most desirable. A non-zero phase shift can be used to avoid the convective cells that plague simulations of the three-dimensional Hasegawa–Wakatani system, and is shown to have measurable effects in periodic low-magnetic-shear gyrokinetic simulations. We propose a numerical program where a sampling of periodic simulations at random pseudo-irrational flux surfaces are used to determine physical observables in a statistical sense. This approach can serve as an alternative to applying the twist-and-shift boundary condition to low-magnetic-shear scenarios, which, while more straightforward, can be computationally demanding.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Scaling theory of three-dimensional magnetic reconnection spreading

We develop a first-principles scaling theory of the spreading of three-dimensional (3D) magnetic reconnection of finite extent in the out of plane direction. This theory addresses systems with or without an out of plane (guide) magnetic field, and with or without Hall physics. The theory reproduces known spreading speeds and directions with and without guide fields, unifying previous knowledge in a single theory. New results include: (1) Reconnection spreads in a particular direction if an x-line is induced at the interface between reconnecting and non-reconnecting regions, which is controlled by the out of plane gradient of the electric field in the outflow direction. (2) The spreading mechanism for anti-parallel collisionless reconnection is convection, as is known, but for guide field reconnection it is magnetic field bending. We confirm the theory using 3D two-fluid and resistive-magnetohydrodynamics simulations. (3) The theory explains why anti-parallel reconnection in resistive-magnetohydrodynamics does not spread. (4) The simulation domain aspect ratio, associated with the free magnetic energy, influences whether reconnection spreads or convects with a fixed x-line length. (5) We perform a simulation initiating anti-parallel collisionless reconnection with a pressure pulse instead of a magnetic perturbation, finding spreading is unchanged rather than spreading at the magnetosonic speed as previously suggested. The results provide a theoretical framework for understanding spreading beyond systems studied here, and are important for applications including two-ribbon solar flares and reconnection in Earth’s magnetosphere.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Comparison of Some RANS Solvers

We will take a look at solving the Reynolds-averaged Navier-Stokes (RANS) equations that are encountered in the context of wind farm performance simulations and optimizations. We will compare some of the more popular ways to solve these equations with a focus on using iterative solvers for the linear solve. We will compare their performance and reliability to a direct solve as we scale the problem both by adding more and parallel resources and by increasing the size of the domain, both in two and three dimensions. There are many strategies that can be applied to solving the RANS equations, some are very efficient, while others are very insensitive to, for example, the Reynolds number. The first contender we will consider is the Pressure-Convection-Diffusion (PCD) preconditioner. Early results suggest that PCD is indeed a very efficient solver, in particular in two dimensions, as long as the Reynold's number remains small. Next we will try to reorder our degrees of freedom such that we can use GMRES with ILU for our linear solve. Another popular choice we will consider for solving the RANS equations is SIMPLE (and its derivatives). For all of our implementations we make use of either FEniCS or Firedrake, basing our work on both existing implementations of some of these solvers while also writing new extensions for others.

CFD↗

PyFLEXTRKR: a flexible feature tracking Python software for convective cloud analysis

Abstract. This paper describes the new open-source framework PyFLEXTRKR (Python FLEXible object TRacKeR), a flexible atmospheric feature tracking software package with specific capabilities to track convective clouds from a variety of observations and model simulations. This software can track any atmospheric 2D objects and handle merging and splitting explicitly. The package has a collection of multi-object identification algorithms, scalable parallelization options, and has been optimized for large datasets including global high-resolution data. We demonstrate applications of PyFLEXTRKR on tracking individual deep convective cells and mesoscale convective systems from observations and model simulations ranging from large-eddy resolving (∼100s m) to mesoscale (∼10s km) resolutions. Visualization, post-processing, and statistical analysis tools are included in the package. New Lagrangian analyses of convective clouds produced by PyFLEXTRKR applicable to a wide range of datasets and scales facilitate advanced model evaluation and development efforts as well as scientific discovery.

54 ENVIRONMENTAL SCIENCES↗

Multiphysics simulation of microscale copper printing by confined electrodeposition using a nozzle array

3D printing of metals at the microscale and nanoscale is crucial to produce high-density interconnects and intricate structures in electronic devices. Conventional melting and sintering processes are not suitable for these scales due to a reliance on individual metal particles in the size range of tens of micrometers. Confined electrodeposition (CED) is an established alternative to conventional metal 3D printing processes in which an electrolyte is used to selectively induce deposition of the metal on the printing surface. However, commercialization and efficiency of this process have been limited due to a reliance on sub-micrometer nozzles to achieve desirable deposition rates and single nozzle to achieve uniformity of printed structures. Here, we address these challenges by computationally analyzing an array of microscale nozzles. We tailor the convection within the electrolyte to alter both deposition rate and geometric uniformity of the printed structures. The results show that for large nozzles the evaporation alone is not sufficient to obtain high deposition rates, yet an external pressure can be used to increase deposition and alter uniformity (thickness) of printed structures. Our results can be used to design and analyze new experiments toward parallel multi-nozzle deposition using CED toward high-throughput metal printing.

3D printing↗

A high accuracy/resolution spectral element/Fourier–Galerkin method for the simulation of shoaling non-linear internal waves and turbulence in long domains with variable bathymetry

A high-order hybrid continuous-Galerkin numerical method, designed for the simulation of non-linear, non -hydrostatic internal waves and turbulence in long computational domains with complex bathymetry, is presented. The spatial discretization in the non-periodic wave-propagating directions, utilizes the nodal spectral element method. Such a high-order element-based discretization allows the highly accurate representation of complex domain geometry along with the flexibility of concentrating resolution in areas of interest. Under the assumption of the normal-to-isobath propagation of non-linear internal waves, a third periodic direction is incorporated via a Fourier-Galerkin discretization. The distinct non-hydrostatic nature of non-linear internal waves and, any instabilities and turbulence therein, necessitates the numerically challenging solution of the pressure Poisson problem. A defining feature of this work is the application of a domain decomposition approach, combined with block-Jacobi/deflation-based preconditioning to the pressure Poisson problem. Such a combined approach is particularly suitable for the long high aspect-ratio complex domains of interest and enables the efficient high-accuracy reproduction of the non-hydrostatic dynamics of non-linear internal waves. Implementation details are also described in the context of the stability of the solver and its parallelization strategy. A series of benchmarks of increasing complexity demonstrate the robustness of the flow solver. The benchmarks culminate with the three-dimensional simulation of a convectively breaking mode-one non-linear internal wave over a realistic South-China-Sea bathymetric transect and background current/stratification profiles.

Deflation↗

Collaborative Research: Advancing Arctic Climate Projection Capability at Seasonal to Decadal Scales (Final Technical Report)

The Regional Arctic System Model (RASM) at process resolving configurations has been used to (i) advance understanding of physical processes and feedbacks involved in Arctic amplification and (ii) understand and potentially reduce uncertainty in prediction of arctic climate change at seasonal to decadal scales. RASM consists the atmosphere (Weather and Research Forecasting model, WRF), ocean (Parallel Ocean Program, POP), sea ice (CICE), land hydrology (Variable Infiltration Capacity model, VIC), river routing scheme (RVIC), marine biogeochemistry components and the coupling framework (CPL7). Its domain is pan-Arctic, with the atmosphere and land components configured on a 50-km or 25-km grid and four configurations of the ocean and sea ice components: 1/12°(~9.3km) or 1/48°(~2.4km) and 45 or 60 vertical layers. These RASM configurations have been motivated by the emerging exascale capability for high performance computing to improve model fidelity. The dynamical downscaling of reanalysis allows comparison of RASM results with observations in place and time to: (i) advance system level understanding of physical processes and coupling involved in an event, (ii) optimize model parameter space, (iii) diagnose and reduce model biases and (iv) produce realistic and consistent across all the components initial conditions for predictions and predictability studies, which are all unique capabilities not available in global Earth System Models (ESMs). An evaluation of RASM 1.0 (Cassano et al. 2017) revealed that it had a cold bias over the oceans and a warm bias over land areas due largely to cloud and radiation biases in the model, with too little cloud cover simulated over land and too much cloud cover simulated over sub-polar oceans. This study has motivated an upgrade to WRF version 3.7.1 in RASM and allowed for the inclusion of the radiative impact of convective clouds. A variety of atmospheric physics parameterizations were evaluated against observations (e.g. data from the Arctic Clouds in Summer Experiment (ACSE); Sedlar et al. 2020) to identify an optimal suite of WRF physics options in RASM. The RASM with the optimized WRF physics were used to study the impact of strong mesoscale winds over the ocean around the southern tip of Greenland (DuVivier and Cassano 2016) and their impact on oceanic convection (DuVivier et al. 2017a). Data from the PolarWinds field campaign were used to evaluate WRF boundary layer physics and resolution impacts on the simulation of a Greenland barrier wind event (DuVivier et al. 2017b). The RVIC streamflow routing model has been implemented in RASM to realistically represent high-resolution streamflow processes (Hamman et al. 2017) and to couple the land buoyancy fluxes to the ocean. The RASM-RVIC high-resolution data set of all coastal freshwater fluxes for the Arctic drainage basin and surrounding areas for 1979-2014 was published as a separate product (https://doi.org/10.5281/zenodo.293037). The fidelity of atmospheric momentum transfer to and the response of polar marine Ekman layer in RASM and Community Earth System Model (CESM) was investigated by Roberts et al. (2015). The increased frequency of oceanic flux exchange in CESM, following the RASM guidance, caused a considerable increase in the median inertial ice speed across the Southern Ocean and parts of the Arctic. A comprehensive evaluation of the RASM1.0 atmosphere-ocean-sea ice-land interface was completed by Brunke et al. (2018). RASM was also demonstrated for its capability to simulate extreme events in agreement with observations in space and time (Lee et al. submitted). In particular, the development of three open water events, known as polynyas, have been simulated north of Greenland in February of 2011, 2017 and 2018, in agreement with satellite observations for the past four decades. The optimized RASM sea ice results have been favorably evaluated against satellite observations and a subset of eleven CMIP6 models (Watts et al. submitted). In a complementary project, Jin et al. (2018) have shown that RASM with higher-resolution and new sea-ice processes contributed to lower model errors in sea-ice conditions, concentrations of nutrients and ice algae, in comparison to results from the coarse-resolution (1°) CESM. In two other complementary studies, RASM results were used (i) to explain areas of concentrated use by bowhead whales, the seasonal progression in the use, and the physical environment within those areas (Citta et al. 2015) and (ii) for a synthesis of fall bowhead whales distribution and migration in the Bering-Chukchi-Beaufort (BCB) Sea to investigate whale movements and feeding to the local ocean hydrography and currents (Citta et al. 2018). However, the multi-decadal output from the CESM Large Ensemble yielded unrealistic forcing. Instead, the shorter NCEP CFSv2 9-month forecasts were successfully tested and afforded an increased ensemble size (~30) to demonstrate gains of dynamical downscaling at sub-seasonal to intra-annual time scales. The improved model physics and coupling among RASM model components have yielded more realistic representation of the sea ice cover and consistent across all model components initial conditions. Consequently, RASM demonstrates significant gains compared to simulation of sea ice in the NCEP reanalysis. In addition, RASM 6-month ensemble forecasts yield very realistic sea ice distribution, which demonstrates both significant gains of dynamical downscaling and the continued impact of the initial conditions on forecasts out to 6 months (https://nps.edu/web/rasm/predictions). A follow up study using RASM for dynamical downscaling of the more realistic CESM initialized Decadal Prediction Large Ensemble output is currently ongoing as part of the DOE RGMA HiLAT-RASM project.

54 ENVIRONMENTAL SCIENCES↗

MAESTROeX: A Massively Parallel Low Mach Number Astrophysical Solver

@e present MAESTROeX, a massively parallel solver for low Mach number astrophysical flows. The underlying low Mach number equation set allows for efficient, long-time integration for highly subsonic flows compared to compressible approaches. MAESTROeX is suitable for modeling full spherical stars as well as well as planar simulations of dynamics within localized regions of a star, and can robustly handle several orders of magnitude of density and pressure stratification. Previously, we have described the development of the predecessor of MAESTROeX, called MAESTRO, in a series of papers. Here, we present a new, greatly simplified temporal integration scheme that retains the same order of accuracy as our previous approaches. We also explore the use of alternative spatial mapping of the one-dimensional base state onto the full Cartesian grid. The code leverages the new AMReX software framework for block-structured adaptive mesh refinement (AMR) applications, allowing for scalability to large fractions of leadership-class machines. Finally, using our previous studies on the convective phase of single-degenerate progenitor models of SNe Ia as a guide, we characterize the performance of the code and validate the new algorithmic features. Like MAESTRO, MAESTROeX is fully open source.

79 ASTRONOMY AND ASTROPHYSICS↗

Meso- to microscale modeling of atmospheric stability effects on wind turbine wake behavior in complex terrain

Abstract. Terrain-induced flow phenomena modulate wind turbine performance and wake behavior in ways that are not adequately accounted for in typical wind turbine wake and wind plant design models. In this work, we simulate flow over two parallel ridges with a wind turbine on one of the ridges, focusing on conditions observed during the Perdigão field campaign in 2017. Two case studies are selected to be representative of typical flow conditions at the site, including the effects of atmospheric stability: a stable case where a mountain wave occurs (as in ∼ 50 % of the nights observed) and a convective case where a recirculation zone forms in the lee of the ridge with the turbine (as occurred over 50 % of the time with upstream winds normal to the ridgeline). We use the Weather Research and Forecasting Model (WRF), dynamically downscaled from the mesoscale (6.75 km resolution) to microscale large-eddy simulation (LES) at 10 m resolution, where a generalized actuator disk (GAD) wind turbine parameterization is used to simulate turbine wakes. We compare the WRF–LES–GAD model results to data from meteorological towers, lidars, and a tethered lifting system, showing good qualitative and quantitative agreement for both case studies. Significantly, the wind turbine wake shows different amounts of vertical deflection from the terrain and persistence downstream in the two stability regimes. In the stable case, the wake follows the terrain along with the mountain wave and deflects downwards by nearly 100 m below hub height at four rotor diameters downstream. In the convective case, the wake deflects above the recirculation zone over 40 m above hub height at the same downstream distance. Overall, the WRF–LES–GAD model is able to capture the observed behavior of the wind turbine wakes, demonstrating the model's ability to represent wakes over complex terrain for two distinct and representative atmospheric stability classes, and, potentially, to improve wind turbine siting and operation in hilly landscapes.

17 WIND ENERGY↗