Search NASA⌕ Search

SEARCH · Search NASA

Results for “overset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Compare linear-system solver and preconditioner stacks with emphasis on GPU performance and propose phase-2 NGP solver development pathway

The goal of the ExaWind project is to enable predictive simulations of wind farms comprised of many megawatt-scale turbines situated in complex terrain. Predictive simulations will require computational fluid dynamics (CFD) simulations for which the mesh resolves the geometry of the turbines and captures the rotation and large deflections of blades. Whereas such simulations for a single turbine are arguably petascale class, multi-turbine wind farm simulations will require exascale-class resources. The primary physics codes in the ExaWind project are Nalu-Wind, which is an unstructured-grid solver for the acoustically incompressible Navier-Stokes equations, and OpenFAST, which is a whole-turbine simulation code. The Nalu-Wind model consists of the mass-continuity Poisson-type equation for pressure and a momentum equation for the velocity. For such modeling approaches, simulation times are dominated by linear-system setup and solution for the continuity and momentum systems. For the ExaWind challenge problem, the moving meshes greatly affect overall solver costs as reinitialization of matrices and recomputation of preconditioners is required at every time step. In this report we evaluated GPU-performance baselines for the linear solvers in the Trilinos and hypre solver stacks using two representative Nalu-Wind simulations: an atmospheric boundary layer precursor simulation on a structured mesh, and a fixed-wing simulation using unstructured overset meshes. Both strong-scaling and weak-scaling experiments were conducted on the OLCF supercomputer Summit and similar proxy clusters. We focused on the performance of multi-threaded Gauss-Seidel and two-stage Gauss-Seidel that are extensions of classical Gauss-Seidel; of one-reduce GMRES, a communication-reducing variant of the Krylov GMRES; and algebraic multigrid methods that incorporate the afore-mentioned methods. The team has established that AMG methods are capable of solving linear systems arising from the fixed-wing overset meshes on CPU, a critical intermediate result for ExaWind FY20 Q3 and Q4 milestones. For the fixed-wing strong-scaling study (model with 3M grid-points), the team identified that Nalu-Wind simulations with the new Trilinos and hypre solvers scale to modest GPU counts, maintaining above 70% efficiency up to 6 GPUs. However, there still remain significant bottlenecks to performance: matrix assembly (hypre), AMG setup (hypre and Trilinos) In the weak-scaling experiments (going from 0.4M to 211M gridpoints), it's shown that the solver apply phases are faster on GPUs, but that Nalu-Wind simulation times grow, primarily due to the multigrid-setup process. Finally, based on the report outcomes, we propose a linear solver path-forward for the remainder of the ExaWind project. Near term, the NREL team will continue their work on GPU-based linear-system assembly. They will also investigate how the use of alternatives to the NVIDIA UVM (unified virtual memory) paradigm affects performance. Longer term, the NREL team will evaluate algorithmic performance on other types of accelerators and merge their improvements back to the main hypre repository branch. Near term, the Trilinos team will address performance bottlenecks identified in this milestone, such as implementing a GPU-based segregated momentum solve and reusing matrix graphs across linear-system assembly phases. Longer term, the Trilinos team will do detailed analysis and optimization of multigrid setup.

17 WIND ENERGY↗

Coupling hydrodynamics to a rigid-body motion solver for fluid-structure interaction [Slides]

Quinoa is a massively parallel computational fluid dynamics with multi-material and programmed burn capabilities developed from Programmatic and LDRD funds. Overset is a well-established method of using an “inset” mesh that communicates with a background mesh. Solutions transfer freely from one to another and operate as boundary conditions on the opposite mesh. Either mesh can move at specified velocity! This project couples the existing Mesh-to-mesh transfer with Quinoa and demonstrates use of resulting Overset solver in computational simulation of blast effects on a re-entry body for survivability assessments.

42 ENGINEERING↗

CFD Simulation of Floating Body Motion with Mooring Dynamics: Coupling MoorDyn with OpenFOAM

It is increasingly popular to use Computational Fluid Dynamics (CFD) models to study floating structures subjected to ocean waves, especially when it comes to applications of floating offshore wind turbines and Wave Energy Converters (WECs). Mooring dynamics are currently lacking in most of these applications. This paper presents a coupled simulation study of moored floating body motion by coupling two open-source libraries: a finite volume CFD toolbox, OpenFOAM, and a lumped-mass mooring model, MoorDyn. The instantaneous floating body position and velocity are passed from the body motion solver in the CFD model to the mooring model to calculate the fairlead kinematics. The mooring reaction forces, which are calculated by MoorDyn after updating the mooring system states, are then returned to the body motion solver to update the floating body motion. Both mesh deformation and overset mesh methods are used as the mesh motion solver in the CFD model to account for the floating body motion. The coupled model was validated against experimental measurements for a floating box moored with four catenary lines under the action of regular waves, which came from a preliminary test campaign for WECs. Apart from the lumped-mass mooring model, the present work also coupled a quasi-static mooring model and a finite element model with the floating body motion solver in OpenFOAM. The mooring line tensions predicted by these models were compared. The coupled model equipped with three mooring line codes may be further used to carry out survivability studies of FOWTs and WECs subject to severe sea states.

floating body↗

Navigating collinear superspace

We introduce a new set of effective field theory rules for constructing Lagrangians with \( \mathcal{N} \) = 1 supersymmetry in collinear superspace. In the standard superspace treatment, superfields are functions of the coordinates \( \left({x}^{\mu },{\theta}^{\alpha },{\theta}^{\dagger \overset{\cdot }{\alpha }}\right) \) , and supersymmetry preservation is manifest at the Lagrangian level in part due to the inclusion of auxiliary F - and D -term components. By contrast, collinear superspace depends on a smaller set of coordinates ( x μ , η , η † ), where η is a complex Grassmann number without a spinor index. This provides a formulation of supersymmetric theories that depends exclusively on propagating degrees of freedom, at the expense of obscuring Lorentz invariance and introducing inverse momentum scales. After establishing the general framework, we construct collinear superspace Lagrangians for free chiral matter and non-Abelian gauge fields. For the latter construction, an important ingredient is a superfield representation that is simultaneously chiral, anti-chiral, and real; this novel object encodes residual gauge transformations on the light cone. Additionally, we discuss a fundamental obstruction to constructing inter- acting theories with chiral matter; overcoming these issues is the subject of our companion paper, where we introduce a larger set of superfields to realize the full range of interactions compatible with \( \mathcal{N} \) = 1. Along the way, we provide a novel framing of reparametrization invariance using a spinor decomposition, which provides insight into this important light-cone symmetry.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Differential cross-section measurements of Higgs boson production in the H → τ + τ - decay channel in pp collisions at $\sqrt{s}$ = 13 TeV with the ATLAS detector

Differential measurements of Higgs boson production in the τ-lepton-pair decay channel are presented in the gluon fusion, vector-boson fusion (VBF), VH and $t\overline{t}H$ associated production modes, with particular focus on the VBF production mode. The data used to perform the measurements correspond to 140 fb -1 of proton-proton collisions collected by the ATLAS experiment at the LHC. Two methods are used to perform the measurements: the Simplified Template Cross-Section (STXS) approach and an Unfolded Fiducial Differential measurement considering only the VBF phase space. For the STXS measurement, events are categorized by their production mode and kinematic properties such as the Higgs boson’s transverse momentum (${p}_{\textrm{T}}^{\textrm{H}}$ ), the number of jets produced in association with the Higgs boson, or the invariant mass of the two leading jets (mjj). For the VBF production mode, the ratio of the measured cross-section to the Standard Model prediction for m jj > 1.5 TeV and ${p}_{\textrm{T}}^{\textrm{H}}$ > 200 GeV (${p}_{\textrm{T}}^{\textrm{H}}$ < 200 GeV) is ${1.29}_{-0.34}^{+0.39}$ (${0.12}_{-0.33}^{+0.34}$ ). This is the first VBF measurement for the higher-${p}_{\textrm{T}}^{\textrm{H}}$ criteria, and the most precise for the lower-${p}_{\textrm{T}}^{\textrm{H}}$ criteria. The fiducial cross-section measurements, which only consider the kinematic properties of the event, are performed as functions of variables characterizing the VBF topology, such as the signed ΔΦ jj between the two leading jets. The measurements have a precision of 30%–50% and agree well with the Standard Model predictions. These results are interpreted in the SMEFT framework, and place the strongest constraints to date on the CP-odd Wilson coefficient ${c}_{H\overset{\sim }{W}}$ .

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A search for the decays of stopped long-lived particles at $ \sqrt{\mathrm{s}} $ = 13 TeV with the ATLAS detector

A search for long-lived particles, which have come to rest within the ATLAS detector, is presented. The subsequent decays of these particles can produce high-momentum jets, resulting in large out-of-time energy deposits in the ATLAS calorimeters. These de- cays are detected using data collected during periods in the LHC bunch structure when collisions are absent. The analysed dataset is composed of events from proton-proton collisions produced by the Large Hadron Collider at a centre-of-mass energy of s = 13 TeV and recorded by the ATLAS experiment during 2017 and 2018. The dataset used for this search corresponds to a total live time of 579 hours. The results of this search are used to derive lower limits on the mass of gluino R -hadrons, assuming a branching fraction $ \mathcal{B}\left(\overset{\sim }{g}\to q\overline{q}{\chi}_1^0\right) $ B g ~ → q q ¯ χ 1 0 = 100%, with masses of up to 1 . 4 TeV excluded for gluino lifetimes of 10 - 5 to 10 3 s.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Continuously bounds-preserving discontinuous Galerkin methods for hyperbolic conservation laws

For finite element approximations of transport phenomena, it is often necessary to apply a form of limiting to ensure that the discrete solution remains well-behaved and satisfies physical constraints. However, these limiting procedures are typically performed at discrete nodal locations, which is not sufficient to ensure the robustness of the scheme when the solution must be evaluated at arbitrary locations (e.g., for adaptive mesh refinement, remapping in arbitrary Lagrangian–Eulerian solvers, overset meshes, etc.). In this work, a novel limiting approach for discontinuous Galerkin methods is presented which ensures that the solution is continuously bounds-preserving (i.e., across the entire solution polynomial) for any arbitrary choice of basis, approximation order, and mesh element type. Through a modified formulation for the constraint functionals, the proposed approach requires only the solution of a single spatial scalar minimization problem per element for which a highly efficient numerical optimization procedure is presented. Here, the efficacy of this approach is shown in numerical experiments by enforcing continuous constraints in high-order unstructured discontinuous Galerkin discretizations of hyperbolic conservation laws, ranging from scalar transport with maximum principle preserving constraints to compressible gas dynamics with positivity-preserving constraints.

97 MATHEMATICS AND COMPUTING↗

Temperature-dependent phonon lifetimes and thermal conductivity of silicon by inelastic neutron scattering and ab initio calculations

In this paper, inelastic neutron scattering on a single crystal of silicon was performed at temperatures from 100 to 1500 K. These experimental data were reduced to obtain phonon spectral intensity at all wave vectors $\overset{→}{Q}$ and frequencies ω in the first Brillouin zone. Thermal broadenings of the phonon peaks were obtained by fitting and by calculating with an iterative ab initio method that uses thermal atom displacements on an ensemble of superlattices. Agreement between the calculated and experimental broadenings was good, with possible discrepancies at the highest temperatures. Distributions of phonon widths versus phonon energy had similar shapes for computation and experiment. These distributions grew with temperature but maintained similar shapes. Parameters from the ab initio calculations were used to obtain the thermal conductivity from the Boltzmann transport equation, which was in good agreement with experimental data. Despite the high group velocities of longitudinal acoustic phonons, their shorter lifetimes reduced their contribution to the thermal conductivity, which was dominated by transverse acoustic modes.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Energy Exascale Computational Fluid Dynamics Simulations With the Spectral Element Method

Development and application of the open-source GPU-based fluid-thermal simulation code, NekRS, are described. Time advancement is based on an efficient kth-order accurate timesplit formulation coupled with scalable iterative solvers. Spatial discretization is based on the high-order spectral element method (SEM), which affords the use of fast, low-memory, matrix-free operator evaluation. Further, recent developments include support for nonconforming meshes using overset grids and for GPU-based Lagrangian particle tracking. Results of large-eddy simulations of atmospheric boundary layers for wind-energy applications as well as extensive nuclear energy applications are presented.

42 ENGINEERING↗

High- and Mid-Fidelity Modeling Comparison for a Floating Marine Turbine System

There is a lack of suitable numerical tools, particularly open-source tools, that can be used for designing and optimizing marine turbine systems. The National Renewable Energy Laboratory has added features to their widely used mid-fidelity wind turbine modeling code, OpenFAST, to enable modeling of axial-flow marine turbines. This necessitated the addition of several physical effects relevant to marine turbines that are neglected for wind turbines. These include buoyancy, added mass and inertial loads, wave-current superposition, and changes to the coordinate systems. This updated version of OpenFAST allows for the modeling of both fixed and floating marine turbines at a speed comparable to real time. While efficient for large sets of load cases and design studies, mid-fidelity codes make simplifying assumptions that may impact their accuracy. High-fidelity computational fluid dynamics (CFD) simulations can capture more flow effects with fewer assumptions and provide detailed body pressure mapping and flow-field information. It is important to compare predictions between mid-fidelity and high-fidelity codes, both to verify the models and to understand the limitations. A floating marine turbine system was modeled both with OpenFAST and with the commercial CFD code STAR-CCM+. The CFD model used a three-dimensional unsteady Reynolds-averaged Navier-Stokes solver for a volume-of-fluid numerical wave and current tank. The blade-resolved simulations used the sliding-interface technique for the spinning rotor and an overset grid to accommodate the rigid-body motion of the floating system. The mooring system was modeled with a custom coupling of the CFD solver with the open-source code MoorDyn. This improves upon the existing quasi-static catenary solver in STAR-CCM+, which lacks seabed contact or line-to-line connections. Simulation results for a floating marine turbine are compared between OpenFAST and CFD, highlighting the capabilities of the mid-fidelity code and identifying the areas where a high-fidelity approach is needed.

CFD↗

AMR-Wind [SWR-20-85]

AMR-Wind is a massively parallel, block-structured adaptive-mesh, incompressible flow solver for wind turbine and wind farm simulations. The solver is built on top of the AMReX library. AMReX is developed at LBNL , NREL , and ANL as part of the Block-Structured AMR Co-Design Center in DOE's Exascale Computing Project. AMReX library provides the mesh data structures, mesh adaptivity, as well as the linear solvers used for solving the governing equations. The primary applications for AMR-Wind are: performing large-eddy simulations (LES) of atmospheric boundary layer (ABL) flows, simulating wind farm turbine-wake interactions using actuator disk or actuator line models for turbines, and as a background solver when coupled with a near-body solver with overset methodology to perform blade-resolved simulations of multiple wind turbines within a wind farm.

Ananthan, Shreyas↗

kynema-sgf [SWR-20-85]

Kynema-SGF (formerly AMR-Wind), wherein SGF stands for structured-grid fluid dynamics, is a massively parallel, block-structured adaptive-mesh, incompressible flow solver. The codebase was initiated in 2019 from incflo. The solver is built on top of the AMReX library. AMReX library provides the mesh data structures, mesh adaptivity, as well as the linear solvers used for solving the governing equations. Kynema-SGF is actively developed and maintained by a dedicated multi-institutional team from Lawrence Berkeley National Laboratory, National Laboratory of the Rockies, and Sandia National Laboratories. The primary applications for Kynema-SGF are: performing large-eddy simulations (LES) of atmospheric boundary layer (ABL) flows, simulating wind farm turbine-wake interactions using actuator disk or actuator line models for turbines, and as a background solver when coupled with a near-body solver (e.g., Kynema-UGF) with overset methodology to perform blade-resolved simulations of multiple wind turbines within a wind farm. For offshore applications, the ability to model the air-sea interaction effects and its impact on the ABL characteristics is another focus for the code development effort. As with other codes in the Kynema ecosystem, Kynema-SGF shares the following objectives: *an open, well-documented implementation of the state-of-the-art computational models for modeling wind farm flow physics at various fidelities that are backed by a comprehensive verification and validation (V&V) process; *be capable of performing the highest-fidelity simulations of flow fields within wind farms; and *be able to leverage the high-performance leadership class computing facilities available at DOE national laboratories.

Ananthan, Shreyas↗

High temporal frequency data from a four turbine, blade-resolved wind farm simulation with ExaWind

The data was generated with ExaWind (https://github.com/Exawind) which couples AMR-Wind (https://github.com/Exawind/amr-wind/), Nalu-Wind (https://github.com/Exawind/nalu-wind), TIOGA (https://github.com/Exawind/tioga), and OpenFAST (https://github.com/OpenFAST/openfast). This is a large-scale simulation of a blade-resolved wind farm using the ExaWind software stack. ExaWind couples together a background flow solver, AMR-Wind, and a near-body solver, Nalu-Wind, through an overset technique from the TIOGA application. Another application, OpenFAST, handles the structural dynamics of the turbine blades and towers, which informs the fluid-structure interaction of the wind turbines with the flow solvers. This particular simulation includes four blade-resolved wind turbines operating in a turbulent atmospheric boundary layer. The AMR-Wind solver uses 500 million cells and is being solved on 256 AMD GPUs of the Oakridge Leadership Computing Facility Frontier supercomputer. Each turbine is assigned its own Nalu-Wind solver with over 13 million elements per turbine and solved using 448 CPU cores, for a total of 1792 CPU cores. For each node, 56 cores contain Nalu-Wind, while 8 cores correspond to AMR-Wind operations on the GPUs. Consequently, ExaWind is entirely utilizing the CPUs and the GPUs of the nodes concurrently. The data used in the visualization is full flow field data output from the simulation. It is lossy-compressed to a specific accuracy using ZFP and written to disk every 16 time-steps to enable real-time flow visualization. The flow fields are sampled at a high temporal frequency to enable real-time, 24fps visualization. The flow fields are sampled every 12 simulation time steps (every 0.04132s).

17 WIND ENERGY↗

High fidelity blade-resolved and actuator line data from a 16 turbine wind farm simulation using ExaWind

This data was generated with the ExaWind code suite (https://github.com/Exawind) as a demonstration of a large, 16 turbine wind farm simulation, calculated using two different levels of fidelity. The lower level of fidelity approach uses an actuator line approach to represent the turbines, and was simulated with AMR-Wind (https://github.com/Exawind/amr-wind/) as the background flow solver, coupled to OpenFAST (https://github.com/OpenFAST/openfast). The higher level of fidelity simulation uses a blade-resolved approach, and is done using AMR-Wind, Nalu-Wind (https://github.com/Exawind/nalu-wind), OpenFAST, and TIOGA (https://github.com/Exawind/tioga). In the blade-resolved simulation, ExaWind couples together a background flow solver, AMR-Wind, and a near-body solver, Nalu-Wind, through an overset technique from the TIOGA application. OpenFAST handles the structural dynamics of the turbine blades and towers, which informs the fluid-structure interaction of the wind turbines with the flow solvers. In the actuator line simulation, a mesh of 295M elements was used for a 5km x 5km domain, and it was simulated using 256 nodes (2048 GPU's) on the Oak Ridge Leadership Computing Facility Frontier supercomputer. For the blade-resolved simulation, 1.5B element mesh was used in the AMR-Wind background 5km x 5km domain, and 16M elements were used for each turbine in the Nalu-Wind domains, for a total of 1.7B elements. This was simulated using 384 nodes on Frontier, with each node using 56 cores for Nalu-Wind and 8 GPU cores. The data in this archive includes the turbine outputs from OpenFAST, 2D sampling planes from AMR-Wind, and full-field solution files from AMR-Wind and Nalu-Wind.

17 WIND ENERGY↗

TEAMER - Extreme Events Modeling for the MARMOK-OWC Wave Energy Converter

Through the TEAMER program, Sandia National Laboratories (SNL) collaborated with IDOM Incorporated to study their MARMOK-Oscillating Water Column (MARMOK-OWC) wave energy conversion device. The study yielded a quantitative understanding of hydrodynamic pressures on the oscillating water column (OWC) device surfaces, the mooring tensions, and the dynamic performance of the device under extreme ocean wave conditions. This project utilized a comprehensive multi-phase Navier-Stokes flow solver with an overset body-fit mesh to predict fluid velocities and hydrodynamic forces on the MARMOK-OWC device. Computational Fluid Dynamics (CFD) analysis were conducted using OpenFOAM. This data includes the OpenFOAM cases (setup and data) to run the extreme events developed during the project. This project is part of the TEAMER RFTS 4 (request for technical support) program.

16 TIDAL AND WAVE POWER↗

Department of Energy Project DE-SC0012198: Probing Electron-Molecule Scattering with HHG: Theory and Experiment (Final Report)

The study of the motion of atoms in molecules is important to understanding many areas of physical and life sciences. Such motion occurs on many different times scales, with electronic motion occurring on a sub-femtosecond time scale, and simple vibrational motion in tens to hundreds of femtoseconds. One way to follow such processes in real time is by the use of shortpulsed lasers, and in particular by studying time-resolved photoionization and the related process of high-harmonic generation (HHG). Thus there has been much effort to develop the tools necessary to probe molecular systems using short pulse lasers and understanding the sensitivity of the different possible probes to the time dependent geometric structure as well as the electronic structure of molecules. Our research has particularly focused on the connection between high-field processes and the more traditional weak field photoionization processes. Strong field and weak field processes can be connected through models that involve the same matrix elements. We have demonstrated in our study of HHG from SF 6 that the spectrum is sensitive to the interplay between the angular dependence of the ionization step and recombination step. In our study of rescattering spectroscopy, we have shown that with a combination of experiment and theory, we can use this high-field spectroscopy to determine molecular structure in molecules such as C 2 H 4 . We have also developed new computational tools based on overset grids to enable studies on larger molecular systems which use much more robust numerical approaches so that the resulting code can be a tool that non-specialists can use to study related systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Demonstration and performance testing of extreme-resolution simulations with static meshes on Summit (CPU & GPU) for a parked-turbine configuration and an actuator-line (mid-fidelity model) wind farm configuration (ECP-Q4 FY2020 Milestone Report)

The goal of the ExaWind project is to enable predictive simulations of wind farms comprised of many megawatt-scale turbines situated in complex terrain. Predictive simulations will require computational fluid dynamics (CFD) simulations for which the mesh resolves the geometry of the turbines and captures the rotation and large deflections of blades. Whereas such simulations for a single turbine are arguably petascale class, multi-turbine wind farm simulations will require exascale-class resources. The primary physics codes in the ExaWind simulation environment are Nalu-Wind, an unstructured-grid solver for the acoustically incompressible Navier-Stokes equations, AMR-Wind, a block-structured-grid solver with adaptive mesh refinement capabilities, and OpenFAST, a wind-turbine structural dynamics solver. The Nalu-Wind model consists of the mass-continuity Poisson-type equation for pressure and Helmholtz-type equations for transport of momentum and other scalars. For such modeling approaches, simulation times are dominated by linear-system setup and solution for the continuity and momentum systems. For the ExaWind challenge problem, the moving meshes greatly affect overall solver costs as reinitialization of matrices and recomputation of preconditioners is required at every time step. The choice of overset-mesh methodology to model the moving and non-moving parts of the computational domain introduces constraint equations in the elliptic pressure-Poisson solver. The presence of constraints greatly affects the performance of algebraic multigrid preconditioners.

17 WIND ENERGY↗

FY2022 Q4: Demonstrate multi-turbine simulation with hybrid-structured/unstructured-moving-grid software stack running primarily on GPUs and propose improvements for successful KPP-2 [Poster]

Milestone accomplishments staged the ExaWind team for successful completion of KPP-2 challenge problem in FY23, which requires the simulation on Frontier of at least four MW-scale turbines in an atmospheric boundary layer with at least 20B gridpoints. The ExaWind project and software stack is many faceted, with team members working on multiple areas, including linear-system solvers (Trilinos, hypre, AMReX), overset meshes, turbulence modeling, and in situ visualization, all with an aim for high fidelity predictions and performance portability. This milestone marks significant improvements on many fronts and provides the team with a pathway to exascale wind farm simulations in FY23.

17 WIND ENERGY↗