Search NASA⌕ Search

SEARCH · Search NASA

Results for “SCALE Code System”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Predictive Modeling of Carbon Ablators

Efforts to build a Predictive Material Modeling (PMM) framework from the micro-scale to the macro-scale are presented in this abstract. To reduce the need for extensive testing, accelerate the design cycle process, and reduce uncertainty margins applied to final designs, NASA is developing simulation and modeling tools that enable characterization of material properties and response to high-enthalpy environments. The Porous Microstructure Analysis (PuMA) code has been developed for computing macroscale (volume averaged) properties of porous materials using microscale images from micro-computed tomography (micro-CT). Microscale modeling requires a realistic representation of a material microstructure; these are obtained either synthetically during the design of the material or through X-ray micro-CT. Volume averaged properties are then used to inform macroscale material response models, such as those implemented in the Porous-material Analysis Toolbox based on OpenFOAM (PATO) software, also actively developed by NASA. The computational model in PATO is a generic heat and mass transfer model for porous reactive materials containing several solid phases and a single gas phase. The detailed chemical interactions occurring between the solid phases and the gas phase are modeled at the pore scale assuming local thermal equilibrium. These tools were developed to efficiently interface with other pre-existing codes such as SPARTA (direct simulation Monte Carlo), DPLR (hypersonic CFD), NEQAIR (radiative transport) and DAKOTA (uncertainty quantification and optimization). Detailed flight data (Mars Science Laboratory [MSL] Entry Descent and Landing Instrument [MEDLI]) is critical for validating these computational tools for NASA applications. Examples of modeling ablative material response using these codes will be presented including 3D simulations of the full-scale heatshield of the MSL capsule. The simulations demonstrate the ability of the modern material response code, PATO, to handle the material response of geometrically complex and large domains, through the use of massively parallel computations.

Thermal Protection Systems↗
DOE OSTI2024

Structure Factors for Hot Neutron Matter from Ab Initio Lattice Simulations with High-Fidelity Chiral Interactions

We present the first ab initio lattice calculations of spin and density correlations in hot neutron matter using high-fidelity interactions at next-to-next-to-next-to-leading order in chiral effective field theory. These correlations have a large impact on neutrino heating and shock revival in core-collapse supernovae and are encapsulated in functions called structure factors. Unfortunately, calculations of structure factors using high-fidelity chiral interactions were well out of reach using existing computational methods. In this Letter, we solve the problem using a computational approach called the rank-one operator (RO) method. The RO method is a general technique with broad applications to simulations of fermionic many-body systems. It solves the problem of exponential scaling of computational effort when using perturbation theory for higher-body operators and higher-order corrections. Using the RO method, we compute the vector and axial static structure factors for hot neutron matter as a function of temperature and density. Here, the ab initio lattice results are in good agreement with virial expansion calculations at low densities but are more reliable at higher densities. Random phase approximation codes used to estimate neutrino opacity in core-collapse supernovae simulations can now be calibrated with ab initio lattice calculations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Modeling mesoscale fission gas behavior in UO2 by directly coupling the phase field method to spatially resolved cluster dynamics

Abstract Fission gas release within uranium dioxide nuclear fuel occurs as gas atoms diffuse through grains and arrive at grain boundary (GB) bubbles; these GB bubbles grow and interconnect with grain edge bubbles; and grain edge tunnels grow and connect to free surfaces. In this study, a hybrid multi-scale/multi-physics simulation approach is presented to investigate these mechanisms of fission gas release at the mesoscale. In this approach, fission gas production, diffusion, clustering to form intragranular bubbles, and re-solution within grains are included using spatially resolved cluster dynamics in the Xolotl code. GB migration and intergranular bubble growth and coalescence are included using the phase field method in the MARMOT code. This hybrid model couples Xolotl to MARMOT using the MultiApp and Transfer systems in the MOOSE framework, with Xolotl passing the arrival rate of gas atoms at GBs and intergranular bubble surfaces to MARMOT and MARMOT passing evolved GBs and bubble surface positions to Xolotl. The coupled approach performs well on the two-dimensional simulations performed in this work, producing similar results to the standard phase field model when Xolotl does not include fission gas clustering or re-solution. The hybrid model performs well computationally, with a negligible cost of coupling Xolotl and MARMOT and good parallel scalability. The hybrid model predicts that intragranular fission gas clustering and bubble formation results in up to 70% of the fission gas being trapped within grains, causing the increase in the intergranular bubble fraction to slow by a factor of six. Re-solution has a small impact on the fission gas behavior at 1800 K but it has a much larger impact at 1000 K, resulting in a twenty-times increase in the concentration of single gas atoms within grains. Due to the low diffusion rate, this increase in mobile gas atoms only results in a small acceleration in the growth of the intergranular bubble fraction. Finally, the hybrid model accounts for migrating GBs sweeping up gas atoms. This results in faster intergranular bubble growth with smaller initial grain sizes, since the additional GB migration results in more immobile gas clusters reaching GBs.

Kim, Dong-Uk↗
DOE OSTI2018

Design Studies for Deep-Water Floating Offshore Vertical Axis Wind Turbines

Deep-water offshore sites are an untapped opportunity to bring large-scale offshore wind energy to coastal population centers. The primary challenge has been the projected high costs for floating offshore wind systems. This work presents a comprehensive investigation of a new opportunity for deep-water offshore wind using large-scale vertical axis wind turbines. Owing to inherent features of this technology, there is a potential transformational opportunity to address the major cost drivers for floating wind using vertical axis wind turbines. The focus of this report is to evaluate the technical potential for this new technology. The approach to evaluating this potential was to perform system design studies focused on improving the understanding of technical performance parameters while looking for cost reduction opportunities. VAWT design codes were developed in order to perform these design studies. To gain a better understanding of the design space for floating VAWT systems, a comprehensive design study of multiple rotor configuration options was carried out. Floating platforms and moorings were then sized and evaluated for each of the candidate rotor configurations. Preliminary LCOE estimates and LCOE ranges were produced based on the design study results for each of the major turbine and system components. The major outcomes of this study are a comprehensive technology assessment of VAWT performance and preliminary LCOE estimates that demonstrate that floating VAWTs may have favorable performance and costs in comparison to conventional HAWTs in the deep-water offshore environment where floating systems are required, indicating that this new technology warrants further study.

17 WIND ENERGY↗
DOE OSTI2024

Ultrafast Surface Phosphor Thermometry for Pulsed-power and Hostile Environments

Modern concepts for next generation pulsed power (NGPP) are slated to deliver up to ten times the energy of Z today. An increase of this magnitude is concerning insofar that Z currently exhibits sizable amounts of inner magnetically insulated transmission line (MITL) loss current on the order of 5-10%. Loss phenomenon in these systems are complex and electrode heating and subsequent thermal desorption are a leading cause. Rapid heat-driven thermal desorption of contaminants scales as the square of the current. Therefore, even a modest doubling of drive current would yield an ~ 4X in non-linear surface electrode heating, quickening thermal desorption-based current loss. Exacerbating these physics is a current inability to measure ultra fast heating rates (>20°C/ns), which are paramount to benchmarking and code validation critical to NGPP design – as an empirical approach is not viable. Therefore, Ultrafast Photoluminescent Surface Heating Optical Thermometry (UP-SHOT) was developed as a new diagnostic for measurement of GHz-scale electrode heating. The discovery of UP-SHOT leveraged expertise in Engineering Science, Material Science, Pulsed-Power, and the Center for Integrated Nanotechnologies. This report includes information on: 1) The preparation of zinc oxide (ZnO) films, characterization, post-deposition treatments 2) Time-resolved photoluminescence at elevated temperatures and thermographic sensitivity

36 MATERIALS SCIENCE↗
DOE OSTI2026

Truchas Overview

Truchas and Truchas-PBF are two sister codes for part-scale multi-physics modeling of manufacturing processes. Both programs are open source and made publicly available. They’re designed for efficient use of HPC resources and can be programmatically driven from Python packages. This enables automatic execution and analysis of ensembles of simulations, in some cases allowing 1000s of simulations to be evaluated in a day on HPC. Beyond just giving engineers a window into the concealed internal state of a system, the goal of Truchas is to provide a framework for developing novel manufacturing processes by understanding how the entire space of engineering inputs affects thermal state. It often is used to explore combinations of capabilities uncommon in commercial software, or to scale up analyses beyond the capabilities of commercial software.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1992

Optical systems integrated modeling

An integrated modeling capability that provides the tools by which entire optical systems and instruments can be simulated and optimized is a key technology development, applicable to all mission classes, especially astrophysics. Many of the future missions require optical systems that are physically much larger than anything flown before and yet must retain the characteristic sub-micron diffraction limited wavefront accuracy of their smaller precursors. It is no longer feasible to follow the path of 'cut and test' development; the sheer scale of these systems precludes many of the older techniques that rely upon ground evaluation of full size engineering units. The ability to accurately model (by computer) and optimize the entire flight system's integrated structural, thermal, and dynamic characteristics is essential. Two distinct integrated modeling capabilities are required. These are an initial design capability and a detailed design and optimization system. The content of an initial design package is shown. It would be a modular, workstation based code which allows preliminary integrated system analysis and trade studies to be carried out quickly by a single engineer or a small design team. A simple concept for a detailed design and optimization system is shown. This is a linkage of interface architecture that allows efficient interchange of information between existing large specialized optical, control, thermal, and structural design codes. The computing environment would be a network of large mainframe machines and its users would be project level design teams. More advanced concepts for detailed design systems would support interaction between modules and automated optimization of the entire system. Technology assessment and development plans for integrated package for initial design, interface development for detailed optimization, validation, and modeling research are presented.

Shannon, Robert R.↗
NASA NTRS1996

Dynamic Performance of High Bypass Ratio Turbine Engines With Water Ingestion

The research on dynamic performance of high bypass turbofan engines includes studies on inlets, turbomachinery and the total engine system operating with air-water mixture; the water may be in vapor, droplet, or film form, and their combinations. Prediction codes (WISGS, WINCOF, WINCOF-1, WINCLR, and Transient Engine Performance Code) for performance changes, as well as changes in blade-casing clearance, have been established and demonstrated in application to actual, generic engines. In view of the continuous changes in water distribution in turbomachinery, the performance of both components and the total engine system must be determined in a time-dependent mode; hence, the determination of clearance changes also requires a time-dependent approach. In general, the performance and clearances changes cannot be scaled either with respect to operating or ingestion conditions. Removal of water prior to phase change is the most effective means of avoiding ingestion effects. Sufficient background has been established to perform definitive, full scale tests on a set of components and a complete engine to establish engine control and operability with various air-water vapor-water mixtures.

Murthy, S. N. B.↗
NASA NTRS2009

NASA Tech Briefs, September 2009

opics covered include: Filtering Water by Use of Ultrasonically Vibrated Nanotubes; Computer Code for Nanostructure Simulation; Functionalizing CNTs for Making Epoxy/CNT Composites; Improvements in Production of Single-Walled Carbon Nanotubes; Progress Toward Sequestering Carbon Nanotubes in PmPV; Two-Stage Variable Sample-Rate Conversion System; Estimating Transmitted-Signal Phase Variations for Uplink Array Antennas; Board Saver for Use with Developmental FPGAs; Circuit for Driving Piezoelectric Transducers; Digital Synchronizer without Metastability; Compact, Low-Overhead, MIL-STD-1553B Controller; Parallel-Processing CMOS Circuitry for M-QAM and 8PSK TCM; Differential InP HEMT MMIC Amplifiers Embedded in Waveguides; Improved Aerogel Vacuum Thermal Insulation; Fluoroester Co-Solvents for Low-Temperature Li+ Cells; Using Volcanic Ash to Remove Dissolved Uranium and Lead; High-Efficiency Artificial Photosynthesis Using a Novel Alkaline Membrane Cell; Silicon Wafer-Scale Substrate for Microshutters and Detector Arrays; Micro-Horn Arrays for Ultrasonic Impedance Matching; Improved Controller for a Three-Axis Piezoelectric Stage; Nano-Pervaporation Membrane with Heat Exchanger Generates Medical-Grade Water; Micro-Organ Devices; Nonlinear Thermal Compensators for WGM Resonators; Dynamic Self-Locking of an OEO Containing a VCSEL; Internal Water Vapor Photoacoustic Calibration; Mid-Infrared Reflectance Imaging of Thermal-Barrier Coatings; Improving the Visible and Infrared Contrast Ratio of Microshutter Arrays; Improved Scanners for Microscopic Hyperspectral Imaging; Rate-Compatible LDPC Codes with Linear Minimum Distance; PrimeSupplier Cross-Program Impact Analysis and Supplier Stability Indicator Simulation Model; Integrated Planning for Telepresence With Time Delays; Minimizing Input-to-Output Latency in Virtual Environment; Battery Cell Voltage Sensing and Balancing Using Addressable Transformers; Gaussian and Lognormal Models of Hurricane Gust Factors; Simulation of Attitude and Trajectory Dynamics and Control of Multiple Spacecraft; Integrated Modeling of Spacecraft Touch-and-Go Sampling; Spacecraft Station-Keeping Trajectory and Mission Design Tools; Efficient Model-Based Diagnosis Engine; and DSN Simulator.

Source record↗
DOE OSTI2025

Quantum simulations of nuclear resonances with variational methods

Background: The many-body nature of nuclear physics problems poses significant computational challenges. These challenges become even more pronounced when studying the resonance states of nuclear systems, which are governed by the non-Hermitian Hamiltonian. Quantum computing, particularly for quantum many-body systems, offers a promising alternative, especially within the constraints of current noisy intermediate-scale quantum (NISQ) devices. Purpose: This work aims to simulate nuclear resonances using quantum algorithms by developing a variational framework compatible with non-Hermitian Hamiltonians and implementing it fully on a quantum simulator. Methods: We employ the complex scaling technique to extract resonance positions classically and adapt it for quantum simulations using a two-step algorithm. First, we transform the non-Hermitian Hamiltonian into a Hermitian form by using the energy variance as a cost function within a variational framework. Second, we perform 𝜃-trajectory calculations to determine optimal resonance positions in the complex energy plane. To address resource constraints on NISQ devices, we utilize Gray code (GC) encoding to reduce qubit requirements. Results: We first validate our approach using a schematic potential model that mimics a nuclear potential, successfully reproducing known resonance energies with high fidelity. We then extend the method to a more realistic 𝛼−𝛼 nuclear potential and compute the 𝐷- and 𝐺-wave resonance energies with a basis size of 𝑁=16, using only four qubits. The quantum simulation results closely match the classical values, demonstrating the feasibility of our approach. Conclusions: This study demonstrates, for the first time, that the complete 𝜃-trajectory method can be implemented on a quantum computer without relying on any classical input beyond the Hamiltonian. The results establish a scalable and efficient quantum framework for simulating resonance phenomena in nuclear systems. This work represents a significant step toward quantum simulations of open quantum systems and lays the foundation for future investigations into resonance structures in nuclear, atomic, and molecular physics.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS1994

Rapid solution of large-scale systems of equations

The analysis and design of complex aerospace structures requires the rapid solution of large systems of linear and nonlinear equations, eigenvalue extraction for buckling, vibration and flutter modes, structural optimization and design sensitivity calculation. Computers with multiple processors and vector capabilities can offer substantial computational advantages over traditional scalar computer for these analyses. These computers fall into two categories: shared memory computers and distributed memory computers. This presentation covers general-purpose, highly efficient algorithms for generation/assembly or element matrices, solution of systems of linear and nonlinear equations, eigenvalue and design sensitivity analysis and optimization. All algorithms are coded in FORTRAN for shared memory computers and many are adapted to distributed memory computers. The capability and numerical performance of these algorithms will be addressed.

Storaasli, Olaf O.↗
DOE OSTI2020

Towards simulation of the dynamics of materials on quantum computers

A highly anticipated application for quantum computers is as a universal simulator of quantum many-body systems, as was conjectured by Richard Feynman in the 1980s. The last decade has witnessed the growing success of quantum computing for simulating static properties of quantum systems, i.e., the ground state energy of small molecules. However, it remains a challenge to simulate quantum many-body dynamics on current-to-near-future noisy intermediate-scale quantum computers. In this work, we demonstrate successful simulation of nontrivial quantum dynamics on IBM's Q16 Melbourne quantum processor and Rigetti's Aspen quantum processor; namely, ultrafast control of emergent magnetism by THz radiation in an atomically-thin two-dimensional material. The full code and step-by-step tutorials for performing such simulations are included to lower the barrier to access for future research on these two quantum computers. As such, this work lays a foundation for the promising study of a wide variety of quantum dynamics on near-future quantum computers, including dynamic localization of Floquet states and topological protection of qubits in noisy environments.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Adaptive Generation of Training Data for ML Reduced Model Creation

Machine learning proxy models are often used to speed up or completely replace complex computational models. The greatly reduced and deterministic computational costs enable new use cases such as digital twin control systems and global optimization. The challenge of building these proxy models is generating the training data. A naive uniform sampling of the input space can result in a non-uniform sampling of the output space of a model. This can cause gaps in the training data coverage that can miss finer scale details resulting in poor accuracy. While larger and larger data sets could eventually fill in these gaps, the computational burden of full-scale simulation codes can make this prohibitive. In this paper, we present an adaptive data generation method that utilizes uncertainty estimation to identify regions where training data should be augmented. By targeting data generation to areas of need, representative data sets can be generated efficiently. The effectiveness of this method will be demonstrated on a simple one-dimensional function and a complex multidimensional physics model.

Cianciosa, Mark↗
NASA NTRS1992

Application of computational fluid dynamics to the design of the film cooled STME subscale nozzle for the National Launch System

The status of computational fluid dynamics (CFD) calculations for the Space Transportation Main Engine (STME) film/dump cooled nozzle design is presented, with an emphasis on the timely impact of CFD on the design of the sub-scale nozzle coolant system. The following aspects of the sub-scale coolant delivery system were analyzed with CFD: 1) a design trade study of a mechanical flow splitting device for uniform distribution of the subsonic cavity flow, 2) a design trade study of the subsonic cavity lip to achieve film integrity, and 3) an analysis of the primary flow interaction with the core/secondary coolant streams. All design calculations were performed with the Generalized Aerodynamic Simulation Program (GASP), a 3-D, multi-block, generalized Navier-Stokes code capable of solving with frozen, finite-rate or equilibrium chemical kinetics. The initial design of the subsonic cavity flow used square posts to distribute the sonic orifice jets into a uniform flow. Calculations for this design indicated that an unacceptable mal-distribution of film occurred. Design modifications involving curved and slotted posts were computed in an effort to uniformly distribute the secondary coolant flow. Analysis of these configurations showed that although the flowfield improved in uniformity, it was still unacceptable, especially at higher feed pressures. Results from these studies were then incorporated into a design that resulted in the insertion of a porous metal ring into the subsonic cavity. Subsequent water flow model studies showed that this concept was successful in uniformly distributing flow exiting the cavity. In addition to the design of the subsonic cavity, CFD was also used to analyze the secondary coolant lip and the primary flow interaction with the core/secondary coolant streams. A series of calculations were first performed to modify the subsonic cavity lip contour. The flow over the modified lip was then computed simultaneously with the primary injectors to determine the impact of the subsonic coolant stream on the primary slot jets. Pressure, temperature, velocity, and coolant mass fraction contours are presented for these configurations. Information is given in viewgraph form.

Garrett, Joseph L.↗
NASA NTRS1992

Full-scale high angle-of-attack tests of an F/A-18

This paper presents an overview of high angle-of-attack tests of a full-scale F/A-18 in the 80- by 120-Foot Wind Tunnel of the National Full-Scale Aerodynamic Complex at NASA Ames Research Center at Moffett Field, California. A production aircraft was tested over an angle-of-attack range of 18 to 50 deg and at wind speeds of up to 100 knots. These tests had three primary test objectives. Pneumatic and mechanical forebody flow control devices were tested at full-scale and shown to produce significant yawing moments for lateral control of the aircraft at high angles of attack. Mass flow requirements for the pneumatic system were found to scale with freestream density and speed rather than freestream dynamic pressure. Detailed measurements of the pressures buffeting the vertical tail were made and spatial variations in the buffeting frequency were found. The LEX fence was found to have a significant effect on the frequency distribution on the outboard surface of the vertical fin. In addition to the above measurements, an extensive set of data was acquired for the validation of computational fluid dynamics codes and for comparison with flight test and small-scale wind tunnel test results.

Meyn, Larry A.↗
NASA NTRS2012

Continental-scale Validation of MODIS-based and LEDAPS Landsat ETM+ Atmospheric Correction Methods

The potential of Landsat data processing to provide systematic continental scale products has been demonstrated by several projects including the NASA Web-enabled Landsat Data (WELD) project. The recent free availability of Landsat data increases the need for robust and efficient atmospheric correction algorithms applicable to large volume Landsat data sets. This paper compares the accuracy of two Landsat atmospheric correction methods: a MODIS-based method and the Landsat Ecosystem Disturbance Adaptive Processing System (LEDAPS) method. Both methods are based on the 6SV radiative transfer code but have different atmospheric characterization approaches. The MODIS-based method uses the MODIS Terra derived dynamic aerosol type, aerosol optical thickness, and water vapor to atmospherically correct ETM+ acquisitions in each coincident orbit. The LEDAPS method uses aerosol characterizations derived independently from each Landsat acquisition and assumes a fixed continental aerosol type and uses ancillary water vapor. Validation results are presented comparing ETM+ atmospherically corrected data generated using these two methods with AERONET corrected ETM+ data for 95 10 km×10 km 30 m subsets, a total of nearly 8 million 30 m pixels, located across the conterminous United States. The results indicate that the MODIS-based method has better accuracy than the LEDAPS method for the ETM+ red and longer wavelength bands.

Landsat↗
NASA NTRS2014

HEMCO v1.0: A Versatile, ESMF-Compliant Component for Calculating Emissions in Atmospheric Models

We describe the Harvard-NASA Emission Component version 1.0 (HEMCO), a stand-alone software component for computing emissions in global atmospheric models. HEMCO determines emissions from different sources, regions, and species on a user-defined grid and can combine, overlay, and update a set of data inventories and scale factors, as specified by the user through the HEMCO configuration file. New emission inventories at any spatial and temporal resolution are readily added to HEMCO and can be accessed by the user without any preprocessing of the data files or modification of the source code. Emissions that depend on dynamic source types and local environmental variables such as wind speed or surface temperature are calculated in separate HEMCO extensions. HEMCO is fully compliant with the Earth System Modeling Framework (ESMF) environment. It is highly portable and can be deployed in a new model environment with only few adjustments at the top-level interface. So far, we have implemented HEMCO in the NASA Goddard Earth Observing System (GEOS-5) Earth system model (ESM) and in the GEOS-Chem chemical transport model (CTM). By providing a widely applicable framework for specifying constituent emissions, HEMCO is designed to ease sensitivity studies and model comparisons, as well as inverse modeling in which emissions are adjusted iteratively. The HEMCO code, extensions, and the full set of emissions data files used in GEOS-Chem are available at http: //wiki.geos-chem.org/HEMCO.

GEOS-5↗
DOE OSTI2018

Deploy threading in Nalu solver stack

The goal of the ExaWind project is to enable predictive simulations of wind farms composed of many MW-scale turbines situated in complex terrain. Predictive simulations will require computational fluid dynamics (CFD) simulations for which the mesh resolves the geometry of the turbines, and captures the rotation and large deflections of blades. Whereas such simulations for a single turbine are arguably petascale class, multi-turbine wind farm simulations will require exascale-class resources. The primary code in the ExaWind project is Nalu, which is an unstructured-grid solver for the acousticallyincompressible Navier-Stokes equations, and mass continuity is maintained through pressure projection. The model consists of the mass-continuity Poisson-type equation for pressure and a momentum equation for the velocity. For such modeling approaches, simulation times are dominated by linear-system setup and solution for the continuity and momentum systems. For the ExaWind challenge problem, the moving meshes greatly affect overall solver costs as re-initialization of matrices and re-computation of preconditioners is required at every time step In this Milestone, we examine the effect of threading on the solver stack performance against flat-MPI results obtained from previous milestones using Haswell performance data full-turbine simulations. Whereas the momentum equations are solved only with the Trilinos solvers, we investigate two algebraic-multigrid preconditioners for the continuity equations: Trilinos/Muelu and HYPRE/BoomerAMG. These two packages embody smoothed-aggregation and classical Ruge-Stiiben AMG methods, respectively. In our FY18 Q2 report, we described our efforts to improve setup and solve of the continuity equations under flat-MPI parallelism. While significant improvement was demonstrated in the solve phase, setup times remained larger than expected. Starting with the optimized settings described in the Q2 report, we explore here simulation performance where OpenMP threading is employed in the solver stack. For Trilinos, threading is acheived through the Kokkos abstraction where, whereas HYPRE/BoomerAMG employs straight OpenMP. We examined results for our mid-resolution baseline turbine simulation configuration (229M DOF). Simulations on 2048 Haswell cores explored the effect of decreasing the number of MPI ranks while increasing the number of threads. Both HYPRE and Trilinos exhibited similar overal solution times, and both showed dramatic increases in simulation time in the shift from MPI ranks to OpenMP threads. This increase is attributed to the large amount of work per MPI rank starting at the single-thread configuration. Decreasing MPI ranks, while increasing threads, may be increasing simulation time due to thread synchronization and start-up overhead contributing to the latency and serial time in the model. These result showed that an MPI+OpenMP parallel decomposition will be more effective as the amount per MPI rank computation per MPI rank decreases and the communication latency increases. This idea was demonstrated in a strong scaling study of our low-resolution baseline model (29M DOF) with the Trilinos-HYPRE configuration. While MPI-only results showed scaling improvement out to about 1536 cores, engaging threading carried scaling improvements out to 4128 cores — roughly 7000 DOF per core. This is an important result as improved strong scaling is needed for simulations to be executed over sufficiently long simulated durations (i.e., for many timesteps). In addition to threading work described above, the team examined solver-performance improvements by exploring communication-overhead in the HYPRE-GMRES implementation through a communicationoptimal- GMRE algorithm (CO-GMRES), and offloading compute-intensive solver actions to GPUs. To those ends, a HYPRE mini-app was allow us to easily test different solver approaches and HYPRE parameter settings without running the entire Nalu code. With GPU acceleration on the Summitdev supercomputer, a 20x speedup was achieved for the overall preconditioner and solver execution time for the mini-app. A study on Haswell processors showed that CO-GMRES provides benefits as one increases MPI ranks.

17 WIND ENERGY↗