Search NASA⌕ Search

SEARCH · Search NASA

Results for “exascale simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

On the Generation of Weddell Sea Polynyas in a High-Resolution Earth System Model

Larger Weddell Sea polynyas (WSPs), differentiated in this study from the smaller Maud Rise Polynyas (MRPs), forming to the east of the prime meridian in the proximity of the Maud Rise seamount, have last been observed in the 1970s. We investigate WSPs that grow realistically out of MRPs in a high-resolution (HR) preindustrial simulation with the Energy Exascale Earth System Model version 0.1. The formation of MRPs requires HR to simulate the detailed flow around Maud Rise, while the realistic formation of WSPs requires a model to produce MRPs. Furthermore, WSPs tend to follow periods of a prolonged build-up of a heat reservoir at depth and weakly negative wind-stress curl in association with the core of the southern hemisphere westerlies at an anomalously northern position. While this scenario also leads to drier conditions over the central Weddell Sea, which some literature claims to be a necessary condition for the formation of WSPs, our model results indicate that open-ocean polynyas do not occur during periods of weakly negative wind-stress curl despite drier atmospheric conditions. Our study supports the hypothesis noted in earlier studies that a shift from a weakly negative to a strongly negative wind-stress curl over the Weddell Sea is a prerequisite for WSPs to form, together with a large heat reservoir at depth. However, the ultimate trigger is a pronounced MRP; whose associated convection creates high surface salinity anomalies that propagate westward with the flow of the Weddell Gyre. If large enough, these anomalies trigger the formation of a WSP and a pulse of newly formed Antarctic Bottom Water.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package, version 1: assessing E3SM aerosol predictions using aircraft, ship, and surface measurements

Abstract. An Earth system model (ESM) aerosol–cloud diagnostics package is developed to facilitate the routine evaluation of aerosols, clouds, and aerosol–cloud interactions simulated by the Energy Exascale Earth System Model (E3SM) from the US Department of Energy (DOE). The first version focuses on comparing simulated aerosol properties with aircraft, ship, and surface measurements, which are mostly measured in situ. The diagnostics currently cover six field campaigns in four geographical regions: eastern North Atlantic (ENA), central US (CUS), northeastern Pacific (NEP), and Southern Ocean (SO). These regions produce frequent liquid- or mixed-phase clouds, with extensive measurements available from the Atmospheric Radiation Measurement (ARM) program and other agencies. Various types of diagnostics and metrics are performed for aerosol number, size distribution, chemical composition, cloud condensation nuclei (CCN) concentration, and various meteorological quantities to assess how well E3SM represents observed aerosol properties across spatial scales. Overall, E3SM qualitatively reproduces the observed aerosol number concentration, size distribution, and chemical composition reasonably well, but it overestimates Aitken-mode aerosols and underestimates accumulation-mode aerosols over the CUS and ENA regions, suggesting that processes related to particle growth or coagulation might be too weak in the model. The current version of E3SM struggles to reproduce the new particle formation events frequently observed over both the CUS and ENA regions, indicating missing processes in current parameterizations. The diagnostics package is coded and organized in a way that can be extended to other field campaign datasets and adapted to higher-resolution model simulations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Pele: An Exascale-Ready Suite of Combustion Codes

High fidelity simulations of realistic combustion devices are extremely demanding computationally because of the requirements to capture complex fuel chemical decomposition, its intricate interactions with turbulent, often multiphase, flows, and the wide separation of space and time scales between the thin flame and the device boundaries. Software required to carry out such computations tends to be extremely complex, particularly when designed to exploit hardware accelerators, and can be difficult to port and maintain. We present Pele, a performance portable suite of tools for the simulation of combustion systems, including codes to evolve reactive multiphase configurations in the low Mach number and compressible flow regimes, along with a set of inter-compatible post processing and in situ analysis tools. The Pele suite of tools is built on top of the AMReX framework for block-structured adaptive mesh refinement, which provides efficient data structures and algorithms that enable the development of a wide variety of efficient mesh and particle based PDE integration schemes. A hierarchical MPI+X parallelism scheme supports CPU-only and accelerated architectures, where X can be OpenMP, CUDA, and HIP based approaches for intra-node computational work distribution. The algorithms and data structures underlying the Pele simulation and analysis tools are highly scalable and performant across a wide variety of high-performance computing platforms, including DOEs newest exascale-class machines, Frontier and Aurora. The simulation and analysis tools are fully documented and freely distributed as open source via GitHub. We present key algorithmic and software challenges, solution strategies, performance and resulting set of capabilities.

AMReX↗
DOE OSTI2020

Wintertime Arctic Oscillation and North Atlantic Oscillation and their impacts on the Northern Hemisphere climate in E3SM

The characteristics of the wintertime Arctic Oscillation (AO) and North Atlantic Oscillation (NAO) and their impacts on climate variability over the Northern Hemisphere are important metrics for evaluating a climate system model. Observational analyses reveal that the horizontal and vertical structures in the AO and NAO exhibit a meridional dipole and a large-scale barotropic pattern between the Arctic and mid-latitudes. Historical model simulations from the Energy Exascale Earth System Model (E3SM-HIST) are used to identify how well it captures these major climate modes. It is found that the simulated AO and NAO modes have spatial structures similar to the observed features. In addition, the observed frequency bands in the AO and NAO-related time variability are captured well in the E3SM-HIST simulation. Associated with the positive phase in wintertime AO and NAO, zonal flow and warm advection in mid-latitude continents are enhanced, along with stronger cold flow from enhanced northerly winds over high latitudes. These features are linked to the atmospheric circulation pattern reflected by lower SLP anomalies over the Arctic and higher SLP anomalies over the mid-latitudes. In E3SM-HIST, these spatial associations and main structural features are analogous to those in observations. In the time-height evolution related to winter AO and NAO modes, it can also be seen that the simulations reproduce the downward propagating patterns in observations. Nevertheless, the vertical structures associated with AO and NAO in E3SM-HIST exhibit substantial biases in the lower stratosphere. The cause of these stratospheric biases is investigated using the strength of climatological stratospheric polar vortex (SPV) and wave activity fluxes. The results herein suggest that E3SM-HIST has a reasonable skill in reproducing the observed characteristics related to the winter AO and NAO, although there exist systematic biases in the associated climate variability.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Approaches for the Simulation of Coupled Processes in Evolving Fractured Porous Media Enabled by Exascale Computing

Models have historically represented fractured porous media with continuum descriptions that characterize the media using bulk parameters. The impact of small-scale features is not captured in these models, although they may be controlling the performance of subsurface applications. Pore-scale models can simulate processes in small-scale features by representing the pore space geometry explicitly but are computationally expensive for large domains. The alternative multiscale approach entails the combination of pore-scale and continuum-scale descriptions in a single framework. We use Chombo-Crunch, a computational capability that discretizes complex geometries with an adaptive, embedded boundary method to contrast these two approaches. Chombo-Crunch takes advantage of recent computational performance and memory bandwidth improvements resulting from the emergence of exascale computing resources. These combined improvements enable the efficient simulation of reactive transport in fractured media with a high degree of fidelity and the ability to capture the control small-scale processes exert on the overall medium evolution.

42 ENGINEERING↗
DOE OSTI2026

High-Latitude, Low-Altitude SAI: Overview of G6-1.5K-HiLLA Simulations in E3SMv3

This report details a contribution of Energy Exascale Earth System Model version 3 (E3SMv3) simulations to a proposed model intercomparison project funded and organized by Reflective, a nonprofit group studying the possible global impacts of SAI. Using annual feedback control and seasonally-variable injection sites to achieve a desired global near-surface temperature target, the simulated SAI campaign indicates robust maintenance of the 2020-2039 climatic state over 60 years into the future.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Parthenon—a performance portable block-structured adaptive mesh refinement framework

On the path to exascale the landscape of computer device architectures and corresponding programming models has become much more diverse. While various low-level performance portable programming models are available, support at the application level lacks behind. To address this issue, we present the performance portable block-structured adaptive mesh refinement (AMR) framework Parthenon, derived from the well-tested and widely used Athena++ astrophysical magnetohydrodynamics code, but generalized to serve as the foundation for a variety of downstream multi-physics codes. Parthenon adopts the Kokkos programming model, and provides various levels of abstractions from multidimensional variables, to packages defining and separating components, to launching of parallel compute kernels. Parthenon allocates all data in device memory to reduce data movement, supports the logical packing of variables and mesh blocks to reduce kernel launch overhead, and employs one-sided, asynchronous MPI calls to reduce communication overhead in multi-node simulations. Using a hydrodynamics miniapp, we demonstrate weak and strong scaling on various architectures including AMD and NVIDIA GPUs, Intel and AMD x86 CPUs, IBM Power9 CPUs, as well as Fujitsu A64FX CPUs. At the largest scale on Frontier (the first TOP500 exascale machine), the miniapp reaches a total of 1.7 × 10 13 zone-cycles/s on 9216 nodes (73,728 logical GPUs) at [Formula: see text] weak scaling parallel efficiency (starting from a single node). In combination with being an open, collaborative project, this makes Parthenon an ideal framework to target exascale simulations in which the downstream developers can focus on their specific application rather than on the complexity of handling massively-parallel, device-accelerated AMR.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Compare linear-system solver and preconditioner stacks with emphasis on GPU performance and propose phase-2 NGP solver development pathway

The goal of the ExaWind project is to enable predictive simulations of wind farms comprised of many megawatt-scale turbines situated in complex terrain. Predictive simulations will require computational fluid dynamics (CFD) simulations for which the mesh resolves the geometry of the turbines and captures the rotation and large deflections of blades. Whereas such simulations for a single turbine are arguably petascale class, multi-turbine wind farm simulations will require exascale-class resources. The primary physics codes in the ExaWind project are Nalu-Wind, which is an unstructured-grid solver for the acoustically incompressible Navier-Stokes equations, and OpenFAST, which is a whole-turbine simulation code. The Nalu-Wind model consists of the mass-continuity Poisson-type equation for pressure and a momentum equation for the velocity. For such modeling approaches, simulation times are dominated by linear-system setup and solution for the continuity and momentum systems. For the ExaWind challenge problem, the moving meshes greatly affect overall solver costs as reinitialization of matrices and recomputation of preconditioners is required at every time step. In this report we evaluated GPU-performance baselines for the linear solvers in the Trilinos and hypre solver stacks using two representative Nalu-Wind simulations: an atmospheric boundary layer precursor simulation on a structured mesh, and a fixed-wing simulation using unstructured overset meshes. Both strong-scaling and weak-scaling experiments were conducted on the OLCF supercomputer Summit and similar proxy clusters. We focused on the performance of multi-threaded Gauss-Seidel and two-stage Gauss-Seidel that are extensions of classical Gauss-Seidel; of one-reduce GMRES, a communication-reducing variant of the Krylov GMRES; and algebraic multigrid methods that incorporate the afore-mentioned methods. The team has established that AMG methods are capable of solving linear systems arising from the fixed-wing overset meshes on CPU, a critical intermediate result for ExaWind FY20 Q3 and Q4 milestones. For the fixed-wing strong-scaling study (model with 3M grid-points), the team identified that Nalu-Wind simulations with the new Trilinos and hypre solvers scale to modest GPU counts, maintaining above 70% efficiency up to 6 GPUs. However, there still remain significant bottlenecks to performance: matrix assembly (hypre), AMG setup (hypre and Trilinos) In the weak-scaling experiments (going from 0.4M to 211M gridpoints), it's shown that the solver apply phases are faster on GPUs, but that Nalu-Wind simulation times grow, primarily due to the multigrid-setup process. Finally, based on the report outcomes, we propose a linear solver path-forward for the remainder of the ExaWind project. Near term, the NREL team will continue their work on GPU-based linear-system assembly. They will also investigate how the use of alternatives to the NVIDIA UVM (unified virtual memory) paradigm affects performance. Longer term, the NREL team will evaluate algorithmic performance on other types of accelerators and merge their improvements back to the main hypre repository branch. Near term, the Trilinos team will address performance bottlenecks identified in this milestone, such as implementing a GPU-based segregated momentum solve and reusing matrix graphs across linear-system assembly phases. Longer term, the Trilinos team will do detailed analysis and optimization of multigrid setup.

17 WIND ENERGY↗
DOE OSTI2023

Understanding Changes in Cloud Simulations from E3SM Version 1 to Version 2

This study documents clouds simulated by the Energy Exascale Earth System Model (E3SM) version 2 (E3SMv2) and attempts to understand what causes the model behavior change in clouds relative to E3SMv1. This is done by analyzing the last 30-year (1985–2014) data from the 165-year historical simulations using E3SMv1 and v2 and four sensitivity tests to isolate the impact of changes in model parameter choices in its turbulence, shallow convection, and cloud macrophysics parameterization (CLUBB), microphysical parameterization (MG2), and deep convection scheme (ZM), as well as model physics changes in convective triggering. It is shown that E3SMv2 significantly improves the simulation of subtropical coastal stratocumulus clouds (Sc) and clouds with optical depth larger than 3.6 over the stratocumulus to cumulus transition regimes, where Shortwave Cloud Radiative Effect (SWCRE) is also improved, and the Southern Ocean (SO) while seeing an overall slight degradation in low clouds over other tropical and subtropical oceans. The better performance in E3SMv1 over those regions is partially due to error compensation between its simulated optically thin and intermediate low clouds for which E3SMv2 actually improves simulation of optically intermediate low clouds. Sensitivity tests indicate that the changes in low clouds are primarily due to the tuning made in CLUBB. The impact of the ZM tuning is mainly on optically intermediate and thick high clouds, contributing to improved SWCRE and Longwave Cloud Radiative Effect (LWCRE). The impact of the MG2 tuning and the new convective trigger is primarily on the high latitudes and the Southern Ocean (SO). They have a relatively smaller impact on clouds than do the CLUBB and ZM tunings. This study offers additional insights about clouds simulated in E3SMv2 by utilizing multiple data sets and the COSP diagnostic tool as well as through sensitivity tests. The improved understanding will benefit the future E3SM developments.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Understanding changes in cloud simulations from E3SM version 1 to version 2

Abstract. This study documents clouds simulated by the Energy Exascale Earth System Model (E3SM) version 2 (E3SMv2) and attempts to understand what causes the model behavior change in clouds relative to E3SMv1. This is done by analyzing the last 30-year (1985–2014) data from the 165-year historical simulations using E3SMv1 and v2 and four sensitivity tests to isolate the impact of changes in model parameter choices in its turbulence, shallow convection, and cloud macrophysics parameterization (Cloud Layers Unified By Binormals, CLUBB); microphysical parameterization (MG2); and deep-convection scheme (ZM), as well as model physics changes in convective triggering. It is shown that E3SMv2 significantly improves the simulation of subtropical coastal stratocumulus clouds and clouds with optical depth larger than 3.6 over the stratocumulus-to-cumulus transition regimes, where the shortwave cloud radiative effect (SWCRE) is also improved, and the Southern Ocean (SO) while seeing an overall slight degradation in low clouds over other tropical and subtropical oceans. The better performance in E3SMv1 over those regions is partially due to error compensation between its simulated optically thin and intermediate low clouds for which E3SMv2 actually improves simulation of optically intermediate low clouds. Sensitivity tests indicate that the changes in low clouds are primarily due to the tuning done in CLUBB. The impact of the ZM tuning is mainly on optically intermediate and thick high clouds, contributing to an improved SWCRE and longwave cloud radiative effect (LWCRE). The impact of the MG2 tuning and the new convective trigger is primarily on the high latitudes and the SO. They have a relatively smaller impact on clouds than CLUBB tuning and ZM tuning do. This study offers additional insights into clouds simulated in E3SMv2 by utilizing multiple data sets and the Cloud Feedback Model Intercomparison Project (CFMIP) Observation Simulator Package (COSP) diagnostic tool as well as sensitivity tests. The improved understanding will benefit future E3SM developments.

58 GEOSCIENCES↗
DOE OSTI2020

Impacts of Ice-Shelf Melting on Water-Mass Transformation in the Southern Ocean from E3SM Simulations

Abstract The Southern Ocean overturning circulation is driven by winds, heat fluxes, and freshwater sources. Among these sources of freshwater, Antarctic sea ice formation and melting play the dominant role. Even though ice-shelf melt is relatively small in magnitude, it is located close to regions of convection, where it may influence dense water formation. Here, we explore the impacts of ice-shelf melting on Southern Ocean water-mass transformation (WMT) using simulations from the Energy Exascale Earth System Model (E3SM) both with and without the explicit representation of melt fluxes from beneath Antarctic ice shelves. We find that ice-shelf melting enhances transformation of Upper Circumpolar Deep Water, converting it to lower density values. While the overall differences in Southern Ocean WMT between the two simulations are moderate, freshwater fluxes produced by ice-shelf melting have a further, indirect impact on the Southern Ocean overturning circulation through their interaction with sea ice formation and melting, which also cause considerable upwelling. We further find that surface freshening and cooling by ice-shelf melting cause increased Antarctic sea ice production and stronger density stratification near the Antarctic coast. In addition, ice-shelf melting causes decreasing air temperature, which may be directly related to sea ice expansion. The increased stratification reduces vertical heat transport from the deeper ocean. Although the addition of ice-shelf melting processes leads to no significant changes in Southern Ocean WMT, the simulations and analysis conducted here point to a relationship between increased Antarctic ice-shelf melting and the increased role of sea ice in Southern Ocean overturning.

Jeong, Hyein↗
DOE OSTI2020

Spatiotemporal dynamics of ecosystem fires and biomass burning-induced carbon emissions in China over the past two decades

Fire is a major type of disturbance that has important influences on ecosystem dynamics and carbon cycles. Yet our understanding of ecosystem fires and their carbon cycle consequences is still limited, largely due to the difficulty of large-scale fire monitoring and the complex interactions between fire, vegetation, climate, and anthropogenic factors. Here, using data from satellite-derived fire observations and ecosystem model simulations, we performed a comprehensive investigation of the spatial and temporal dynamics of China's ecosystem fire disturbances and their carbon emissions over the past two decades (1997–2016). Satellite-derived results showed that on average about 3.47 - 4.53 x 10 4 km 2 of the land was burned annually during the past two decades, among which annual burned forest area was about 0.81 - 1.25 × 10 4 km 2 , accounting for 0.33-0.51% of the forest area in China. Biomass burning emitted about 23.02 TgC per year. Compared to satellite products, simulations from the Energy Exascale Earth System Land Model (ELM) strongly overestimated China's burned area and fire-induced carbon emissions. Annual burned area and fire-induced carbon emissions were high for boreal forest in Northeast China's Daxing'anling region and subtropical dry forest in South Yunnan, as revealed by both the satellite product and the model simulations. Our results suggest that climate and anthropogenic factors play critical roles in controlling the spatial and seasonal distribution of China's ecosystem fire disturbances. Our findings highlight the importance of multiple complementary approaches in assessing ecosystem fire disturbance and its carbon consequences. Further studies are required to improve the methods of observing and modelling China's ecosystem fire disturbances, which will provide valuable information for fire management and ecosystem sustainability in an era when both human activities and the natural environment are rapidly changing.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Investigation of Arctic Cloud Properties and Surface Radiation Based on MOSAiC Shipborne Observations

The Arctic is rapidly changing due to changes of the Earth system. This study investigates cloud fraction, phase partition, cloud type, and their relationships with surface radiation based on yearlong shipborne observations in the Arctic regions. The Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) campaign provided lidar and radar observations of cloud microphysical properties and surface shortwave (SW) and longwave (LW) radiation. Cloud and radiative properties were examined at daily and monthly resolutions in four seasons. Low clouds were found to be most prevalent throughout the year, followed by deep clouds. The ice phase is the dominant phase except for summer (June–August). Liquid and mixed phases show more significant monthly and annual mean radiative effects in SW and LW than the ice phase. The clouds show net warming effects due to LW heating in most months, while the SW cooling effects of clouds become more dominant for July and August. The cloud and radiation observations from MOSAiC were used to evaluate simulations of the atmospheric component of the Energy Exascale Earth System Model version 2. The simulations show large overestimations of the liquid and mixed phases in the Arctic regions from February to September. The simulations also underestimate the percentages of low clouds and overestimate the percentages of deep clouds throughout the year. Altogether, this work provides a unique analysis of cloud and radiation properties based on high-resolution shipborne observations, which can be used to assist future model evaluation and development.

58 GEOSCIENCES↗
DOE OSTI2024

A Cast of Thousands: How the IDEAS Productivity Project Has Advanced Software Productivity and Sustainability

Computational and data-enabled science and engineering are revolutionizing advances throughout science and society, at all scales of computing. For example, teams in the U.S. Department of Energy’s Exascale Computing Project have been tackling new frontiers in modeling, simulation, and analysis by exploiting unprecedented exascale computing capabilities—building an advanced software ecosystem that supports next-generation applications and addresses disruptive changes in computer architectures. However, concerns are growing about the productivity of the developers of scientific software. Members of the Interoperable Design of Extreme-scale Application Software project serve as catalysts to address these challenges through fostering software communities, incubating and curating methodologies and resources, and disseminating knowledge to advance developer productivity and software sustainability. This article discusses how these synergistic activities are advancing scientific discovery—mitigating technical risks by building a firmer foundation for reproducible, sustainable science at all scales of computing, from laptops to clusters to exascale and beyond.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Influence of Eastern Pacific Hurricanes on the Southwest US Wildfire Environment

Abstract While some previous studies examined the contribution of Eastern Pacific (EP) hurricanes toward precipitation in the arid Southwest US (SWUS), their potential to influence wildfires in that region has not been explored. Here we show, using observations and simulations from the Energy Exascale Earth System Model (E3SM), that recurving EP hurricanes modulate the wildfire environment in the SWUS by increasing precipitation and soil moisture, and reducing the vapor pressure deficit. This is especially the case during late season months of September–October when the likelihood of storms to recurve and make landfall increases. Further, analysis of burnt area observations reveals that for the months of September–October, recurving EP hurricanes may significantly reduce the prevalence of wildfires in the SWUS. Finally, E3SM simulations indicate that late season EP hurricanes have been on the decline, with important implications for wildfires in the SWUS.

54 ENVIRONMENTAL SCIENCES↗