Search NASA⌕ Search

SEARCH · Search NASA

Results for “exascale simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Validation of time-dependent shift using the pulsed sphere benchmarks

The detailed behavior of neutrons in a rapidly changing time-dependent physical system is a challenging computational physics problem, particularly when using Monte Carlo methods on heterogeneous high-performance computing architectures. A small number of algorithms and code implementations have been shown to be performant for time-independent (fixed source and k-eigenvalue) Monte Carlo, and there are existing simulation tools that successfully solve the time-dependent Monte Carlo problem on smaller computing platforms. To bridge this gap, a time-dependent version of ORNL’s Shift code has been recently developed. Shift’s history-based algorithm on CPUs, and its event-based algorithm on GPUs, have both been observed to scale well to very large numbers of processors, which motivated the extension of this code to solve time-dependent problems. The validation of this new capability requires a comparison with time-dependent neutron experiments. Lawrence Livermore National Laboratory’s (LLNL) pulsed sphere benchmark experiments were simulated in Shift to validate both the time-independent as well as new time-dependent features recently incorporated into Shift. A suite of pulsed-sphere models was simulated using Shift and compared to the available experimental data and simulations with MCNP. Overall results indicate that Shift accurately simulates the pulsed sphere benchmarks, and that the new time-dependent modifications of Shift are working as intended. Validated exascale neutron transport codes are essential for a wide variety of future multiphysics applications.

Palmer, Camille J.↗

Impacts of Sea‐Level Rise on Coastal Groundwater Table Simulated by an Earth System Model With a Land‐Ocean Coupling Scheme

Abstract Sea‐level rise (SLR) poses a severe threat to the coastal environment through seawater intrusion into freshwater aquifers. The rising groundwater table also exacerbates the risk of pluvial, fluvial, and groundwater flooding in coastal regions. However, current Earth system models (ESMs) commonly ignore the exchanges of water at the land‐ocean interface. To address this gap, we developed a novel land‐ocean hydrologic coupling scheme in a state‐of‐the‐science ESM, the Energy Exascale Earth System Model version 2 (E3SMv2). The new scheme includes the lateral exchange between seawater and groundwater and the vertical infiltration of seawater driven by the SLR‐induced inundation. Simulations were performed with the updated E3SMv2 for the global land‐ocean interface to assess the impacts of SLR on coastal groundwater under a high CO 2 emission scenario. By the middle of this century, seawater infiltration on the inundated areas will be the dominant component in the land‐ocean coupling process, while the lateral subsurface flow exchange will be much smaller. The SLR‐induced seawater infiltration will raise the groundwater levels, enhance evapotranspiration, and increase runoff with distinct spatial patterns globally in the future. Although the coupling process is induced by SLR, we found topography and warming temperature have more control on the coupling impacts, probably due to the relatively modest magnitude of SLR during the selected future period. Overall, our study suggests significant groundwater and seawater exchange at the land‐ocean interface, which needs to be considered in ESMs.

54 ENVIRONMENTAL SCIENCES↗

HSW-V v1.0: localized injections of interactive volcanic aerosols and their climate impacts in a simple general circulation model

Abstract. A new set of standalone parameterizations is presented for simulating the injection, evolution, and radiative forcing by stratospheric volcanic aerosols against an idealized Held–Suarez–Williamson (HSW) atmospheric background in the Energy Exascale Earth System Model version 2 (E3SMv2). In this model configuration (HSW with enabled volcanism, HSW-V), sulfur dioxide (SO2) and ash are injected into the atmosphere with a specified profile in the vertical, and they proceed to follow a simple exponential decay. The SO2 decay is modeled as a perfect conversion to a long-living sulfate aerosol which persists in the stratosphere. All three species are implemented as tracers in the model framework and are transported by the dynamical core's advection algorithm. The aerosols contribute simultaneously to local heating of the stratosphere and cooling of the surface by a simple plane-parallel Beer–Lambert law applied on two zonally symmetric radiation broadbands in the longwave and shortwave ranges. It is shown that the implementation parameters can be tuned to produce realistic temperature anomaly signatures of large volcanic events. In particular, results are shown for an ensemble of runs that mimic the volcanic eruption of Mt. Pinatubo in 1991. The design requires no coupling to microphysical subgrid-scale parameterizations and thus approaches the computational affordability of prescribed aerosol forcing strategies. The idealized simulations contain a single isolated volcanic event against a statistically uniform climate, where no background aerosols or other sources of externally forced variability are present. HSW-V represents a simpler-to-understand tool for the development of climate source-to-impact attribution methods.

Hollowed, Joseph P. (ORCID:0000000286581672)↗

Programming approaches for scalability, performance, and portability of combustion physics codes

Here, this paper presents the process, strategy, and results associated with porting a typical combustion physics flow solver to current state-of-the-art and future massively-parallel computer architectures. Major focus is placed on the distinct algorithmic structure of these types of codes and how it can be integrated with modern programming paradigms for heterogeneous platforms (i.e., distributed many-core systems with accelerators). An end-to-end case study is presented that exemplifies the process in a generic manner, which then serves as a clear guide with respect to the strategy and best practices leading to a robust and adaptable framework that performs well, is durable over time, is portable, and requires minimal human-effort. This end is accomplished beginning with the use of a mature, validated, structured, multiblock code framework optimized for application of both Large Eddy Simulation (LES) and Direct Numerical Simulation (DNS). This code has been ported to a variety of platforms over the past decade, including most recently the Oak Ridge Leadership Computing Facility’s “Summit” Platform. The experience gained on these multiple platforms provides general insights and thus the results presented are not specific to any one code or platform other than the overarching trend toward distributed many-core systems with accelerators in order to move toward exascale performance. The resultant performance and scalability of the ported code is demonstrated on a real-world application; a state-of-the-art rotating detonation rocket engine simulation that matches the complex geometry and boundary conditions imposed as part of a companion experimental campaign.

97 MATHEMATICS AND COMPUTING↗

Exascale-capable cellular automaton for nucleation and grain growth

This model is a cellular automata-based algorithm used to predict grain-scale microstructure development. Nucleation and growth of existing grains are considered in an initially liquid domain, where the temperature field evolution is either driven through heat transport simulation data or a frozen temperature approximation (i.e., a constant cooling rate and a fixed thermal gradient). The growth of grains is based on the decentered octahedron algorithm published by Gandin and Rappaz (https://doi.org/10.1016/S1359-6454(96)00303-5), where the grain envelopes are tracked as approximations of the evolving dendritic growth front. The input heat transport data, which can come from simulation of an arbitrary processing technique, consists of coordinates and times at which said coordinates fall below the liquidus and solidus temperatures for the final time. As a result, only the final solidification of a given region is modeled (no remelting). The code is designed to be compatible with pre-Exascale architectures, and uses MPI and the Kokkos library to decompose the computational domain and offload solidification calculations to GPUs.

Rolchigo, MatthewR.↗

Global gross primary production simulated by three terrestrial biosphere models to analyse smoothing of limiting rates

Processed global terrestrial gross primary production (GPP) from three terrestrial biosphere models (TBMs). Two simulations were run with each model, one that selects the rate limiting process of photosynthesis based on the minimum of the potential rates (following Farquhar et al. 1980) and the other that uses quadratic smoothing between the potential rates (following Collatz et al. 1991). The three TBMs are: 1) the Energy Exascale Earth System Model (E3SM) land model (ELM) (release: v1.1.0) (Burrows et al., 2020), a coupled carbon, nitrogen, and phosphorus model with sun/shade big-leaf canopy photosynthesis scaling. 2) The Functionally Assembled Terrestrial Ecosystem Simulator (FATES, tag: sci.1.30.0_api.8.0.0) (Koven et al., 2019), coupled with the Community Land Model (CLM, version 5; Lawrence et al., 2019), a carbon-only vegetation demography model with multi-leaf and multi-canopy layers for scaling photosynthesis, and with a leaf area index (LAI) optimisation scheme. 3) The Sheffield Dynamic Global Vegetation Model (SDGVM, tag: Walkeretal2020_GCB), a carbon-only model with multi-leaf-layer canopy photosynthesis scaling and also with an LAI optimisation scheme (Walker et al., 2017; Woodward & Lomas, 2004). These data were generated to evaluate the effect of Collatz smoothing of limiting rates on simulated GPP across a range of terrestrial biosphere models. Analysis of results can be found in Walker et al. (2020). This dataset is comprised of R scripts to process data and produce figures and .RDS files, a binary format specific to R and read with the 'readRDS' function.

54 ENVIRONMENTAL SCIENCES↗

Vertically Resolved Analysis of the Madden-Julian Oscillation Highlights the Role of Convective Transport of Moist Static Energy

We simulate the Madden-Julian oscillation (MJO) over an aquaplanet with uniform surface temperature using the multiscale modeling framework (MMF) configuration of the Energy Exascale Earth System Model (E3SM-MMF). The model produces MJO-like features that have a similar spatial structure and propagation behavior to the observed MJO. To explore the processes involved in the propagation and maintenance of these MJO-like features, we perform a vertically resolved moist static energy (MSE) analysis for the MJO (Yao et al., 2022, https://doi.org/10.1175/jas-d-20-0254.1). Unlike the column-integrated MSE analysis, our method emphasizes the local production of MSE variance and quantifies how individual physical processes amplify and propagate the MJO's characteristic vertical structure. We find that radiation, convection, and boundary layer (BL) processes all contribute to maintaining the MJO, balanced by the large-scale MSE transport. Furthermore, large-scale dynamics, convection, and BL processes all contribute to the propagation of the MJO, while radiation slows the propagation. Additionally, we perform mechanism-denial experiments to examine the role of radiation and associated feedbacks in simulating the MJO. We find that the MJO can still self-emerge and maintain its characteristic structures without radiative feedbacks. This study highlights the role of convective MSE transport in the MJO dynamics, which was overlooked in the column-integrated MSE analysis.

54 ENVIRONMENTAL SCIENCES↗

Simulation of Compound Flooding Using River‐Ocean Two‐Way Coupled E3SM Ensemble on Variable‐Resolution Meshes

Abstract Coastal zone compound flooding (CF) can be caused by the interactive fluvial and oceanic processes, particularly when coastal backwater propagates upstream and interacts with high river discharge. The modeling of CF is limited in existing Earth System Models (ESMs) due to coarse mesh resolutions and one‐way coupled river‐ocean components. In this study, we present a novel multi‐scale coupling framework within the Energy Exascale Earth System Model (E3SM), integrating global atmosphere and land with interactively coupled river and ocean models using different meshes with refined resolutions near the coastline. To evaluate this framework, we conducted ensemble simulations of a CF event (Hurricane Irene in 2011) in a Mid‐Atlantic estuary. The results demonstrate that the novel E3SM configuration can reasonably reproduce river discharge and sea surface height variations. The two‐way river‐ocean coupling improves the representation of coastal backwater effects at the terrestrial‐aquatic interface that are caused by the combined actions of tide and storm surge during the CF event, thus providing a valuable modeling tool for better understanding the river‐estuary‐ocean dynamics in extreme events under climate change. Notably, our results show that the most significant CF impacts occur when the highest storm surge generated by a tropical cyclone meets with a moderate river discharge. This study highlights the state‐of‐the‐art advancements developed within E3SM for simulating multi‐scale coastal processes.

54 ENVIRONMENTAL SCIENCES↗

Quantifying the Impacts of Land-Cover Change on the Hydrologic Response to Hurricane Ida in the Lower Mississippi River Basin

Abstract The Lower Mississippi River basin (LMRB) has experienced significant changes in land cover and is one of the most vulnerable regions to hurricanes in the United States. Here, we study the impacts of land-cover change on the hydrologic response to Hurricane Ida in LMRB. By using an integrated surface–subsurface hydrologic model, Energy Exascale Earth System Model (E3SM) Land Model coupled with the three-dimensional ParFlow subsurface flow model (ELM-ParFlow), we simulate the effects of land-cover change on the flood volume and peak timing induced by rainfall from Hurricane Ida. The results show that land-cover changes from 1850 to 2015, which resulted in a smoother surface and less vegetation, exacerbated both flood peak time and volume induced by Hurricane Ida. The effects of land-cover changes can be decomposed into two mechanisms: a smoother surface routes more water faster to a watershed outlet and less vegetation allows more water to contribute to surface runoff. By comparing scenarios in which the two mechanisms were isolated, we found that changes in soil moisture due to vegetation cover change have more dominant effects on floods in the southern part and changes in Manning’s coefficient have the largest effect on floods in the northern part of the LMRB. The study provides important insights into the complex relationship between land-use, land-cover, and hydrologic processes in coastal regions.

54 ENVIRONMENTAL SCIENCES↗

CondiDiag1.0: a flexible online diagnostic tool for conditional sampling and budget analysis in the E3SM atmosphere model (EAM)

Abstract. Numerical models used in weather and climate prediction take into account a comprehensive set of atmospheric processes (i.e., phenomena) such as the resolved and unresolved fluid dynamics, radiative transfer, cloud and aerosol life cycles, and mass or energy exchanges with the Earth's surface. In order to identify model deficiencies and improve predictive skills, it is important to obtain process-level understanding of the interactions between different processes. Conditional sampling and budget analysis are powerful tools for process-oriented model evaluation, but they often require tedious ad hoc coding and large amounts of instantaneous model output, resulting in inefficient use of human and computing resources. This paper presents an online diagnostic tool that addresses this challenge by monitoring model variables in a generic manner as they evolve within the time integration cycle. The tool is convenient to use. It allows users to select sampling conditions and specify monitored variables at run time. Both the evolving values of the model variables and their increments caused by different atmospheric processes can be monitored and archived. Online calculation of vertical integrals is also supported. Multiple sampling conditions can be monitored in a single simulation in combination with unconditional sampling. The paper explains in detail the design and implementation of the tool in the Energy Exascale Earth System Model (E3SM) version 1. The usage is demonstrated through three examples: a global budget analysis of dust aerosol mass concentration, a composite analysis of sea salt emission and its dependency on surface wind speed, and a conditionally sampled relative humidity budget. The tool is expected to be easily portable to closely related atmospheric models that use the same or similar data structures and time integration methods.

58 GEOSCIENCES↗

Features of mid- and high-latitude low-level clouds and their relation to strong aerosol effects in the Energy Exascale Earth System Model version 2 (E3SMv2)

The E3SMv2 model, like various other global models that include representations of aerosol–cloud interactions, uses an empirically chosen lower bound on the simulated in-cloud cloud droplet number concentration (CDNC) to help constrain the effective radiative forcing of anthropogenic aerosols, ERFaer. This study identifies where ultra-low CDNCs (i.e., concentrations lower than 10 cm−3) occur in the stratiform and shallow convective clouds simulated by E3SMv2 and which of the occurrences have the strongest impact on ERF aer . Process-level analyses are presented to reveal characteristics of the cloud droplet formation and removal processes associated with impactful ultra-low CDNCs. Simulations performed with present-day emissions show that ultra-low CDNCs are most frequently found over the mid- and high-latitude oceans in both hemispheres, while the occurrences are also frequent in polluted continental regions despite the high aerosol concentrations. Ultra-low CDNCs with the largest impacts on the simulated regional and global mean ERF aer are found in the lower troposphere in the Northern Hemisphere middle and high latitudes. These cases are typically associated with large cloud fractions, strong water vapor condensation, weak turbulence, and lack of cloud droplet nucleation from aerosol activation. Under such atmospheric conditions, boosting aerosol activation and enhancing turbulent mixing of cloud droplet number can increase the simulated CDNCs, although the magnitude of the global mean ERF aer increases undesirably. The reason for this model behavior is discussed. Overall, our study suggests that mid- and high-latitude low-level stratus occurring under weak turbulence is a cloud regime worth further investigating for the purpose of identifying and addressing the root causes of ultra-low CDNCs and strong ERF aer in E3SM.

Aerosol-Cloud Interaction↗

Performance Portability Evaluation of Fluid-Structure Interaction Simulations on Heterogeneous Platforms

The rapid proliferation of heterogeneous programming languages and multi-vendor hardware has underscored the critical need to evaluate the performance portability of scientific applications. In this work, we present the systematic porting and optimization of a massively parallel fluid-structure interaction code across multiple heterogeneous programming frameworks for deployment on leadership-class supercomputers from major vendors. Our analysis focuses on at-scale performance for simulations involving hundreds of millions of deformable cells, executed on a combination of CPUs and GPUs spanning thousands of nodes on exascale machines. We benchmark the performance of each implementation, highlighting the trade-offs inherent in adopting diverse programming models. Key insights regarding the portability of CUDA on multi-vendor platforms, the superior multi-core CPU performance from SYCL, and architectural considerations on performance optimization are distilled from our experience, offering guidance to other users of high performance computing based on our findings.

Martin, Aristotle [Duke University]↗

HPC Molecular Simulation Tries Out a New GPU: Experiences on Early AMD Test Systems for the Frontier Supercomputer

Molecular simulation is an important tool for nu- merous efforts in physics, chemistry, and the biological sciences. Simulating molecular dynamics requires extremely rapid cal- culations to enable sufficient sampling of simulated temporal molecular processes. The Hewlett Packard Enterprise (HPE) Cray EX Frontier supercomputer installed at the Oak Ridge Leadership Computing Facility (OLCF) will provide an exascale resource for open science, and will feature graphics processing units (GPUs) from Advanced Micro Devices (AMD). The future LUMI supercomputer in Finland will be based on an HPE Cray EX platform as well. Here we test the ports of several widely used molecular dynamics packages that have each made substantial use of acceleration with NVIDIA GPUs, on Spock, the early Cray pre-Frontier testbed system at the OLCF which employs AMD GPUs. These programs are used extensively in industry for pharmaceutical and materials research, as well as academia, and are also frequently deployed on high-performance computing (HPC) systems, including national leadership HPC resources. We find that in general, performance is competitive and installation is straightforward, even at these early stages in a new GPU ecosystem. Our experiences point to an expanding arena for GPU vendors in HPC for molecular simulation.

Sedova, Ada↗

ECP Software Technology Capability Assessment Report

The Exascale Computing Project Software Technology (ECP ST) focus area represents the key bridge between Exascale systems and the scientists developing applications that will run on those platforms. ECP offers a unique opportunity to build a coherent set of software (often referred to as the "software stack") that will allow application developers to maximize their ability to write highly parallel applications, targeting multiple Exascale architectures with runtime environments that will provide high performance and resilience. But applications are only useful if they can provide scientific insight, and the unprecedented data produced by these applications require a complete analysis work ow that includes new technology to scalably collect, reduce, organize, curate, and analyze the data into actionable decisions. This requires approaching scientific computing in a holistic manner, encompassing the entire user workflow - from conception of a problem, setting up the problem with validated inputs, performing high-fidelity simulations, to the application of uncertainty quantification to the final analysis. The software stack plan defined here aims to address all of these needs by extending current technologies to Exascale where possible, by performing the research required to conceive of new approaches necessary to address unique problems where current approaches will not suffice, and by deploying high-quality and robust software products on the platforms developed in the Exascale systems project. The ECP ST portfolio has established a set of interdependent projects that will allow for the research, development, and delivery of a comprehensive software stack,

97 MATHEMATICS AND COMPUTING↗

Performance Understanding and Analysis for Exascale Data Management Workflows (Collaboration)

The general approach of the MONA project is depicted in Figure 1. The figure shows performance monitoring applied to an I/O workflow associated with a scientific simulation, with online measurements captured from this workflow informing methods for workflow reconfiguration and dynamic adjustment. The goal is to maintain suitable levels of Quality of Service for workflow execution, by understanding the underlying causes of workflow performance and behavior. One outcome will be workflow performance models able to characterize realistic workflows. Another outcome will be performance ‘mini-apps’ implementing such workflow behavior. Out of scope for this project are advanced methods for online workflow control.

97 MATHEMATICS AND COMPUTING↗

Convective Momentum Transport and Its Impact on the Madden‐Julian Oscillation in E3SM‐MMF

Abstract Convective momentum transport (CMT) is the process of vertical redistribution of horizontal momentum by small‐scale turbulent flows from moist convection. Traditional general circulation models (GCMs) and their multiscale modeling framework (MMF) versions poorly represent CMT due to insufficient information of subgrid‐scale flows at each GCM grid. Here the explicit scalar momentum transport (ESMT) scheme for representing CMT is implemented in the Energy Exascale Earth System Model‐Multiscale Modeling Framework (E3SM‐MMF) with embedded 2‐D cloud‐resolving models (CRMs), and verified against E3SM‐MMF simulations with 3‐D CRMs and observations. The results show that representing CMT by ESMT helps reduce climatological mean precipitation model bias over the western Pacific and the ITCZ regions, which is attributed to the weakened mean easterlies over the Pacific. Also, CMT from simulations with 2‐D and 3‐D CRMs impose a similar impact on Kelvin waves by reducing their variability and slowing down their phase speed, but opposite impacts on the Madden‐Julian Oscillation (MJO) variability. The ESMT scheme readily captures the climatological mean spatial patterns of the zonal and meridional components of CMT and their variability across multiple time scales, but shows some differences in estimating its magnitude. CMT mainly affects the MJO by decelerating its winds in the free troposphere, but accelerates its near‐surface winds. This study serves as a prototype for implementing CMT scheme in the MMF simulations, highlighting its crucial role in reducing model bias in mean state and spatiotemporal variability.

54 ENVIRONMENTAL SCIENCES↗

Improving North American Wildfire Prediction by Integrating a Machine-Learning Fire Model in a Land Surface Model

Wildfires have shown increasing trends in both frequency and severity across the Contiguous United States (CONUS). However, process-based fire models have difficulties in accurately simulating the burned area over the CONUS due to a simplification of the physical process and cannot capture the interplay among fire, ignition, climate, and human activities. The deficiency of burned area simulation deteriorates the description of fire impact on energy balance, water budget, and carbon fluxes in the Earth System Models (ESMs). Alternatively, machine learning (ML) based fire models, which capture statistical relationships between the burned area and environmental factors, have shown promising burned area predictions and corresponding fire impact simulation. We develop a hybrid framework (ML4Fire-XGB) that integrates a pretrained eXtreme Gradient Boosting (XGBoost) wildfire model with the Energy Exascale Earth System Model (E3SM) land model (ELM) version 2.1. A Fortran-C-Python deep learning bridge is adapted to support online communication between ELM and the ML fire model. Specifically, the burned area predicted by the ML-based wildfire model is directly passed to ELM to adjust the carbon pool and vegetation dynamics after disturbance, which are then used as predictors in the ML-based fire model in the next time step. Evaluated against the historical burned area from Global Fire Emissions Database 5 from 2001-2020, the ML4Fire-XGB model outperforms process-based fire models in terms of spatial distribution and seasonal variations. Sensitivity analysis confirms that the ML4Fire-XGB well captures the responses of the burned area to rising temperatures. The ML4Fire-XGB model has proved to be a new tool for studying vegetation-fire interactions, and more importantly, enables seamless exploration of climate-fire feedback, working as an active component in E3SM.

54 ENVIRONMENTAL SCIENCES↗

Simulated wildfire burned area over the CONUS during 2001-2020

Wildfires have shown increasing trends in both frequency and severity across the Contiguous United States (CONUS). However, process-based fire models have difficulties in accurately simulating the burned area over the CONUS due to a simplification of the physical process and cannot capture the interplay among fire, ignition, climate, and human activities. The deficiency of burned area simulation deteriorates the description of fire impact on energy balance, water budget, and carbon fluxes in the Earth System Models (ESMs). Alternatively, machine learning (ML) based fire models, which capture statistical relationships between the burned area and environmental factors, have shown promising burned area predictions and corresponding fire impact simulation. We develop a hybrid framework (ML4Fire-XGB) that integrates a pretrained eXtreme Gradient Boosting (XGBoost) wildfire model with the Energy Exascale Earth System Model (E3SM) land model (ELM). A Fortran-C-Python deep learning bridge is adapted to support online communication between ELM and the ML fire model. Specifically, the burned area predicted by the ML-based wildfire model is directly passed to ELM to adjust the carbon pool and vegetation dynamics after disturbance, which are then used as predictors in the ML-based fire model in the next time step. Evaluated against the historical burned area from Global Fire Emissions Database 5 from 2001-2020, the ML4Fire-XGB model outperforms process-based fire models in terms of spatial distribution and seasonal variations. Sensitivity analysis confirms that the ML4Fire-XGB well captures the responses of the burned area to rising temperatures. The ML4Fire-XGB model has proved to be a new tool for studying vegetation-fire interactions, and more importantly, enables seamless exploration of climate-fire feedback, working as an active component in E3SM.

Liu, Ye↗