Search NASASearch

SEARCH · Search NASA

Results for “Exascale simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

ELM model simulations of Plum Island Ecosystems LTER low marsh site 2018-2020

Model simulations using the Department of Energy's Energy Exascale Earth System Model (E3SM) land model (ELM) with improved capabilities to represent vegetation response to salinity and inundation. The simulations were conducted for a tidal salt marsh at Plum Island Ecosystems Long Term Ecological Research (LTER) site near Rowley, Massachusetts, USA; the site is a low marsh dominated by Spartina alterniflora. The model was forced with site-specific meteorology, salinity and tidal cycles from 2018-2020. Four sets of model simulations are included and described below:1. Parameterization of the salinity response function. These simulations tested different combinations of values for optimal salinity and salinity tolerance.2. Model evaluation. This comparison conducted simulations using the default model, the salinity function only, the submergence function only, and both the salinity and submergence functions. 3. Salinity scenarios. These simulations used the 2018 salinity input data varied by -5 to +10 ppt salinity.4. Water level scenarios. These simulations used the tide height varied by -10 to +50 cm. These simulations were used to demonstrate how the salinity and submergence functions better represent carbon uptake by tidal salt marshes.The data package includes netCDF files used as forcing files for tide height and salinity, one for each year 2018-2020 at observed salinity concentrations, and an additional three forcing files in which salinity concentrations were varied 5 ppt lower, 5 ppt higher, and 10 ppt higher than the measured 2018 time series. Also included are python scripts for creating forcing files, plain text parameter and command files for running simulations, model outputs in netCDF format, and python scripts for visualizing outputs. Code for the modified E3SM model is archived in Sulman et al 2023 at doi:10.15485/1991625. More detail about files is provided in the README.md file.

54 ENVIRONMENTAL SCIENCES

The ECP ALPINE project: In situ and post hoc visualization infrastructure and analysis capabilities for exascale

A significant challenge on an exascale computer is the speed at which we compute results exceeds by many orders of magnitude the speed at which we save these results. Therefore the Exascale Computing Project (ECP) ALPINE project focuses on providing exascale-ready visualization solutions including in situ processing. In situ visualization and analysis runs as the simulation is run, on simulations results are they are generated avoiding the need to save entire simulations to storage for later analysis. The ALPINE project made post hoc visualization tools, ParaView and VisIt, exascale ready and developed in situ algorithms and infrastructures. The suite of ALPINE algorithms developed under ECP includes novel approaches to enable automated data analysis and visualization to focus on the most important aspects of the simulation. Many of the algorithms also provide data reduction benefits to meet the I/O challenges at exascale. ALPINE developed a new lightweight in situ infrastructure, Ascent.

97 MATHEMATICS AND COMPUTING

Impact of Turbulence Representation on the Relationship Between Cloud Feedback and Aerosol‐Cloud Interaction in an E3SMv2 Perturbed Parameter Ensemble

Recent studies reveal an anti‐correlation between global cloud feedback (CF) and effective radiative forcing due to aerosol‐cloud interaction (ERFaci) in Earth system models, but the physical mechanisms underlying it remain uncertain. Here we investigate how different turbulence representations contribute to this relationship over the global ocean using an ensemble of Energy Exascale Earth System Model version 2 simulations with perturbed turbulence parameters. The anti‐correlation appears only in the tropical ascent regime. In the Northern Hemisphere midlatitude and high latitude regimes, there is no significant correlation, and in the tropical marine low cloud and Southern Ocean regimes, the correlation is positive. These opposite correlations are primarily driven by opposing CF responses to perturbed parameters. We find that the mean‐state turbulent mixing strength affects both CF and ERFaci, enabling strong correlations in certain regimes. This study highlights the complex linkages between CF and ERFaci through turbulent processes across diverse cloud regimes.

54 ENVIRONMENTAL SCIENCES

Numerical Water Tracers in the Atmospheric Component of the Energy Exascale Earth System Model: Implementation and Changes in Moisture Origin

Numerical water tracers are implemented in the Energy Exascale Earth System Model version 2. Simulations performed with the water‐tag‐enabled model for both pre‐industrial and future greenhouse gas concentrations reveal a marked increase in the role of mid‐latitude and southern subtropical regions as exporters of atmospheric moisture—to the extratropical upper troposphere and the tropical free troposphere. For the latter, the northward shift of the Intertropical Convergence Zone increases cross‐hemispheric transport of subtropical water vapor to the Northern Hemisphere. In the polar regions, most of the lower tropospheric moistening instead arises from increases in local evaporation. These findings illustrate the utility of the water tags, underscore critical changes in global hydrologic cycle, and provide insight into atmospheric dynamics under future climate scenarios. For applications when a global grid is desired, we additionally propose a novel statistical reconstruction, based on copula modeling, of the joint distribution of origin of water vapor, which reduces the number of tracers from order $\mathcal{O}\left({n}^{2}\right)$to order $\mathcal{O}(n)$, substantially ameliorating the considerable computational cost of water tracers. This statistical reconstruction is particularly beneficial to the interpretation of the relationship between latitude and longitude of origin of moisture over the tropical oceans and in the lower troposphere over land.

copula modeling

Building a Transdisciplinary, Exascale-Capable Workforce for Geospace Science

Key Points: ●First-principles, self-consistent geospace modeling will require at least exascale-level computing capabilities; however, the technical skills necessary to develop such simulation codes are not taught as part of Heliophysics training/PhD programs. ●Developing exascale Heliophysics codes will require transdisciplinary collaborations between physicists, computer scientists, software engineers, data scientists, and applied mathematics. Such teams must be persistent and formed around specific skills, not specific problems. ●We must have stable, positive long-term career outcomes for Heliophysics scientific developers in order to retain knowledge of and promote future innovation in scientific algorithm development and advanced computing techniques. One such way to do this is by funding long-term scientific programming groups, akin to Heliophysics DRIVE Centers. ●We must have a balance between promoting innovation via funding short-term closed-source development and allowing the open-source community to benefit from and build on the newest scientific modeling techniques.

C Bard

LHC Event Generation in the Exascale Era

MCFM is a dedicated Monte-Carlo simulation program for collider phenomenology at highest energies. Designed during the Tevatron era, it has successfully incorporated the latest developments needed for LHC precision calculations and remained on the forefront of collider phenomenology. The Fortran code includes interfaces to modern PDF and loop reduction libraries but has been unchanged structurally compared to the earlier versions. Parallel computing has been enabled using OpenMP and MPI. MCFM provides numerically highly stable one-loop amplitudes and superior phase-space efficiency, leading to excellent performance in NXLO calculations using jettiness or qT subtraction techniques for IR regularization.

Campbell, John [Fermilab]

Large-scale Multiphysics Simulations of Small Modular Reactors Operating in Natural Circulation

Thanks to the advancements in high-performance computing, advanced modeling and simulation have become crucial in driving the development and deployment of next-generation nuclear reactors, such as small modular reactors (SMRs). SMRs offer the promise of cost-effective baseload electricity production and improved safety, while addressing some of the challenges associated with large reactor designs, such as high capital costs and extended construction timelines. As part of the Exascale Computing Project, the large-scale multiphysics simulation of an entire SMR primary system has been achieved by combining computational fluid dynamics and neutronics. In addition to the successful demonstration of full-core SMR simulations, the current study integrated the impact of natural circulation into the system. Natural circulation is the primary mechanism driving coolant circulation in SMRs. The mass flow rate in the core depends on the core power, and a numerical model has been developed to predict it. The pressure drop caused by the helical coil steam generator was also accounted for by developing a pressure drop correlation based on high-fidelity large eddy simulation results, further improving prediction accuracy. In conclusion, the results of the study demonstrate that the implemented natural circulation model is effective in predicting the responses of SMR full-core multiphysics simulations.

ECP

Atmospheric-river-induced precipitation in California as simulated by the regionally refined Simple Convective Resolving E3SM Atmosphere Model (SCREAM) Version 0

Abstract. Using the regionally refined mesh (RRM) configuration of the US Department of Energy's Simple Cloud-Resolving Energy Exascale Earth System Model (E3SM) Atmosphere Model (SCREAM), we simulate and evaluate four meteorologically distinct atmospheric river events over California. We test five different RRM configurations, each differing in terms of the areal extent of the refined mesh and the resolution (ranging from 800 m to 3.25 km). We find that SCREAM RRM generally has a good representation of the AR-generated precipitation in CA, even for the control simulation which has a very small 3 km refined patch, and is able to capture the fine-scale regional distributions that are controlled largely by the fine-scale topography of the state. It is found that SCREAM generally has a wet bias over topography, most prominently over the Sierra Nevada mountain range, with a corresponding dry bias on the lee side. We find that refining the resolution beyond 3 km (specifically 1.6 km and 800 m) has virtually no benefit towards reducing systematic precipitation biases but that improvements can be found when increasing the areal extent of the upstream refined mesh. However, these improvements are relatively modest and only realized if the size of the refined mesh is expanded to the scale where employing RRM no longer achieves the substantial cost benefit it was intended for.

54 ENVIRONMENTAL SCIENCES

Evaluating Mean State Cloud Properties in the Simple Cloud‐Resolving E3SM Atmosphere Model (SCREAM)

Accurately simulating clouds remains a key challenge in global climate models, primarily because cloud formation involves sub-grid processes that are parameterized and crudely represented in models. This study examines the performance of DOE's Simple Cloud-Resolving Energy Exascale Earth System (E3SM) Atmosphere Model (SCREAM) in simulating cloud properties and their spatio-temporal distribution by comparing against satellite observations. Two horizontal resolutions of SCREAM (3 and 12 km) are examined, and both depict a realistic spatial structure of mean-state cloud cover but underestimate its global mean magnitude. SCREAM 3 km reasonably reproduces the distribution of mean-state cloud properties across various cloud optical thickness and cloud-top pressure regimes, with performance comparable to CMIP5 and CMIP6 ensemble and marginally outperforming SCREAM 12 km. Still, SCREAM 3 km tends to underpredict low clouds and optically thin clouds, highlighting the need for continued improvement in representing unresolved processes. This study provides a basis for confidence in the representation of clouds in SCREAM, as simulating mean-state clouds is a necessary prerequisite for trusting its cloud responses to changes in aerosols and greenhouse gases.

Geosciences

MFC 5.0: An exascale many-physics flow solver

Many problems of interest in engineering, medicine, and the fundamental sciences rely on high-fidelity flow simulation, making performant computational fluid dynamics solvers a mainstay of the open-source software community. Previous work MFC 3.0 was made a published, documented, and open-source solver via Bryngelson et al. Comp. Phys. Comm. (2021) with numerous physical features, numerical methods, and scalable infrastructure. MFC 5.0 is a significant update to MFC 3.0, featuring a broad set of well-established and novel physical models and numerical methods, as well as the introduction of GPU and APU (or superchip) acceleration. Here, we exhibit state-of-the-art performance and ideal scaling on the first two exascale supercomputers, OLCF Frontier and LLNL El Capitan. Combined with MFC’s single-accelerator performance, MFC achieves exascale computation in practice, and achieved the largest-to-date public CFD simulation at 200 trillion grid points as a 2025 ACM Gordon Bell Prize finalist. New physical features include the immersed boundary method, N-fluid phase change, Euler–Euler and Euler–Lagrange sub-grid bubble models, fluid-structure interaction, hypo- and hyper-elastic materials, chemically reacting flow, two-material surface tension, magnetohydrodynamics (MHD), and more. Numerical techniques now represent the current state-of-the-art, including general relaxation characteristic boundary conditions, WENO variants, Strang splitting for stiff sub-grid flow features, and low Mach number treatments. Weak scaling to tens of thousands of GPUs on OLCF Summit and Frontier and LLNL El Capitan achieves efficiencies within 5% of ideal to over 90% of their respective system sizes. Strong scaling results for a 16-times increase in device count show parallel efficiencies over 90% on OLCF Frontier. MFC’s software stack has undergone further improvements, including continuous integration, which ensures code resilience and correctness through over 300 regression tests; metaprogramming, which reduces code length while maintaining performance portability; and code generation for computing chemical reactions

Computational fluid dynamics

Testing NeuralGCM's capability to simulate future heatwaves based on the 2021 Pacific Northwest heatwave event

AI-based weather and climate models are emerging as accurate and computationally efficient tools. Beyond weather forecasting, they also show promise to accelerate storyline analyses. We evaluate NeuralGCM’s ability to simulate an extreme heatwave against the Energy Exascale Earth System Model (E3SM), a physics-based climate model. NeuralGCM accurately replicates the targeted event, and generates stable and realistic mid-century projections. However, due to the absence of land feedbacks, NeuralGCM underestimates the projected warming amplitude compared to physics-based model references.

54 ENVIRONMENTAL SCIENCES

pyRMG: A framework for high-throughput, large-cell DFT calculations on supercomputers

Exascale computing delivers the raw power to simulate ever larger and more chemically realistic systems, but realizing this potential requires codes that can efficiently use thousands of processors. Our real-space multigrid (RMG) density functional theory (DFT) code’s grid-decomposition approach scales nearly linearly with the number of graphics processing units (GPUs), even for simulations exceeding thousands of atoms. This scalability makes RMG a compelling tool for high-throughput DFT studies of materials that would otherwise be bottlenecked in other codes (for example, by global fast Fourier transforms in plane-wave DFT). However, the limited workflow infrastructure for RMG has thus far constrained its adoption to a small user community. In this work, we present pyRMG, a Python package designed to streamline the setup and execution of RMG DFT calculations. Built on the pymatgen and ASE (Atomic Simulation Environment) computational materials science Python packages, pyRMG automates input generation and convergence checking, and it integrates with modern job schedulers (e.g., Flux) on leadership-class platforms such as Frontier and Perlmutter. Here, we demonstrate pyRMG for a high-throughput study of strain effects in 2D 2L-Bi 2 Se 3 /2L-NbSe 2 heterostructures, which offers chemical insights into this system and shows that RMG-based workflows can converge with limited user intervention.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH

Gridded Vegetation and Land Unit Datasets over North America (1km x 1km) for E3SM Land Model, Version 2

Gridded 1 km land-surface-property dataset for Energy Exascale Earth System Model Land Model (ELM) simulations over North America. Thirty-metre NALCMS land cover is aggregated to the Daymet grid; vegetation classes are cross-walked to ELM plant functional types using mean-temperature-of-the-coldest-month (MTCO) rules. NetCDF includes PFT and land-unit fractions, counts, and MTCO.

54 ENVIRONMENTAL SCIENCES

Implementation of a turbine farm model into the Energy Exascale Earth System Model for investigation and quantification of global climate impacts

Although there has been widespread deployment of wind farms in the United States, and plans to continue deployment into the future, the complete effects of wind farms on Earth systems are not well understood. The work performed here has incorporated wind farm models into the Energy Exascale Earth System Model (E3SM) capable of simulating the effects of extracting momentum from the atmospheric flow field using power generating wind farms. This new capability will allow scientists to quantify the impacts of wind farm induced changes on Earth systems by exploiting E3SM’s ability to couple atmospheric, oceanic, and biogeochemical (BGC) models on a global scale and monitor precipitation levels, extreme weather events, soil moisture content and jet stream location over decades-long time periods. This tool will be used to inform decision making on wind farm citing and will contribute to the Lab’s ability to assess energy technology impacts on the environment and evaluate the trade-offs between energy infrastructure investments and their impacts on natural systems.

17 WIND ENERGY

Regime-based aerosol–cloud interactions from CALIPSO-MODIS and the Energy Exascale Earth System Model version 2 (E3SMv2) over the Eastern North Atlantic

This study investigates aerosol-cloud interactions in marine boundary layer (MBL) clouds using an advanced deep-learning-driven synoptic-regime-based framework, combining satellite data (CALIPSO vertically resolved aerosol extinction and MODIS cloud properties) with 1° nudged Energy Exascale Earth System Model version 2 (E3SMv2) simulation over the Eastern North Atlantic (ENA; ∼10°×10°, 2006–2014). The E3SMv2 captures observed seasonal variations in cloud droplet number concentrations (N d ) and liquid water path (LWP), though it systematically underestimates N d . We then partition ENA meteorology into four synoptic regimes (Pre-Trough, Post-Trough, Ridge, Trough) via a deep-learning clustering of ERA5 reanalysis fields, enabling regime-dependent aerosol-cloud interactions analyses. Both satellite and E3SMv2 exhibit an inverted-V LWP-N d relationship. In Post-Trough and Ridge regimes, the satellite shows stronger negative LWP-N d sensitivities than in Pre-Trough regime. The Trough regime displays a muted satellite LWP response. In comparison, the model predicts more exaggerated LWP responses across regimes, with LWP increasing too quickly at low N d and decreasing more sharply at high N d , especially in Pre-Trough and Trough regimes. These exaggerated model LWP sensitivities may stem from uncertainties in representing drizzle processes, entrainment, and turbulent mixing. As for N d susceptibility to aerosols, N d increases with MBL aerosol extinction in both datasets, but the simulated aerosol-cloud interactions appear oversensitive to meteorological conditions. Overall, E3SMv2 better captures aerosol effects under regimes that favor stratiform clouds (Post-Trough, Ridge), but performance deteriorates for regimes with deeper, dynamically complex clouds (Trough), highlighting the need for improved representations of those cloud processes in climate models.

Environmental sciences

PETSc/TAO developments for GPU-based early exascale systems

The Portable Extensible Toolkit for Scientific Computation (PETSc) library provides scalable solvers for nonlinear time-dependent differential and algebraic equations and for numerical optimization via the Toolkit for Advanced Optimization (TAO). PETSc is used in dozens of scientific fields and is an important building block for many simulation codes. During the U.S. Department of Energy’s Exascale Computing Project, the PETSc team has made substantial efforts to enable efficient utilization of the massive fine-grain parallelism present within exascale compute nodes and to enable performance portability across exascale architectures. We recap some of the challenges that designers of numerical libraries face in such an endeavor, and then discuss the many developments we have made, which include the addition of new GPU backends, features supporting efficient on-device matrix assembly, better support for asynchronicity and GPU kernel concurrency, and new communication infrastructure. In conclusion, we evaluate the performance of these developments on some pre-exascale systems as well as the early exascale systems Frontier and Aurora, using compute kernel, communication layer, solver, and mini-application benchmark studies, and then close with a few observations drawn from our experiences on the tension between portable performance and other goals of numerical libraries.

Exascale Computing Project (ECP)

Multigrid Reduction in Time for Chaotic and Hyperbolic Problems (Final Report)

The coming massive parallelism of exascale computing presents a pressing challenge for the many DOE simulations of time-dependent partial differential equations (PDEs), which typically use traditional sequential time stepping methods. Since this traditional approach is inherently serial, it presents a sequential bottleneck when moving to exascale computing, because future performance gains will come through greater concurrency, not faster clock speeds. Thus, the goal of this work is to research parallelism in time, i.e., methods that compute multiple time values simultaneously, not sequentially. The focus will be on hyperbolic and chaotic problems of interest to DOE, with the goal of enabling scalable simulations of time-dependent hyperbolic and chaotic problems on future architectures. The chosen methodology for solving these problems parallel-in-time is multigrid, because multigrid (when it works) is a powerful, optimal, and scalable solver for discretized PDEs. Multigrid is already commonly used in many DOE simulations for scalably and optimally solving space-only PDE problems. The areas of hyperbolic and chaotic problems are chosen because of their relevance to problems of programmatic interest to DOE. However, these problems are also well-known to be difficult for parallel-in-time methods, with the most common method, parareal, diverging in many cases. The current state of-the-art for parallel-in-time at LLNL is the multigrid reduction in time (MGRIT) XBraid package, which also struggles for such problems, while still showing some improvement over parareal. In summary, new methods are needed for an efficient parallel-in-time scheme for hyperbolic and chaotic problems, and this work shall research promising new multigrid methods in this area. In particular, this work shall continue researching the directions from the current collaboration with Dr. Falgout, which are laid out in the work Toward Parallel in Time for Chaotic Dynamical Systems and showed the first known results of a parallel-in-time speedup for a chaotic problem. This work outlines two key improvements to XBraid for chaotic problems, the so-called “theta” and “delta-correction” methods. Here, these two improvements will be further researched and improved (including with a new relaxation method inspired by on Least Squares Shadowing (LSS)) and explored for more complicated problems.

97 MATHEMATICS AND COMPUTING

Improving thermodynamic nudging in the E3SM Atmosphere Model version 2 (EAMv2): strategy and hindcast skills on weather systems

Nudging techniques are commonly employed to constrain atmospheric simulations toward observed states, facilitating model evaluation and sensitivity studies. However, if applied improperly – particularly to thermodynamic variables such as temperature and humidity – nudging can distort physical processes and introduce spurious biases, undermining the credibility of the simulations. This study presents an improved nudging implementation that applies vertically modulated tendencies to reduce adverse impacts on model physics. The framework is tested in version 2 of the Energy Exascale Earth System Model (EAMv2) using a suite of hindcast simulations nudged toward ERA5 reanalysis. We systematically evaluate the individual and combined effects of nudging wind, temperature, and humidity fields on the model's ability to represent large-scale atmospheric states and high-impact weather systems. Results show that the revised strategy – particularly when nudging temperature and humidity at selected levels – enhances hindcast skill by improving agreement with ERA5 without degrading the hydrological cycle or precipitation processes. Additional improvements in surface temperature, outgoing longwave radiation, and precipitation biases are achieved through targeted nudging of land-surface variables. The proposed approach strengthens the representation of large-scale conditions relevant to tropical cyclones, atmospheric rivers, and extratropical cyclones in the low-resolution EAMv2. These findings demonstrate that carefully designed thermodynamic nudging, especially of temperature and humidity, improves the realism of constrained simulations and broadens the utility of nudged EAMv2 for atmospheric modeling, machine learning, and high-impact weather research.

Atmospheric river