Search NASA⌕ Search

SEARCH · Search NASA

Results for “Exascale simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Massively parallel phase-field simulations targeting exascale

The interface thickness in the phase-field (PF) method limits its simulation scales. Consequently, large-scale PF simulations become prohibitively expensive for resolving the extremely fine microstructures that typically form during rapid solidification processing. This challenge is significant in predicting microstructure evolution in metal additive manufacturing and has been identified by the United States Department of Energy’s Exascale Computing Project. Here, to address this, we develop a multi-GPU and MPI-based massively parallel simulation code, utilizing state-of-the-art algorithms, software, and libraries, for large-scale three-dimensional (3D) PF simulations. We report the first GPU-parallel PF simulations on Frontier (currently the second TOP500 exascale cluster) and Summit machines, taking dendritic growth as an example problem. We evaluate the parallel performance of our implementation using scaling studies with more than 24 000 GPUs (among the largest known computations to date) and the acceleration performance using large-scale simulations of dendritic growth in 3D. Finally, massively parallel GPUs in these supercomputers enabled the first coupled multiscale simulations of laser melting and subsequent dendritic solidification on the scale of a full melt-pool, demonstrating the feasibility of performing PF simulations with a point total over 2 billion grid points within an acceptable time.

Exascale↗
DOE OSTI2026

Frameworks, Algorithms, and Scalable Technologies for Mathematics (FASTMath) SciDAC Institute

As computational models scale to larger computers, the rate at which they produce data has far outstripped the same computers ability to write that data and further the file systems ability to store that data. Almost all of the SciDAC applications, but especially those related to fusion solve very large scale PDEs whose scientific output his impacted by this problem. To gain access to dynamics in an exascale simulation that are not identifiable a priori and to make that dynamical data available to machine learning requires fundamental research in the area of in situ data data analytics. Here data analytics includes compression, visualization, uncertainty quantification, and machine learning. This in situ data analytics will enable on-the-fly spatial and temporal compression of solution dynamics, expose that space-time compressed field to machine learning algorithms that have been specialized to work with dynamically evolving data (existing machine learning algorithms treat data sets as static), greatly improving the opportunity for machine learning to provide feedback to the compression, all within an ongoing simulation, without the need to write data to files. The same concepts are also being applied to uncertainty quantification and multi-fidelity modeling which have similar needs for spatial and temporal compression of the ongoing exascale simulation to perform either without the typical, unacceptable writing of data to files.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

A roadmap toward scaling, reasoning and self-evolving foundation models for nuclear and particle physics

Foundation models have revolutionized artificial intelligence, with Large Language Models demonstrating unprecedented capabilities in multimodal understanding, reasoning and tool use. Nuclear and particle physics stands at a critical juncture where similar transformative potential awaits realization. The field generates exabytes of experimental data, exascale simulations, and decades of theoretical insights — yet these remain largely disconnected from modern Artifical Intelligence (AI) capabilities, with most physics AI applications confined to narrow, task-specific models that suffer from domain shifting when applied to real experimental data. We present a roadmap for FM4NPP (Foundation Model for Nuclear and Particle Physics), systematically scaling from current proof-of-concept models to trillion-parameter architectures capable of autonomous discovery. Our approach advances three critical frontiers: unified data infrastructure integrating detector data, scientific knowledge and computational tools across global facilities; multi-facility foundation models enabling cross-experiment knowledge transfer and accelerated discovery; and agentic AI capabilities for reasoning and autonomous tool use. The resulting self-evolving FM4NPP will transform physics research by converting time-intensive data analysis, theory derivation and computational bottlenecks into rapid AI–human collaborative discovery. This paradigm shift promises to fundamentally accelerate scientific progress in nuclear and particle physics, enabling researchers to focus on high-level insights while AI handles routine analysis and explores vast parameter spaces beyond human capacity.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Collaborative: in situ visual analytics technologies for extreme scale combustion simulations

This project aims to drastically enhance the usability of in situ analysis and visualization for extreme-scale scientific simulations. Current exascale computing capabilities promise to offer greater predictive ability of simulations and to further push the frontiers of science and technology. However, to validate the simulation output at extreme scale, examine the modeled phenomena, and discover previously unknowns from the output data, the output must be reduced or transformed in situ as it is being generated during the simulation such that the amount of data to examine and store is kept to a minimum. Such in situ approaches allow us to process and analyze the data and any embedded geometry to an extent that would be prohibitively expensive, if not impossible, to perform as a post hoc task. While in situ processing has been demonstrated to be a feasible and promising approach, its full potential has not yet been leveraged. In this project, we have developed comprehensive enhancements to in situ technology based on probability distributions in data. Our research focuses on jointly developing new ways of interacting with massive statistical samples while creatively utilizing new state-of-the-art computational resources to push the boundaries of in situ exploration. Moreover, we have developed new time-dependent techniques to enable previously unattainable capabilities in areas such as intelligent simulation steering and precise feature identification. We have experimentally studied our design and implementation at NERSC and OLCF, and are able to leverage existing in situ infrastructures whenever possible. While the exemplar in this project is combustion, many other fields for which turbulent transport is important, e.g., fusion, climate, astrophysics among others, encounter similar issues as simulations scale up to the exascale. This project shows its potential to generate high impact on DOE missions since the resulting technology promises to improve scientists’ ability to rapidly and correctly interpret and tune extreme-scale simulations, leading to new scientific understanding and advancements.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Advances in ArborX to support exascale applications

ArborX is a performance portable geometric search library developed as part of the Exascale Computing Project (ECP). In this paper, we explore a collaboration between ArborX and a cosmological simulation code HACC. Large cosmological simulations on exascale platforms encounter a bottleneck due to the in-situ analysis requirements of halo finding, a problem of identifying dense clusters of dark matter (halos). This problem is solved by using a density-based DBSCAN clustering algorithm. With each MPI rank handling hundreds of millions of particles, it is imperative for the DBSCAN implementation to be efficient. In addition, the requirement to support exascale supercomputers from different vendors necessitates performance portability of the algorithm. We describe how this challenge problem guided ArborX development, and enhanced the performance and the scope of the library. We explore the improvements in the basic algorithms for the underlying search index to improve the performance, and describe several implementations of DBSCAN in ArborX. Further, we report the history of the changes in ArborX and their effect on the time to solve a representative benchmark problem, as well as demonstrate the real world impact on production end-to-end cosmology simulations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Planar Collisionless Shock Simulations with the Semi-implicit Particle-in-cell Model FLEKS

This study investigates the applicability of the semi-implicit particle-in-cell code FLexible Exascale Kinetic Simulator (FLEKS) to heliospheric shock simulations. We examine one- and two-dimensional local planar shock simulations, initialized using MHD states with upstream conditions representative of plasmas in the hypersonic, β ∼ 1 regime, for both quasi-perpendicular and quasi-parallel configurations. The refined algorithm in FLEKS proves robust, enabling accurate shock simulations with a grid resolution on the order of the electron inertial length d e . Our simulations successfully capture key shock features, including shock structures (foot, ramp, overshoot, and undershoot), upstream and downstream waves (fast magnetosonic, whistler, Alfvén ion-cyclotron, and mirror modes), and non-Maxwellian particle distributions. Crucially, we find that at least two spatial dimensions are critical for accurately reproducing downstream-wave physics in quasi-perpendicular shocks and capturing the complex dynamics of quasi-parallel shocks, including surface rippling, shocklets, short, large-amplitude magnetic structures, magnetic reconnection, and jets. Furthermore, our parameter studies demonstrate the impact of mass ratio and grid resolution on shock physics. This work provides valuable guidance for selecting appropriate physical and numerical parameters for shock simulations using a semi-implicit PIC method, paving the way for incorporating kinetic shock processes into large-scale collisionless plasma simulations with the MHD-AEPIC model.

plasma astrophysics↗
DOE OSTI2025

Development of a River Dynamical Core for E3SM to simulate compound flooding on Exascale-class heterogeneous supercomputers

Flooding events pose significant risk to human life, property, and infrastructure. Physically-consistent quantification of altered flood risks in global models requires hyper-resolution (~1 km) or fine flood simulations using two-dimensional (2D) physics schemes, both of which are unavailable in the current generation Earth System Models. Here, in this work, we have developed the River Dynamical Core (RDycore), which is an open-source, 2D shallow water equation (SWE) library for the U.S. Department of Energy's Energy Exascale Earth System Model (E3SM). RDycore uses PETSc and libCEED libraries that allows it to run efficiently on CPUs and GPUs, as well as select a time-integration algorithm at runtime without requiring any code modifications. RDycore achieves spatial error convergence rates for problems with analytical and manufactured solutions similar to those reported previously in the literature, or consistent with the implemented first-order spatial discretization scheme. RDycore's accuracy in predicting flooding for a well-studied dam break problem is comparable to existing SWE models. For a problem with 471 million grid cells, RDycore achieves a speedup of 6.6x and 7.6x on GPUs compared to CPUs when using 320 compute nodes on DOE's Perlmutter and Frontier supercomputers, respectively. The one-way coupling of the RDycore library within E3SM is demonstrated by performing multiple 5-day flooding simulations during Hurricane Harvey driven by five precipitation datasets. The E3SM--RDycore simulations at 30 m spatial resolution accurately simulate maximum water height during the hurricane when benchmarked against a previously published study and achieve a speedup of 15x (Perlmutter) and 21x (Frontier) on GPUs relative to CPUs. The work presented here is the foundational step in providing hardware and algorithmic portability framework for simulating kilometer-scale river dynamics within E3SM.

Flood Simulation↗
DOE OSTI2025

Flexible User-Defined Domain Decomposition in Kilometer-Scale E3SM Land Model Simulation

The Energy Exascale Earth System Model (E3SM) Land Model (ELM) has been extended to kilometer-scale (km-ELM) resolutions, enabling high-fidelity simulations of terrestrial processes at 1 km x 1 km grid spacing. In ELM, domain decomposition partitions the computational domain across processors, ensuring efficient parallel execution. Currently, round-robin decomposition is applied, providing a straightforward way to distribute computational workload. As ELM continues evolving at the kilometer-scale (km-scale), particularly with integrating lateral flow modeling, decomposition strategies must also account for the increased workload and data movement. This paper introduces a flexible user-defined domain decomposition framework, allowing users to customize domain partitioning based on application requirements. The impact of different decomposition strategies is evaluated across various applications concerning computation, communication, and I/O. Results demonstrate that while 1D partitioning yields superior I/O performance, k-nearest neighbors (KNN) clustering effectively reduces inter-process communication overhead. This study lays the groundwork for scalable partitioning in large-scale land surface simulations, enhancing next-generation Earth system modeling.

Wang, Dali [ORNL] (ORCID:0000000168065108)↗
DOE OSTI2026

Subseasonal Tropical Convection Characteristics in the Energy Exascale Earth System Model Version 2

Accurate simulation of subseasonal tropical moist convection remains a key challenge for Earth system models. The difficulties stem from the reliance of cumulus cloud processes on model parameterizations and the need to represent the multiscale nature of interactions among clouds, radiation, moisture, circulation, and surface energy fluxes. Equatorial convection drives circulation anomalies that can affect weather patterns and extremes globally, motivating efforts to better understand and simulate these tropical disturbances. Here, a detailed review of subseasonal tropical convective behavior as simulated in the Energy Exascale Earth System Model version 2 (E3SMv2) is presented, with comparison to its predecessor version 1 (E3SMv1) and reference data sets. Model structural changes to the deep convective trigger function and surface fluxes, along with parametric tuning of the cloud and microphysics schemes, together result in an improved depiction of organized tropical convection across scales. In particular, E3SMv2 exhibits a more realistic Madden‐Julian oscillation (MJO) and low‐frequency Kelvin waves—owing to a sharper time mean equatorial meridional moisture gradient and improved convection‐circulation coupling —as well as a better depiction of MJO Northern Hemisphere teleconnections. Despite these improvements, subseasonal precipitation variance continues to be strongly underestimated in E3SMv2. Use of a cloud plume model also reveals that the coupling between daily averaged tropical precipitation and lower tropospheric instability in E3SM is inconsistent with observations, a bias that could potentially impact the simulation of intraseasonal disturbances.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Advancing Quantum Many-Body GW Calculations on Exascale Supercomputing Platforms

Advanced ab initio materials simulations face growing challenges as increasing systems and phenomena complexity requires higher accuracy, driving up computational demands. Quantum many-body GW methods are state-of-the-art for treating electronic excited states and couplings but often hindered due to the costly numerical complexity. Here, we present innovative implementations of advanced GW methods within the BerkeleyGW package, enabling large-scale simulations on Frontier and Aurora exascale platforms. Our approach demonstrates exceptional versatility for complex heterogeneous systems with up to 17,574 atoms, along with achieving true performance portability across GPU architectures. We demonstrate excellent strong and weak scaling to thousands of nodes, reaching double-precision core-kernel performance of 1.069 ExaFLOP/s on Frontier (9,408 nodes) and 707.52 PetaFLOP/s on Aurora (9,600 nodes), corresponding to 59.45% and 48.79% of peak, respectively. Our work demonstrates a breakthrough in utilizing exascale computing for quantum materials simulations, delivering unprecedented predictive capabilities for rational designs of future quantum technologies.

Zhang, Benran [University of Southern California, ↗
DOE OSTI2025

Establishing model credibility for process-microstructure-property relationships in additive manufacturing using exascale computing

Additive Manufacturing (AM) of alloys holds significant promise as a disruptive technology in various industries, yet its adoption is often hindered by challenges in achieving consistent part quality. These issues are primarily due to the complex process-microstructure-property (PSP) relationships inherent to AM. Computational models can greatly aid in understanding these relationships, but their widespread impact and adoption has been limited by a lack of validated, open-source, and computationally efficient PSP modeling frameworks and hardware limitations. Here, this study leverages the ExaAM software suite and data from the AMBench-2018 series of laser powder bed fusion (LPBF) benchmark experiments to perform a comprehensive model assessment, including verification, validation, sensitivity analysis, and uncertainty quantification. The RADICAL-EnTK workflow manager was used to perform an ensemble of heat transport, solidification, and mechanical response simulations on the exascale computer Frontier, considering uncertainties in critical model inputs such as laser spot size and nucleation parameters, and consisting of 125 explicit grain structure simulations and 7875 crystal plasticity simulations. For a selected location within the Inconel 625 AMBench-2018 test artifact, sensitivity analysis and uncertainty quantification were performed using the predicted distributions of grain structure and mechanical properties. Qualitative agreement was found between the predicted grain size and texture and the observed AMBench-2018 microstructure, the mean predicted yield stress was within 5% of the experimental measurement mean, and the mean predicted engineering stress at 5% strain was within 10% of the experimental measurement mean. The insights gained from development and validation of the ExaAM PSP modeling framework will help guide future directions for enhancing the credibility and reliability of PSP models in AM, thereby accelerating the adoption of AM technologies in various industries.

Additive manufacturing↗
DOE OSTI2026

High-Latitude, Low-Altitude SAI: Overview of G6-1.5K-HiLLA Simulations in E3SMv3

This report details a contribution of Energy Exascale Earth System Model version 3 (E3SMv3) simulations to a proposed model intercomparison project funded and organized by Reflective, a nonprofit group studying the possible global impacts of SAI. Using annual feedback control and seasonally-variable injection sites to achieve a desired global near-surface temperature target, the simulated SAI campaign indicates robust maintenance of the 2020-2039 climatic state over 60 years into the future.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Investigation of Arctic Cloud Properties and Surface Radiation Based on MOSAiC Shipborne Observations

The Arctic is rapidly changing due to changes of the Earth system. This study investigates cloud fraction, phase partition, cloud type, and their relationships with surface radiation based on yearlong shipborne observations in the Arctic regions. The Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) campaign provided lidar and radar observations of cloud microphysical properties and surface shortwave (SW) and longwave (LW) radiation. Cloud and radiative properties were examined at daily and monthly resolutions in four seasons. Low clouds were found to be most prevalent throughout the year, followed by deep clouds. The ice phase is the dominant phase except for summer (June–August). Liquid and mixed phases show more significant monthly and annual mean radiative effects in SW and LW than the ice phase. The clouds show net warming effects due to LW heating in most months, while the SW cooling effects of clouds become more dominant for July and August. The cloud and radiation observations from MOSAiC were used to evaluate simulations of the atmospheric component of the Energy Exascale Earth System Model version 2. The simulations show large overestimations of the liquid and mixed phases in the Arctic regions from February to September. The simulations also underestimate the percentages of low clouds and overestimate the percentages of deep clouds throughout the year. Altogether, this work provides a unique analysis of cloud and radiation properties based on high-resolution shipborne observations, which can be used to assist future model evaluation and development.

58 GEOSCIENCES↗
DOE OSTI2025

In situ multi-tier auto-ignition detection applied to dual-fuel combustion simulations

Here we use an anomaly detection methodology that is centered on analyzing fourth-order joint moments (co-kurtosis), particularly focusing on its application in auto-ignition of combustion problems with large numbers of species. Unsupervised anomaly detection is challenging to generalize across problem types and domains. A recent technique, centered on analyzing information in the fourth-order joint moment co-kurtosis, has shown promise, especially for high-dimensional scientific data. In this work we present developments to the co-kurtosis based anomaly detection method needed to make it effective and scalable for large-scale distributed scientific data, such as those generated by massively parallel simulations. An in situ co-kurtosis algorithm is employed as the anomaly detection method for identifying ignition kernels in simulations of turbulent combustion. Here, we extend an existing methodology which identifies regions of the domain where anomalies are present, and add another tier of anomaly detection where the individual samples contributing to the anomaly are identified. We apply this algorithm on-the-fly to a variety of turbulent reacting flow problems and compare it to the widely used (but significantly more expensive) chemical explosive mode analysis (CEMA). We demonstrate the ability of the method to detect and identify the onset of low and high temperature ignition which can be used for computational steering, as chemical and combustion anomalies occur intermittently at spatio-temporal locations unknown a priori. Finally, we apply our lightweight in situ algorithm to an exascale high-fidelity simulation with a total of 2.4 Trillion degrees of freedom, performed using an adaptive mesh refinement solver. Furthermore, through a scalability analysis, we show that the relative computational cost of this in-situ anomaly detection algorithm compared to an iteration of the reacting flow solver is negligible.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

On the Dependence of Simulated Convection on Domain Size in CRMs

Abstract We present a heuristic model to explain the suppression of deep convection in convection‐resolving models (CRMs) with a small number of grid columns, such as those used in super‐parameterized or multi‐scale modeling framework (MMF) general circulation models (GCM) of the atmosphere. Domains with few grid columns require greater instability to sustain convection because they force a large convective fraction, driving strong compensating subsidence warming. Updraft dilution, which is stronger for reduced horizontal grid spacing, enhances this effect. Thus, suppression of deep convection in CRMs with few grid columns can be reduced by increasing grid spacing. Radiative‐convective equilibrium simulations using standalone CRM simulations with the System for Atmospheric Modeling (SAM) and using GCM‐coupled CRM simulations with the Energy Exascale Earth System Model (E3SM)‐MMF confirm the heuristic model results.

CRM↗
DOE OSTI2025

Developing Partnership between San Jose State University and DOE Lawrence Livermore National Laboratory to Enhance Climate Research Equity and Inclusion

One of the key objectives of this project was to develop partnership between San Jose State University (SJSU) and the Lawrence Livermore National Laboratory (LLNL), a US Department of Energy (DOE) funded national laboratory. Both institutions are closely located within the San Francisco Bay Area in California and their researchers share overlapping research interests and expertise related to Earth system sciences. By leveraging their connections with LLNL, faculty and students from SJSU gained exposure to state-of-the-art observations and simulations related to Earth system sciences, including but not limited to the usage of the facility data provided by the DOE Atmospheric Radiation Measurement (ARM) program and data analysis techniques for interpreting and analyzing the DOE Energy Exascale Earth System Model (E3SM) simulations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Assessing Simulations of Forest Hurricane Disturbance and Recovery in Puerto Rico by ELM-FATES Using Field Measurements

In the past three decades, Puerto Rico (PR) experienced five hurricanes that met or exceeded category three, and they caused severe forest structural damage and elevated tree mortality. To improve our mechanistic understanding of hurricane impacts on tropical forests and assess hurricane-affected forest dynamics in Earth system models, we use in situ forest measurements at the Bisley Experimental Watersheds in Northeast PR to evaluate the Functionally Assembled Terrestrial Ecosystem Simulator coupled with the Energy Exascale Earth System Model Land Model (ELM-FATES). The observations show that before Hurricane Hugo, 77.3% of the aboveground biomass (AGB) is from the shade-tolerant plant function type (PFT). The Hugo-induced mortality rates are over ~50%, and they induce a ~39% AGB reduction, which recovers to a level like the pre-Hugo condition in 2014, following a second, lower intensity hurricane, Georges. We perform numerical experiments that simulate damage from Hugo and Georges on the forests, including defoliation, sapwood and structural biomass damage, and hurricane-induced mortality. ELM-FATES can reasonably represent coexistence between the two PFTs–light-demanding and shade-tolerant–for both the pre-Hugo and post-Hugo conditions. The model represents a reasonable size distribution of mid-and large-sized trees although it underestimates AGB, likely due to the overestimated nonhurricane mortality. ELM-FATES temporarily stimulated leaf biomass and diameter increment after Georges, an effect that should be tested with observations of future hurricane defoliation events. This research indicates that addressing model-data mismatches in tree mortality and understory dynamics are essential to simulation of more extreme hurricane effects under climate change.

58 GEOSCIENCES↗
DOE OSTI2025

Advancing the Understanding of Cloud Microphysical Processes and Aerosol Indirect Effects in High-Latitude Mixed-Phase Clouds by Linking ARM Measurements with Climate Model Simulations (Final Report)

The key objectives of this project were to advance our understanding of cloud microphysical characteristics and aerosol indirect effects on mixed-phase clouds in high latitudes. To improve the representation of ice and mixed-phase clouds in Earth System Models (ESMs), we propose an integrated observation and modeling study of cloud macro- and microphysical properties, including spatial heterogeneities, mass partitioning between ice crystals and supercooled liquid water, effects of ice nucleating particles (INPs), and efficiency of secondary ice production (SIP), etc. Specifically, we took four main approaches in this project: (1) examining macro- and microphysical properties of ice and mixed-phase clouds based on in-situ and ground-based observations from multiple field campaigns funded by the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) program, including the Mixed-Phase Arctic Cloud Experiment (M-PACE), Indirect and Semi-Direct Aerosol Campaign (ISDAC), Ice Nucleating Particle Sources at Oliktok Point (INPOP), ARM West Antarctic Radiation Experiment (AWARE), Measurements of Aerosols, Radiation, and Clouds over the Southern Ocean (MARCUS), and Macquarie Island Cloud and Radiation Experiment (MICRE); (2) evaluating the DOE Energy Exascale Earth System Model (E3SM) simulations based on observations, particularly for ice and mixed-phase cloud microphysical properties; (3) examining the impacts of INPs on ice and mixed-phase clouds. Specifically, a series of comparisons were conducted using observations over the Arctic, Southern Ocean, and Antarctica, including comparisons between the lower and higher southern latitudes as well as comparisons between the northern and southern hemispheres. In addition, aerosol indirect effects from distinct sources of dust particles were examined; and (4) investigating the impacts of SIP. Ultimately, these results helped to improve cloud microphysics and aerosol-cloud interaction parameterizations in the E3SM model. Overall, the project provided improved understanding regarding various factors, including thermodynamic, dynamic, and aerosol conditions, on the micro- and macrophysical properties of ice and mixed-phase clouds in the high latitudes. Resulting analysis helped to provide an improved physical basis for refining the current cloud microphysics parameterizations related to ice and mixed-phase clouds in E3SM.

54 ENVIRONMENTAL SCIENCES↗