Search NASASearch

DOE OSTI · 3019954

MFC 5.0: An exascale many-physics flow solver

Wilfong, Benjamin [Georgia Institute of Technology, Atlanta, GA (United States)] (ORCID:0009000100746668)·Le Berre, Henry A. [Georgia Institute of Technology, Atlanta, GA (United States)] (ORCID:0000000247819502)·Radhakrishnan, Anand [Georgia Institute of Technology, Atlanta, GA (United States)] (ORCID:0000000151272741)·Gupta, Ansh [Georgia Institute of Technology, Atlanta, GA (United States)] (ORCID:0009000165999105)·Vickers, Daniel J. [Georgia Institute of Technology, Atlanta, GA (United States)] (ORCID:0000000252315528)·Vaca-Revelo, Diego [Worcester Polytechnic Institute, MA (United States)] (ORCID:0000000248119057)·Adam, Dimitrios [Georgia Institute of Technology, Atlanta, GA (United States)] (ORCID:0009000943472984)·Yu, Haocheng [Georgia Institute of Technology, Atlanta, GA (United States)]·Lee, Hyeoksu [California Institute of Technology (CalTech), Pasadena, CA (United States)]·Chreim, Jose Rodolfo [California Institute of Technology (CalTech), Pasadena, CA (United States)]·Carcana Barbosa, Mirelys [Brown Univ., Providence, RI (United States)] (ORCID:0000000258062701)·Zhang, Yanjun [California Institute of Technology (CalTech), Pasadena, CA (United States)] (ORCID:0000000260024501)·Cisneros-Garibay, Esteban [Univ. of Illinois at Urbana-Champaign, IL (United States)] (ORCID:0000000325033215)·Gnanaskandan, Aswin [Worcester Polytechnic Institute, MA (United States)] (ORCID:0000000161356084)·Rodriguez Jr, Mauro [Brown Univ., Providence, RI (United States)] (ORCID:0000000305450265)·Budiardja, Reuben D. [Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)] (ORCID:0000000303958532)·Abbott, Stephen [Hewlett Packard Enterprise, Bloomington, MN (United States)] (ORCID:000900001028819X)·Colonius, Tim [California Institute of Technology (CalTech), Pasadena, CA (United States)] (ORCID:0000000303263909)·Bryngelson, Spencer H. [Georgia Institute of Technology, Atlanta, GA (United States)] (ORCID:0000000317507265)

Abstract

Many problems of interest in engineering, medicine, and the fundamental sciences rely on high-fidelity flow simulation, making performant computational fluid dynamics solvers a mainstay of the open-source software community. Previous work MFC 3.0 was made a published, documented, and open-source solver via Bryngelson et al. Comp. Phys. Comm. (2021) with numerous physical features, numerical methods, and scalable infrastructure. MFC 5.0 is a significant update to MFC 3.0, featuring a broad set of well-established and novel physical models and numerical methods, as well as the introduction of GPU and APU (or superchip) acceleration. Here, we exhibit state-of-the-art performance and ideal scaling on the first two exascale supercomputers, OLCF Frontier and LLNL El Capitan. Combined with MFC’s single-accelerator performance, MFC achieves exascale computation in practice, and achieved the largest-to-date public CFD simulation at 200 trillion grid points as a 2025 ACM Gordon Bell Prize finalist. New physical features include the immersed boundary method, N-fluid phase change, Euler–Euler and Euler–Lagrange sub-grid bubble models, fluid-structure interaction, hypo- and hyper-elastic materials, chemically reacting flow, two-material surface tension, magnetohydrodynamics (MHD), and more. Numerical techniques now represent the current state-of-the-art, including general relaxation characteristic boundary conditions, WENO variants, Strang splitting for stiff sub-grid flow features, and low Mach number treatments. Weak scaling to tens of thousands of GPUs on OLCF Summit and Frontier and LLNL El Capitan achieves efficiencies within 5% of ideal to over 90% of their respective system sizes. Strong scaling results for a 16-times increase in device count show parallel efficiencies over 90% on OLCF Frontier. MFC’s software stack has undergone further improvements, including continuous integration, which ensures code resilience and correctness through over 300 regression tests; metaprogramming, which reduces code length while maintaining performance portability; and code generation for computing chemical reactions

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Wilfong, Benjamin [Georgia Institute of Technology, Atlanta, GA (United States)] (ORCID:0009000100746668), Le Berre, Henry A. [Georgia Institute of Technology, Atlanta, GA (United States)] (ORCID:0000000247819502), Radhakrishnan, Anand [Georgia Institute of Technology, Atlanta, GA (United States)] (ORCID:0000000151272741), Gupta, Ansh [Georgia Institute of Technology, Atlanta, GA (United States)] (ORCID:0009000165999105), Vickers, Daniel J. [Georgia Institute of Technology, Atlanta, GA (United States)] (ORCID:0000000252315528), Vaca-Revelo, Diego [Worcester Polytechnic Institute, MA (United States)] (ORCID:0000000248119057), Adam, Dimitrios [Georgia Institute of Technology, Atlanta, GA (United States)] (ORCID:0009000943472984), Yu, Haocheng [Georgia Institute of Technology, Atlanta, GA (United States)], Lee, Hyeoksu [California Institute of Technology (CalTech), Pasadena, CA (United States)], Chreim, Jose Rodolfo [California Institute of Technology (CalTech), Pasadena, CA (United States)], Carcana Barbosa, Mirelys [Brown Univ., Providence, RI (United States)] (ORCID:0000000258062701), Zhang, Yanjun [California Institute of Technology (CalTech), Pasadena, CA (United States)] (ORCID:0000000260024501), Cisneros-Garibay, Esteban [Univ. of Illinois at Urbana-Champaign, IL (United States)] (ORCID:0000000325033215), Gnanaskandan, Aswin [Worcester Polytechnic Institute, MA (United States)] (ORCID:0000000161356084), Rodriguez Jr, Mauro [Brown Univ., Providence, RI (United States)] (ORCID:0000000305450265), Budiardja, Reuben D. [Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)] (ORCID:0000000303958532), Abbott, Stephen [Hewlett Packard Enterprise, Bloomington, MN (United States)] (ORCID:000900001028819X), Colonius, Tim [California Institute of Technology (CalTech), Pasadena, CA (United States)] (ORCID:0000000303263909), Bryngelson, Spencer H. [Georgia Institute of Technology, Atlanta, GA (United States)] (ORCID:0000000317507265). 2026-01-30. MFC 5.0: An exascale many-physics flow solver. https://doi.org/10.1016/j.cpc.2026.110055

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

Effect of soot concentration on radiative transport in a 2 m JP-8 pool fire

Hubbard et al. (2024) investigated conjugate heat transfer in a 7.9 m JP-8 pool fire, utilizing both heavily sooting and non-sooting fuel models. Their findings indicated that all models produced pool radiative heat fluxes within the measurement uncertainty for large-scale outdoor experiments. This study aims to further investigate the influence of soot concentration on radiative transport. To this end, Large Eddy Simulations (LES) of a 2 m diameter JP-8 pool fire were conducted, employing four turbulent combustion chemistry models: the Eddy Dissipation Concept (EDC) and three variants of flamelet model. Additionally, three variations of the one-equation subgrid scale turbulence kinetic energy model, and multiple mesh resolutions were utilized. The primary validation metrics were pool radiative heat flux and plume radiative fraction, with simulation data compared to experimental results published by Blanchat et al. (2010). The EDC model produced high soot concentrations near the pool surface, resulting in a significant shielding effect. In contrast, the flamelet combustion model has different kinetic limiters for soot production, leading to soot formation higher in the flame, where it can be more readily oxidized. Flamelet models incorporating both acetylene and benzene contributions to soot growth demonstrated better agreement with experimental data. To assess the sensitivity of pool radiative heat flux to soot mass concentration, we used a one-dimensional approximation over a wide range of soot concentrations and compared it to three-dimensional solutions obtained using Discrete Ordinates. Furthermore, this analysis illustrates the impacts of soot shielding and Turbulence Radiation Interactions (TRI), with TRI emission enhancement factors predicted to be in the range of 3–5 near the edges of the plume.

Computational fluid dynamics

Examination of entrainment, combustibility, and heat transfer due to cell venting inside simplified battery energy storage enclosures

Battery energy storage systems (ESS) assembled of modules containing lithium-ion batteries can pose fire and explosion hazards during thermal runaway because vented gases may accumulate, combust, or escape enclosures. Here, we propose a prototypical configuration composed of the main components of an ESS rack, where modules are represented as rectangles within an enclosure and vent gas is injected steadily through the top of a module. This idealized geometry allows for exploration of how rack-level characteristics can influence smaller single-cell or module-level scales. Through this geometry, we conduct numerical simulations to understand how variations in the vent velocity, temperature, and vertical location affect entrainment rates, fraction of uncombusted fuel, rich-gas coverage, and heat flux to other modules. At lower vent velocities and vertical positions, buoyancy drives enough entrainment and mixing to react with most of the vent gases on the converging plenum. As jet momentum increases and/or buoyancy decreases via higher vent position in the rack, vent gases can propagate into and burn in the divergence plenum. Heat flux to the impinged module scales strongly with vent momentum and temperature, while heat transfer to upper modules peaks when flames in the diverging plenum reach the surface and declines when combustion is suppressed.

Computational fluid dynamics

Insight into pseudo-film-boiling in supercritical water under simplified interfacial conditions

The focus of this paper is the physics of supercritical water film boiling through the simulation of natural convection of supercritical water in a rectangular cavity. It has been widely believed that above a fluid's critical point, only one phase exists. However, recent research has indicated the existence of distinct gas-like and liquid-like regions separated by the Widom line, which is the locus of the maxima of the specific heat. Along the Widom line, density decreases sixfold, viscosity drops by a factor of two, while specific heat spikes by an order of magnitude. These variations, specifically in density and viscosity, produce a thick pseudo-interface and flow dynamics behavior akin to film-boiling, denoted here as pseudo-two-phase flow dynamics. When the cavity is heated from the bottom, a pseudo-film of gas-like fluid is formed at the heated wall, and the flow complexity evolves, characterized by the formation of multiple vortices. Results demonstrate the ability of modern conjugate heat transfer computational fluid dynamics to capture the pseudo two-phase regime, with the formation of a pseudo-film at the heated wall. Further, the boiling curve is studied, showing an increase in heat flux with an increase in the temperature differential between the wall and the pseudo-critical temperature. Furthermore, results also show a previously uncharacterized instability, where the convection cells in the cavity oscillate and can flip directions under certain conditions.

Computational fluid dynamics