Search NASA⌕ Search
Home/Archive/DOE OSTI

DOE OSTI · 2440630

Regional-scale fault-to-structure earthquake simulations with the EQSIM framework: Workflow maturation and computational performance on GPU-accelerated exascale platforms

McCallen, David·Pitarka, Arben·Tang, Houjun·Pankajakshan, Ramesh·Petersson, N. Anders·Miah, Mamun·Huang, Junfei
View original source ↗Read source document ↗Export metadata ↓

Abstract

Continuous advancements in scientific and engineering understanding of earthquake phenomena, combined with the associated development of representative physics-based models, is providing a foundation for high-performance, fault-to-structure earthquake simulations. However, regional-scale applications of high-performance models have been challenged by the computational requirements at the resolutions required for engineering risk assessments. The EarthQuake SIMulation (EQSIM) framework, a software application development under the US Department of Energy (DOE) Exascale Computing Project, is focused on overcoming the existing computational barriers and enabling routine regional-scale simulations at resolutions relevant to a breadth of engineered systems. This multidisciplinary software development—drawing upon expertise in geophysics, engineering, applied math and computer science—is preparing the advanced computational workflow necessary to fully exploit the DOE’s exaflop computer platforms coming online in the 2023 to 2024 timeframe. Achievement of the computational performance required for high-resolution regional models containing upward of hundreds of billions to trillions of model grid points requires numerical efficiency in every phase of a regional simulation. This includes run time start-up and regional model generation, effective distribution of the computational workload across thousands of computer nodes, efficient coupling of regional geophysics and local engineering models, and application-tailored highly efficient transfer, storage, and interrogation of very large volumes of simulation data. This article summarizes the most recent advancements and refinements incorporated in the workflow design for the EQSIM integrated fault-to-structure framework, which are based on extensive numerical testing across multiple graphics processing unit (GPU)-accelerated platforms, and demonstrates the computational performance achieved on the world’s first exaflop computer platform through representative regional-scale earthquake simulations for the San Francisco Bay Area in California, USA.

Explore related subjects

58 GEOSCIENCESGPU-accelerated exaflop computersfault-to-structure simulationmassively parallel simulationsregional hazard and riskregional-scale simulations

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

McCallen, David, Pitarka, Arben, Tang, Houjun, Pankajakshan, Ramesh, Petersson, N. Anders, Miah, Mamun, Huang, Junfei. 2024-05-03. Regional-scale fault-to-structure earthquake simulations with the EQSIM framework: Workflow maturation and computational performance on GPU-accelerated exascale platforms. https://doi.org/10.1177/87552930241246235

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

DOE OSTI2026

Spectrophotometric study of erbium (III) speciation in chloride solutions from 25 to 75 °C

In this study, UV-Vis spectrophotometric experiments were conducted from 25 to 75 °C using Er-HClO4-bearing solutions with varying NaCl concentrations. The molar absorbance coefficient of Er3+ decreases with temperature, and the absorbance intensity gradually decreases with increasing mCl/mEr ratios. The number of absorbing species include Er3+ and ErCl2+ even at the highest mCl/mEr ratio. The formation constant (β 1 ) for the ErCl 2+ species was derived and fitted between 50 and 250 °C with existing literature values, yielding the following equation: logβ 1 0 = −22.4315 + 0.0345T + 3.9379·10 3 /T, where T is temperature in Kevin.

58 GEOSCIENCES↗
DOE OSTI2026

The future of subsurface monitoring: AEC’s breakthroughs in CCS technology

Carbon capture and storage (CCS) has emerged as a key solution in the fight against climate change. However, for CCS to succeed, it is crucial to ensure that the sequestered CO2 stays safely trapped underground. The U.S. Department of Energy (DOE) has emphasized the need for advancements in subsurface monitoring, measurement, reporting, and verification. Aside from caprock integrity failure, the other primary failure points usually involve defective cement in the casing annulus of wellbores or plugged and abandoned wells. In addition, many energy producers (e.g., oil and gas, geothermal) and storage and disposal operators (e.g., H2 and water) must deal with the same issue. Poorly placed or degraded cement can create pathways for gas or fluid to escape from casing annuli and in plugged and abandoned or orphan wells, posing environmental risks. Yet, a reliable and cost-effective way to monitor cement and well integrity over multiple decades is still unavailable. Traditional geophysical methods like 4D seismic imaging and surface-based electromagnetic monitoring lack the resolution and accuracy for detecting these types of failures (Vasco et al., 2022; Fawad and Mondol, 2021). Wireline logging is expensive to run continuously and is obtrusive to the operation. While fiber optics can potentially be a solution, its bulkiness can significantly compromise the cement's integrity. To address these challenges, the Advanced Energy Consortium (AEC) at The University of Texas at Austin’s Bureau of Economic Geology (the Bureau) has been pioneering research in subsurface monitoring using its portfolio of distributed autonomous microfabricated sensors for harsh subsurface environments since 2008. A class of these microsensors [System on a Chip (SoC)] can be mixed in cement and permanently placed without compromising the cement column; the sensors would then communicate with each other or a data acquisition (DAQ) master node. Another class of the AEC microsensors can be fully autonomous, with rechargeable micro-batteries capable of exceeding 100°C, flash memory, and, currently, a pressure and temperature sensor. They are designed to circulate in mud, geothermal fluids, U-loops, or pipelines. They can log data into memory and are unobtrusive to operations. Our team has been working on a multi-year DOE-funded project (DE-FE0031856)—supported by $2.95M in federal funding and $0.75M in cost-matching from the AEC—to demonstrate SoC sensor utility for CO2 leakage monitoring in CCS applications. This multi-institutional collaboration developed a novel sensing architecture utilizing radiofrequency (RF) microsensors embedded within the cement sheath. These sensors detect CO2 migration and are interrogated via a Smart Casing Collar (SCC).

58 GEOSCIENCES↗
DOE OSTI2026

Hydrogeological assessment of CO2 containment assurance and wellbore integrity at a Gulf Coast storage site

Abstract A large-scale carbon capture and storage (CCS) initiative on the Texas Gulf Coast serves as a premier demonstration of the U.S. Department of Energy’s CarbonSAFE program. Targeting deep saline formations, specifically Oligo-Miocene deltaic sequences, the project aims to establish technical and commercial viability for geologic CO2 storage within a major industrial corridor. This study provides a rigorous hydrogeological assessment to support Class VI permitting by quantifying the high degree of containment security. Utilizing a compositional reservoir simulator, we developed a suite of 27 distinct simulation cases to evaluate vertical plume dynamics near both planned injection wells and proximal legacy infrastructure. To ensure numerical accuracy near wellbores, we implemented a refined mesh strategy, determining that a 5.6 ft × 5.6 ft grid refinement offered the optimal balance between computational efficiency and descriptive precision. The modeling framework utilized a systematic sensitivity-based approach to evaluate the mechanical redundancy of the subsurface system by performing a bounding analysis of wellbore interfaces against hypothetical high-permeability microannuli. By systematically isolating competing physical drivers, including permeability, porosity, gas hysteresis, thermal gradients, salinity, and solubility trapping (quantified via Henry’s law with dynamically adjusted coefficients), this work moves beyond binary assessments to establish a nuanced hierarchy of containment factors. The results confirm that primary trapping mechanisms (e.g., gas hysteresis and solubility), combined with the site's unique geomechanical stratigraphy, significantly restrict vertical mobility and reinforce the robust containment security of the reservoir. Baseline results demonstrate substantial vertical separation between the CO2 plume and the upper confining system, ensuring robust containment. Sensitivity analysis reveals that even under highly conservative bounding scenarios—assuming theoretical 10-Darcy pathways at specific wellbore locations—the 2,900-ft thick multi-layered confining zone remains a reliable barrier. In these hypothetical upper-bound cases, peak upward fluxes of CO2 and saltwater after 15 years of injection remain localized and dissipate rapidly within the lower sections of the confining interval, leaving the integrity of the seal uncompromised. Furthermore, the study identifies that while localized wellbore pathways define theoretical upper bounds of vertical migration, the Area of Review (AoR) is primarily sensitive to regional thermal gradients and hysteresis, which can influence the AoR by over 3,000 acres in pessimistic configurations. Also, primary trapping mechanisms, specifically gas hysteresis and solubility, work in tandem with the Gulf Coast’s unique geomechanical stratigraphy to significantly restrict vertical mobility. Ductile, smectite-rich mudstones facilitate natural borehole convergence and the self-healing of potential conduits, creating a natural geomechanical bridge that effectively mitigates migration potential at both current injection points and legacy-well locations. This comprehensive modeling effort demonstrates that the integration of high-resolution wellbore simulations and regional geomechanical observations confirms the long-term storage security of the studied site, providing a physics-based foundation for industrial-scale CCS deployments. This modeling framework establishes a baseline for future research into coupled geomechanical effects, such as time-dependent borehole convergence, to further refine long-term containment projections. Acknowledgements We thank the Gulf Coast Carbon Center (GCCC) at the Bureau of Economic Geology for foundational research support. We appreciate Alex Bump for technical guidance and David Hoffman for model mesh generation. This work used TACC’s Frontera cluster for simulations and CMG Ltd. software licenses provided to UT-Austin. This material is based upon work supported by the Department of Energy under Award Number DE-FE0032338. Disclaimer This material is based upon work supported by the U.S. Department of Energy’s Fossil Energy and Carbon Management Office under the CarbonSAFE program, award Number DE-FE0032338. The views expressed herein do not necessarily represent the views of the U.S. Department of Energy or the United States Government.

58 GEOSCIENCES↗