Search NASA⌕ Search

DOE OSTI · 1571735

Earthquake Ground Motion Simulations on the Sierra High-Performance Computing System

Abstract

Physics-based three-dimensional (3D) numerical simulations of earthquake ground motions provide an alternative to reliance on limited and highly scattered empirical data and models for seismic hazard assessment. We performed fully 3D earthquake ground motion simulations on the Sierra and Lassen high-performance computing (HPC) platforms at Livermore Computing. These new HPC platforms feature graphics processing unit (GPU) acceleration for improved performance. Ground motions were computed with SW4, a summation-by-parts finite difference code for anelastic wave propagation. SW4 was recently enhanced to run efficiently on GPU-accelerated platforms. We found that SW4 runs almost fifty (50) times faster in terms of node-hours on new GPU-accelerated platforms compared to conventional central processing unit (CPU) platforms with agreement of computed ground motion time-series to the full single precision which they are written. We focused on moment magnitude, M W , 7.0 earthquakes on the Hayward Fault. We were able to run three simulations resolving ground motions from static displacements (0 Hz) to frequencies of 10 Hz (wavelengths as short as 50 meters) making these Sierra calculations the highest resolution regional-scale earthquake simulations ever made for California. Results show good agreement between simulated ground motion intensities (peak ground velocity and acceleration, spectral response) and empirical models, including frequencies above 10 Hz. On Lassen we were able to run a suite of 52 M W 7.0 Hayward Fault earthquake simulations resolved 0-5 Hz for both plane-layered, one-dimensional (1D) and 3D Earth models. These simulations were used to develop a methodology for characterizing and removing systematic path and site effects which bias ground motion intensities. These simulations using the newly enhanced SW4 code allow us to run higher resolution seismic simulations with shorter run times, providing a new capability for seismic hazard and risk studies. Results were presented at scientific conferences and workshops and two publications are being prepared based on work performed in this project.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Rodgers, Arthur J.. 2019-10-12. Earthquake Ground Motion Simulations on the Sierra High-Performance Computing System. https://doi.org/10.2172/1571735

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

Spectrophotometric study of erbium (III) speciation in chloride solutions from 25 to 75 °C

In this study, UV-Vis spectrophotometric experiments were conducted from 25 to 75 °C using Er-HClO4-bearing solutions with varying NaCl concentrations. The molar absorbance coefficient of Er3+ decreases with temperature, and the absorbance intensity gradually decreases with increasing mCl/mEr ratios. The number of absorbing species include Er3+ and ErCl2+ even at the highest mCl/mEr ratio. The formation constant (β 1 ) for the ErCl 2+ species was derived and fitted between 50 and 250 °C with existing literature values, yielding the following equation: logβ 1 0 = −22.4315 + 0.0345T + 3.9379·10 3 /T, where T is temperature in Kevin.

58 GEOSCIENCES↗

The future of subsurface monitoring: AEC’s breakthroughs in CCS technology

Carbon capture and storage (CCS) has emerged as a key solution in the fight against climate change. However, for CCS to succeed, it is crucial to ensure that the sequestered CO2 stays safely trapped underground. The U.S. Department of Energy (DOE) has emphasized the need for advancements in subsurface monitoring, measurement, reporting, and verification. Aside from caprock integrity failure, the other primary failure points usually involve defective cement in the casing annulus of wellbores or plugged and abandoned wells. In addition, many energy producers (e.g., oil and gas, geothermal) and storage and disposal operators (e.g., H2 and water) must deal with the same issue. Poorly placed or degraded cement can create pathways for gas or fluid to escape from casing annuli and in plugged and abandoned or orphan wells, posing environmental risks. Yet, a reliable and cost-effective way to monitor cement and well integrity over multiple decades is still unavailable. Traditional geophysical methods like 4D seismic imaging and surface-based electromagnetic monitoring lack the resolution and accuracy for detecting these types of failures (Vasco et al., 2022; Fawad and Mondol, 2021). Wireline logging is expensive to run continuously and is obtrusive to the operation. While fiber optics can potentially be a solution, its bulkiness can significantly compromise the cement's integrity. To address these challenges, the Advanced Energy Consortium (AEC) at The University of Texas at Austin’s Bureau of Economic Geology (the Bureau) has been pioneering research in subsurface monitoring using its portfolio of distributed autonomous microfabricated sensors for harsh subsurface environments since 2008. A class of these microsensors [System on a Chip (SoC)] can be mixed in cement and permanently placed without compromising the cement column; the sensors would then communicate with each other or a data acquisition (DAQ) master node. Another class of the AEC microsensors can be fully autonomous, with rechargeable micro-batteries capable of exceeding 100°C, flash memory, and, currently, a pressure and temperature sensor. They are designed to circulate in mud, geothermal fluids, U-loops, or pipelines. They can log data into memory and are unobtrusive to operations. Our team has been working on a multi-year DOE-funded project (DE-FE0031856)—supported by $2.95M in federal funding and $0.75M in cost-matching from the AEC—to demonstrate SoC sensor utility for CO2 leakage monitoring in CCS applications. This multi-institutional collaboration developed a novel sensing architecture utilizing radiofrequency (RF) microsensors embedded within the cement sheath. These sensors detect CO2 migration and are interrogated via a Smart Casing Collar (SCC).

58 GEOSCIENCES↗

Hydrogeological assessment of CO2 containment assurance and wellbore integrity at a Gulf Coast storage site

Abstract A large-scale carbon capture and storage (CCS) initiative on the Texas Gulf Coast serves as a premier demonstration of the U.S. Department of Energy’s CarbonSAFE program. Targeting deep saline formations, specifically Oligo-Miocene deltaic sequences, the project aims to establish technical and commercial viability for geologic CO2 storage within a major industrial corridor. This study provides a rigorous hydrogeological assessment to support Class VI permitting by quantifying the high degree of containment security. Utilizing a compositional reservoir simulator, we developed a suite of 27 distinct simulation cases to evaluate vertical plume dynamics near both planned injection wells and proximal legacy infrastructure. To ensure numerical accuracy near wellbores, we implemented a refined mesh strategy, determining that a 5.6 ft × 5.6 ft grid refinement offered the optimal balance between computational efficiency and descriptive precision. The modeling framework utilized a systematic sensitivity-based approach to evaluate the mechanical redundancy of the subsurface system by performing a bounding analysis of wellbore interfaces against hypothetical high-permeability microannuli. By systematically isolating competing physical drivers, including permeability, porosity, gas hysteresis, thermal gradients, salinity, and solubility trapping (quantified via Henry’s law with dynamically adjusted coefficients), this work moves beyond binary assessments to establish a nuanced hierarchy of containment factors. The results confirm that primary trapping mechanisms (e.g., gas hysteresis and solubility), combined with the site's unique geomechanical stratigraphy, significantly restrict vertical mobility and reinforce the robust containment security of the reservoir. Baseline results demonstrate substantial vertical separation between the CO2 plume and the upper confining system, ensuring robust containment. Sensitivity analysis reveals that even under highly conservative bounding scenarios—assuming theoretical 10-Darcy pathways at specific wellbore locations—the 2,900-ft thick multi-layered confining zone remains a reliable barrier. In these hypothetical upper-bound cases, peak upward fluxes of CO2 and saltwater after 15 years of injection remain localized and dissipate rapidly within the lower sections of the confining interval, leaving the integrity of the seal uncompromised. Furthermore, the study identifies that while localized wellbore pathways define theoretical upper bounds of vertical migration, the Area of Review (AoR) is primarily sensitive to regional thermal gradients and hysteresis, which can influence the AoR by over 3,000 acres in pessimistic configurations. Also, primary trapping mechanisms, specifically gas hysteresis and solubility, work in tandem with the Gulf Coast’s unique geomechanical stratigraphy to significantly restrict vertical mobility. Ductile, smectite-rich mudstones facilitate natural borehole convergence and the self-healing of potential conduits, creating a natural geomechanical bridge that effectively mitigates migration potential at both current injection points and legacy-well locations. This comprehensive modeling effort demonstrates that the integration of high-resolution wellbore simulations and regional geomechanical observations confirms the long-term storage security of the studied site, providing a physics-based foundation for industrial-scale CCS deployments. This modeling framework establishes a baseline for future research into coupled geomechanical effects, such as time-dependent borehole convergence, to further refine long-term containment projections. Acknowledgements We thank the Gulf Coast Carbon Center (GCCC) at the Bureau of Economic Geology for foundational research support. We appreciate Alex Bump for technical guidance and David Hoffman for model mesh generation. This work used TACC’s Frontera cluster for simulations and CMG Ltd. software licenses provided to UT-Austin. This material is based upon work supported by the Department of Energy under Award Number DE-FE0032338. Disclaimer This material is based upon work supported by the U.S. Department of Energy’s Fossil Energy and Carbon Management Office under the CarbonSAFE program, award Number DE-FE0032338. The views expressed herein do not necessarily represent the views of the U.S. Department of Energy or the United States Government.

58 GEOSCIENCES↗