Search NASA⌕ Search

Engineering topics

Beroza, Gregory C.

Publications and source records attributed to Beroza, Gregory C..

At least 19 records

A Complete Machine-Learning-Based Workflow to Illuminate Earthquake Processes

Under this grant we developed, tested, and made available, machine learning models to improve the tasks in the earthquake monitoring workflow (Figure 1). We implemented these models as a part of an end-to-end workflow for seismic network processing and demonstrated, in a variety of settings, that these methods generalize and that they result in dramatically more comprehensive earthquake catalogs. These catalogs illuminate earthquake processes in detail and to an extent that had previously not been possible, and they do so for both tectonic seismicity and seismicity induced by fluid injection related to unconventional hydrocarbon development. This report summarizes the results from the 15 publications that resulted from this grant. Those contributes are divided into: (1) the development of specific tasks related to monitoring (7 publications), (2) the organization of those tasks into workflows for seismic monitoring (2 publications), and (3) applications of those workflows to data (6 publications).

58 GEOSCIENCES↗

En echelon faults reactivated by wastewater disposal near Musreau Lake, Alberta

We use machine-learning and cross-correlation techniques to enhance earthquake detectability by two magnitude units for the earthquake sequence near Musreau Lake, Alberta, which is induced by wastewater disposal. This deep catalogue reveals a series of en echelon ~N–S oriented strike-slip faults that are favourably oriented for reactivation. These faults require only ~0.6 MPa overpressure for triggering to occur. Earthquake activity occurs in bursts, or episodes; episodes restricted to the largest fault tend to have earthquakes starting near the southern end (distant from injectors) and progressing northwards (towards the injectors). While most events are concentrated along these ~N–S oriented faults, we also delineate smaller faults. Together, these findings suggest pore pressure as the triggering mechanism, where a time-dependent increase in pore pressure likely caused these faults to progressively reawaken. Analysis of the ‘next record-breaking event’, a statistical model that forecasts the sequencing of earthquake magnitudes, suggests that the next largest event would be M L ~4.3. The seismically illuminated length of the largest fault indicates potential magnitudes as large as M w 5.3.

58 GEOSCIENCES↗

A Mitigation Strategy for the Prediction Inconsistency of Neural Phase Pickers

Neural phase pickers—neural networks designed and trained to pick seismic phase arrivals—have proven to be a powerful tool for developing earthquake catalogs. However, these pickers suffer from prediction inconsistency in which the results they produce change, sometimes substantially, even under a small perturbation to the input waveform. This problem has not been addressed by the developers and users of these pickers. In this study, we show how prediction inconsistency can negatively affect the completeness of earthquake catalogs developed using neural phase pickers. Further, we show that simply using a small step size for the sliding window when processing continuous waveform data and aggregating the results significantly mitigates this problem. We also highlight the importance of training datasets for increasing the consistency and other performance metrics.

58 GEOSCIENCES↗

PubDAS: A PUBlic Distributed Acoustic Sensing Datasets Repository for Geosciences

During the past few years, distributed acoustic sensing (DAS) has become an invaluable tool for recording high-fidelity seismic wavefields with great spatiotemporal resolutions. However, the considerable amount of data generated during DAS experiments limits their distribution with the broader scientific community. Such a bottleneck inherently slows down the pursuit of new scientific discoveries in geosciences. Here, we introduce PubDAS—the first large-scale open-source repository where several DAS datasets from multiple experiments are publicly shared. PubDAS currently hosts eight datasets covering a variety of geological settings (e.g., urban centers, underground mines, and seafloor), spanning from several days to several years, offering both continuous and triggered active source recordings, and totaling up to ~90 TB of data. Here this article describes these datasets, their metadata, and how to access and download them. Some of these datasets have only been shallowly explored, leaving the door open for new discoveries in Earth sciences and beyond.

54 ENVIRONMENTAL SCIENCES↗

Induced seismicity red-light thresholds for enhanced geothermal prospects in the Netherlands

Prospects for geothermal energy in the Netherlands have renewed concerns around induced earthquakes. Risks from induced earthquakes are managed by traffic light protocols (TLPs), where the red-light is chosen as the stop-point before exceeding a tolerance to risk. Here, we simulate post-shut-in earthquake scenarios based on realistic information for the Netherlands. We focus on three risk metrics: aggregates like nuisance and damage impacts and also local personal risk (LPR) – a likelihood of building collapse fatality for an individual. Our results show that the severity of these risks varies spatially by orders of magnitude. Prior induced seismicity (e.g., the 2012 Huizinge event) provides a reference baseline to calibrate the Dutch earthquake risk tolerances. We find that these calibrated risk tolerances are similar to those observed in North America, suggesting an underlying sociological ‘license to operate.’ Furthermore, the use of calibrated risk tolerances results in nuisance concerns completely eclipsing the other two metrics. We compare our results to a hypothetical Groningen geothermal operation and find that our approach sets red-light thresholds approximately one magnitude unit below the ML 3.6 Huizinge event. Overall, our results provide a first-order recommendation for red-light thresholds and proactive management of Dutch enhanced geothermal induced seismicity.

15 GEOTHERMAL ENERGY↗

Basement Fault Activation before Larger Earthquakes in Oklahoma and Kansas

Oklahoma and Kansas experienced unprecedented seismic activity over the past decade due to earthquakes associated with unconventional hydrocarbon development. The modest natural seismicity and incomplete knowledge of the fault network in the region made it difficult to anticipate the locations of earthquakes with larger magnitudes (M w ≥ 4). Here, we show that monitoring of microearthquakes at regional scale using a pretrained neural phase picker and an earthquake relocation algorithm can illuminate unknown fault structures, and deliver information that can be synthesized for earthquake forecasting. We found that 80% of the larger earthquakes that occurred in the past decade could have been anticipated based on the spatial extent of the seismicity clusters that were formed before these earthquakes occurred. We also found that once a seismicity cluster with a length scale enough to host a larger earthquake was formed, there was a ~5% chance that it would host one or more larger earthquakes within a year. This probability is nearly an order of magnitude higher than one based on Gutenberg–Richter statistics and preceding seismicity. Applying our approach in practice can provide critical information on seismic hazards for risk management and regulatory decision making.

58 GEOSCIENCES↗

Ambient Noise Attenuation Tomography Reveals an Asymmetric Damage Zone Across San Jacinto Fault Near Anza, California

Here, we perform seismic attenuation tomography of the shallow structure for the San Jacinto Fault in the Ramona Reservation of southern California. The study uses ambient seismic noise recorded by a linear array of 65 3-C sensors across the fault. We extract amplitude decay information, with uncertainty, from noise interferometry functions. To account for strong heterogeneities in the complex shallow fault zone structure, we apply a frequency-dependent amplitude correction for focusing/defocusing effects using inverted phase velocity maps obtained by solving the transport equation. We then estimate the attenuation structure based on the linear station-triplet method for both Love and Rayleigh waves. The attenuation tomography indicates strong attenuation correlated with known San Jacinto Fault surface traces. The Love wave attenuation tomography reveals an asymmetric damage zone that exists primarily on the fault side with faster seismic velocity, consistent with earthquake ruptures on a fault bimaterial interface with preferred propagation direction to the northwest.

58 GEOSCIENCES↗

Toward improved urban earthquake monitoring through deep-learning-based noise suppression

Earthquake monitoring in urban settings is essential but challenging, due to the strong anthropogenic noise inherent to urban seismic recordings. Here, we develop a deep-learning-based denoising algorithm, UrbanDenoiser, to filter out urban seismological noise. UrbanDenoiser strongly suppresses noise relative to the signals, because it was trained using waveform datasets containing rich noise sources from the urban Long Beach dense array and high signal-to-noise ratio (SNR) earthquake signals from the rural San Jacinto dense array. Application to the dense array data and an earthquake sequence in an urban area shows that UrbanDenoiser can increase signal quality and recover signals at an SNR level down to ~0 dB. Earthquake location using our denoised Long Beach data does not support the presence of mantle seismicity beneath Los Angeles but suggests a fault model featuring shallow creep, intermediate locking, and localized stress concentration at the base of the seismogenic zone.

58 GEOSCIENCES↗

Earthquake Phase Association Using a Bayesian Gaussian Mixture Model

Earthquake phase association algorithms aggregate picked seismic phases from a network of seismometers into individual seismic events and play an important role in earthquake monitoring and research. Dense seismic networks and improved phase picking methods produce massive seismic phase datasets, particularly for earthquake swarms and aftershocks occurring closely in time and space, making phase association a challenging problem. Here, we present a new association method, the Gaussian Mixture Model Association (GaMMA), that combines the Gaussian mixture model with earthquake location, origin time, and magnitude estimation. We treat earthquake phase association as an unsupervised clustering problem in a probabilistic framework, where each earthquake corresponds to a cluster of P and S phases with a hyperbolic moveout of arrival times and a decay of amplitude with distance. We use the multivariate Gaussian distribution to model the collection of phase picks of an event; and the mean of the multivariate Gaussian distribution is given by the predicted arrival time and amplitude from the causative event. We carry out the pick assignment to each earthquake and determine earthquake source parameters (i.e., earthquake location, origin time, and magnitude) under the maximum likelihood criterion using the Expectation-Maximization algorithm. The GaMMA method does not require typical association steps of other algorithms, such as grid-search or supervised training. The results for both synthetic tests and for the 2019 Ridgecrest earthquake sequence show that GaMMA effectively associates phases from a temporally and spatially dense earthquake sequence while producing useful estimates of earthquake location and magnitude.

58 GEOSCIENCES↗

An End-To-End Earthquake Detection Method for Joint Phase Picking and Association Using Deep Learning

Earthquake monitoring by seismic networks typically involves a workflow consisting of phase detection/picking, association, and location tasks. In recent years, the accuracy of these individual stages has been improved through the use of machine learning techniques. Here, in this study, we introduce a new end-to-end approach that improves overall earthquake detection accuracy by jointly optimizing each stage of the detection pipeline. We propose a neural network architecture for the task of multi-station processing of seismic waveforms recorded over a seismic network. This end-to-end architecture consists of three sub-networks: a backbone network that extracts features from raw waveforms, a phase picking sub-network that picks P- and S-wave arrivals based on these features, and an event detection sub-network that aggregates the features from multiple stations to associate and detect earthquakes across a seismic network. We use these sub-networks together with a shift-and-stack module based on back-projection that introduces kinematic constraints on arrival times, allowing the neural network model to generalize to different velocity models and to variable station geometry in seismic networks. We evaluate our proposed method on the STanford EArthquake Dataset (STEAD) and on the 2019 Ridgecrest, CA earthquake sequence. The results demonstrate that our end-to-end approach can effectively pick P- and S-wave arrivals and achieve earthquake detection accuracy rivaling that of other state-of-the-art approaches. Because our approach preserves information across tasks in the detection pipeline, it has the potential to outperform approaches that do not.

58 GEOSCIENCES↗

A Wrapper to Use a Machine-Learning-Based Algorithm for Earthquake Monitoring

Seismology is one of the main sciences used to monitor volcanic activity worldwide. Fast, efficient, and accurate seismicity detectors are crucial to assess the activity level of a volcano in near–real time and to issue timely warnings. Traditional real–time seismic processing software uses phase onset pickers followed by a phase association algorithm to declare an event and estimate its location. The pickers typically do not identify whether the detected phase is a P or S arrival, which can have a negative impact on hypocentral location quality and complicates phase association. We implemented the deep–neural–network–based method PhaseNet to identify in real time P and S seismic waves on data from one– and three–component seismometers. We tuned the Earthworm binder_ew associator module to use the phase identification from PhaseNet to detect and locate the events, which we archive in a SeisComP3 database. We assessed the performance of the algorithm by comparing the results with existing catalogs built to monitor seismic and volcanic activity in Mayotte and the Lesser Antilles region. Our algorithm, which we refer to as PhaseWorm, showed promising results in both contexts and clearly outperformed the previous automatic method implemented in Mayotte. As a result, this innovative real–time processing system is now operational for seismicity monitoring in Mayotte and Martinique.

58 GEOSCIENCES↗

Integrating deep neural networks with full-waveform inversion: Reparameterization, regularization, and uncertainty quantification

Full-waveform inversion (FWI) is an accurate imaging approach for modeling the velocity structure by minimizing the misfit between recorded and predicted seismic waveforms. However, the strong nonlinearity of FWI resulting from fitting oscillatory waveforms can trap the optimization in local minima. We have adopted a neural-network-based full-waveform inversion (NNFWI) method that integrates deep neural networks with FWI by representing the velocity model with a generative neural network. Neural networks can naturally introduce spatial correlations as regularization to the generated velocity model, which suppresses noise in the gradients and mitigates local minima. Furthermore, the velocity model generated by neural networks is input to the same partial differential equation (PDE) solvers used in conventional FWI. The gradients of the neural networks and PDEs are calculated using automatic differentiation, which back propagates gradients through the acoustic PDEs and neural network layers to update the weights of the generative neural network. Experiments on 1D velocity models, the Marmousi model, and the 2004 BP model determine that NNFWI can mitigate local minima, especially for imaging high-contrast features such as salt bodies, and it significantly improves the inversion in the presence of noise. Adding dropout layers to the neural network model also allows analyzing the uncertainty of the inversion results through Monte Carlo dropout. NNFWI opens a new pathway to combine deep learning and FWI for exploiting the characteristics of deep neural networks and the high accuracy of PDE solvers. Because NNFWI does not require extra training data and optimization loops, it provides an attractive and straightforward alternative to conventional FWI.

58 GEOSCIENCES↗

Machine-Learning-Based High-Resolution Earthquake Catalog Reveals How Complex Fault Structures Were Activated during the 2016–2017 Central Italy Sequence

The 2016–2017 central Italy seismic sequence occurred on an 80 km long normal-fault system. The sequence initiated with the Mw 6.0 Amatrice event on 24 August 2016, followed by the Mw 5.9 Visso event on 26 October and the Mw 6.5 Norcia event on 30 October. We analyze continuous data from a dense network of 139 seismic stations to build a high-precision catalog of ~900,000 earthquakes spanning a 1 yr period, based on arrival times derived using a deep-neural-network-based picker. Our catalog contains an order of magnitude more events than the catalog routinely produced by the local earthquake monitoring agency. Aftershock activity reveals the geometry of complex fault structures activated during the earthquake sequence and provides additional insights into the potential factors controlling the development of the largest events. Activated fault structures in the northern and southern regions appear complementary to faults activated during the 1997 Colfiorito and 2009 L’Aquila sequences, suggesting that earthquake triggering primarily occurs on critically stressed faults. Delineated major fault zones are relatively thick compared to estimated earthquake location uncertainties, and a large number of kilometer-long faults and diffuse seismicity were activated during the sequence. These properties might be related to fault age, roughness, and the complexity of inherited structures. The rich details resolvable in this catalog will facilitate continued investigation of this energetic and well-recorded earthquake sequence.

58 GEOSCIENCES↗

A general approach to seismic inversion with automatic differentiation

Imaging Earth structure or seismic sources from seismic data involves minimizing a target misfit function, and is commonly solved through gradient-based optimization. The adjoint-state method has been developed to compute the gradient efficiently; however, its implementation can be time-consuming and difficult. We develop a general seismic inversion framework to calculate gradients using reverse-mode automatic differentiation. The central idea is that adjoint-state methods and reverse-mode automatic differentiation are mathematically equivalent. Here, the mapping between numerical PDE simulation and deep learning allows us to build a seismic inverse modeling library, ADSeismic, based on deep learning frameworks, which supports high performance reverse-mode automatic differentiation on CPUs and GPUs. We demonstrate the performance of ADSeismic on inverse problems related to velocity model estimation, rupture imaging, earthquake location, and source time function retrieval. ADSeismic has the potential to solve a wide variety of inverse modeling applications within a unified framework.

58 GEOSCIENCES↗

Network analysis of earthquake ground motion spatial correlation: a case study with the San Jacinto seismic nodal array

SUMMARY The spatial correlation of earthquake ground motion intensity can be measured from strong motion data; however, the data used in past studies is sparsely sampled in space, and only the interstation distance was considered as a correlation variable. These limitations mean that we have only weak constraints on the true correlation structure of ground motion and that potentially important aspects of spatial correlation are unconstrained. In this study, we combine a large-N seismic array and graph analytics to explore this issue at a local scale using small local and regional earthquakes. Our result suggests site conditions, and how they interact with the incident seismic wavefield, strongly condition the spatial correlation of ground motion. Future progress in characterizing ground motion spatial variability will require dense wavefield measurements, either through nodal deployments, or perhaps distributed acoustic sensing measurements, of seismic wavefields. Aftershock sequences of major earthquakes would provide particularly data-rich targets of opportunity.

58 GEOSCIENCES↗

Laboratory earthquake forecasting: A machine learning competition

Earthquake prediction, the long-sought holy grail of earthquake science, continues to confound Earth scientists. Could we make advances by crowdsourcing, drawing from the vast knowledge and creativity of the machine learning (ML) community? We used Google’s ML competition platform, Kaggle, to engage the worldwide ML community with a competition to develop and improve data analysis approaches on a forecasting problem that uses laboratory earthquake data. The competitors were tasked with predicting the time remaining before the next earthquake of successive laboratory quake events, based on only a small portion of the laboratory seismic data. The more than 4,500 participating teams created and shared more than 400 computer programs in openly accessible notebooks. Complementing the now well-known features of seismic data that map to fault criticality in the laboratory, the winning teams employed unexpected strategies based on rescaling failure times as a fraction of the seismic cycle and comparing input distribution of training and testing data. In addition to yielding scientific insights into fault processes in the laboratory and their relation with the evolution of the statistical properties of the associated seismic data, the competition serves as a pedagogical tool for teaching ML in geophysics. The approach may provide a model for other competitions in geosciences or other domains of study to help engage the ML community on problems of significance.

58 GEOSCIENCES↗

Seismic signal augmentation to improve generalization of deep neural networks

Deep learning has emerged as an effective approach for seismic data processing in general, and for earthquake monitoring in particular. The ability of deep learning models to generalize beyond the training and validation data is important for comprehensive earthquake monitoring; this ability furthermore depends on the availability of a sufficiently large and complete training dataset. However, this requirement can prove challenging to meet due to significant effort and time for data collection and labeling. Data augmentation provides an efficient and effective approach for increasing the dimension of training samples and improving generalization to unseen samples. In this paper, we present augmentation methods appropriate for seismic waveforms and demonstrate their ability to reduce bias and increase performance. Furthermore, these augmentation methods can be applied to a wide range of deep learning applications designed for seismic data.

58 GEOSCIENCES↗