Search NASA⌕ Search

Engineering topics

Harp, Dylan Robert

Publications and source records attributed to Harp, Dylan Robert.

At least 19 records

Improving deep learning performance for predicting large-scale geological ${{CO}_{2}}$ sequestration modeling through feature coarsening

Physics-based reservoir simulation for fluid flow in porous media is a numerical simulation method to predict the temporal-spatial patterns of state variables (e.g. pressure p) in porous media, and usually requires prohibitively high computational expense due to its non-linearity and the large number of degrees of freedom (DoF). This work describes a deep learning (DL) workflow to predict the pressure evolution as fluid flows in large-scale 3-dimensional(3D) heterogeneous porous media. In particular, we develop an efficient feature coarsening technique to extract the most representative information and perform the training and prediction of DL at the coarse scale, and further recover the resolution at the fine scale by spatial interpolation. We validate the DL approach to predict pressure field against physics-based simulation data for a field-scale 3D geologic CO 2 sequestration reservoir model. We evaluate the impact of feature coarsening on DL performance, and observe that the feature coarsening not only decreases the training time by >74% and reduces the memory consumption by >75%, but also maintains temporal error 0.63% on average. Besides, the DL workflow provides predictive efficiency with 1406 times speedup compared to physics-based numerical simulation. The key findings from this research significantly improve the training and prediction efficiency of deep learning model to deal with large-scale heterogeneous reservoir models, and thus it can also be further applied to accelerate workflows of history matching and reservoir optimization for close-loop reservoir management.

58 GEOSCIENCES↗

Physics-informed machine learning with differentiable programming for heterogeneous underground reservoir pressure management

Abstract Avoiding over-pressurization in subsurface reservoirs is critical for applications like CO $$_2$$ 2 sequestration and wastewater injection. Managing the pressures by controlling injection/extraction are challenging because of complex heterogeneity in the subsurface. The heterogeneity typically requires high-fidelity physics-based models to make predictions on CO $$_2$$ 2 fate. Furthermore, characterizing the heterogeneity accurately is fraught with parametric uncertainty. Accounting for both, heterogeneity and uncertainty, makes this a computationally-intensive problem challenging for current reservoir simulators. To tackle this, we use differentiable programming with a full-physics model and machine learning to determine the fluid extraction rates that prevent over-pressurization at critical reservoir locations. We use DPFEHM framework, which has trustworthy physics based on the standard two-point flux finite volume discretization and is also automatically differentiable like machine learning models. Our physics-informed machine learning framework uses convolutional neural networks to learn an appropriate extraction rate based on the permeability field. We also perform a hyperparameter search to improve the model’s accuracy. Training and testing scenarios are executed to evaluate the feasibility of using physics-informed machine learning to manage reservoir pressures. We constructed and tested a sufficiently accurate simulator that is 400 000 times faster than the underlying physics-based simulator, allowing for near real-time analysis and robust uncertainty quantification.

54 ENVIRONMENTAL SCIENCES↗

Gas diffusion through variably-water-saturated zeolitic tuff: Implications for transport following a subsurface nuclear event

Noble gas transport through geologic media has important applications in the characterization of underground nuclear explosions (UNEs). Without accurate transport models, it is nearly impossible to distinguish between xenon signatures originating from civilian nuclear facilities and UNEs. Understanding xenon transport time through the earth is a key parameter for interpreting measured xenon isotopic ratios. One of the most challenging aspects of modeling gas transport time is accounting for the effect of variable water saturation of geological media. In this study, we utilize bench-scale laboratory experiments to characterize the diffusion of krypton, xenon, and sulfur hexafluoride (SF6) through intact zeolitic tuff under different saturations. Here, we demonstrate that the water in rock cores with low partial saturation dramatically affects xenon transport time compared to that of krypton and SF6 by blocking sites in zeolitic tuff that preferentially adsorb xenon. This leads to breakthrough trends that are strongly influenced by the degree of the rock saturation. Xenon is especially susceptible to this phenomenon, a finding that is crucial to incorporate in subsurface gas transport models used for nuclear event identification. We also find that the breakthrough of SF6 diverges significantly from that of noble gases within our system. When developing field scale models, it is important to understand how the behavior of xenon deviates from chemical tracers used in the field, such as SF6 (Carrigan et al., 1996). These new insights demonstrate the critical need to consider the interplay between rock saturation and fission product sorption during transport modeling, and the importance of evaluating specific interactions between geomedia and gases of interest, which may differ from geomedia interactions with chemical tracers.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

A gradient-based deep neural network model for simulating multiphase flow in porous media

We report simulation of multiphase flow in porous media is crucial for the effective management of subsurface energy and environment-related activities. The numerical simulators used for modeling such processes rely on spatial and temporal discretization of the governing mass and energy balance partial-differential equations (PDEs) into algebraic systems via finite-difference/volume/element methods. These simulators usually require dedicated software development and maintenance, and suffer low efficiency from a runtime and memory standpoint for problems with multi-scale heterogeneity, coupled-physics processes or fluids with complex phase behavior. Therefore, developing cost-effective, data-driven models can become a practical choice, and in this work, we choose deep learning approaches as they can handle high dimensional data and accurately predict state variables with strong nonlinearity. In this paper, we describe a gradient-based deep neural network (GDNN) constrained by the physics related to multiphase flow in porous media. We tackle the nonlinearity of flow in porous media induced by rock heterogeneity, fluid properties, and fluid-rock interactions by decomposing the nonlinear PDEs into a dictionary of elementary differential operators. We use a combination of operators to handle rock spatial heterogeneity and fluid flow by advection. Since the augmented differential operators are inherently related to the physics of fluid flow, we treat them as first principles prior knowledge to regularize the GDNN training. We use the example of pressure management at geologic CO 2 storage sites, where CO 2 is injected in saline aquifers and brine is produced, and apply GDNN to construct a predictive model that is trained with physics-based simulation data and emulates the physics process. We demonstrate that GDNN can effectively predict the nonlinear patterns of subsurface responses, including the temporal and spatial evolution of the pressure and saturation plumes. We also successfully extend the GDNN to convolutional neural network (CNN), namely gradient-based CNN (GCNN), and validate its capability to improve the prediction accuracy. GDNN has great potential to tackle challenging problems that are governed by highly nonlinear physics and enable the development of data-driven models with higher fidelity.

42 ENGINEERING↗

Thermal and solubility effects on fault leakage during geologic carbon storage

Geologic carbon storage (GCS) is a promising method for reducing anthropogenic CO 2 emissions to the atmosphere. To safely deploy GCS in the field, it is necessary to assess risks and the effect of uncertainty on safe storage. The effect of uncertainty can be quantified using batches of simulations, but the high computational costs of high-resolution simulations necessitate use of reduced-order models (ROMs). Previous work involves ROMs for quantifying the risk of different potential leakage paths from storage reservoirs to shallow formations. However, previous studies on development of fault-leakage ROMs have limited numbers of uncertain parameters and do not explicitly examine impacts of CO 2 solubility and thermal stresses on fault reactivation, which can generate high-permeability pathways and compromise CO 2 storage. Here, we analyze an ensemble of simulations considering CO 2 leakage from a storage reservoir to a shallow aquifer through a fault while varying a number of uncertain parameters related to thermo-hydro-mechanical properties and CO 2 injection. We show the effects of solubility on: free-phase CO 2 -leakage rates, brine-leakage rates, and poroelastic fault destabilization. We find that CO 2 solubility is more important for estimating free-phase CO 2 -leakage rates compared to brine-leakage rates or poroelastic fault destabilization. We also find that thermal stresses and overpressures have different spatial distributions within the fault, indicating that the spatial variability of overpressures due to variation in flow parameters does not necessarily make the spatial variability of thermal stresses negligible. We suggest the use of the CO 2 phase-change path as a variable in future fault-leakage ROMs.

03 NATURAL GAS↗

A robust deep learning workflow to predict multiphase flow behavior during geological C O 2 sequestration injection and Post-Injection periods

Simulation of multiphase flow in porous media is essential to manage the geologic CO 2 sequestration (GCS) process, and physics-based simulation approaches usually take prohibitively high computational cost due to the nonlinearity of the coupled physics. This paper contributes to the development and evaluation of a deep learning workflow that accurately and efficiently predicts the temporal-spatial evolution of pressure and CO 2 plumes during injection and post-injection periods of GCS operations. Based on a Fourier Neural Operator, the deep learning workflow takes input variables or features including rock properties, well operational controls and time steps, and predicts the state variables of pressure and CO 2 saturation. To further improve the predictive fidelity, separate deep learning models are trained for CO 2 injection and post-injection periods due to the difference in primary driving force of fluid flow and transport during these two phases. We also explore different combinations of features to predict the state variables. We use a realistic example of CO 2 injection and storage in a 3D heterogeneous saline aquifer, and apply the deep learning workflow that is trained from physics-based simulation data and emulate the physics process. Through this numerical experiment, we demonstrate that using two separate deep learning models to distinguish post-injection from injection period generates the most accurate prediction of pressure, and a single deep learning model of the whole GCS process including the cumulative injection volume of CO 2 as a deep learning feature, leads to the most accurate prediction of CO 2 saturation. For the post-injection period, it is key to use cumulative CO 2 injection volume to inform the deep learning models about the total carbon storage when predicting either pressure or saturation. The deep learning workflow not only provides high predictive fidelity across temporal and spatial scales, but also offers a speedup of 250 times compared to full physics reservoir simulation, and thus will be a significant predictive tool for engineers to manage the long-term process of GCS.

58 GEOSCIENCES↗

A Physics-Constrained Deep Learning Model for Simulating Multiphase Flow in 3D Heterogeneous Porous Media

Physics-based simulators for multiphase flow in porous media emulate nonlinear processes with coupled physics, and usually require extensive computational resources for software development, maintenance and simulation execution. As a result, a huge demand exists for fast modeling of coupled processes in a wide range of subsurface applications including geological sequestration, hydrocarbon recovery and geothermal energy extraction. In this work, an efficient physics-constrained deep learning model is developed for solving multiphase flow in 3-Dimensional (3D) heterogeneous porous media. The model fully leverages the spatial topology predictive capability of convolutional neural networks, specifically U-Net with successive contracting and expansive steps, and is coupled with an efficient continuity-based smoother to predict flow responses that need spatial continuity. Furthermore, the transient regions are penalized to steer the training process such that the model can accurately capture flow in these regions. The model takes inputs including properties of porous media, fluid properties and well controls, and predicts the temporal-spatial evolution of the state variables (pressure and saturation). While maintaining the continuity of fluid flow, the 3D spatial domain is decomposed into 2D images for reducing training cost, and the decomposition results in an increased number of training data samples and better training efficiency. Additionally, a surrogate model is separately constructed as a postprocessor to calculate well flow rate based on the predictions of state variables from the deep learning model. We use the example of CO 2 injection into saline aquifers, and apply the physics-constrained deep learning model that is trained from physics-based simulation data and emulates the physics process. The model performs prediction with a speedup of ~ 1400 times compared to physics-based simulations, and the average temporal errors of predicted pressure and saturation plumes are 0.27% and 0.099% respectively. Furthermore, water production rate is efficiently predicted by a surrogate model for well flow rate, with a mean error less than 5%. Therefore, with its unique scheme to cope with the fidelity in fluid flow in porous media, the physics-constrained deep learning model can become an efficient predictive model for computationally demanding inverse problems or other coupled processes.

58 GEOSCIENCES↗

Continental-Scale Geographic Trends in Barometric-Pumping Efficiency Potential: A North American Case Study

Barometric pumping is a gas transport mechanism that has important implications for many applications involving subsurface gas seepage processes. Here, this study provides the first continental-scale analysis of barometric-pumping efficiency potential based on meteorology. We quantified the barometric-pumping efficiency potential at 1,257 locations across the continental US and Canada. The results provide continental-scale geographic dependencies of barometric-pumping efficiency potential, indicating a significant correlation with latitude and a nonlinear dependence on longitude. The analysis also indicates that variability in barometric-pumping efficiency potential decreases with distance from the coast and as elevation increases. Locations far from the coastline are more likely to have upper mid-range potentials, while higher elevation locations are more likely to have low potentials. The highest barometric-pumping efficiency potentials are mostly found around the Gulf of St. Lawrence around 50°N. Locations along the Atlantic coast exhibit large-scale variations in potentials with a clear increasing trend with latitude.

58 GEOSCIENCES↗

On the feasibility of using physics-informed machine learning for underground reservoir pressure management

In this work, we evaluate the feasibility of using physics-informed machine learning (PIML) for underground energy-related pressure management. To this end, we develop a PIML framework to manage underground reservoir pressures by training neural networks to determine fluid extraction rates for dedicated extraction wells during fluid injection operations given a range of reservoir conditions (e.g., transmissivity and storativity). We implement an automatically-differentiable analytical physics model of fluid flow in porous media within the PIML framework as a proxy for more complicated models. This allows us to execute a sufficient number of training scenarios to fully evaluate the feasibility of using PIML to support pressure management activities. We quantify the number of physics-model parameters required for automatic differentiation to become more efficient than finite-difference gradient calculations. We use a simple scenario with a single injector, extractor, and critical location for our feasibility analysis. We evaluate the effect of the size of the training dataset (i.e., the number of reservoir condition samples) on the accuracy and efficiency of the PIML framework. For an equivalent number of model evaluations, the larger training dataset took less time to train and produced a neural network that was able to more accurately manage reservoir pressures. We also evaluate the effect of the training dataset batch size (i.e., number of reservoir condition samples used to update the neural network coefficients during training; i.e., how the training dataset is partitioned). While training ran faster with larger batch sizes, they produced neural networks that managed pressures less accurately. We demonstrate the approach on a more complex scenario involving 10 injectors, 10 extractors, and 4 critical locations (a relatively high well density of 20 wells/km2). We provide the number of forward and adjoint model evaluations required in each case as an indication of the feasibility of using PIML for pressure management when more complicated physics models with longer execution times are used.

54 ENVIRONMENTAL SCIENCES↗

Porting E3SM from LANL’s Open to Classified Computing Networks

This project used turquoise computing time to support a LANL TED project focused on porting E3SM to classified computing resources. Computing time was used to test and confirm a complete and working simulation and analysis workflow prior to porting to yellow and SCI-level computing platforms. The code port and all planned simulations and analysis were successful. E3SM analysis from simulations on classified platforms was published to C2S and will be used to demonstrate and advertise LANL’s classified Earth system modeling and analysis capabilities to current and new customers in the intelligence community. This project also significantly improved library and E3SM analysis support on turquoise, yellow, and classified computing platforms at LANL, which will result in benefits beyond the work discussed here.

97 MATHEMATICS AND COMPUTING↗