Search NASA⌕ Search

Engineering topics

Moulton, John David

Publications and source records attributed to Moulton, John David.

At least 19 records

Tausch: A halo exchange library for large heterogeneous computing systems using MPI, OpenCL, and CUDA

Exchanging halo data is a common task in modern scientific computing applications and efficient handling of this operation is critical for the performance of the overall simulation. Tausch is a novel header-only library that provides a simple API for efficiently handling these types of data movements. Tausch supports both simple CPU-only systems, but also more complex heterogeneous systems with both CPUs and GPUs. It currently supports both OpenCL and CUDA for communicating with GPGPU devices, and allows for communication between GPGPUs and CPUs. The API allows for drop-in replacement in existing codes and can be used for the communication layer in new codes. This paper provides an overview of the approach taken in Tausch, and a performance analysis that demonstrates expected and achieved performance. Here, we highlight the ease of use and performance with three applications: First Tausch is compared to the halo exchange framework from two Mantevo applications, HPCCG and miniFE, and then it is used to replace a legacy halo exchange library in the flexible multigrid solver framework Cedar.

97 MATHEMATICS AND COMPUTING↗

Solving Coupled Surface and Subsurface Flow with Multirate Time Integration [Slides]

This report details an end of summer internship. The report lists the objective, "Add more multirate time integration methods to Amanzi" and concludes that, "Multirate methods can be used to speed up simulations and to get higher orders of accuracy", and "Coupled surface and subsurface simulations could benefit from using multirate schemes".

47 OTHER INSTRUMENTATION↗

IDEAS-Watersheds FY21 Annual Report for July 1, 2020-June 30, 2021

Watersheds play a critical role in our water supply infrastructure and require sustainable management in a changing environment. Sustainable management of watershed systems and their interaction with the built environment rely on understanding the hydrologic and biogeochemical processes that control watershed system dynamics and water availability and quality. The overarching objective of the U.S. Department of Energy’s (DOE’s) Environmental System Science (ESS) program is to advance a robust, predictive understanding of how watersheds function and respond to perturbations as integrated hydrobiogeochemical systems. ESS supports a network of watershed testbeds within the United States where national laboratories and university partners work in interdisciplinary teams to advance watershed system science for energy.

54 ENVIRONMENTAL SCIENCES↗

Understanding the eco-geomorphologic feedback of coastal marsh under sea level rise: vegetation dynamic representations, processes interaction, and parametric sensitivity

A growing number of coastal eco-geomorphologic modeling studies have been conducted to understand coastal marsh evolution under sea-level rise (SLR). Although these models quantify marsh topographic change as a function of sedimentation and erosion, their representations of vegetation dynamics that control organic sedimentation differ. How vegetation dynamic schemes contribute to simulation outcomes is not well quantified. Additionally, the sensitivity of modeling outcomes to parameter selection in the available formulations has not been rigorously tested to date, especially under the influence of an accelerating SLR. In this paper, we used a coastal eco-geomorphologic model with different vegetation dynamic schemes to investigate the eco-geomorphologic feedbacks of coastal marshes and parametric sensitivity under SLR scenarios. We found that marsh platform relief increased with sea level rise rate. The simulations with different vegetation schemes exhibited different spatial-temporal variations in elevation and biomass. The nonlinear Spartina scheme presented the most resilient prediction with generally the highest marsh accretion and vegetation biomass, and the least elevation relief under SLR. But the linear Spartina scheme predicts the lowest unvegetated-vegetated ratio. We also found that vegetation-related parameters and sediment diffusivity, which were not well measured or discussed in previous studies, were identified as some of the most critical parameters. Additionally, the model sensitivity to vegetation-related parameters increased with SLR rates. The identified most sensitive parameters may inform how to appropriately choose modeling representations of key processes and parameters for different coastal marsh landscapes under SLR, and demonstrate the importance of future field measurements of these key parameters.

58 GEOSCIENCES↗

Scalable line and plane relaxation in a parallel structured multigrid solver

The efficient solution of sparse, linear systems that arise through the discretization of partial differential equations remains a key challenge for a range of high performance scientific simulations. One approach for reducing data movement and improving performance is by exposing and exploiting structure in a problem through the use of robust structured multilevel solvers. By choosing coarsening that preserves the structure of the problem, these methods maintain efficient structured computation and communication throughout the multigrid hierarchy. However, when coarsening is not permitted to be dependent on the operator, anisotropy must be addressed by the smoother — producing error compatible for coarse-grid correction with structured coarsening. Here, the components required in a scalable parallel structured solver are described with a focus on memory and communication efficiency of robust smoothers. While the implementation of communication and memory reduction techniques in smoothers integrated in a complete 3D solver present a significant engineering challenge, a novel approach is proposed that addresses these challenges systematically through a change to the solver’s execution model. Enabled by user-level threading paired with a set of data and communication abstractions, this approach permits seamless aggregation of communication in plane smoothers — directly reusing code for a 2D distributed multilevel cycle. Results show an effective reduction in communication costs for coarse-grid problems, and result in a speedup of 8.7x in smoothing routines shown in Fig. 12 using this approach. This produces a significant improvement to strong scalability while maintaining favorable weak scaling behavior. Finally, a parallel scaling study using a series of refined meshes is included that demonstrates the effectiveness of this approach in an application of interest.

97 MATHEMATICS AND COMPUTING↗

Specification of the near-Earth space environment with SHIELDS

Here, predicting variations in the near-Earth space environment that can lead to spacecraft damage and failure is one example of “space weather” and a big space physics challenge. A project recently funded through the Los Alamos National Laboratory (LANL) Directed Research and Development (LDRD) program aims at developing a new capability to understand, model, and predict Space Hazards Induced near Earth by Large Dynamic Storms, the SHIELDS framework. The project goals are to understand the dynamics of the surface charging environment (SCE), the hot (keV) electrons representing the source and seed populations for the radiation belts, on both macro- and micro-scale. Important physics questions related to particle injection and acceleration associated with magnetospheric storms and substorms, as well as plasma waves, are investigated. These challenging problems are addressed using a team of world-class experts in the fields of space science and computational plasma physics, and state-of-the-art models and computational facilities. A full two-way coupling of physics-based models across multiple scales, including a global MHD (BATS-R-US) embedding a particle-in-cell (iPIC3D) and an inner magnetosphere (RAM-SCB) codes, is achieved. New data assimilation techniques employing in situ satellite data are developed; these provide an order of magnitude improvement in the accuracy in the simulation of the SCE. SHIELDS also includes a post-processing tool designed to calculate the surface charging for specific spacecraft geometry using the Curvilinear Particle-In-Cell (CPIC) code that can be used for reanalysis of satellite failures or for satellite design.

54 ENVIRONMENTAL SCIENCES↗

Algebraic Multigrid Preconditioners for Multiphase Flow in Porous Media

Multiphase flow is a critical process in a wide range of applications, including carbon sequestration, contaminant remediation, and groundwater management. Typically, this process is modeled by a nonlinear system of partial differential equations derived by considering the mass conservation of each phase (e.g., oil, water), along with constitutive laws for the relationship of phase velocity to phase pressure. In this study, we develop and study efficient solution algorithms for solving the algebraic systems of equations derived from a fully coupled and time-implicit treatment of models of multiphase flow. We explore the performance of several preconditioners based on algebraic multigrid (AMG) for solving the linearized problem, including “black-box” AMG applied directly to the system, a new version of constrained pressure residual multigrid (CPR-AMG) preconditioning, and a new preconditioner derived using an approximate Schur complement arising from the block factorization of the Jacobian. Finally, we show that the new methods are the most robust with respect to problem character, as determined by varying effects of capillary pressures, and we show that the block factorization preconditioner both is efficient and scales optimally with problem size.

97 MATHEMATICS AND COMPUTING↗

Mimetic Finite Differences and Algebraic Multilevel Methods for Reservoir Performance Predictions: CRADA Final Report

The need to better predict and control reservoir performance is driving the development of increasingly sophisticated reservoir models that use unstructured general polyhedral grids to capture highly detailed stratigraphy. However, both discretization methods and scalable iterative solution algorithms for these situations are an active area of research. In this work we compared the performance of a new Mimetic Finite Difference (MFD) method with two new Mixed Finite Element methods, and LANL and the CRADA Participant investigated the performance of Los Alamos National Laboratory’s algebraic multigrid code on realistic flow problems. Furthermore, uncertainty quantification requires rapid evaluations of reservoir models. To do this, fine-scale reservoir models need to be coarsened and yet important fine-scale features and processes that have a significant impact on flows need to be preserved. To this end, we investigated the use of multi-resolution methods, such as the Multilevel Multiscale Mimetic (M3) method, to coarsen reservoir models.

97 MATHEMATICS AND COMPUTING↗

Predicting Climate Feedbacks and Impacts in the Terrestrial Arctic: w14_terraarctic progress report

Regarding the Arctic Terrestrial Simulator (ATS), previous work solved integrated hydrology (coupled surface/subsurface flow) on multiple polygons, and surface flow over larger domains to guide landscape characterization. Solved thermal hydrology with freeze/thaw dynamics in three dimensions. Ongoing efforts apply state of the art thermal hydrology model to complex topography, and include mesh deformation processes.

54 ENVIRONMENTAL SCIENCES↗