Engineering topics

Jiang, Weiyuan

Publications and source records attributed to Jiang, Weiyuan.

3 records

NASA NTRS2014

Using SpF to Achieve Petascale for Legacy Pseudospectral Applications

Pseudospectral (PS) methods possess a number of characteristics (e.g., efficiency, accuracy, natural boundary conditions) that are extremely desirable for dynamo models. Unfortunately, dynamo models based upon PS methods face a number of daunting challenges, which include exposing additional parallelism, leveraging hardware accelerators, exploiting hybrid parallelism, and improving the scalability of global memory transposes. Although these issues are a concern for most models, solutions for PS methods tend to require far more pervasive changes to underlying data and control structures. Further, improvements in performance in one model are difficult to transfer to other models, resulting in significant duplication of effort across the research community. We have developed an extensible software framework for pseudospectral methods called SpF that is intended to enable extreme scalability and optimal performance. Highlevel abstractions provided by SpF unburden applications of the responsibility of managing domain decomposition and load balance while reducing the changes in code required to adapt to new computing architectures. The key design concept in SpF is that each phase of the numerical calculation is partitioned into disjoint numerical kernels that can be performed entirely inprocessor. The granularity of domain decomposition provided by SpF is only constrained by the datalocality requirements of these kernels. SpF builds on top of optimized vendor libraries for common numerical operations such as transforms, matrix solvers, etc., but can also be configured to use open source alternatives for portability. SpF includes several alternative schemes for global data redistribution and is expected to serve as an ideal testbed for further research into optimal approaches for different network architectures. In this presentation, we will describe our experience in porting legacy pseudospectral models, MoSST and DYNAMO, to use SpF as well as present preliminary performance results provided by the improved scalability.

DYNAMO↗

NASA NTRS2011

Geomagnetic Secular Variation Prediction with Thermal Heterogeneous Boundary Conditions

It has long been conjectured that thermal heterogeneity at the core-mantle boundary (CMB) affects the geodynamo substantially. The observed two pairs of steady and strong magnetic flux lobes near the Polar Regions and the low secular variation in the Pacific over the past 400 years (and perhaps longer) are likely the consequences of this CMB thermal heterogeneity. There are several studies on the impact of the thermal heterogeneity with numerical geodynamo simulations. However, direct correlation between the numerical results and the observations is found very difficult, except qualitative comparisons of certain features in the radial component of the magnetic field at the CMB. This makes it difficult to assess accurately the impact of thermal heterogeneity on the geodynamo and the geomagnetic secular variation. We revisit this problem with our MoSST_DAS system in which geomagnetic data are assimilated with our geodynamo model to predict geomagnetic secular variations. In this study, we implement a heterogeneous heat flux across the CMB that is chosen based on the seismic tomography of the lowermost mantle. The amplitude of the heat flux (relative to the mean heat flux across the CMB) varies in the simulation. With these assimilation studies, we will examine the influences of the heterogeneity on the forecast accuracies, e.g. the accuracies as functions of the heterogeneity amplitude. With these, we could be able to assess the model errors to the true core state, and thus the thermal heterogeneity in geodynamo modeling.

Kuang, Weijia↗

NASA NTRS2004

High Speed Networking and Large-scale Simulation in Geodynamics

Large-scale numerical simulation has been one of the most important approaches for understanding global geodynamical processes. In this approach, peta-scale floating point operations (pflops) are often required to carry out a single physically-meaningful numerical experiment. For example, to model convective flow in the Earth's core and generation of the geomagnetic field (geodynamo), simulation for one magnetic free-decay time (approximately 15000 years) with a modest resolution of 150 in three spatial dimensions would require approximately 0.2 pflops. If such a numerical model is used to predict geomagnetic secular variation over decades and longer, with e.g. an ensemble Kalman filter assimilation approach, approximately 30 (and perhaps more) independent simulations of similar scales would be needed for one data assimilation analysis. Obviously, such a simulation would require an enormous computing resource that exceeds the capacity of a single facility currently available at our disposal. One solution is to utilize a very fast network (e.g. 10Gb optical networks) and available middleware (e.g. Globus Toolkit) to allocate available but often heterogeneous resources for such large-scale computing efforts. At NASA GSFC, we are experimenting with such an approach by networking several clusters for geomagnetic data assimilation research. We shall present our initial testing results in the meeting.

Kuang, Weijia↗