Search NASA⌕ Search

SEARCH · Search NASA

Results for “Grid computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

A comparison of Eulerian and semi-Lagrangian approaches for modeling stream water quality

This paper describes and compares some of the advantages and limitations of Eulerian and Lagrangian approaches to water quality modeling and introduces a mixed Eulerian-Lagrangian (or semi-Lagrangian) methodology that captures the strengths of both approaches. The semi-Lagrangian modeling approach is applied to advection-dominated rivers, and flexibly ensures unconditional stability for all time step durations and grid segmentations. The semi-Lagrangian modeling approach is demonstrated by applying it to estimate the dissolved oxygen concentrations in the Sava River in Slovenia, focusing on aspects of the methodology and findings that would be of broad interest to managers of water quality in fluvial water bodies. Results of comparisons of the semi-Lagrangian model with the Eulerian-based QUAL2K model in steady and non-steady scenarios demonstrate that while both models are fully capable of producing satisfactory results when optimally configured, the semi-Lagrangian approach offers accuracy and stability without sensitivity to the interaction of time step size and computational grid segmentation scheme.

Sava River↗

Coordinate transformation methodology for simulating quasistatic elastoplastic solids

Molecular dynamics simulations frequently employ periodic boundary conditions where the positions of the periodic images are manipulated in order to apply deformation to the material sample. For example, Lees-Edwards conditions use moving periodic images to apply simple shear. Here, we examine the problem of precisely comparing this type of simulation to continuum solid mechanics. We employ a hypo-elastoplastic mechanical model, and develop a projection method to enforce quasi-static equilibrium. We introduce a simulation framework that uses a fixed Cartesian computational grid on a reference domain, and imposes deformation via a time-dependent coordinate transformation to the physical domain. As a test case for our method, we consider the evolution of shear bands in a bulk metallic glass using the shear transformation zone theory of amorphous plasticity. We examine the growth of shear bands in simple shear and pure shear conditions as a function of the initial preparation of the bulk metallic glass.

74 ATOMIC AND MOLECULAR PHYSICS↗

WLCG Transition from X.509 to Tokens. Status, Plans, and Timeline

Since 2017, the Worldwide LHC Computing Grid (WLCG) has been working towards enabling token-based authentication and authorization throughout its entire middleware stack. Following the initial publication of the WLCG Token Schema v1.0 in 2019, OAuth2.0 token workflows have been integrated across grid middleware. There are many complex challenges to be addressed before the WLCG can be end-to-end token-based, including not just technical hurdles but also interoperability with the wider authentication and authorization landscape. This paper presents the status of the WLCG coordination and deployment work, and how it relates to software providers and partner communities. The authors also detail how the WLCG token transition timeline has progressed, and how it has changed since its publication.

97 MATHEMATICS AND COMPUTING↗

FTS3: Data Movement Service in containers deployed in OKD [Slides]

The File Transfer Service (FTS3) is a data movement service developed at CERN which is used to distribute the majority of the Large Hadron Collider's data across the Worldwide LHC Computing Grid (WLCG) infrastructure. At Fermilab, we have deployed FTS3 instances for Intensity Frontier experiments (e.g. DUNE) to transfer data in America and Europe, using a container-based strategy. In this article we summarize our experience building docker images based on work from the SLATE project (slateci.io) and deployed in OKD, the community distribution of Red Hat OpenShift. Additionally, we discuss our method of certificate management and maintenance utilizing Kubernetes CronJobs. Finally, we also report on the two different configurations currently running at Fermilab, comparing and contrasting a Docker-based OKD deployment against a traditional RPM-based deployment.

97 MATHEMATICS AND COMPUTING↗

Supporting multiple hardware architectures at CMS: the integration and validation of POWER9

Computing resources in the Worldwide LHC Computing Grid (WLCG) have been based entirely on the x86 architecture for more than two decades. In the near future, however, heterogeneous non-x86 resources, such as ARM, POWER and Risc-V, will become a substantial fraction of the resources that will be provided to the LHC experiments, due to their presence in existing and planned world-class HPC installations. The CMS experiment, one of the four large detectors at the LHC, has started to prepare for this situation, with the CMS software stack (CMSSW) already compiled for multiple architectures. In order to allow for a production use, the tools for workload management and job distribution need to be extended to be able to exploit heterogeneous architectures. Profiting from the opportunity to exploit the first sizable IBM Power9 allocation available on Marconi100 HPC system at CINECA, CMS developed all the needed modifications to the CMS workload management system. After a successful proof of concept, a full physics validation has been performed in order to bring the system in production. The experiences are of very high value, when it comes to commissioning of the similar (even larger) Summit HPC system at Oak Ridge, where CMS is also expecting a resource allocation. Moreover the compute power of those systems is being provided also via GPUs and this represents an extremely valuable opportunity to exploit the offloading capability already implemented in CMSSW. The status of the current integration including the exploitation of the GPUs, the results of the validation as well as the future plans will be shown and discussed.

Boccali, Tommaso [INFN, Pisa]↗

A fully-integrated lattice Boltzmann method for fluid–structure interaction

Here we present a fully-integrated lattice Boltzmann (LB) method for fluid–structure interaction (FSI) simulations that efficiently models deformable solids in complex suspensions and active systems. Our Eulerian method (LBRMT) couples finite-strain solids to the LB fluid on the same fixed computational grid with the reference map technique (RMT). An integral part of the LBRMT is a new LB boundary condition for moving deformable interfaces across different densities. With this fully Eulerian solid–fluid coupling, the LBRMT is well-suited for parallelization and simulating multi-body contact without remeshing or extra meshes. We validate its accuracy via a benchmark of a deformable solid in a lid-driven cavity, then showcase its versatility through examples of soft solids rotating and settling. The LBRMT achieves a spatial convergence rate between first-order and second-order for FSI simulations and is designed for low to intermediate Reynolds number flows with finite inertia at small Mach numbers. With simulations of complex suspensions mixing, we highlight the potential of the LBRMT for studying collective behavior in soft matter and biofluid dynamics.

97 MATHEMATICS AND COMPUTING↗

A Fast Butterfly-Compressed Hadamard–Babich Integrator for High-Frequency Helmholtz Equations in Inhomogeneous Media with Arbitrary Sources

Here we present a butterfly-compressed representation of the Hadamard-Babich (HB) ansatz for the Green's function of the high-frequency Helmholtz equation in smooth inhomogeneous media. For a computational domain discretized with Nv discretization cells, the proposed algorithm first solves and tabulates the phase and HB coefficients via eikonal and transport equations with observation points and point sources located at the Chebyshev nodes using a set of much coarser computation grids, and then butterfly compresses the resulting HB interactions from all Nv cell centers to each other. The overall CPU time and memory requirement scale as O(Nv log2 Nv) for any bounded two-dimensional (2D) domains with arbitrary excitation sources. A direct extension of this scheme to bounded 3D domains yields an O(Nv4/3) CPU complexity, which can be further reduced to quasi-linear complexities with proposed remedies. The scheme can also efficiently handle scattering problems involving inclusions in inhomogeneous media. Although the current construction of our HB integrator does not accommodate caustics, the resulting HB integrator itself can be applied to certain sources, such as concave-shaped sources, to produce caustic effects. Compared to finite-difference frequency domain methods, the proposed HB integrator is free of numerical dispersion and requires fewer discretization points per wavelength. As a result, it can solve wave propagation problems well beyond the capability of existing solvers. Remarkably, the proposed scheme can accurately model wave propagation in 2D domains with 640 wavelengths per direction and in 3D domains with 54 wavelengths per direction on a state-of-the-art supercomputer at Lawrence Berkeley National Laboratory.

Hadamard--Babich ansatz↗

Discretization limits of lattice‐Boltzmann methods for studying immiscible two‐phase flow in porous media

Summary Digital images of porous media often include features approaching the image resolution length scale. The behavior of numerical methods at low resolution is therefore important even for well‐resolved systems. We study the behavior of the Shan‐Chen (SC) and Rothman‐Keller (RK) multicomponent lattice‐Boltzmann models in situations where the fluid‐fluid interfacial radius of curvature and/or the feature size of the medium approaches the discrete unit size of the computational grid. Various simple, small‐scale test geometries are considered, and a drainage test is also performed in a Bentheimer sandstone sample. We find that both RK and SC models show very high ultimate limits: in ideal conditions the models can simulate static fluid configuration with acceptable accuracy in tubes as small as three lattice units across for RK model (six lattice units for SC model) and with an interfacial radius of curvature of two lattice units for RK and SC models. However, the stability of the models is affected when operating in these extreme discrete limits: in certain circumstances the models exhibit behaviors ranging from loss of accuracy to numerical instability. We discuss the circumstances where these behaviors occur and the ramifications for larger‐scale fluid displacement simulations in porous media, along with strategies to mitigate the most severe effects. Overall we find that the RK model, with modern enhancements, exhibits fewer instabilities and is more suitable for systems of low fluid‐fluid miscibility. The shortcomings of the SC model seem to arise predominantly from the high, strongly pressure‐dependent miscibility of the two fluid components.

Li, Zhe↗

Dynamo: Handling Scientific Data Across Sites and Storage Media

Abstract Dynamo is a full-stack software solution for scientific data management. Dynamo’s architecture is modular, extensible, and customizable, making the software suitable for managing data in a wide range of installation scales, from a few terabytes stored at a single location to hundreds of petabytes distributed across a worldwide computing grid. This article documents the core system design of Dynamo and describes the applications that implement various data management tasks. A brief report is also given on the operational experiences of the system at the CMS experiment at the CERN Large Hadron Collider and at a small-scale analysis facility.

Iiyama, Yutaro (ORCID:0000000282975930)↗

A particle resolved simulation approach for studying shock interactions with moving, colliding solid particles

This work applies a new combination of techniques for the fully resolved simulation of compressible, gas–particle multiphase flows. Here, the adaptive wavelet collocation method is used to dynamically, and efficiently, adapt the computational grid to localized flow features and the particles. A characteristic-based volume penalization method that imposes arbitrary Dirichlet, Neumann, or Robin-type immersed boundary conditions, is used to enforce the no-slip condition at particle surfaces. A hard-sphere collision model is applied to capture the particle–particle collisions. Proof of concept test cases are presented, showcasing the dynamic grid adaptation and fully resolved two-way coupling between the phases that is possible with this approach. Results for a shock-driven single cylinder under viscous and inviscid conditions are presented along with a demonstration of a shock interacting with a cloud of randomly distributed cylinders and spheres.

42 ENGINEERING↗

Development of a Filtered CFD-DEM Drag Model with Multiscale Markers Using an Artificial Neural Network and Nonlinear Regression

Here, the accuracy of coarse-grained Euler-Lagrangian simulations of fluidized beds heavily depends on the mesoscale drag models to account for the influences of the unresolved sub-grid structures. Traditional filtered drag models are regressed with mesoscale markers such as voidage and slip velocities. In this research, a filtered drag was regressed with both mesoscale and macro-scale markers using fine grid Computational Fluid Dynamics - Discrete Element Method (CFD-DEM) simulations. The traditional non-linear regression method was compared with machine learning regression using an Artificial Neural Network (ANN) implemented in PyTorch and coupled with MFiX. The new drag showed higher accuracy than the Wen-Yu drag and another filtered drag derived from the two-fluid model. The nonlinear regression shows slightly better results than ANN regression in cases with similar R 2 values. The utilization of the gas inlet velocity as an additional macro-scale marker reduced the errors by up to 55.3% in the tested cases.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Microstructure, Transport, and Mechanics of Compacted Clay Simulated at the 0.1 μm Scale (1400 Smectite Clay Particles) Using a Coarse-Grained Model with Explicit Counterions

Clay-rich geomaterials play a critical role in many subsurface systems. The macroscale properties of these materials (low permeability, high ionic conductivity, high swelling pressure, etc.) are sensitive to molecular-level adsorption and hydration interactions at clay−water interfaces. Efforts to develop multiscale simulation approaches to predict these properties reveal a scale gap between atomistic simulations (typically limited to systems smaller than 10 nm) and continuum-scale models (which use computational grid elements with dimensions ≳ 10 μm). In this study, we present a coarse-grained (CG) framework that partly bridges this gap by simulating compacted smectite clay assemblages with dimensions of 0.1 μm containing 1,400 clay particles across a range of dry densities (1,050 to 1,850 kg·m −3 ) and Na/Ca counterion compositions (Na fraction ranging from 0.2 to 1). The simulated systems, along with their reconstructed binary three-dimensional pore networks, are used to evaluate the microstructure, pore size distribution, tortuosity, ion diffusivity, and swelling pressure of compacted smectite clay. Results show that our approach captures important features of the mesoscale heterogeneity of compacted clays, including tactoid formation, hierarchical porosity, and anisotropic pore networks. Results also reveal how compaction and counterion composition govern emergent behaviors, including dominant pore sizes, directional transport, and electrochemical response. This work highlights the potential of CG simulations to bridge molecular and continuum scales and to advance geotechnical and environmental applications involving clay-rich materials as well as related nanoporous media such as geopolymers and calcium-silicate-hydrate. However, the results also suggest that accurate prediction of certain microstructural and mechanical properties (e.g., swelling pressure) may require even larger-scale systems on the order of 1 μm.

02 PETROLEUM↗

Multidimensional low-Mach number time-implicit hydrodynamic simulations of convective helium shell burning in a massive star

A realistic parametrization of convection and convective boundary mixing in conventional stellar evolution codes is still the subject of ongoing research. Furthermore, to improve the current situation, multidimensional hydrodynamic simulations are used to study convection in stellar interiors. Such simulations are numerically challenging, especially for flows at low Mach numbers which are typical for convection during early evolutionary stages. We explore the benefits of using a low-Mach hydrodynamic flux solver and demonstrate its usability for simulations in the astrophysical context. Simulations of convection for a realistic stellar profile are analyzed regarding the properties of convective boundary mixing. The time-implicit Seven-League Hydro (SLH) code was used to perform multidimensional simulations of convective helium shell burning based on a 25 M ⊙ star model. The results obtained with the low-Mach AUSM + -up solver were compared to results when using its non low-Mach variant AUSM B + -up. We applied well-balancing of the gravitational source term to maintain the initial hydrostatic background stratification. The computational grids have resolutions ranging from 180 × 90 2 to 810 × 540 2 cells and the nuclear energy release was boosted by factors of 3 × 10 3 , 1 × 10 4 , and 3 × 10 4 to study the dependence of the results on these parameters.

79 ASTRONOMY AND ASTROPHYSICS↗

WLCG Token Usage and Discovery

Since 2017, the Worldwide LHC Computing Grid (WLCG) has been working towards enabling token based authentication and authorisation throughout its entire middleware stack. Following the publication of the WLCG Common JSON Web Token (JWT) Schema v1.0 [1] in 2019, middleware developers have been able to enhance their services to consume and validate the JWT-based [2] OAuth2.0 [3] tokens and process the authorization information they convey. Complex scenarios, involving multiple delegation steps and command line flows, are a key challenge to be addressed in order for the system to be fully operational. This paper expands on the anticipated token based workflows, with a particular focus on local storage of tokens and their discovery by services. The authors include a walk-through of this token flow in the RUCIO managed data-transfer scenario, including delegation to FTS and authorised access to storage elements. Next steps are presented, including the current target of submitting production jobs authorised by Tokens within 2021.

Bockelman, Brian↗

WLCG transition from X.509 to Tokens: Progress and Outlook

Since 2017, the Worldwide LHC Computing Grid (WLCG) has been working towards enabling token-based authentication and authorization throughout its entire middleware stack.Taking guidance from the WLCG Token Transition Timeline, published in 2022, substantial progress has been achieved not only in making middleware compatible with the use of tokens, but also in understanding the limitations of the WLCG Common JWT Profiles, first published in 2019. Significant scalability experience has been gained from Data Challenge 2024, during which millions of files were transferred with tokens used as credentials - a significant percentage of the total transfers completed.Besides describing the state of affairs in the transition to tokens, revisions to the WLCG token profile, and the evolving road maps, this contribution also covers the corresponding transition from VOMS-Admin to INDIGO-IAM services, with continuing improvements in terms of functionality as well as deployment.

Dack, Thomas [Rutherford Appleton Laboratory]↗

Towards an IPv6-only WLCG: More successes in reducing IPv4

The Worldwide Large Hadron Collider Computing Grid (WLCG) community’s deployment of dual-stack IPv6/IPv4 on its worldwide storage infrastructure has been very successful. Dual-stack is not, however, a viable longterm solution; the HEPiX IPv6 Working Group has focused on studying where and why IPv4 is still being used, and how to flip such traffic to IPv6. The agreed end goal is to turn IPv4 off and run IPv6-only over the wide-area network to simplify both operations and security management.This paper reports our work since the CHEP2023 conference. Firstly, we present our campaign to deploy IPv6 on CPU services and Worker Nodes, with a deadline of end of June 2024. Then, the WLCG Data Challenge (DC24) performed in February 2024 was an excellent opportunity to observe the percentage of data transfers carried by IPv6. We observed the predominance of IPv6 in data transfers during DC24 and were able to understand yet more reasons for the use of IPv4 and areas for remedial action.The paper ends with the working group’s plans for moving WLCG to “IPv6- only”. One aspect of this is the possible automated use of IPv6-only clients configured with a customer-side translator, or CLAT, together with a deployment of NAT64 using what is often known as “IPv6-Mostly”, enabling IPv6-only sites to connect to non-WLCG IPv4-only services.

Attebury, Garhan [U. Nebraska, Lincoln]↗

Eulerian simulation of complex suspensions and biolocomotion in three dimensions

Significance Fluid–structure interactions are ubiquitous in many natural and man-made environments. They are difficult to study analytically, and therefore accurate and flexible computational methods are an indispensable tool in the field. Typically, fluids are simulated with a fixed background computational mesh, whereas a solid is simulated with a mesh that moves with it, making it challenging to couple the two. Here we develop a three-dimensional computational method where both fluid and solid can be represented on a fixed computational grid, which simplifies the coupling between the two phases considerably. Our method can simulate scenarios that are difficult to do with other methods, such as complex suspensions containing soft particles that are both heavier and lighter than the fluid.

3D fluid-structure interaction↗

Numerical error analysis of SOLPS-ITER simulations of EAST

Abstract Plasma edge simulations with codes like SOLPS-ITER are widely employed to interpret fusion experiments. However, numerical errors appearing in such simulations are rarely investigated, despite their potential large impact on simulation results. These errors consist of the statistical error and the bias, both resulting from the finite number of employed EIRENE Monte Carlo particles and incomplete convergence, and the discretization error due to the finite resolution of the computational grids. In this contribution, the resulting numerical errors on simulations of pure deuterium and neon seeded H-mode EAST discharges are examined. The statistical error can be kept small compared to other numerical error contributions by averaging the plasma profiles. This allows investigating the bias and discretization errors using Richardson extrapolation. It is shown that grid refinement and the number of employed Monte Carlo particles have the largest influence on the result, in agreement with similar studies of an ITER deuterium case. For the first time, numerical error bars on the entire simulated target profiles are determined showing that the largest numerical error is 17.9%, mainly due to the plasma grid discretization. On top, also numerical errors on simulated neutral pressures are investigated in detail, for which the statistical error is dominant. The analysis demonstrates which setup is needed to keep numerical errors limited: the SOLPS-ITER averaging procedure should be employed including enough EIRENE particles, and the involved grids should be sufficiently refined to reduce discretization errors.

Boeyaert, Dieter (ORCID:0000000309208660)↗