SEARCH · Search NASA

Results for “grid computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

DOE OSTI2023

A Fast Butterfly-Compressed Hadamard–Babich Integrator for High-Frequency Helmholtz Equations in Inhomogeneous Media with Arbitrary Sources

Here we present a butterfly-compressed representation of the Hadamard-Babich (HB) ansatz for the Green's function of the high-frequency Helmholtz equation in smooth inhomogeneous media. For a computational domain discretized with Nv discretization cells, the proposed algorithm first solves and tabulates the phase and HB coefficients via eikonal and transport equations with observation points and point sources located at the Chebyshev nodes using a set of much coarser computation grids, and then butterfly compresses the resulting HB interactions from all Nv cell centers to each other. The overall CPU time and memory requirement scale as O(Nv log2 Nv) for any bounded two-dimensional (2D) domains with arbitrary excitation sources. A direct extension of this scheme to bounded 3D domains yields an O(Nv4/3) CPU complexity, which can be further reduced to quasi-linear complexities with proposed remedies. The scheme can also efficiently handle scattering problems involving inclusions in inhomogeneous media. Although the current construction of our HB integrator does not accommodate caustics, the resulting HB integrator itself can be applied to certain sources, such as concave-shaped sources, to produce caustic effects. Compared to finite-difference frequency domain methods, the proposed HB integrator is free of numerical dispersion and requires fewer discretization points per wavelength. As a result, it can solve wave propagation problems well beyond the capability of existing solvers. Remarkably, the proposed scheme can accurately model wave propagation in 2D domains with 640 wavelengths per direction and in 3D domains with 54 wavelengths per direction on a state-of-the-art supercomputer at Lawrence Berkeley National Laboratory.

Hadamard--Babich ansatz↗

DOE OSTI2020

Discretization limits of lattice‐Boltzmann methods for studying immiscible two‐phase flow in porous media

Summary Digital images of porous media often include features approaching the image resolution length scale. The behavior of numerical methods at low resolution is therefore important even for well‐resolved systems. We study the behavior of the Shan‐Chen (SC) and Rothman‐Keller (RK) multicomponent lattice‐Boltzmann models in situations where the fluid‐fluid interfacial radius of curvature and/or the feature size of the medium approaches the discrete unit size of the computational grid. Various simple, small‐scale test geometries are considered, and a drainage test is also performed in a Bentheimer sandstone sample. We find that both RK and SC models show very high ultimate limits: in ideal conditions the models can simulate static fluid configuration with acceptable accuracy in tubes as small as three lattice units across for RK model (six lattice units for SC model) and with an interfacial radius of curvature of two lattice units for RK and SC models. However, the stability of the models is affected when operating in these extreme discrete limits: in certain circumstances the models exhibit behaviors ranging from loss of accuracy to numerical instability. We discuss the circumstances where these behaviors occur and the ramifications for larger‐scale fluid displacement simulations in porous media, along with strategies to mitigate the most severe effects. Overall we find that the RK model, with modern enhancements, exhibits fewer instabilities and is more suitable for systems of low fluid‐fluid miscibility. The shortcomings of the SC model seem to arise predominantly from the high, strongly pressure‐dependent miscibility of the two fluid components.

Li, Zhe↗

DOE OSTI2018

Interface and embedded joint methods for modeling dynamic fracture opening by explosive products [Two methods for modeling dynamic fracture opening by explosive products]

Two computational approaches are proposed in the paper to model dynamic fracture opening by explosive products. The first method assumes that the fractures may be modeled using flow elements embedded along the mesh lines. This method models crack opening in a straightforward way by splitting the nodes of the computational grid. It can account for crack branching; however, the crack directions are constrained by existing mesh faces, which may lead to mesh dependence. Also, the stress in flow elements is calculated explicitly separate from the surrounding solid elements that can impose additional limits on the time step stability condition for explicit integration. The second approach uses embedded flow elements to model the cracks. Typical thickness of the cracks is much smaller than the element size. Therefore, gas pressure in the cracks is assumed to be in stress equilibrium with the element stress. To achieve this, the crack thickness and the state of the gas is updated simultaneously with the state of the solid element which contains the crack. Therefore, the time step is controlled by the explicit solver applied for the solid and does not depend on the thickness of the crack. In conclusion, the main disadvantage of the second approach is due to the complexity of modeling multiple intersecting cracks, which go through the same element. We discuss the areas of possible applications of these 2 methods and the ways to improve and enhance them for future practical applications.

58 GEOSCIENCES↗

DOE OSTI2021

Dynamo: Handling Scientific Data Across Sites and Storage Media

Abstract Dynamo is a full-stack software solution for scientific data management. Dynamo’s architecture is modular, extensible, and customizable, making the software suitable for managing data in a wide range of installation scales, from a few terabytes stored at a single location to hundreds of petabytes distributed across a worldwide computing grid. This article documents the core system design of Dynamo and describes the applications that implement various data management tasks. A brief report is also given on the operational experiences of the system at the CMS experiment at the CERN Large Hadron Collider and at a small-scale analysis facility.

Iiyama, Yutaro (ORCID:0000000282975930)↗

DOE OSTI2022

A particle resolved simulation approach for studying shock interactions with moving, colliding solid particles

This work applies a new combination of techniques for the fully resolved simulation of compressible, gas–particle multiphase flows. Here, the adaptive wavelet collocation method is used to dynamically, and efficiently, adapt the computational grid to localized flow features and the particles. A characteristic-based volume penalization method that imposes arbitrary Dirichlet, Neumann, or Robin-type immersed boundary conditions, is used to enforce the no-slip condition at particle surfaces. A hard-sphere collision model is applied to capture the particle–particle collisions. Proof of concept test cases are presented, showcasing the dynamic grid adaptation and fully resolved two-way coupling between the phases that is possible with this approach. Results for a shock-driven single cylinder under viscous and inviscid conditions are presented along with a demonstration of a shock interacting with a cloud of randomly distributed cylinders and spheres.

42 ENGINEERING↗

DOE OSTI2019

Parameterizing hot electron energy distributions for tabular emissivities and opacities

Cold Kα and Kβ emission spectroscopy is a powerful diagnostic for plasma conditions and distributions of energetic electrons produced in short pulse laser experiments. SPECT3D post-processes hydrodynamics code output and simulates high-resolution spectra and images for plasmas containing arbitrary distributions of hot electrons, however these calculations can become prohibitively expensive for plasmas requiring complex atomic data and detailed computational grids. To significantly increase calculation speed, it is desirable to use pre-configured opacity tables that include information about hot electrons, rather than calculating emissivity and opacity for every grid point by solving collisional-radiative atomic kinetic rate equations. However, to tabulate such opacities, a general parameter-based description of hot electron energy distributions must be found. To be practical, hot electrons should be represented with an analytic function of just a few parameters which, in addition to temperature and density, can be used to define parameter space for opacity tables. In this paper, we present a method that allows for describing a set of arbitrary binned hot electron distributions with a simple analytic function, with only a modest impact on the accuracy of the simulations. Increased calculation speeds of 50–100x are demonstrated. In conclusion, we also discuss details of opacity calculations and present synthetic spectroscopy data based on post-processing of detailed particle-in-cell simulations relevant to the ongoing experimental campaign at the Omega EP laser facility.

74 ATOMIC AND MOLECULAR PHYSICS↗

DOE OSTI2021

Development of a Filtered CFD-DEM Drag Model with Multiscale Markers Using an Artificial Neural Network and Nonlinear Regression

Here, the accuracy of coarse-grained Euler-Lagrangian simulations of fluidized beds heavily depends on the mesoscale drag models to account for the influences of the unresolved sub-grid structures. Traditional filtered drag models are regressed with mesoscale markers such as voidage and slip velocities. In this research, a filtered drag was regressed with both mesoscale and macro-scale markers using fine grid Computational Fluid Dynamics - Discrete Element Method (CFD-DEM) simulations. The traditional non-linear regression method was compared with machine learning regression using an Artificial Neural Network (ANN) implemented in PyTorch and coupled with MFiX. The new drag showed higher accuracy than the Wen-Yu drag and another filtered drag derived from the two-fluid model. The nonlinear regression shows slightly better results than ANN regression in cases with similar R 2 values. The utilization of the gas inlet velocity as an additional macro-scale marker reduced the errors by up to 55.3% in the tested cases.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2026

Microstructure, Transport, and Mechanics of Compacted Clay Simulated at the 0.1 μm Scale (1400 Smectite Clay Particles) Using a Coarse-Grained Model with Explicit Counterions

Clay-rich geomaterials play a critical role in many subsurface systems. The macroscale properties of these materials (low permeability, high ionic conductivity, high swelling pressure, etc.) are sensitive to molecular-level adsorption and hydration interactions at clay−water interfaces. Efforts to develop multiscale simulation approaches to predict these properties reveal a scale gap between atomistic simulations (typically limited to systems smaller than 10 nm) and continuum-scale models (which use computational grid elements with dimensions ≳ 10 μm). In this study, we present a coarse-grained (CG) framework that partly bridges this gap by simulating compacted smectite clay assemblages with dimensions of 0.1 μm containing 1,400 clay particles across a range of dry densities (1,050 to 1,850 kg·m −3 ) and Na/Ca counterion compositions (Na fraction ranging from 0.2 to 1). The simulated systems, along with their reconstructed binary three-dimensional pore networks, are used to evaluate the microstructure, pore size distribution, tortuosity, ion diffusivity, and swelling pressure of compacted smectite clay. Results show that our approach captures important features of the mesoscale heterogeneity of compacted clays, including tactoid formation, hierarchical porosity, and anisotropic pore networks. Results also reveal how compaction and counterion composition govern emergent behaviors, including dominant pore sizes, directional transport, and electrochemical response. This work highlights the potential of CG simulations to bridge molecular and continuum scales and to advance geotechnical and environmental applications involving clay-rich materials as well as related nanoporous media such as geopolymers and calcium-silicate-hydrate. However, the results also suggest that accurate prediction of certain microstructural and mechanical properties (e.g., swelling pressure) may require even larger-scale systems on the order of 1 μm.

02 PETROLEUM↗

DOE OSTI2021

Multidimensional low-Mach number time-implicit hydrodynamic simulations of convective helium shell burning in a massive star

A realistic parametrization of convection and convective boundary mixing in conventional stellar evolution codes is still the subject of ongoing research. Furthermore, to improve the current situation, multidimensional hydrodynamic simulations are used to study convection in stellar interiors. Such simulations are numerically challenging, especially for flows at low Mach numbers which are typical for convection during early evolutionary stages. We explore the benefits of using a low-Mach hydrodynamic flux solver and demonstrate its usability for simulations in the astrophysical context. Simulations of convection for a realistic stellar profile are analyzed regarding the properties of convective boundary mixing. The time-implicit Seven-League Hydro (SLH) code was used to perform multidimensional simulations of convective helium shell burning based on a 25 M ⊙ star model. The results obtained with the low-Mach AUSM + -up solver were compared to results when using its non low-Mach variant AUSM B + -up. We applied well-balancing of the gravitational source term to maintain the initial hydrostatic background stratification. The computational grids have resolutions ranging from 180 × 90 2 to 810 × 540 2 cells and the nuclear energy release was boosted by factors of 3 × 10 3 , 1 × 10 4 , and 3 × 10 4 to study the dependence of the results on these parameters.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

Third-party transfers in WLCG using HTTP

Since its earliest days, the Worldwide LHC Computational Grid (WLCG) has relied on GridFTP to transfer data between sites. The announcement that Globus is dropping support of its open source Globus Toolkit (GT), which forms the basis for several FTP client and servers, has created an opportunity to reevaluate the use of FTP. HTTP-TPC, an extension to HTTP compatible with WebDAV, has arisen as a strong contender for an alternative approach.In this paper, we describe the HTTP-TPC protocol itself, along with the current status of its support in different implementations, and the interoperability testing done within the WLCG DOMA working group’s TPC activity. This protocol also provides the first real use-case for token-based authorisation for this community. We will demonstrate the benefits of such authorisation by showing how it allows HTTP-TPC to support new technologies (such as OAuth, OpenID Connect, Macaroons and SciTokens) without changing the protocol. We will also discuss the next steps for HTTP-TPC and the plans to use the protocol for WLCG transfers.

Bockelman, Brian↗

DOE OSTI2021

WLCG Token Usage and Discovery

Since 2017, the Worldwide LHC Computing Grid (WLCG) has been working towards enabling token based authentication and authorisation throughout its entire middleware stack. Following the publication of the WLCG Common JSON Web Token (JWT) Schema v1.0 [1] in 2019, middleware developers have been able to enhance their services to consume and validate the JWT-based [2] OAuth2.0 [3] tokens and process the authorization information they convey. Complex scenarios, involving multiple delegation steps and command line flows, are a key challenge to be addressed in order for the system to be fully operational. This paper expands on the anticipated token based workflows, with a particular focus on local storage of tokens and their discovery by services. The authors include a walk-through of this token flow in the RUCIO managed data-transfer scenario, including delegation to FTS and authorised access to storage elements. Next steps are presented, including the current target of submitting production jobs authorised by Tokens within 2021.

Bockelman, Brian↗

DOE OSTI2025

WLCG transition from X.509 to Tokens: Progress and Outlook

Since 2017, the Worldwide LHC Computing Grid (WLCG) has been working towards enabling token-based authentication and authorization throughout its entire middleware stack.Taking guidance from the WLCG Token Transition Timeline, published in 2022, substantial progress has been achieved not only in making middleware compatible with the use of tokens, but also in understanding the limitations of the WLCG Common JWT Profiles, first published in 2019. Significant scalability experience has been gained from Data Challenge 2024, during which millions of files were transferred with tokens used as credentials - a significant percentage of the total transfers completed.Besides describing the state of affairs in the transition to tokens, revisions to the WLCG token profile, and the evolving road maps, this contribution also covers the corresponding transition from VOMS-Admin to INDIGO-IAM services, with continuing improvements in terms of functionality as well as deployment.

Dack, Thomas [Rutherford Appleton Laboratory]↗

DOE OSTI2025

Towards an IPv6-only WLCG: More successes in reducing IPv4

The Worldwide Large Hadron Collider Computing Grid (WLCG) community’s deployment of dual-stack IPv6/IPv4 on its worldwide storage infrastructure has been very successful. Dual-stack is not, however, a viable longterm solution; the HEPiX IPv6 Working Group has focused on studying where and why IPv4 is still being used, and how to flip such traffic to IPv6. The agreed end goal is to turn IPv4 off and run IPv6-only over the wide-area network to simplify both operations and security management.This paper reports our work since the CHEP2023 conference. Firstly, we present our campaign to deploy IPv6 on CPU services and Worker Nodes, with a deadline of end of June 2024. Then, the WLCG Data Challenge (DC24) performed in February 2024 was an excellent opportunity to observe the percentage of data transfers carried by IPv6. We observed the predominance of IPv6 in data transfers during DC24 and were able to understand yet more reasons for the use of IPv4 and areas for remedial action.The paper ends with the working group’s plans for moving WLCG to “IPv6- only”. One aspect of this is the possible automated use of IPv6-only clients configured with a customer-side translator, or CLAT, together with a deployment of NAT64 using what is often known as “IPv6-Mostly”, enabling IPv6-only sites to connect to non-WLCG IPv4-only services.

Attebury, Garhan [U. Nebraska, Lincoln]↗

DOE OSTI2018

Towards district scale flood simulations using conventional and anisotropic porosity shallow water models with high-resolution topographic information

Current topographic survey technology provides high-resolution (HR) datasets for urban environments. Incorporating this HR information in models aiming to provide flood risk assessment is desirable because the flood wave propagation is depending on the urban topographic features, i.e. buildings, bridges and street networks. Conceptual, numerical and practical challenges arise from the application of shallow water models to HR urban flood modeling. For example, numerical challenges are occurrence of wet-dry fronts, geometric discontinuities in the urban environment and discontinuous solutions, i.e. shock waves. These challenges can be overcome by using a Godunov-type scheme. However, the computational cost of this type of schemes is high, such that HR two-dimensional shallow water simulations with practical relevance have to be run on supercomputers. The porous shallow water model is an alternative approach that aims to reduce computational cost by using a coarse resolution and accounting for unresolved processes by means of the porosity terms. Usually, a speedup between two and three orders of magnitude in comparison to HR simulations can be obtained. This study presents preliminary results of a practical test case concerning pluvial flooding in a district of the city of Nice, France, caused by the intense rainfall event on October 3rd, 2015. HR topography data set on a 1 m resolution is available for the district, whereby street features of infra-metric dimensions have been included. A reference solution is calculated by a HR shallow water model on a 1 m by 1 m structured computational grid. The porous shallow water model is run on a 10 m by 10 m grid and the influence of the drag source term is studied. The model calculations show a large deviation, which is caused by the poor meshing strategy of the porous shallow water (AP) model. The study also summarizes practical challenges that arise during the application of the AP and HR models to a large urban catchment. The main difficulty is to obtain a good mesh. In smaller scale investigations, the mesh is currently constructed by hand such that the cell edges align with buildings. This approach is not feasible for large scale urban catchments with a large number of buildings. Future steps that have to be taken, such as a strategy for automatic mesh generation, are reported on.

42 ENGINEERING↗

DOE OSTI2021

Eulerian simulation of complex suspensions and biolocomotion in three dimensions

Significance Fluid–structure interactions are ubiquitous in many natural and man-made environments. They are difficult to study analytically, and therefore accurate and flexible computational methods are an indispensable tool in the field. Typically, fluids are simulated with a fixed background computational mesh, whereas a solid is simulated with a mesh that moves with it, making it challenging to couple the two. Here we develop a three-dimensional computational method where both fluid and solid can be represented on a fixed computational grid, which simplifies the coupling between the two phases considerably. Our method can simulate scenarios that are difficult to do with other methods, such as complex suspensions containing soft particles that are both heavier and lighter than the fluid.

3D fluid-structure interaction↗

DOE OSTI2022

Numerical error analysis of SOLPS-ITER simulations of EAST

Abstract Plasma edge simulations with codes like SOLPS-ITER are widely employed to interpret fusion experiments. However, numerical errors appearing in such simulations are rarely investigated, despite their potential large impact on simulation results. These errors consist of the statistical error and the bias, both resulting from the finite number of employed EIRENE Monte Carlo particles and incomplete convergence, and the discretization error due to the finite resolution of the computational grids. In this contribution, the resulting numerical errors on simulations of pure deuterium and neon seeded H-mode EAST discharges are examined. The statistical error can be kept small compared to other numerical error contributions by averaging the plasma profiles. This allows investigating the bias and discretization errors using Richardson extrapolation. It is shown that grid refinement and the number of employed Monte Carlo particles have the largest influence on the result, in agreement with similar studies of an ITER deuterium case. For the first time, numerical error bars on the entire simulated target profiles are determined showing that the largest numerical error is 17.9%, mainly due to the plasma grid discretization. On top, also numerical errors on simulated neutral pressures are investigated in detail, for which the statistical error is dominant. The analysis demonstrates which setup is needed to keep numerical errors limited: the SOLPS-ITER averaging procedure should be employed including enough EIRENE particles, and the involved grids should be sufficiently refined to reduce discretization errors.

Boeyaert, Dieter (ORCID:0000000309208660)↗

DOE OSTI2019

STAR Data Production Workflow on HPC: Lessons Learned & Best Practices

The Solenoidal Tracker at RHIC (STAR) is a multi-national supported experiment located at Brookhaven National Lab. The raw physics data captured from the detector is on the order of tens of PBytes per data acquisition campaign, which makes STAR fit well within the definition of a big data science experiment. The production of the data has typically run on standard nodes or on standard Grid computing environments. All embedding simulations (complex workflow mixing real and simulated events) have been run on standard Linux resources at the National Energy Research Scientific Computing Center (NERSC) aka PDSF. However, HPC resources such as Cori have become available for STAR's data production as well as embedding, and STAR has been the very first experiment to show feasibility of running a sustainable data production campaign on this computing resource. The use of Docker containers with Shifter is required to run on HPC @ NERSC - this approach encapsulates the environment in which a standard STAR workflow runs. From the deployment of a tailored Scientific Linux environment (requiring many of its own libraries and special configurations required to run) to the deployment of third-party software and the STAR specific software stack, it has become impractical to rely on a set of containers containing each specific software release. To this extent, solutions based on the CERN VM File System (CVMFS) for the deployment of software and services have been employed in HENP, but one needs to make careful scalability considerations when using a resource like Cori, such as not allowing all software to be deployed in containers or bare node. Additionally, CVMFS clients are not compatible on Cori nodes and one needs to rely on an indirect NFS/DVS mount scheme. In our contribution, we will discuss our strategies from the past and our current solution based on CVMFS. Furthermore, running on HPC is not a simple task as each aspect of the workflow must be enabled to scale, run efficiently, and the workflow needs to fit within the boundaries of the provided queue system (SLURM in this case). Lastly, we will also discuss what we have learned so far about what is the best method for grouping jobs to maximize a single 48 core HPC node within a specific time frame and maximize our workflow efficiency.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

General relativistic simulations of collapsing binary neutron star mergers with Monte Carlo neutrino transport

Recent gravitational wave observations of neutron-star-neutron-star and neutron-star-black-hole binaries appear to indicate that massive neutron stars may not be too uncommon in merging systems. These discoveries have led to an increased interest in the simulation of merging compact binaries involving massive stars. In this paper, we present a first set of evolution of massive neutron star binaries using Monte Carlo radiation transport for the evolution of neutrinos. Here, we study a range of systems, from nearly symmetric binaries that collapse to a black hole before forming a disk or ejecting material, to more asymmetric binaries in which tidal disruption of the lower mass star leads to the production of more interesting postmerger remnants. For the latter type of systems, we additionally study the impact of viscosity on the properties of the outflows, and compare our results to two recent simulations of identical binaries performed with the whiskyTHC code. We find agreement on the black hole properties, disk mass, and mass and velocity of the outflows within expected numerical uncertainties, and some minor but noticeable differences in the evolution of the electron fraction when using a subgrid viscosity model, with viscosity playing a more minor role in our simulations. The method used to account for r-process heating in the determination of the outflow properties appears to have a larger impact on our result than those differences between numerical codes. We also use the simulation with the most ejected material to verify that our newly implemented Lagrangian tracers provide a reasonable sampling of the matter outflows as they leave the computational grid. We note that, given the lack of production of hot outflows in these mergers, the main role of neutrinos in these systems is to set the composition of the postmerger remnant. One of the main potential uses of our simulations is, thus, as improved initial conditions for longer evolutions of such remnants.

79 ASTRONOMY AND ASTROPHYSICS↗