Search NASA⌕ Search

SEARCH · Search NASA

Results for “parallel, scaling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,711 records · Page 95
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Progress and R/D challenges for FCC-ee SRF

The FCC-ee machines present a huge challenge for the RF systems, which need to be adapted to very diverse beam conditions going from moderate energy and high current for the Z machine to high energy and low beam current for the ttbar. This inverse scaling results naturally from a fixed budget for the synchrotron radiation, which the SRF cavities need to compensate. A global solution was elaborated for the FCC Conceptual Design Report (Abada in Eur Phys J Spec Top 228):261–623, 2019), and is referred here as the baseline. Recently, further studies have led to a new optimized baseline, still based on traditional elliptical cavities. In parallel, a novel concept, named the Slotted Waveguide ELLiptical (SWELL), was proposed with the potential of greatly simplified logistics and reduced costs. Under several aspects, all these changes call for enhanced performance of the RF systems. A vigorous R&D program has therefore continued since the publication of the CDR, with the aim of pushing the performance and demonstrating the feasibility of a more advanced baseline and, more recently, of the SWELL option. The progress and challenges of this ambitious program were presented in the dedicated SRF sessions at FCC week 2022 and are summarized in this paper.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Initial Developments in Modeling Graphite Behavior

Graphite is used in High Temperature Reactor designs as a moderator, reflector and core material responsible for protecting the fuel and maintaining structural stability. From a safety perspective, it is imperative to be able to predict how graphite will behave under reactor operating conditions which may compromise the core’s structural integrity or fuel’s safety performance. The following report summarizes recent modeling work undertaken at Idaho National Laboratory which focuses on graphite degradation behavior. One phenomenon which is explored in this report and can cause significant degradation to graphite properties is oxidation. Oxidation behavior in graphite is highly temperature dependent. At low temperatures, oxygen can fully penetrate a component and cause a homogeneous damage profile. At high temperatures, only the graphite near the surface of a component is affected. Understanding and modeling this temperature dependence is essential to predicting graphite behavior. In this report, three graphite models are discussed. The first model is used to investigate strength loss after low temperature oxidation. It does this by generating an approximate graphite microstructure then determining the required load to cause crack propagation. It has been shown that the model reproduces the quasi brittle stress versus strain relationship observed in graphite. Strength loss results from the model are shown to match experimental values. The second model investigates strength loss under high temperature oxidation conditions. This model is more applicable to full scale graphite components where the oxidation damage is often inhomogeneous throughout a component. The third model computes stresses in graphite under reactor conditions. Specifically, the model incorporates the effect of creep, irradiation dose, thermal strains, and oxidation in order to predict internal stresses in a component. All of these models are implemented in the Multiphysics Object-Oriented Simulation Environment (MOOSE), an open source, parallel finite element framework.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

GPU-enabled extreme-scale turbulence simulations: Fourier pseudo-spectral algorithms at the exascale using OpenMP offloading

Fourier pseudo-spectral methods for nonlinear partial differential equations are of wide interest in many areas of advanced computational science, including direct numerical simulation of three-dimensional (3-D) turbulence governed by the Navier-Stokes equations in fluid dynamics. This paper presents a new capability for simulating turbulence at a new record resolution up to 35 trillion grid points, on the world's first exascale computer, Frontier, comprising AMD MI250x GPUs with HPE's Slingshot interconnect and operated by the US Department of Energy's Oak Ridge Leadership Computing Facility (OLCF). Key programming strategies designed to take maximum advantage of the machine architecture involve performing almost all computations on the GPU which has the same memory capacity as the CPU, performing all-to-all communication among sets of parallel processes directly on the GPU, and targeting GPUs efficiently using OpenMP offloading for intensive number-crunching including 1-D Fast Fourier Transforms (FFT) performed using AMD ROCm library calls. With 99% of computing power on Frontier being on the GPU, leaving the CPU idle leads to a net performance gain via avoiding the overhead of data movement between host and device except when needed for some I/O purposes. Memory footprint including the size of communication buffers for MPI_ALLTOALL is managed carefully to maximize the largest problem size possible for a given node count. Detailed performance data including separate contributions from different categories of operations to the elapsed wall time per step are reported for five grid resolutions, from 2048 3 on a single node to 32768 3 on 4096 or 8192 nodes out of 9408 on the system. Both 1D and 2D domain decompositions which divide a 3D periodic domain into slabs and pencils respectively are implemented. The present code suite (labeled by the acronym GESTS, GPUs for Extreme Scale Turbulence Simulations) achieves a figure of merit (in grid points per second) exceeding goals set in the Center for Accelerated Application Readiness (CAAR) program for Frontier. The performance attained is highly favorable in both weak scaling and strong scaling, with notable departures only for 2048 3 where communication is entirely intra-node, and for 32768 3 , where a challenge due to small message sizes does arise. Communication performance is addressed further using a lightweight test code that performs all-to-all communication in a manner matching the full turbulence simulation code. Performance at large problem sizes is affected by both small message size due to high node counts as well as dragonfly network topology features on the machine, but is consistent with official expectations of sustained performance on Frontier. Overall, although not perfect, the scalability achieved at the extreme problem size of 32768 3 (and up to 8192 nodes — which corresponds to hardware rated at just under 1 exaflop/sec of theoretical peak computational performance) is arguably better than the scalability observed using prior state-of-the-art algorithms on Frontier's predecessor machine (Summit) at OLCF. New science results for the study of intermittency in turbulence enabled by this code and its extensions are to be reported separately in the near future.

3D fast Fourier transform↗
DOE OSTI2018

Argo Observations of the Deep Mixing Band in the Southern Ocean: A Salinity Modeling Challenge

The Southern Ocean plays an important role in mediating oceanic uptake of CO 2 and heat due to a strong meridional overturning circulation. Gridded Argo float data for 2004–2017 were used to evaluate subsurface processes at the mixed layer depth (MLD) that occur in a narrow deep mixing band. Shifts in the value of the Turner Angle at the MLD indicate that early in the season the MLD deepens slowly as it encounters and is stabilized by a subsurface salt maximum. By September mixing has penetrated this salinity feature and the rate of deepening is faster once the MLD is deeper than the depth where the maximum salinity occurs (~150–200 m). This distinctive salinity layer is the result of surface Ekman transport of fresh water from the south and subsurface advection of high-salinity water from the north. Two configurations of the Community Earth System Model (CESM) ocean-ice forced hindcast experiments—one with 1° and the other with 0.1° horizontal resolution (Parallel Ocean Program low and high resolutions [POP-LR and POP-HR], respectively)—are compared with the Argo data for 2005–2009. POP-LR has a shallow MLD bias common to many Fifth Coupled Models Intercomparison Project (CMIP5) models, while POP-HR has a mix of deep and shallow MLD biases. While both models were able to replicate the large-scale processes leading to formation of a high-salinity layer, the salinity feature in POP-HR is too strong and deep. Neither model was able to replicate the vertical mixing processes leading to penetration of the subsurface salt maximum.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Unconventional short-range structural fluctuations in cuprate superconductors

Abstract The interplay between structural and electronic degrees of freedom in complex materials is the subject of extensive debate in physics and materials science. Particularly interesting questions pertain to the nature and extent of pre-transitional short-range order in diverse systems ranging from shape-memory alloys to unconventional superconductors, and how this microstructure affects macroscopic properties. Here we use neutron and X-ray diffuse scattering to uncover universal structural fluctuations in La 2-x Sr x CuO 4 and Tl 2 Ba 2 CuO 6+δ , two cuprate superconductors with distinct point disorder effects and with optimal superconducting transition temperatures that differ by more than a factor of two. The fluctuations are present in wide doping and temperature ranges, including compositions that maintain high average structural symmetry, and they exhibit unusual, yet simple scaling behaviour. The scaling regime is robust and universal, similar to the well-known critical fluctuations close to second-order phase transitions, but with a distinctly different physical origin. We relate this behaviour to pre-transitional phenomena in a broad class of systems with structural and magnetic transitions, and propose an explanation based on rare structural fluctuations caused by intrinsic nanoscale inhomogeneity. We also uncover parallels with superconducting fluctuations, which indicates that the underlying inhomogeneity plays an important role in cuprate physics.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2016

Preferential heating of oxygen 5{sup +} ions by finite-amplitude oblique Alfvén waves

Minor ions in the fast solar wind are known to have higher temperatures and to flow faster than protons in the interplanetary space. In this study we combine previous research on parametric instability theory and 2.5D hybrid simulations to study the onset of preferential heating of Oxygen 5{sup +} ions by large-scale finite-amplitude Alfvén waves in the collisionless fast solar wind. We consider initially non-drifting isotropic multi-species plasma, consisting of isothermal massless fluid electrons, kinetic protons and kinetic Oxygen 5{sup +} ions. The external energy source for the plasma heating and energization are oblique monochromatic Alfvén-cyclotron waves. The waves have been created by rotating the direction of initial parallel pump, which is a solution of the multi-fluid plasma dispersion relation. We consider propagation angles θ ≤ 30°. The obliquely propagating Alfvén pump waves lead to strong diffusion in the ion phase space, resulting in highly anisotropic heavy ion velocity distribution functions and proton beams. We discuss the application of the model to the problems of preferential heating of minor ions in the solar corona and the fast solar wind.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Investigating nonlinear magnetohydrodynamics in an optimized, reactor-scale quasi-axisymmetric stellarator

We use the new simulation capabilities of the extended-magnetohydrodynamic (MHD) code, M3D-C1, to investigate the nonlinear MHD properties of a reactor-scale quasisymmetric stellarator equilibrium. Our model captures the self-consistent evolution of the magnetic field, temperature, density, and flow profiles without imposing restrictions on the structure of the first. We include the effects of resistivity using a realistic temperature-dependent Spitzer model, along with a model for heat transport that captures the key physical characteristic, namely, strongly anisotropic diffusion in directions perpendicular and parallel to the magnetic field. We consider a quasi-axisymmetric, finite-pressure equilibrium that was optimized for self-consistent bootstrap current, quasi-symmetry, and energetic particle confinement. Our assessment finds that the equilibrium is highly unstable to interchange-like pressure-driven instabilities near the plasma edge. The initially unstable modes rapidly destabilize other modes in the direction of the N-fold rotational symmetry (toroidal, in this case). For this equilibrium, N = 2, meaning destabilization of a large number of even-numbered toroidal Fourier modes. Thus, field-periodicity is likely to be an important factor in the nonlinear MHD stability characteristics of optimized stellarators.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Online and Scalable Data Compression Pipeline with Guarantees on Quantities of Interest

Data compression is becoming critical for data-intensive scientific applications. Scientists require compression techniques that accurately preserve derived quantities of interest (QoIs). Prior work has shown that a pipeline can be built to guarantee error on the primary data (PD) within user-defined bounds and achieve near-floating point QoI errors. In this paper, we present novel computational approaches for accelerating the pipeline and demonstrate results that enable concurrent execution of compression in parallel with the simulation nodes. This allows compression, including the writing of the required compression data, for the previous time step to be completed while the simulation proceeds with the current time step. Overall, the approach presented in this paper results in a 6–8 times improvement in computational overhead compared to previous work. These results were obtained using data generated by a large-scale fusion code called XGC, which produces hundreds of terabytes of data in a single day.

Banerjee, Tania↗
DOE OSTI2024

Radiological Source Term Estimation and Isotopic Identification with Parallel Log Domain Particle Filters

This paper presents a parallel log-domain particle filtering algorithm combined with gamma spectrum unfolding to perform localization, identification, and evaluation of multiple point sources of various isotopes in an environment with attenuating obstacles. The method uses sets of precomputed attenuation kernels that map the attenuation characteristics of the environment. These kernels are specific to the energy level of a photopeak of interest. The spectral measurements are deconvolved into count measurements of each photopeak. These count measurements are fed into a set of parallel particle filters using attenuation kernels computed for that photopeak’s energy level. The individual regularized particle filters perform all likelihood calculations in the logarithmic domain to mitigate the effects of particle degeneracy. The output of each particle filter is combined to estimate which isotopes are present as well as their positions and strengths. The performance of the algorithm is characterized in a lab-scale environment using a mobile robot equipped with a gamma ray spectrometer in the presence of up to three different radioactive isotopes simultaneously. The sources were localized to within 10 cm, and their strengths were estimated within 10% of their true values. Furthermore, the isotopes were all correctly identified, and no spurious sources were reported.

42 ENGINEERING↗
DOE OSTI2024

Distributed Augmentation, Hypersweeps, and Branch Decomposition of Contour Trees for Scientific Exploration

Contour trees describe the topology of level sets in scalar fields and are widely used in topological data analysis and visualization. A main challenge of utilizing contour trees for large-scale scientific data is their computation at scale using highperformance computing. To address this challenge, recent work has introduced distributed hierarchical contour trees for distributed computation and storage of contour trees. However, effective use of these distributed structures in analysis and visualization requires subsequent computation of geometric properties and branch decomposition to support contour extraction and exploration. In this work, we introduce distributed algorithms for augmentation, hypersweeps, and branch decomposition that enable parallel computation of geometric properties, and support the use of distributed contour trees as query structures for scientific exploration. Finally, we evaluate the parallel performance of these algorithms and apply them to identify and extract important contours for scientific visualization.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Scalable Asynchronous Domain Decomposition Solvers

We discuss how parallel implementations of linear iterative solvers generally alternate between phases of data exchange and phases of local computation. Increasingly large problem sizes and more heterogeneous compute architectures make load balancing and the design of low latency network interconnects that are able to satisfy the communication requirements of linear solvers very challenging tasks. In particular, global communication patterns such as inner products become increasingly limiting at scale. We explore the use of asynchronous communication based on one-sided Message Passing Interface primitives in the context of domain decomposition solvers. In particular, a scalable asynchronous two-level Schwarz method is presented. We discuss practical issues encountered in the development of a scalable solver and show experimental results obtained on a state-of-the-art supercomputer system that illustrate the benefits of asynchronous solvers in load balanced as well as load imbalanced scenarios. Using the novel method, we can observe speedups of up to four times over its classical synchronous equivalent.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

A New Superalloy Enabling Heavy Duty Gas Turbine Wheels for Improved Combined Cycle Efficiency

The drive to increase combined cycle turbine efficiency from 62% to 65% for the next-generation advanced cycle requires a new heavy duty gas turbine wheel material capable of operating at 1200°F and above. Current wheel materials are limited by the stability of their major strengthening phase (gamma double prime), which coarsens at temperatures approaching 1200°F, resulting in a substantial reduction in strength. More advanced gamma prime superalloys, such as those used in jet engine turbine disks, are also not suitable due to size constraints; the gamma prime phase overages during the slow cooling rates inherent in processing thick-section turbine wheels. The current program addresses this need by screening two new alloy design concepts. The first concept exploits a gamma prime/gamma double prime coprecipitation reaction. Through manipulation of alloy chemistry, coprecipitation is controlled such that gamma double prime is used only to slow the growth of gamma prime during slow cooling, preventing over-aging, and allowing for subsequent heat treatment to maximize strength. In parallel, phase field modeling provides fundamental understanding of the coprecipitation reaction. The second concept uses oxide dispersion strengthening to improve on two existing alloys that exhibit excellent hold time fatigue crack growth resistance, but have insufficient strength to be considered for gas turbine wheels. Mechanical milling forces the dissolution of starting oxide powders into a metal matrix allowing for solid state precipitation of new, nanometer scale oxides that are effective at dispersion strengthening.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Planar Collisionless Shock Simulations with the Semi-implicit Particle-in-cell Model FLEKS

This study investigates the applicability of the semi-implicit particle-in-cell code FLexible Exascale Kinetic Simulator (FLEKS) to heliospheric shock simulations. We examine one- and two-dimensional local planar shock simulations, initialized using MHD states with upstream conditions representative of plasmas in the hypersonic, β ∼ 1 regime, for both quasi-perpendicular and quasi-parallel configurations. The refined algorithm in FLEKS proves robust, enabling accurate shock simulations with a grid resolution on the order of the electron inertial length d e . Our simulations successfully capture key shock features, including shock structures (foot, ramp, overshoot, and undershoot), upstream and downstream waves (fast magnetosonic, whistler, Alfvén ion-cyclotron, and mirror modes), and non-Maxwellian particle distributions. Crucially, we find that at least two spatial dimensions are critical for accurately reproducing downstream-wave physics in quasi-perpendicular shocks and capturing the complex dynamics of quasi-parallel shocks, including surface rippling, shocklets, short, large-amplitude magnetic structures, magnetic reconnection, and jets. Furthermore, our parameter studies demonstrate the impact of mass ratio and grid resolution on shock physics. This work provides valuable guidance for selecting appropriate physical and numerical parameters for shock simulations using a semi-implicit PIC method, paving the way for incorporating kinetic shock processes into large-scale collisionless plasma simulations with the MHD-AEPIC model.

plasma astrophysics↗
DOE OSTI2017

The fusion code XGC: Enabling kinetic study of multi-scale edge turbulent transport in ITER

The XGC fusion gyrokinetic code combines state-of-the-art, portable computational and algorithmic technologies to enable complicated multiscale simulations of turbulence and transport dynamics in ITER edge plasma on the largest US open-science computer, the CRAY XK7 Titan, at its maximal heterogeneous capability, which have not been possible before due to a factor of over 10 shortage in the time-to-solution for less than 5 days of wall-clock time for one physics case. Frontier techniques such as nested OpenMP parallelism, adaptive parallel I/O, staging I/O and data reduction using dynamic and asynchronous applications interactions, dynamic repartitioning.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2019

Scaling and Quality of Modularity Optimization Methods for Graph Clustering

Real-world graphs exhibit structures known as “communities” or “clusters” consisting of a group of vertices with relatively high connectivity between them, as compared to the rest of the vertices in the network. Graph clustering or community detection is a fundamental graph operation used to analyze real-world graphs occurring in the areas of computational biology, cybersecurity, electrical grids, etc. Similar to other graph algorithms, owing to irregular memory accesses and inherently sequential nature, current algorithms for community detection are challenging to parallelize. However, in order to analyze large networks, it is important to develop scalable parallel implementations of graph clustering that are capable of exploiting the architectural features of modern supercomputers. In response to the 2019 Streaming Graph Challenge, we present quality and performance analysis of our distributed- memory community detection using Vite, which is our distributed memory implementation of the popular Louvain method, on the ALCF Theta supercomputer. Clustering methods such as Louvain that rely on modularity maximization are known to suffer from the resolution limit problem, preventing identification of clusters of certain sizes. Hence, we also include quality analysis of our shared-memory implementation of the Fast-tracking Resistance method, in comparison with Louvain on the challenge datasets. Furthermore, we introduce an edge-balanced graph distribution for our distributed memory implementation, that significantly reduces communication, offering up to 80% improvement in the overall execution time. In addition to performance/quality analysis, we also include details on the power/energy consumption, and memory traffic of the distributed-memory clustering implementation using real-world graphs with over a billion edges.

Ghosh, Sayan↗
DOE OSTI2017

Investigation of high-speed shaft bearing loads in wind turbine gearboxes through dynamometer testing

Many wind turbine gearboxes require repair or replacement well before reaching the end of their design life. The most common failure is bearing axial cracks, commonly called white etching cracks (WECs), which typically occur in the inner raceways of the high-speed parallel-stage rolling element bearings. Although the root causes of WECs are debated, one theory is that they are related to routine dynamic operating conditions and occasional transient events prevalent in wind turbines that can result in high bearing stress and sliding of the rolling elements. Here, this paper examined wind turbine gearbox high-speed shaft bearing loads and stresses through modeling and full-scale dynamometer testing. Bearing outer race loads were directly measured and predicted using a variety of modeling tools in normal operations, misaligned conditions, and transient events particularly prone to bearing sliding. Test data and models of bearing loads were well correlated. Neither operational misalignment due to rotor moments nor static generator misalignment affected the bearing loads when compared with pure-torque conditions. Thus, it is not likely that generator misalignment is a causal factor of WECs. In contrast, during transient events, the bearings experienced alternating periods of high stress, torque reversals, and loads under the minimum requisite at high rotating speeds while showing indications of sliding, all of which could be related to the formation of WECs.

17 WIND ENERGY↗
DOE OSTI2025

Randomized Preconditioned Solvers for Strong Constraint 4D-Var Data Assimilation

The Strong Constraint 4D Variational (SC-4DVAR) data assimilation method is widely used in climate and weather applications. SC-4DVAR involves solving a minimization problem to compute the maximum a posteriori estimate, which we tackle using the Gauss-Newton method. The computation of the descent direction is expensive since it involves the solution of a large-scale and potentially ill-conditioned linear system, solved using the preconditioned conjugate gradient (PCG) method. Here, to address this cost, we efficiently construct scalable preconditioners using three different randomization techniques, which all rely on a certain low-rank structure involving the Gauss-Newton Hessian. The proposed techniques come with theoretical guarantees on the condition number, and at the same time, are amenable to parallelization. We also develop an adaptive approach to estimate the sketch size and choose between the reuse or recomputation of the preconditioner. We demonstrate the performance and effectiveness of our methodology on two representative model problems—the Burgers and barotropic vorticity equation—showing a drastic reduction in both the number of PCG iterations and the number of Gauss-Newton Hessian products after including the preconditioner construction cost.

Gauss-Newton↗
DOE OSTI2026

Benchmarking of massively parallel phase-field codes for directional solidification

We present a detailed benchmark comparing two state-of-the-art phase-field implementations for simulating alloy solidification under experimentally relevant conditions. The study investigates the directional solidification of Al-3wt%Cu under high-velocity solidification conditions and SCN-0.46wt% camphor under microgravity conditions from National Aeronautics and Space Administration (NASA) DECLIC-DSI-R experiments. Both codes, one employing finite-difference discretization with uniform mesh and GPU-acceleration (GPU-PF) and the other one employing finite-element discretization with adaptive-mesh and CPU-parallelization (PRISMS-PF), solve the same quantitative phase-field formulation that incorporates an anti-trapping current for the solidification of dilute alloys. We evaluate the predictions of each code for dendritic morphology, primary spacing, and tip dynamics in both 2D and 3D, as well as their numerical convergence and computational performance. While existing benchmark problems have primarily focused on simplified or small-scale simulations, they do not reflect the computational and modeling challenges posed by employing experimentally relevant time and length scales. Our results provide a practical framework for assessing phase-field code performance as well as validating and facilitating their application in integrated computational materials engineering (ICME) workflows that require integration with realistic experimental data.

36 MATERIALS SCIENCE↗