Search NASA⌕ Search

SEARCH · Search NASA

Results for “large scale network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

GPU-enabled extreme-scale turbulence simulations: Fourier pseudo-spectral algorithms at the exascale using OpenMP offloading

Fourier pseudo-spectral methods for nonlinear partial differential equations are of wide interest in many areas of advanced computational science, including direct numerical simulation of three-dimensional (3-D) turbulence governed by the Navier-Stokes equations in fluid dynamics. This paper presents a new capability for simulating turbulence at a new record resolution up to 35 trillion grid points, on the world's first exascale computer, Frontier, comprising AMD MI250x GPUs with HPE's Slingshot interconnect and operated by the US Department of Energy's Oak Ridge Leadership Computing Facility (OLCF). Key programming strategies designed to take maximum advantage of the machine architecture involve performing almost all computations on the GPU which has the same memory capacity as the CPU, performing all-to-all communication among sets of parallel processes directly on the GPU, and targeting GPUs efficiently using OpenMP offloading for intensive number-crunching including 1-D Fast Fourier Transforms (FFT) performed using AMD ROCm library calls. With 99% of computing power on Frontier being on the GPU, leaving the CPU idle leads to a net performance gain via avoiding the overhead of data movement between host and device except when needed for some I/O purposes. Memory footprint including the size of communication buffers for MPI_ALLTOALL is managed carefully to maximize the largest problem size possible for a given node count. Detailed performance data including separate contributions from different categories of operations to the elapsed wall time per step are reported for five grid resolutions, from 2048 3 on a single node to 32768 3 on 4096 or 8192 nodes out of 9408 on the system. Both 1D and 2D domain decompositions which divide a 3D periodic domain into slabs and pencils respectively are implemented. The present code suite (labeled by the acronym GESTS, GPUs for Extreme Scale Turbulence Simulations) achieves a figure of merit (in grid points per second) exceeding goals set in the Center for Accelerated Application Readiness (CAAR) program for Frontier. The performance attained is highly favorable in both weak scaling and strong scaling, with notable departures only for 2048 3 where communication is entirely intra-node, and for 32768 3 , where a challenge due to small message sizes does arise. Communication performance is addressed further using a lightweight test code that performs all-to-all communication in a manner matching the full turbulence simulation code. Performance at large problem sizes is affected by both small message size due to high node counts as well as dragonfly network topology features on the machine, but is consistent with official expectations of sustained performance on Frontier. Overall, although not perfect, the scalability achieved at the extreme problem size of 32768 3 (and up to 8192 nodes — which corresponds to hardware rated at just under 1 exaflop/sec of theoretical peak computational performance) is arguably better than the scalability observed using prior state-of-the-art algorithms on Frontier's predecessor machine (Summit) at OLCF. New science results for the study of intermittency in turbulence enabled by this code and its extensions are to be reported separately in the near future.

3D fast Fourier transform↗

Toward prediction of turbulent atmospheric flows over propagating oceanic waves via machine-learning augmented large-eddy simulation

Wind-wave interactions have important effects on the energy harvesting of offshore wind farms. High-fidelity large-eddy simulation (LES) is a powerful approach for investigating wind-wave interactions in turbulent oceanic environments. Due to the large scale of the flow domain and the high grid resolution required to resolve multi-scale flow motions, however, brute-force LES of wind-wave interactions is computationally very expensive. We propose augmenting brute-force LES via machine-learning data-driven modeling (ML-LES) to dramatically reduce the computational time required to obtain converged turbulence statistics when the brute-force approach is employed. Namely, we employ a convolutional neural network (CNN) autoencoder trained and validated with LES data sets to develop a highly efficient ML-LES approach for computing turbulence statistics from just a few snapshots of instantaneous LES flow fields. Further, our results demonstrate the accuracy and efficiency of ML-LES in predicting the mean velocity, velocity fluctuations, and turbulence kinetic energy in highly stretched computational grid systems required to carry out simulations in real-life oceanic environments.

42 ENGINEERING↗

HydraGNN 2.0

HydraGNN is an Oak Ridge National Laboratory (ORNL)-branded implementation of distributed multi-tasking graph neural networks that supports several scientific applications within the ORNL portfolio to support the US-DOE mission. New or improved capabilities included in v2.0.0 release are as follows: 1) Enhancement in message passing layers through class inheritance 2) Adding transformation to ensure translation and rotation invariance 3) Supporting various optimizers 4) Atomic descriptors 5) Integration with continuous CI test 6) Distributed printouts and timers 7) Profiling 8) Support of ADIOS2 for scalable data loading 9) Large-scale system support, including Summit (ORNL) and Perlmutter (NERSC)

Lupo Pasini, Massimiliano [Oak Ridge National Labo↗

General-Purpose Bayesian Tensor Learning With Automatic Rank Determination and Uncertainty Quantification

A major challenge in many machine learning tasks is that the model expressive power depends on model size. Low-rank tensor methods are an efficient tool for handling the curse of dimensionality in many large-scale machine learning models. The major challenges in training a tensor learning model include how to process the high-volume data, how to determine the tensor rank automatically, and how to estimate the uncertainty of the results. While existing tensor learning focuses on a specific task, this paper proposes a generic Bayesian framework that can be employed to solve a broad class of tensor learning problems such as tensor completion, tensor regression, and tensorized neural networks. We develop a low-rank tensor prior for automatic rank determination in nonlinear problems. Our method is implemented with both stochastic gradient Hamiltonian Monte Carlo (SGHMC) and Stein Variational Gradient Descent (SVGD). We compare the automatic rank determination and uncertainty quantification of these two solvers. We demonstrate that our proposed method can determine the tensor rank automatically and can quantify the uncertainty of the obtained results. We validate our framework on tensor completion tasks and tensorized neural network training tasks.

Bayesian inference↗

Corrigendum and Addendum: Helium flux effects on bubble growth and surface morphology in plasma-facing tungsten from large-scale molecular dynamics simulations (2019 Nucl. Fusion 59 066035)

Two of the simulations discussed in a prior article (Hammond et al 2019 Nucl. Fusion 59 066035) were affected by a simulation glitch. We repeated the affected calculations and discuss them here. Here, the overall conclusions are essentially unchanged, though the details are different. In particular, observations that we referred to as ‘concerted bursting’ were caused primarily by non-physical heating and cooling applied by the thermostat after most atoms’ velocities were deleted (for reasons that are not known for certain). The phenomenon of one bubble bursting and causing another nearby bubble to burst does exist, though its effects are much less spectacular in the absence of non-physical driving forces. The observation of an interconnected network of sub-surface cavities formed by burst bubbles is real, and the observation of holes on the surface 1–2 nm in diameter is also confirmed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

From force chains to nonclassical nonlinear dynamics in cemented granular materials

In this letter, we present evidence for a mechanism responsible for the nonclassical nonlinear dynamics observed in many cemented granular materials that are generally classified as mesoscopic nonlinear elastic materials. We demonstrate numerically that force chains are created within the complex grain-pore network of these materials when subjected to dynamic loading. The interface properties between grains along with the sharp and localized increase of the stress occurring at the grain-grain contacts leads to a reversible decrease of the elastic properties at macroscopic scale and peculiar effects on the propagation of elastic waves when grain boundary properties are appropriately considered. These effects are observed for relatively small amplitudes of the elastic waves, i.e., within tens of microstrain, and relatively large wavelengths, i.e., orders of magnitude larger than the material constituents. The mechanics are investigated numerically using the hybrid finite-discrete-element method and match those observed experimentally using nonlinear resonant ultrasound spectroscopy.

36 MATERIALS SCIENCE↗

Role of interfaces on the mechanical response of accumulative roll bonded nanometallic laminates investigated via dislocation dynamics simulations

Unraveling the effects of continuous dislocation interactions with interfaces, particularly at the nanometer length scales, is key to a broader understanding of plasticity, to material design and to material certification. To this end, this work proposes a novel discrete dislocation dynamics-based model for dislocation interface interactions tracking the fate of residual dislocation on interfaces. This new approach is used to predict the impact of dislocation/interface reactions on the overall mechanical behavior of accumulative roll bonded nanometallic laminates. The framework considers the dynamic evolution of the interface concurrent with a large network of dislocations, thus, accounting for the local short and long range effects of the dislocations under the external boundary conditions. Specifically, this study focuses on two-phase Fe/Cu nanometallic laminates, and investigates the role of the underlying elastic and plastic contrast of the Fe and the Cu layers on the composite response of the material. Moreover, the role of initial microstructures, resulting from processing is also investigated. Subsequently, the model is used to examine the effect of layer thickness and interface orientation relationship on the residual stresses of the relaxed microstructure. The associated mechanical response of these laminates are compared when loaded under normal direction compression, as well as shear compression. Finally, this work predicts a dominant effect of the layer thickness, as compared to the interface orientation relationship, on the macroscopic response and on the residual stresses of these nanolaminates, while the local dislocation transmission propensity through the interface is significantly influenced by the corresponding orientation relationship.

36 MATERIALS SCIENCE↗

Allometric Trophic Networks From Individuals to Socio-Ecosystems: Consumer–Resource Theory of the Ecological Elephant in the Room

A well-known parable is that of the blind men studying an elephant each of which assert the elephant is the part they first hold in their hands, e.g., “rope!” says the tail holder while the leg holder asserts “tree!” The various subdisciplines of ecology appear similar in that we each engage in our enthusiastic but at least somewhat myopic study with remarkably limited agreement or even discussion about the overall system which we all study. Allometric trophic network (ATN) theory offers a path out of this dilemma by integrating across scales, taxa, habitats and organizational levels from physiology to ecosystems based on consumer-resource interactions among co-existing organisms. The network architecture and the metabolic and behavioral processes that determine the structure and dynamics of these interactions form the first principles of ATN theory, which in turn provides a synthetic overview and powerfully predictive framework for ecology from organisms to ecosystems. Beyond ecology, ATN theory also synthesizes eco-evolutionary and socio-ecological research still largely based on consumer-resource mechanisms but respectively integrated with different processes including natural selection and market mechanisms. This paper briefly describes foundations, advances, and future directions of ATN theory including predicting an ecosystem’s phenotype from its community’s genotype in order to accelerate more predictive and unified understanding of the complex systems studied by ecologists and other environmental scientists.

54 ENVIRONMENTAL SCIENCES↗

Towards Quantum-Chemical Level Calculations of SARS-CoV-2 Spike Protein Variants of Concern by First Principles Density Functional Theory

The spike protein (S-protein) is a crucial part of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), with its many domains responsible for binding, fusion, and host cell entry. In this review we use the density functional theory (DFT) calculations to analyze the atomic-scale interactions and investigate the consequences of mutations in S-protein domains. We specifically describe the key amino acids and functions of each domain, which are essential for structural stability as well as recognition and fusion processes with the host cell; in addition, we speculate on how mutations affect these properties. Such unprecedented large-scale ab initio calculations, with up to 5000 atoms in the system, are based on the novel concept of amino acid–amino acid-bond pair unit (AABPU) that allows for an alternative description of proteins, providing valuable information on partial charge, interatomic bonding and hydrogen bond (HB) formation. In general, our results show that the S-protein mutations for different variants foster an increased positive partial charge, alter the interatomic interactions, and disrupt the HB networks. We conclude by outlining a roadmap for future computational research of biomolecular virus-related systems.

60 APPLIED LIFE SCIENCES↗

A mesoscopic link-transmission-model able to track individual vehicles

Macroscopic traffic flow is a common choice for large-scale traffic simulations. These models do not provide individual-specific metrics as outputs. However, this treatment is necessary in agent-based-models, as in, for example, assigning routes based on personal characteristics. Here, in this paper, we propose an extension of the link-transmission-model, an efficient and yet accurate discretization of the Lighthill-Whitham-Richards (LWR) model, which allow vehicles to be tracked individually while keeping the main features of the underlying model. The extension comprises modifying the link and node models to ensure that the flow between links is always at discrete levels. Therefore, every unit of flow is associated with one individual vehicle moving from its current to its next link. An upper bound of the discretization error is provided. We show that the proposed model resembles its continuous counterpart on lane drop, merge, and diverge cases. In addition, we apply the model into three different networks to validate its applicability in large networks. Finally, we also confirm the parameter transferability between continuous and discrete models and that both can well reproduce field data.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Protist diversity and community complexity in the rhizosphere of switchgrass are dynamic as plants develop

Abstract Background Despite their widespread distribution and ecological importance, protists remain one of the least understood components of the soil and rhizosphere microbiome. Knowledge of the roles that protists play in stimulating organic matter decomposition and shaping microbiome dynamics continues to grow, but there remains a need to understand the extent to which biological and environmental factors mediate protist community assembly and dynamics. We hypothesize that protists communities are filtered by the influence of plants on their rhizosphere biological and physicochemical environment, resulting in patterns of protist diversity and composition that mirror previously observed diversity and successional dynamics in rhizosphere bacterial communities. Results We analyzed protist communities associated with the rhizosphere and bulk soil of switchgrass (SG) plants ( Panicum virgatum ) at different phenological stages, grown in two marginal soils as part of a large-scale field experiment. Our results reveal that the diversity of protists is lower in rhizosphere than bulk soils, and that temporal variations depend on soil properties but are less pronounced in rhizosphere soil. Patterns of significantly prevalent protists groups in the rhizosphere suggest that most protists play varied ecological roles across plant growth stages and that some plant pathogenic protists and protists with omnivorous diets reoccur over time in the rhizosphere. We found that protist co-occurrence network dynamics are more complex in the rhizosphere compared to bulk soil. A phylogenetic bin-based null model analysis showed that protists’ community assembly in our study sites is mainly controlled by homogenous selection and dispersal limitation, with stronger selection in rhizosphere than bulk soil as SG grew and senesced. Conclusions We demonstrate that environmental filtering is a dominant determinant of overall protist community properties and that at the rhizosphere level, plant control on the physical and biological environment is a critical driver of protist community composition and dynamics. Since protists are key contributors to plant nutrient availability and bacterial community composition and abundance, mapping and understanding their patterns in rhizosphere soil is foundational to understanding the ecology of the root-microbe-soil system.

54 ENVIRONMENTAL SCIENCES↗

Architecture for Web-Based Visualization of Large-Scale Energy Domains: Preprint

With the growing penetration of inverter-based distributed energy resources and increased loads through electrification, power systems analyses are becoming more important and more complex. Moreover, these analyses increasingly involve the combination of interconnected energy domains with data that are spatially and temporally increasing in scale by orders of magnitude, surpassing the capabilities of many existing analysis and decision-support systems. We present the architectural design, development, and application of a high-resolution web-based visualization environment capable of cross-domain analysis of tens of millions of energy assets, focusing on scalability and performance. Our system supports the exploration, navigation, and analysis of large data from diverse domains such as electrical transmission and distribution systems, mobility and electric vehicle charging networks, communications networks, cyber assets, and other supporting infrastructure. We evaluate this system across multiple use cases, describing the capabilities and limitations of a web-based approach for high-resolution energy system visualizations.

grid modernization↗

Computationally efficient models for aqueous organic redox flow batteries

The rising usage of intermittent energy has garnered the need for large scale energy storage systems. Redox flow batteries (RFB) based energy storage system shows promising potential. Numerical simulations and machine learning approaches have been widely used to study RFB performance. The development of autonomous material discovery framework and digital twin of energy storage system usually needs to query cell performance through fast response models. In this study, two computationally efficient models are introduced: a physics-based analytical flow battery model (EZBattery), and a machine learning operator model (Deep Operator Network, denoted by DeepONet). Both models can provide cell performance near instantly, and prediction accuracy was systematically examined on an application of evaluating the performances of a 780 cm 2 aqueous organic redox flow battery (AORFB), using potential anolyte candidates in dihydroxyphenazine (DHP)-based family of organic materials. A validated computationally expansive 3-dimensional multi-physics finite element model by COMSOL was used as the ground truth and provided the training data set for the DeepONet. 1280 samples were generated with 10 properties to mimic the different possible anolyte candidates, and the cell performances were evaluated under 10 different combined operating conditions. The accuracy comparisons for the two computationally efficient models show that both models can provide comparable accuracy in predicting cell charging/discharging voltage curves. DeepONet can provide slightly higher overall accuracy than EZBattery with faster calculation speed, but highly relies on the training dataset. EZBattery does not need a training dataset and can provide interpretable physics-based explanations of the results, while being more flexible to adjust to adapt any different cell designs, flow battery architectures, and electrolyte materials.

Analytical model↗

Electromagnetic energy calibration of the SoLid detector with horizontal muons

SoLid is a neutrino experiment at very-short baselinesearching for active-to-sterile oscillations of reactorantineutrinos. The detection principle is based on the pairing oftwo types of solid scintillators: polyvinyl toluene and $^{6}$Li:ZnS(Ag), which is a new technology used in this field ofPhysics. In addition to good neutron-gamma discrimination, thissetup allows the detector to be highly segmented; the basicdetection unit is a 5 cm cube. High segmentation provides numerousadvantages including precise localisation of the Inverse Beta Decay(IBD) products, the derivation of an antineutrino energy estimatorbased on the isolated positron energy, and a powerful backgroundreduction tool that relies on the topological signature of thesignal. Finally, the system is read out by a network ofwavelength-shifting fibres coupled to photosensors. A relativeelectromagnetic calibration is performed with horizontal cosmicmuons. This source poses the simplest calibration problem in which asingle detection unit is involved. In addition, large muon energydeposits allow us to perform a calibration at the most detailedlevel (i.e. per fibre) and to accurately define the fraction ofenergy escaping to neighbouring detection cells. A statisticalprecision at the sub-percent level is reached. The paper alsodiscusses two methods to calibrate the absolute energy scale andpresents their implementation and results. The first method relieson horizontal muons, though the precision is limited to around 10%because of the uncertainty in the energy distribution of suchmuons. A novel, alternative method based on the radioactiveamericium-beryllium source is proposed. It takes advantage of theelectron-positron pair-production process and provides a calibrationpoint at 3.4 MeV (i.e. in the core of the IBD positronspectrum). The paper is concluded with various cross-check includinga determination of the energy spectrum of the standard cosmogenicbackground candle: $^{12}$B.

Abreu, Y. [Antwerp U.]↗

Design Considerations and Analysis of Multi-Level Erasure Coding in Large-Scale Data Centers

Multi-level erasure coding (MLEC) has seen large deployments in the field, but there is no in-depth study of design considerations for MLEC at scale. In this paper, we provide comprehensive design considerations and analysis of MLEC at scale. We introduce the design space of MLEC in multiple dimensions, including various code parameter selections, chunk placement schemes, and various repair methods. We quantify their performance and durability, and show which MLEC schemes and repair methods can provide the best tolerance against independent/correlated failures and reduce repair network traffic by orders of magnitude. To achieve this, we use various evaluation strategies including simulation, splitting, dynamic programming, and mathematical modeling. We also compare the performance and durability of MLEC with other EC schemes such as SLEC and LRC and show that MLEC can provide high durability with higher encoding throughput and less repair network traffic over both SLEC and LRC.

Wang, Meng↗

Energy-efficient, Large-scale Molecular Dynamics Simulations via Hardware- and Algorithm-level Optimization

This work aims to develop a framework for energy-efficient computing that will enable molecular dynamics (MD) simulations of large-scale phenomena with atomic precision and simultaneously remove computational bottlenecks limiting the speed of MD simulations. We seek to implement such an approach through the development of surrogate models for the interatomic force calculation combined with the use of mixed numerical precision formats. For a model system of neutral atoms (only pairwise interactions), significant force calculation efficiency improvements were achieved, without detrimental effects on atomic structures or average energies, using single precision, by developing a surrogate model (deep neural network), and by quantizing this surrogate model. For a model system of charged atoms, the reciprocal-space calculation of electrostatic interactions was identified as the main bottleneck, and the development of a surrogate model should be pursued to achieve an estimated one-order-of-magnitude additional speedup.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Measurement-informed Dynamic Aggregation of Distribution Systems

This paper proposes a measurement-informed dynamic aggregation methodology in order to create equivalent representations of distribution systems that are compatible with large-scale transmission analysis. By optimizing an equivalent feeder parameters using time-series measurements of active power, reactive power, and voltage at the Point of Interconnection (POI), the approach yields simplified yet dynamically accurate equivalents. Implemented in PSCAD with models of photovoltaic–battery systems, three-phase motors, and static loads, the method employs hybrid differential evolution and bounded least-squares optimization laying the foundation for for real-time state estimation and optimized sensor placement in distribution networks.

Ahmed, Kazi Ishrak [University of Tennessee, Knoxv↗