Search NASA⌕ Search

SEARCH · Search NASA

Results for “Large Scale Simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

FCP: A Fast and Scalable Data Copy Tool for High Performance Parallel File Systems

The design of HPC file and storage systems has largely been driven by the requirements on capability, reliability, and capacity. However, the convergence of large-scale simulations with big data analytics have put the data, its usability, and management back on the front and center position. One of the most common and time consuming data management tasks is the transfer of very large datasets within and across file systems.In this paper, we are introducing the FCP tool, a file system agnostic copy tool designed at the OLCF for scalable and high-performance data transfers between two file system endpoints. It provides an array of interesting features such as adaptive chunking, checksumming on the fly, checkpoint and resume capabilities to handle failures, and preserving stripe information for Lustre file system among others. It is currently available on the Titan supercomputer at the OLCF. Initial tests have shown that FCP has much better and scalable performance than traditional data copy tools and it was capable of transferring petabyte-scale datasets between two Lustre file systems.

Wang, Feiyi↗

Job Management with mpi_jm

About this book: This book constitutes the refereed post-conference proceedings of 13 workshops held at the 33rd International ISC High Performance 2018 Conference, in Frankfurt, Germany, in June 2018: HPC I/O in the Data Center, HPC-IODC 2018; Workshop on Performance and Scalability of Storage Systems, WOPSSS 2018; 13th Workshop on Virtualization in High­-Performance Cloud Computing, VHPC 2018; Third International Workshop on In Situ Visualization, WOIV 2018; 4th International Workshop on Communication Architectures for HPC, Big Data, Deep Learning and Clouds at Extreme Scale, ExaComm 2018; International Workshop on OpenPOWER for HPC, IWOPH 2018; IXPUG Workshop: Many-Core Computing on Intel Processors; Workshop on Sustainable Ultrascale Computing Systems; Approximate and Transprecision Computing on Emerging Technologies, ATCET 2018; First Workshop on the Convergence of Large-Scale Simulation and Artificial Intelligence; Third Workshop for Open Source Supercomputing, OpenSuCo 2018; First Workshop on Interactive High-Performance Computing; Workshop on Performance Portable Programming Models for Accelerators, P^3MA 2018. The 53 full papers included in this volume were carefully reviewed and selected from 80 submissions. They cover all aspects of research, development, and application of large-scale, high performance experimental and commercial systems. Topics include HPC computer architecture and hardware; programming models, system software, and applications; solutions for heterogeneity, reliability, power efficiency of systems; virtualization and containerized environments; big data and cloud computing; and artificial intelligence.

Berkowitz, Evan↗

Molecular-scale insights into the electrical double layer at oxide-electrolyte interfaces

The electrical double layer (EDL) at metal oxide-electrolyte interfaces critically affects fundamental processes in water splitting, batteries, and corrosion. However, limitations in the microscopic-level understanding of the EDL have been a major bottleneck in controlling these interfacial processes. Herein, we use ab initio-based machine learning potential simulations incorporating long-range electrostatics to unravel the molecular-scale picture of the EDL at the prototypical anatase TiO 2 -electrolyte interface under various pH conditions. Our large-scale simulations, capable of capturing interfacial water dissociation/recombination reactions and electrolytic proton transport, provide unprecedented insights into the detailed structure of the EDL. Moreover, the larger capacitance of the EDL under basic relative to acidic conditions, originating from the higher affinity of the cations for the oxide surface, is found to give rise to distinct charging mechanisms on negative and positive surfaces. Our results are validated by the agreement between the computed EDL capacitance and experimental data.

Chemical physics↗

DETECTING THE RISE AND FALL OF THE FIRST STARS BY THEIR IMPACT ON COSMIC REIONIZATION

The intergalactic medium was reionized before redshift z {approx} 6, most likely by starlight which escaped from early galaxies. The very first stars formed when hydrogen molecules (H{sub 2}) cooled gas inside the smallest galaxies, minihalos (MHs) of mass between 10{sup 5} and 10{sup 8} M{sub Sun }. Although the very first stars began forming inside these MHs before redshift z {approx} 40, their contribution has, to date, been ignored in large-scale simulations of this cosmic reionization. Here we report results from the first reionization simulations to include these first stars and the radiative feedback that limited their formation, in a volume large enough to follow the crucial spatial variations that influenced the process and its observability. We show that, while MH stars stopped far short of fully ionizing the universe, reionization began much earlier with MH sources than without, and was greatly extended, which boosts the intergalactic electron-scattering optical depth and the large-angle polarization fluctuations of the cosmic microwave background significantly. This boost should be readily detectable by Planck, although within current Wilkinson Microwave Anisotropy Probe uncertainties. If reionization ended as late as z{sub ov} {approx}< 7, as suggested by other observations, Planck will thereby see the signature of the first stars at high redshift, currently undetectable by other probes.

79 ASTRONOMY AND ASTROPHYSICS↗

Neutrino fast flavor oscillations with moments: Linear stability analysis and application to neutron star mergers

Providing an accurate modeling of neutrino physics in dense astrophysical environments such as binary neutron star mergers presents a challenge for hydrodynamic simulations. Nevertheless, understanding how flavor transformation can occur and affect the dynamics, the mass ejection, and the nucleosynthesis will need to be achieved in the future. Computationally expensive, large-scale simulations frequently evolve the first classical angular moments of the neutrino distributions. By promoting these quantities to matrices in flavor space, we develop a linear stability analysis of fast flavor oscillations using only the first two “quantum” moments, which notably requires generalizing the classical closure relations that appropriately truncate the hierarchy of moment equations in order to treat quantum flavor coherence. After showing the efficiency of this method on a well-understood test situation, we perform a systematic search of the occurrence of fast flavor instabilities in a neutron star merger simulation. Here, we discuss the successes and shortcomings of moment linear stability analysis, as this framework provides a time-efficient way to design and study better closure prescriptions in the future.

79 ASTRONOMY AND ASTROPHYSICS↗

Atomistic Mechanism Underlying the Si ( 111 ) - ( 7 × 7 ) Surface Reconstruction Revealed by Artificial Neural-Network Potential

The 7×7 reconstruction of the Si(111) surface represents arguably the most fascinating surface reconstruction so far observed in nature. Yet, the atomistic mechanism underpinning its formation remains unclear after it was discovered sixty years ago. Experimentally, it is observed post priori so that analysis of its formation mechanism can only be carried out in analogy with archaeology. Theoretically, density-functional theory (DFT) correctly predicts the Si(111)-(7×7) ground state but is impractical to simulate its formation process; while empirical potentials failed to produce it as the ground state. Developing an artificial neural-network potential of DFT quality, we carried out accurate large-scale simulations to unravel the formation of the Si(111)-(7×7) surface. We reveal a possible step-mediated atom-pop rate-limiting process that triggers massive nonconserved atomic rearrangements, most remarkably, a critical process of collective vacancy diffusion that mediates a sequence of selective dimer, corner-hole, stacking-fault, and dimer-line pattern formation, to fulfill the 7×7 reconstruction. Our findings may not only solve the long-standing mystery of this famous surface reconstruction but they also illustrate the power of machine learning in studying complex structures.

36 MATERIALS SCIENCE↗

Deep Learning-based Surrogate Model for Efficient Reservoir Simulation in Large-scale Geological Carbon Storage: Application in IBDP Dataset

This project introduces an advanced deep learning (DL)-based surrogate modeling approach to enhance the efficiency and accuracy of large-scale geological carbon storage (GCS) simulations. Using the Illinois Basin Decatur Project (IBDP) dataset as training data, the study employs a residual U-Net architecture to predict critical state variables such as pressure and CO₂ saturation, as well as CO₂ plume migration. By incorporating key geological parameters (e.g., porosity, permeability, and rock facies) and physics-informed inputs like the diffusive time of flight and time step, the DL model effectively reduces computational complexity while maintaining robust physical constraints. Compared to traditional simulators like Eclipse, the DL model achieves remarkable accuracy, with a root mean square error (RMSE) of 1.57 psi for pressure and 0.007 for saturation, and dramatically reduces computational time from hours to just 69.9 seconds for 50-step simulations. These results demonstrate the potential of innovative DL methodologies to improve the predictivity and operational efficiency of GCS simulations, providing a reliable foundation for decision-making in CCS operations. Supported by the SMART initiative, this project underscores the success of leveraging computational innovations to advance CCS technologies.

advanced deep learning↗

Parallel Higher-order Finite Element Method for Accurate Field Computations in Wakefield and PIC Simulations

Over the past years, SLAC's Advanced Computations Department (ACD), under SciDAC sponsorship, has developed a suite of 3D (2D) parallel higher-order finite element (FE) codes, T3P (T2P) and Pic3P (Pic2P), aimed at accurate, large-scale simulation of wakefields and particle-field interactions in radio-frequency (RF) cavities of complex shape. The codes are built on the FE infrastructure that supports SLAC's frequency domain codes, Omega3P and S3P, to utilize conformal tetrahedral (triangular)meshes, higher-order basis functions and quadratic geometry approximation. For time integration, they adopt an unconditionally stable implicit scheme. Pic3P (Pic2P) extends T3P (T2P) to treat charged-particle dynamics self-consistently using the PIC (particle-in-cell) approach, the first such implementation on a conformal, unstructured grid using Whitney basis functions. Examples from applications to the International Linear Collider (ILC), Positron Electron Project-II (PEP-II), Linac Coherent Light Source (LCLS) and other accelerators will be presented to compare the accuracy and computational efficiency of these codes versus their counterparts using structured grids.

43 PARTICLE ACCELERATORS↗

High temporal frequency data from a four turbine, blade-resolved wind farm simulation with ExaWind

The data was generated with ExaWind (https://github.com/Exawind) which couples AMR-Wind (https://github.com/Exawind/amr-wind/), Nalu-Wind (https://github.com/Exawind/nalu-wind), TIOGA (https://github.com/Exawind/tioga), and OpenFAST (https://github.com/OpenFAST/openfast). This is a large-scale simulation of a blade-resolved wind farm using the ExaWind software stack. ExaWind couples together a background flow solver, AMR-Wind, and a near-body solver, Nalu-Wind, through an overset technique from the TIOGA application. Another application, OpenFAST, handles the structural dynamics of the turbine blades and towers, which informs the fluid-structure interaction of the wind turbines with the flow solvers. This particular simulation includes four blade-resolved wind turbines operating in a turbulent atmospheric boundary layer. The AMR-Wind solver uses 500 million cells and is being solved on 256 AMD GPUs of the Oakridge Leadership Computing Facility Frontier supercomputer. Each turbine is assigned its own Nalu-Wind solver with over 13 million elements per turbine and solved using 448 CPU cores, for a total of 1792 CPU cores. For each node, 56 cores contain Nalu-Wind, while 8 cores correspond to AMR-Wind operations on the GPUs. Consequently, ExaWind is entirely utilizing the CPUs and the GPUs of the nodes concurrently. The data used in the visualization is full flow field data output from the simulation. It is lossy-compressed to a specific accuracy using ZFP and written to disk every 16 time-steps to enable real-time flow visualization. The flow fields are sampled at a high temporal frequency to enable real-time, 24fps visualization. The flow fields are sampled every 12 simulation time steps (every 0.04132s).

17 WIND ENERGY↗

CCC7-119 Reactive Molecular Dynamics Simulations of Hot Spot Growth in Shocked Energetic Materials

The purpose of this work is to understand how defects control initiation in energetic materials used in stockpile components; Sequoia gives us the core-count to run very large-scale simulations of up to 10 million atoms and; Using an OpenMP threaded implementation of the ReaxFF package in LAMMPS, we have been able to get good parallel efficiency running on 16k nodes of Sequoia, with 1 hardware thread per core.

74 ATOMIC AND MOLECULAR PHYSICS↗

Thermodynamic analysis and atomistic modeling of subsurface cavitation in photomechanical spallation

According to the article, the thermodynamic conditions defining the spatial extent of a subsurface region affected by the nucleation and growth of voids in photomechanical spallation of metals is investigated theoretically and in atomistic simulations. A theoretical analysis of cavitation in a surface region of a target melted by laser irradiation suggests a functional form for the temperature dependence of the cavitation threshold. A series of small-scale molecular dynamics simulations performed for Al, Ag, Cr, and Ni has revealed the minimum value of the free energy barrier that results in the onset of cavitation on the timescale of 10s of ps, which is a typical duration of transient tensile stresses produced by the unloading wave generated in the spallation regime. The predictive ability of the theoretical description is verified in large-scale simulations of photomechanical spallation of a Ni target and ablation of an Al target in the phase explosion regime. The temporal and spatial evolution of the free energy barrier for the onset of cavitation under conditions of short pulse laser processing is shown to univocally define the region where the nucleation of voids takes place.

Materials Science↗

optimas v0.1

optimas is a Python library that can coordinate a large number of numerical simulations on high-performance computing resources, with the aim of optimizing a given simulation result. More specifically, this library is currently used for design optimization of laser-plasma particle accelerators. In this context, the performance of particle accelerator designs are often evaluated with large-scale simulation codes, and many separate simulations need to be run - with different design parameters - in order to find the most performant design. optimas facilitates this process by providing a convenient interface to advanced optimizers (e.g. Bayesian optimization), and by coordinating the execution of the different simulations on HPC resources. (This is done by leveraging the library libensemble.) Compared to other open-source optimization libraries (e.g. Ax), optimas is more tailored towards execution on DOE HPC resources (e.g. Perlmutter, Summit, etc.) and is specialized for the type of simulation codes and workflows that are used in the community of laser-plasma acceleration.

Lehe, Remi↗

Runtime volume visualization for parallel CFD

This paper discusses some aspects of design of a data distributed, massively parallel volume rendering library for runtime visualization of parallel computational fluid dynamics simulations in a message-passing environment. Unlike the traditional scheme in which visualization is a postprocessing step, the rendering is done in place on each node processor. Computational scientists who run large-scale simulations on a massively parallel computer can thus perform interactive monitoring of their simulations. The current library provides an interface to handle volume data on rectilinear grids. The same design principles can be generalized to handle other types of grids. For demonstration, we run a parallel Navier-Stokes solver making use of this rendering library on the Intel Paragon XP/S. The interactive visual response achieved is found to be very useful. Performance studies show that the parallel rendering process is scalable with the size of the simulation as well as with the parallel computer.

Ma, Kwan-Liu↗

Carbon Nanotubes in Water: MD Simulations of Internal and External Flow, Self Organization

We have developed computational tools, based on particle codes, for molecular dynamics (MD) simulation of carbon nanotubes (CNT) in aqueous environments. The interaction of CNTs with water is envisioned as a prototype for the design of engineering nano-devices, such as artificial sterocillia and molecular biosensors. Large scale simulations involving thousands of water molecules are possible due to our efficient parallel MD code that takes long range electrostatic interactions into account. Since CNTs can be considered as rolled up sheets of graphite, we expect the CNT-water interaction to be similar to the interaction of graphite with water. However, there are fundamental differences between considering graphite and CNTs, since the curvature of CNTs affects their chemical activity and also since capillary effects play an important role for both dynamic and static behaviour of materials inside CNTs. In recent studies Gordillo and Marti described the hydrogen bond structure as well as time dependent properties of water confined in CNTs. We are presenting results from the development of force fields describing the interaction of CNTs and water based on ab-initio quantum mechanical calculations. Furthermore, our results include both water flows external to CNTs and the behaviour of water nanodroplets inside heated CNTs. In the first case (external flows) the hydrophobic behaviour of CNTs is quantified and we analyze structural properties of water in the vicinity of CNTs with diagnostics such as hydrogen bond distribution, water dipole orientation and radial distribution functions. The presence of water leads to attractive forces between CNTs as a result of their hydrophobicity. Through extensive simulations we quantify these attractive forces in terms of the number and separation of the CNT. Results of our simulations involving arrays of CNTs indicate that these exhibit a hydrophobic behaviour that leads to self-organising structures capable of trapping water clusters. In the second case (internal flows) we study the behaviour of water droplets confined inside CNTs. Constant temperature simulations allow us to capture structural properties such as the contact angles and density profiles of the equilibrated drops. By heating and subsequently cooling of the CNT, we are able to measure the evaporation and the condensation rate of the entrapped water.

Jaffe, Richard L.↗

Semi-Empirical Shadow Molecular Dynamics: A PyTorch Implementation

Here, extended Lagrangian Born–Oppenheimer molecular dynamics (XL-BOMD) in its most recent shadow potential energy version has been implemented in the semiempirical PyTorch-based software PySeQM. The implementation includes finite electronic temperatures, canonical density matrix perturbation theory, and an adaptive Krylov subspace approximation for the integration of the electronic equations of motion within the XL-BOMB approach (KSA-XL-BOMD). The PyTorch implementation leverages the use of GPU and machine learning hardware accelerators for the simulations. The new XL-BOMD formulation allows studying more challenging chemical systems with charge instabilities and low electronic energy gaps. The current public release of PySeQM continues our development of modular architecture for large-scale simulations employing semi-empirical quantum-mechanical treatment. Applied to molecular dynamics, simulation of 840 carbon atoms, one integration time step executes in 4 s on a single Nvidia RTX A6000 GPU.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Hybrid iterative approach for simulation of radio-frequency fields in plasma

In this work, a novel iterative approach for solving discretized linear wave equations in a frequency domain, which combines time evolution with iterative relaxation schemes, is presented. In this hybrid approach, each iteration cycle consists of evolution of electromagnetic (EM) fields in time over a specified number of field periods followed by several iterative relaxations. Provided that there is sufficient dissipation, both the time evolution and the iterative relaxations contribute to the convergence of the EM fields to the solution of the formulated full wave boundary value problem. Time evolution rapidly distributes EM fields, propagating with group velocity, over the simulation domain, while the iterative relaxations smooth the fields, reducing the numerical errors such that iteration cycles converge to a steady state solution, approximating the solution of the formulated problem. This approach is intended for large scale simulations which are beyond the capabilities of direct solvers presently used for solving wave equations in the frequency domain. Lastly, the technique is demonstrated for solving wave equations on a regular grid using a cold plasma dielectric model with collisions for 2D modeling of EM fields in tokamak in an electron cyclotron frequency range.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Breaking Rayleigh’s Law with Spatially Correlated Disorder to Control Phonon Transport

Controlling thermal transport in insulators and semiconductors is crucial for many technological fields such as thermoelectrics and thermal insulation, for which a low thermal conductivity (κ) is desirable. A major obstacle for realizing low κ materials is Rayleigh’s law, which implies that acoustic phonons, which carry most of the heat, are insensitive to scattering by point defects at low energy. We demonstrate, with large scale simulations on tens of millions of atoms, that isotropic long-range spatial correlations in the defect distribution can dramatically reduce phonon lifetimes of important low-frequency heat-carrying modes, leading to a large reduction of κ—potentially an order of magnitude at room temperature. We propose a general and quantitative framework for controlling thermal transport in complex functional materials through structural spatial correlations, and we establish the optimal functional form of spatial correlations that minimize κ. Finally, we end by briefly discussing experimental realizations of various correlated structures.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Understanding the Impact of Data Staging for Coupled Scientific Workflows

We report the rate of data generated by cutting-edge experimental science facilities and large-scale simulations enabled by current high-performance computing (HPC) systems has continued to grow at a far greater pace than the development of the network and storage capabilities on which these systems rely. To cope with this challenge, scientist are moving toward the creation of autonomous experiments and HPC simulations using machine learning. However, efficiently moving, storing, and processing large amounts of data away from the point of origin presents an incredible challenge. In-memory computing, in situ analysis, data staging, and data streaming are recognized viable alternatives to traditional file-based methods for transferring data between coupled workflows. However, the performance trade-offs and limitations for these methods are not fully understood when used in HPC applications. This article presents a comprehensive performance assessment of the current solutions for data staging when applied to applications that are not necessary I/O intensive which makes them not ideal candidates for these methods. Our study is based on experiments running at scale on Oak Ridge National Laboratory's Summit supercomputer using applications and simulations that cover typical computational motifs and patterns. We investigated the usability and cost/benefit trade-offs of staging algorithms for HPC applications under different scenarios and highlight opportunities for optimizing the dataflow between coupled simulation workflows.

97 MATHEMATICS AND COMPUTING↗