SEARCH · Search NASA
Results for “parallel simulation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
ddcMD.os
ddcMD is a general purpose molecular dynamics (MD) code that supports MPI parallelism. MD codes are used for simulation of particles systems and capture all the many-body effects of the underlying particle potential that defines the physical system. Though MD can be used to model systems from the subatomic to astrological length scales ddcMD is mainly focused on the atomic scale length scale, In this release of ddcMD the support will be mainly for systems using the coarse-grain Martini potential, a particle potential for biological systems.
KinCat v.1.0
SAND2024-02099O The software is designed to allow researchers to perform kinetic Monte Carlo (KMC) simulations of catalytic reactions on a 2D lattice. The code is written efficiently to run on a variety of shared memory computing architectures (e.g. GPU, multi-core) and to natively express the full complexity of lateral interactions on reaction rates. The software allows researchers to perform KMC simulations of catalytic reactions on a 2D lattice. It uses parallel shared-memory computing architectures to reduce run-times and allows for simultaneous simulation of multiple independent runs. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.
Framework Application for Core Edge Transport Simulations (FACETS) Performance Analysis (Final Report)
The goal of the FACETS project (Framework Application for Core-Edge Transport Simulations) was to provide a multiphysics, parallel framework application (FACETS) that will enable whole-device modeling for the U.S. fusion program, to provide the modeling infrastructure needed for ITER, the next step fusion confinement device. Through use of modern computational methods, including component technology and object oriented design, FACETS is able to switch from one model to another for a given aspect of the physics in a flexible manner. This enables use of simplified models for rapid turnaround or high-fidelity models that can take advantage of the largest supercomputer hardware. FACETS does so in a heterogeneous parallel context, where different parts of the application execute in parallel by utilizing task farming, domain decomposition, and/or pipelining as needed and applicable. ParaTools, Inc. was tasked with supporting the performance analysis and tuning of the FACETS components and framework in order to achieve the parallel scaling goals of the project. The TAU Performance System® was used for instrumentation, measurement, archiving, and profile / tracing analysis. ParaTools, Inc. also assisted in FACETS performance engineering efforts. Through the use of the TAU Performance System, ParaTools provided instrumentation, measurement, analysis and archival support for the FACETS project. Performance optimization of key components has yielded significant performance speedups. TAU was integrated into the FACETS build for both the full coupled application and the UEDGE component. The performance database provided archival storage of the performance regression testing data generated by the project, and helped to track improvements in the software development.
Toward the Theory of Turbulence in Magnetized Plasmas (Final report)
The goal of the project was to develop a theory of turbulence in magnetized plasmas at large scales, that is, scales larger than the characteristic plasma microscales (ion gyroscale, ion inertial scale, etc.). Collisions of counter-propagating Alfven packets govern the turbulent cascade of energy toward small scales. It has been established that such an energy cascade is intrinsically anisotropic, in that it predominantly supplies energy to the modes with mostly field-perpendicular wave numbers. The resulting energy spectrum of MHD turbulence, and the structure of the fluctuations were studied both analytically and numerically. A new parallel numerical code was developed for simulating reduced MHD equations driven by an external force. The numerical setting was proposed, where the spectral properties of the force could be varied in order to simulate either strong or weak turbulent regimes. It has been found both analytically and numerically that weak MHD turbulence spontaneously generates a “condensate”, that is, concentration of magnetic and kinetic energy at small k ∥ . A related topic that was addressed in the project is turbulent dynamo action, that is, generation of magnetic field in a turbulent flow. We were specifically concentrated on the generation of large-scale magnetic field compared to the scales of the turbulent velocity field. We investigate magnetic field amplification in a turbulent velocity field with nonzero helicity, in the framework of the kinematic Kazantsev-Kraichnan model.
Combinatorial Algorithms to Enable Computational Science and Engineering: Work from the CSCAPES Institute
This final progress report summarizes the work accomplished at the Combinatorial Scientific Computing and Petascale Simulations Institute. We developed Zoltan, a parallel mesh partitioning library that made use of accurate hypergraph models to provide load balancing in mesh-based computations. We developed several graph coloring algorithms for computing Jacobian and Hessian matrices and organized them into a software package called ColPack. We developed parallel algorithms for graph coloring and graph matching problems, and also designed multi-scale graph algorithms. Three PhD students graduated, six more are continuing their PhD studies, and four postdoctoral scholars were advised. Six of these students and Fellows have joined DOE Labs (Sandia, Berkeley), as staff scientists or as postdoctoral scientists. We also organized the SIAM Workshop on Combinatorial Scientific Computing (CSC) in 2007, 2009, and 2011 to continue to foster the CSC community.
Integrated Surface/subsurface flow modeling in PFLOTRAN
Understanding soil water, groundwater, and shallow surface water dynamics as an integrated hydrological system is critical for understanding the Earth’s critical zone, the thin outer layer at our planet’s surface where vegetation, soil, rock, and gases interact to regulate the environment. Computational tools that take this view of soil moisture and shallow surface flows as a single integrated system are typically referred to as integrated surface/subsurface hydrology models. We extend the open-source, highly parallel, subsurface flow and reactive transport simulator PFLOTRAN to accommodate surface flows. In contrast to most previous implementations, we do not represent a distinct surface system. Instead, the vertical gradient in hydraulic head at the land surface is neglected, which allows the surface flow system to be eliminated and incorporated directly into the subsurface system. This tight coupling approach leads to a robust capability and also greatly simplifies implementation in existing subsurface simulators such as PFLOTRAN. Successful comparisons to independent numerical solutions build confidence in the approximation and implementation. Example simulations of the Walker Branch and East Fork Poplar Creek watersheds near Oak Ridge, Tennessee demonstrate the robustness of the approach in geometrically complex applications. The lack of a robust integrated surface/subsurface hydrology capability had been a barrier to PFLOTRAN’s use in critical zone studies. This work addresses that capability gap, thus enabling PFLOTRAN as a community platform for building integrated models of the critical zone.
Online Monitoring of Medium Voltage Cable Systems with Spread Spectrum Time Domain and Frequency Domain Reflectometry
In-service failures of wave energy convertor (WEC) cable systems can have a significant cost and power availability impact. Close parallel research 2019 data showed > 1B£ and 9 Terra-Watt-Hours associated with global off-shore wind (OSW) cable failures (Strang-Moran 2020). OSW is a closely related technology but currently is significantly cheaper than WEC technology. For wave energy to compete, the problem of reliable cable transmission must be mitigated. This project develops isolation technology to allow online high frequency reflectometry testing of medium voltage cables (1 to 10 kV and higher) without arcing or damage to the test instrument. Online spread spectrum time domain reflectometry (SSTDR) testing has been established for low voltage cable systems in the aircraft and rail industry and the ability to detect and locate cable flaws of interest is well understood. Extending reflectometry testing to medium voltage systems could enable detection of cable damage before failures occur thereby allowing repair and replacement of damaged cable segments to be scheduled and managed. The seedling project succeeded to pass and receive high frequency SSTDR signals onto a cable up to 1 kV using a parallel trace isolation circuit board that can be connected onto the test cable. The approach used a novel circuit design for which an invention disclosure has been filed. A proposed sapling project would extend the technology toward the higher operating voltages used by WEC systems, thereby enabling online SSTDR cable monitoring. The goal of the seedling project was to extend the capability of the ARENA cable/motor test bed to address medium voltages and to develop a high pass filter isolation architecture to protect the reflectometry instrument from the low frequency (DC – 60 Hz) line voltage while allowing the high frequency diagnostic signal to pass to and from the test instrument to the live line. Initial efforts focused on passive LCR filter circuits to reduce 60 Hz levels below 10 volts from a 10 kV line while allowing the MHz high frequency chirps to pass onto the cables and for mV signals to be detected. We discovered that the parasitic loss behavior of real high voltage components precluded this approach from working. An alternate approach was adapted for the electric field to couple between two parallel traces on a printed circuit board much like a radio-frequency coupler. The challenge here was and is to have the parallel traces close enough to each other to effectively pass the high frequency chirp onto the live line and receive any reflected signal from any encountered impedance change along the cable. This reflected signal will be in the mV range. The traces however must be far enough apart to not allow arcing on the board. A design with 3 mm spacing was determined to allow the high frequency signal to pass onto the live line and receive the mV signal back into the instrument while reducing the 60 Hz voltage amplitude by >80 dB (more than a factor of 10,000) without allowing arcing from across the parallel traces. This was confirmed by simulation and test.
SmartApps: Middle-ware for Adaptive Applications on Reconfigurable Platforms
There are several reasons why the performance of current distributed and heterogeneous systems is often disappointing. For example, the characteristics of the application may be input sensitive and evolve during execution causing dramatic changes in memory reference patterns, resource requirements, or degree of concurrency between different phases of the computation. Or, the system may change dynamically with nodes failing or appearing, some network links severed and other links established with different latencies and bandwidths. Another important reason for poor performance is the fairly compartmentalized approach to optimization: applications, compilers, operating systems and hardware configurations are designed and optimized in isolation and without the knowledge of instance specific information and needs of a running application. There is too little information flow across these boundaries and no global optimization is even attempted. For example, most operating systems services like paging, virtual-to-physical page mapping, I/O, or data layout in disks, provide little or no application customization. Similarly, the off-the-shelf hardware used by most commercial systems is optimized to give best average-case performance. To address this problem, we have proposed application-centric computing, or Smart Applications (SAS). In the SAS executable, the compiler embeds most run-time system services, and a performance-optimizing feedback loop that monitors the application's performance and adaptively reconfigures the application and the OS/system platform. At run-time, after incorporating the code's input and determining the system's resources and state, the SAS performs an *instance* specific optimization, which is more tractable than a global generic optimization between application, OS and system. The overriding philosophy of SAS is ``measure, compare, and adapt if beneficial.'' That is, the application will continually monitor its performance and the available resources to determine if, and by how much, performance could be improved if the application was restructured. Then, if the potential performance benefit outweighs the projected overhead costs, the application will restructure itself and the underlying system accordingly. The SAS framework includes performance monitoring and modeling components and mechanisms for performing the actual restructuring at various levels including: (i) algorithmic adaptation, (ii) run-time software optimization (e.g., input sensitivity analysis, etc.), (iii) tuning reconfigurable OS services (scheduling policy, page size, etc), and (iv) system configuration (e.g., selecting which, and how many, computational resources to use). SmartApps is being developed in the STAPL infrastructure. STAPL (the Standard Template Adaptive Parallel Library) is a framework for developing highly-optimizable, adaptable, and portable parallel and distributed applications. It consists of a relatively new and still evolving collection of generic parallel algorithms and distributed containers and a run-time system (RTS) through which the application and compiler interact with the OS and hardware.
Modeling commercial-scale CO 2 storage in the gas hydrate stability zone with PFLOTRAN v6.0
Abstract. Safe and secure carbon dioxide (CO2) storage is likely to be critical for mitigating some of the most dangerous effects of climate change. In the last decade, there has been a significant increase in activity associated with reservoir characterization and site selection for large-scale CO2 storage projects across the globe. These prospective storage sites tend to be selected for their optimal structural, petrophysical, and geochemical trapping potential. However, it has also been suggested that storing CO2 in reservoirs within the CO2 hydrate stability zone (GHSZ), characterized by high pressures and low temperatures (e.g., Arctic or marine environments), could provide a natural thermodynamic barrier to gas leakage. Evaluating the prospect of commercial-scale, long-term storage of CO2 in the GHSZ requires reservoir-scale modeling capabilities designed to account for the unique physics and thermodynamics associated with these systems. We have developed the HYDRATE flow mode and the accompanying fully implicit parallel well model in the massively parallel subsurface flow and reactive transport simulator PFLOTRAN to model CO2 injection into the marine GHSZ. We have applied these capabilities to a set of CO2 injection scenarios designed to reveal the challenges and opportunities for commercial-scale CO2 storage in the GHSZ.
Building the next generation of parallel applications.
No abstract prepared.
Initial Developments in Modeling Graphite Behavior
Graphite is used in High Temperature Reactor designs as a moderator, reflector and core material responsible for protecting the fuel and maintaining structural stability. From a safety perspective, it is imperative to be able to predict how graphite will behave under reactor operating conditions which may compromise the core’s structural integrity or fuel’s safety performance. The following report summarizes recent modeling work undertaken at Idaho National Laboratory which focuses on graphite degradation behavior. One phenomenon which is explored in this report and can cause significant degradation to graphite properties is oxidation. Oxidation behavior in graphite is highly temperature dependent. At low temperatures, oxygen can fully penetrate a component and cause a homogeneous damage profile. At high temperatures, only the graphite near the surface of a component is affected. Understanding and modeling this temperature dependence is essential to predicting graphite behavior. In this report, three graphite models are discussed. The first model is used to investigate strength loss after low temperature oxidation. It does this by generating an approximate graphite microstructure then determining the required load to cause crack propagation. It has been shown that the model reproduces the quasi brittle stress versus strain relationship observed in graphite. Strength loss results from the model are shown to match experimental values. The second model investigates strength loss under high temperature oxidation conditions. This model is more applicable to full scale graphite components where the oxidation damage is often inhomogeneous throughout a component. The third model computes stresses in graphite under reactor conditions. Specifically, the model incorporates the effect of creep, irradiation dose, thermal strains, and oxidation in order to predict internal stresses in a component. All of these models are implemented in the Multiphysics Object-Oriented Simulation Environment (MOOSE), an open source, parallel finite element framework.
Coupling Big Data Analytics and Reactive Transport Modeling for Cost-effective Groundwater Monitoring - 17163
This study presents an innovative approach for sustainable and cost-effective groundwater monitoring. This approach takes advantage of recent advances in various technologies: (1) in situ autonomous sensors, (2) big data analytics, and (3) parallel high-performance computing for flow and reactive transport modeling. In situ sensors are used to periodically measure the key variables (such as pH, redox potential, electrical conductivity, and groundwater level), which control contaminant mobility and the plume spatial and temporal distribution. Based on a limited number of groundwater sampling, the data analytics methods-data mining and machine learning-allow us to identify and quantify the correlations between the in situ-measured variables and contaminant concentrations, and also to detect significant changes associated with the plume mobility. In addition, a state-of-the-art parallel numerical flow and reactive transport simulator Amanzi, and uncertainty quantification software Agni are used to provide an improved physical and mechanistic understanding of the contaminated groundwater system behavior, and to predict the long-term plume distribution for optimizing and adapting the monitoring strategy. Amanzi and Agni were developed as part of the Advanced Simulation Capability for Environmental Management (ASCEM) program of the DOE Office of Environmental Management. Such modeling is critical, particularly, for assessing the impact of climate change and associated hydrological shifts. The developed approach is expected to significantly reduce the groundwater sampling frequency and associated cost. In addition, the real-time information on plume mobility serves as an early warning system, improving the resiliency of contaminated or potentially contaminated sites. We demonstrate this approach using as an example the Savannah River Site (SRS) F-Area, where groundwater is contaminated by various radionuclides, including uranium, tritium and technetium. (authors)
Beam dynamics studies of the 8 GeV Linac at FNAL
The proposed 8-GeV proton driver (PD) linac at FNAL includes a front end up to {approx}420 MeV operating at 325 MHz and a high energy section at 1300 MHz. A normal conducting RFQ and short CH type resonators are being developed for the initial acceleration of the H-minus or proton beam up to 10 MeV. From 10 MeV to {approx}420 MeV, the voltage gain is provided by superconducting (SC) spoke-loaded cavities. In the high-energy section, the acceleration will be provided by the International Linear Collider (ILC)-style SC elliptical cell cavities. To employ existing, readily available klystrons, an RF power fan out from high-power klystrons to multiple cavities is being developed. The beam dynamics simulation code TRACK, available in both serial and parallel versions, has been updated to include all known H-minus stripping mechanisms to predict the exact location of beam losses. An iterative simulation procedure is being developed to interact with a transient beam loading model taking into account RF feedback and feedforward systems.
Equations of State for Collisionless Guide-Field Reconnection
Direct in situ observation of magnetic reconnection in the Earth's magnetotail as well as kinetic numerical studies have recently shown that the electron pressure in a collisionless reconnection region is strongly anisotropic. This anisotropy is mainly caused by the trapping of electrons in parallel electric fields. We present new equations of state for the parallel and perpendicular pressures for magnetized electrons. This model - derived here and tested against a kinetic simulation - allows a fluid description in a collisionless regime where parallel electric fields and the dynamics of both passing and trapped electrons are essential.
Imaging of magnetic DW injection processed in patterened Ni80Fe20 structures
Magnetization reversal in patterned ferromagnetic nanowires usually occurs via domain wall (DW) nucleation and propagation from one end (or both ends) of the wire which can be significantly reduced by a large, magnetically soft pad on one of the wire ends. These 'nucleation pads' reverse at lower fields than an isolated nanowire and introduce a DW to the wire from the wire end attached to the pad. Once a critical 'injection' field is reached, the DW sweeps through the wire, reversing its magnetization. Nucleation pads are frequently used as part of nanowire devices and experimental structures. Magnetic-field-driven shift register memory can include an injection pad to write data while those attached to nanowire spiral turn sensors act as both a source and sink of domain walls. Both of these devices use two-dimensional wire circuits and therefore require the use of orthogonal in-plane magnetic fields to drive domain walls through wires of different orientations. These bi-axial fields can significantly alter the fields at which DW injection occurs and control the number of different injection modes. We have used magnetic transmission soft X-ray microscopy (M-TXM) [6] providing 25nm spatial resolution to image the evolution of magnetization configurations in patterned 24nm thick Ni{sub 80}Fe{sub 20} rectangular nucleation pads and attached wires during DW injection. The structures consisted of 2 {micro}m x 3 {micro}m nucleation pads with wires of width 200 nm, 300 nm or 500 nm attached Comparing the magnetic configuration of the injection pads with micromagnetic models, we find that the relative orientation of closure domains in the remanent magnetization configuration of injection pads determines the reversal pathway that follows, although this is further affected by applied transverse fields. Micromagnetic simulations were performed using a hybrid finite element/boundary element code. The magnetic elements were designed with 20 nm thickness and discretized into a mesh of tetrahedral elements with a maximum cell size of 20 nm. Material properties for bulk permalloy were used, i.e. exchange stiffness A = 1.3 x 10{sup -11} J/m, saturation magnetization M{sub S} = 800 kA/m, magneto-crystalline anisotropy K = 0 Jm{sup -3}, damping constant a = 0.01. A linearly increasing magnetic field (1 Oe/ns) was applied parallel to the wire long axis to simulate switching fields. The dimensions of the simulated structures mimicked the essential features of the experimental structures, although edge roughness was neglected from the model. The remanent magnetization state of the pad with no transverse field consists of a uniform magnetization aligned with the wire axis, with closure domains at the edges facing and joining the wire. When H{sub y} = 0 Oe and H{sub x} = 20 Oe, the magnetization state of the pad buckles, forming eight domains, half of which have magnetizations rotated away from the x-axis. As H{sub x} is increased, the rotation of the domains become larger and the non-rotated domains shrink A transverse field applied in addition to the axial field exhibits a more complex modes of magnetization reversal in the pad (Fig. 1). We understand the pathway of pad magnetization more generally by using micromagnetic simulations. Two initial configurations are shown in Fig. 2 with the closure domain on the left-hand edge of the pad either parallel or anti-parallel to both closure domains on the righthand edges of the pad. As H{sub x} is increased to inject a domain wall, the pad magnetization states changed to vortex states, as observed by M-TXM. At higher fields, the magnetization of the modeled pad became single-domain, although closure domains remained at fields up to H{sub x} = 90 Oe. This supports the suggestion that experimentally observed multi-modal injection is due to the magnetization state of the pad. In summary, the relative orientation of closure domains in the pads determines the magnetization reversal pathway under an axial field. However, the addition of transverse fields can alter these and lead to the pads undergoing reversal under lower axial fields. Our observations have wider implications for experiments and devices using patterned magnetic wires.
Asynchronous in situ connected-components analysis for complex fluid flows
Fluid flow in porous media is at the heart of problems such as groundwater contamination and carbon sequestration, and presents an important challenge for scientific computing. For this class of problem, large three-dimensional simulations are performed to advance scientific inquiry. On massively parallel computing systems, the volume of data generated by such approaches can become a productivity bottleneck if the raw data generated from the simulation is analyzed in a post-processing step. We present a physics-based framework for in situ data reduction that is theoretically grounded in multiscale averaging theory. We show how task parallelism can be exploited to concurrently perform a variety of analysis tasks with data-dependent costs, including the generation of iso-surfaces, morphological analyses, and connected components analysis. A task management framework is constructed to launch asynchronous analysis threads, manage dependencies between different tasks, promote data locality and hide the impact of data transfers. The framework is applied to analyze GPU-based simulations of two-fluid flow in porous media, generating a set of averaged measures that represents the overall system behavior. We demonstrate how the approach can be applied to perform physically-consistent averaging over fluid subregions using connected components analysis. Simulations performed on Oak Ridge National Lab s Titan supercomputer are profiled to demonstrate the performance of the associated multi-threaded in situ analysis for typical production simulation of two-fluid flow.
A Sparse Distributed Gigascale Resolution Material Point Method
In this paper, we present a four-layer distributed simulation system and its adaptation to the Material Point Method (MPM). The system is built upon a performance portable C++ programming model targeting major High-Performance-Computing (HPC) platforms. A key ingredient of our system is a hierarchical block-tile-cell sparse grid data structure that is distributable to an arbitrary number of Message Passing Interface (MPI) ranks. We additionally propose strategies for efficient dynamic load balance optimization to maximize the efficiency of MPI tasks. Our simulation pipeline can easily switch among backend programming models, including OpenMP and CUDA, and can be effortlessly dispatched onto supercomputers and the cloud. Finally, we construct benchmark experiments and ablation studies on supercomputers and consumer workstations in a local network to evaluate the scalability and load balancing criteria. We demonstrate massively parallel, highly scalable, and gigascale resolution MPM simulations of up to 1.01 billion particles for less than 323.25 seconds per frame with 8 OpenSSH-connected workstations.