Search NASA⌕ Search

SEARCH · Search NASA

Results for “Large Scale Simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

MOSCATO Solver Development and Integration Plan

During FY21, we conducted ongoing development work for the MOSCATO (Molten Salt Chemistry and Transport) solver. The code development work primarily consisted of transitioning capabilities from the original version of the solver, which was written in OpenFOAM, into Nek5000. In doing so, a fast, highly parallelizable solver was created that is capable of complex chemistry and corrosion simulations for engineering-scale molten salt systems. The Nek5000 version of MOSCATO is now fully featured and capable of higher-fidelity simulations than were previously possible. Demonstration cases including a thermal convection loop have been simulated to test these new capabilities. Although capable of large-scale simulations, MOSCATO is not well-suited to parametric studies of complete reactor geometries. These types of simulations are instead better handled by reduced-order modeling codes such as ORNL’s Mole code. Reduced-order simulation tools like Mole, however, are dependent on high fidelity correlations to account for complex, coupled three-dimensional phenomena that they do not directly simulate. Tools such as MOSCATO must therefore be used to create these correlations, as suitable empirical relationships are not available for most molten salt systems. Toward that end, we used the Nek-derived version of MOSCATO to create new mass transfer correlations for three relevant cases including tubular, tube bank, and subchannel geometries. These new correlations are more accurate than any existing ones and can be readily integrated into any reduced-order modeling tools that are targeting full-scale MSR simulations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Understanding GPU errors on large-scale HPC systems and the implications for system design and operation

Increase in graphics hardware performance and improvements in programmability has enabled GPUs to evolve from a graphics-specific accelerator to a general-purpose computing device. Titan, the world's second fastest supercomputer for open science in 2014, consists of more dum 18,000 GPUs that scientists from various domains such as astrophysics, fusion, climate, and combustion use routinely to run large-scale simulations. Unfortunately, while the performance efficiency of GPUs is well understood, their resilience characteristics in a large-scale computing system have not been fully evaluated. We present a detailed study to provide a thorough understanding of GPU errors on a large-scale GPU-enabled system. Our data was collected from the Titan supercomputer at the Oak Ridge Leadership Computing Facility and a GPU cluster at the Los Alamos National Laboratory. We also present results from our extensive neutron-beam tests, conducted at Los Alamos Neutron Science Center (LANSCE) and at ISIS (Rutherford Appleron Laboratories, UK), to measure the resilience of different generations of GPUs. We present several findings from our field data and neutron-beam experiments, and discuss the implications of our results for future GPU architects, current and future HPC computing facilities, and researchers focusing on GPU resilience.

Tiwari, Devesh↗

On the use of graph search techniques for the analysis of extreme-scale combustion simulation data

With the continuous increase in high performance computing capabilities, simulations are becoming ever larger and more complex, using bigger domains, tracking more variables, and producing more time steps. This increase in the ranges of spatial and temporal simulation scales results in data that presents significant challenges to as well as new opportunities for the visualization and data analysis community. For example, highly-localized, intermittent events (such as the formation of ignition kernels in turbulent combustion) may be caused by interactions between multiple variables across a series of time steps, making both their definition and their extraction difficult, particularly at scale. This paper introduces an intuitive framework to support the identification, characterization, and tracking of such complex, multivariate, temporally evolving events in large-scale simulations. In a pre-processing step, we use topological techniques to create a hierarchical family of feature definitions for each variable of interest. Subsequently, we select a particular set of features for analysis and, using overlap-based metrics, we generate an attributed relational graph (ARG) capturing the relationships between different variables both within one and across multiple time steps. Finally, we leverage subgraph-isomorphism search heuristics to identify patterns in the ARG that characterize interesting events. We demonstrate the power of this approach by analyzing a large-scale turbulent combustion simulation.

McLendon, W. C.↗

Understanding power and energy utilization in large scale production physics simulation codes

Power is an often-cited reason for the move to advanced architectures on the path to Exascale computing. Here, this is due to practical considerations related to delivering enough power to successfully site and operate these machines, as well as concerns about energy usage while running large simulations. Since obtaining accurate power measurements can be challenging, it may be tempting to use the processor thermal design power (TDP) as a surrogate due to its simplicity and availability. However, TDP is not indicative of typical power usage while running simulations. Using commodity and advanced technology systems at Lawrence Livermore and Sandia National Labs, we performed a series of experiments to measure power and energy usage in running simulation codes. These experiments indicate that large scale Lawrence Livermore simulation codes are significantly more efficient than a simple processor TDP model might suggest.

HPC↗

NESSi : The N on- E quilibrium S ystems S imulation package

The nonequilibrium dynamics of correlated many-particle systems is of interest in connection with pump–probe experiments on molecular systems and solids, as well as theoretical investigations of transport properties and relaxation processes. Nonequilibrium Green’s functions are a powerful tool to study interaction effects in quantum many-particle systems out of equilibrium, and to extract physically relevant information for the interpretation of experiments. Here, we present the open-source software package NESSi (The Non-Equilibrium Systems Simulation package) which allows to perform many-body dynamics simulations based on Green’s functions on the L-shaped Kadanoff–Baym contour. NESSi contains the library libcntr which implements tools for basic operations on these nonequilibrium Green’s functions, for constructing Feynman diagrams, and for the solution of integral and integro-differential equations involving contour Green’s functions. The library employs a discretization of the Kadanoff–Baym contour into time points and a high-order implementation of integration routines. The total integrated error scales up to $\mathcal{O}(N^{-7})$, which is important since the numerical effort increases at least cubically with the simulation time. A distributed-memory parallelization over reciprocal space allows large-scale simulations of lattice systems. We provide a collection of example programs ranging from dynamics in simple two-level systems to problems relevant in contemporary condensed matter physics, including Hubbard clusters and Hubbard or Holstein lattice models. The libcntr library is the basis of a follow-up software package for nonequilibrium dynamical mean-field theory calculations based on strong-coupling perturbative impurity solvers.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A method for data handling numerical results in parallel OpenFOAM simulations

Parallel computational fluid dynamics simulations produce vast amount of numerical result data. This paper introduces a method for reducing the size of the data by replaying the interprocessor traffic. The results are recovered only in certain regions of interest configured by the user. A known test case is used for several mesh partitioning scenarios using the OpenFOAM toolkit{sup ®}[1]. The space savings obtained with classic algorithms remain constant for more than 60 Gb of floating point data. Our method is most efficient on large simulation meshes and is much better suited for compressing large scale simulation results than the regular algorithms.

42 ENGINEERING↗

Characteristics of energy exchange between inter- and intramolecular degrees of freedom in crystalline 1,3,5-triamino-2,4,6-trinitrobenzene (TATB) with implications for coarse-grained simulations of shock waves in polyatomic molecular crystals

In this report, we characterize the kinetics and dynamics of energy exchange between intramolecular and intermolecular degrees of freedom (DoF) in crystalline 1,3,5-triamino-2,4,6-trinitrobenzene (TATB). All-atom molecular dynamics (MD) simulations are used to obtain predictions for relaxation from certain limiting initial distributions of energy between the intra- and intermolecular DoF. The results are used to parameterize a coarse-grained Dissipative Particle Dynamics at constant Energy (DPDE) model for TATB. Each TATB molecule in the DPDE model is represented as an all-atom, rigid-molecule mesoparticle, with explicit external (molecular translational and rotational) DoF and coarse-grained implicit internal (vibrational) DoF. In addition to conserving linear and angular momentum, the DPDE equations of motion conserve the total system energy provided that particles can exchange energy between their external and internal DoF. The internal temperature of a TATB molecule is calculated using an internal equation of state, which we develop here, and the temperatures of the external and internal DoF are coupled using a fluctuation-dissipation relation. The DPDE force expression requires specification of the input parameter σ that determines the rate at which energy is exchanged between external and internal DoF. We adjusted σ based on the predictions for relaxation processes obtained from MD simulations. The parameterized DPDE model was employed in large-scale simulations of shock compression of TATB. We show that the rate of energy exchange governed by σ can significantly influence the transient behavior of the system behind the shock.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Improving Residential Building Simulations Through Large-Scale Empirical Validation

Residential building energy simulations are increasingly used for energy-efficient building design, codes and standards analysis, home certifications and ratings, utility programs, and technology assessments. Various software tools exist to perform residential building simulations, and these tools often use different models, inputs, and assumptions. This leads to inconsistencies that can undermine confidence in the predicted results. Validation of these tools can increase confidence by ensuring their accuracy and consistency. One way to validate simulation tools is through empirical testing, which compares predicted energy usage to measured utility billing data. This paper describes the process of data collection, data standardization, and empirical validation, and illustrates its use with our residential EnergyPlus (R)-based software. The data and process can be extended to other simulation tools and contribute to improving residential building simulations more broadly.

empirical validation↗

SpaceFOM: An Interoperability Standard for Space Systems Simulations

There is a long history of simulation supporting space systems development. This includes relatively simple parametric simulations to more complex trajectory simulations to large scale integrated vehicle simulation. One area of relatively recent development is in the area of distributed or interoperable simulation. Distributed simulation has been in wide use by the US military for years but is being used more widely in the aerospace community. To support large scale distributed simulation, the military community has developed a number of standards to support a priori interoperability between large collections of disparate simulation. For example, the IEEE 1516 High Level Architecture (HLA) and the Real-time Platform Reference Federation Object Model (RPR FOM). While HLA is suitable for space systems, there are a number of design decisions made in the development of the RPR FOM that prevent it from working well for space applications. In order to address these deficiencies, the Simulation Interoperability Standards Organization (SISO) developed a new HLS-compatible interoperability standard to support the needs of complex space systems. This standard is the Space Reference Federation Object Model (SpaceFOM). This paper presents on overview of the SpaceFOM including the fundamentals of the SpaceFOM, the key features of the SpaceFOM, and how the SpaceFOM supports large scale distributed simulation of complex space systems.

SISO↗

A Graph Dynamical neural network approach for decoding dynamical states in ferroelectrics.

Ferroelectric materials such as BaTiO 3 show tremendous potential for emerging advances in memory devices, particular neuromorphic type devices. High density of memory can be obtained by stabilising polar domain walls at the nanoscale, regions of discontinuity between the well-defined polarization order parameter, but little is known about what controls their structure and dynamics in real nanoscale materials. Indeed, chiral polar domain walls have been observed in heterogeneous ferroelectrics, such as oxygen-deficient BaTiO 3 , but very little is known about how such polar-domains walls interact with defects. Indeed, a critical understanding of how dynamics of domain-walls depend on point-defects is crucial to create engineered ferroelectric memory devices. For this work, we perform large-scale simulations of nansocale domain-wall dynamics in pristine and defective BaTiO 3 using reactive force-field developed by us earlier (Phys. Chem. Chem. Phys., 2019, 21, 18240–18249), and capture their dynamical dependence on point defects using a graph dynamical neural-network approach, which we adapted to interrogate solids with well-defined order-parameters, and implemented using Pytorch based libraries. Our machine learning (ML) approach goes beyond the traditional post-processing methods to capture both spatial and temporal heterogeneities of large-scale molecular dynamics simulations of complex defective ferroelectric oxide materials. We crucially find that isolated oxygen vacancies introduce very localized spatial regions (~1–2 unit-cell in length) that show slow dipole relaxation due to formation of defect-dipoles, and that these defect-dipoles in turn slow the intrinsic dynamics of domain walls. Further, the roughness of domain walls, also influenced by vacancies, introduce dynamic heterogeneity along the domain-wall. As such we find a novel mechanism by which quenched disorder due to defects introduce dynamic heterogeneity thereby influencing response to external fields (particularly time varying fields) in a ferroelectric. Our study also emphasizes the need for creating digital twins of dynamical quantities to achieve autonomous in operando control of nanoscale switching.

42 ENGINEERING↗

SpaceFOM: An Interoperability Standard for Space Systems Simulations

There is a long history of simulation supporting space systems development. This includes relatively simple parametric simulations to more complex trajectory simulations to large scale integrated vehicle simulation. One area of relatively recent development is in the area of distributed or interoperable simulation. Distributed simulation has been in wide use by the US military for years but is being used more broadly in the aerospace community. To support large scale distributed simulation, the military community has developed a number of standards to support a-priori interoperability between large collections of disparate simulations. For example, the IEEE 1516 High Level Architecture (HLA) and the Real-time Platform Reference Federation Object Model (RPR FOM). While HLA is suitable for space systems, there are a number of design decisions made in the development of the RPR FOM that prevent it from working well for space applications. In order to address these deficiencies, the Simulation Interoperability Standards Organization (SISO) developed a new HLA-based interoperability standard to support the needs of complex space systems. This standard is the Space Reference Federation Object Model (SpaceFOM). This paper presents an overview of the SpaceFOM including the fundamentals of the SpaceFOM, the key features of the SpaceFOM, and how the SpaceFOM supports large scale distributed simulation of complex space systems.

SpaceFOM↗

On fast simulation of dynamical system with neural vector enhanced numerical solver

The large-scale simulation of dynamical systems is critical in numerous scientific and engineering disciplines. However, traditional numerical solvers are limited by the choice of step sizes when estimating integration, resulting in a trade-off between accuracy and computational efficiency. To address this challenge, we introduce a deep learning-based corrector called Neural Vector (NeurVec), which can compensate for integration errors and enable larger time step sizes in simulations. Our extensive experiments on a variety of complex dynamical system benchmarks demonstrate that NeurVec exhibits remarkable generalization capability on a continuous phase space, even when trained using limited and discrete data. NeurVec significantly accelerates traditional solvers, achieving speeds tens to hundreds of times faster while maintaining high levels of accuracy and stability. Moreover, NeurVec’s simple-yet-effective design, combined with its ease of implementation, has the potential to establish a new paradigm for fast-solving differential equations based on deep learning.

97 MATHEMATICS AND COMPUTING↗

New Developments and Verification of the Fusion Blanket Simulation Capabilities in the MOOSE Framework

This poster contains new developments and updates in the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework related to fusion modeling and simulation, and forms the basis for an on-going effort in modeling whole fusion devices at Idaho National Laboratory using MOOSE. In this work, a slice of the midplane of a proposed ceramic breeder blanket design for the Fusion Nuclear Science Facility is simulated using a combination of neutronics, 1D system level thermal hydraulics for helium, 3D heat conduction, and tritium transport. Previous work focused on the engineering scale full assembly of a blanket sector, but the simulations here form the basis for software quality and verification efforts to increase confidence as the large scale simulations continue. This poster was presented at the Idaho National Laboratory Intern Poster Session 2023.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Large-scale epitaxial growth kinetics of graphene: A kinetic Monte Carlo study

Epitaxial growth via chemical vapor deposition is considered to be the most promising way towards synthesizing large area graphene with high quality. However, it remains a big theoretical challenge to reveal growth kinetics with atomically energetic and large-scale spatial information included. Here, we propose a minimal kinetic Monte Carlo model to address such an issue on an active catalyst surface with graphene/substrate lattice mismatch, which facilitates us to perform large scale simulations of the growth kinetics over two dimensional surface with growth fronts of complex shapes. A geometry-determined large-scale growth mechanism is revealed, where the rate-dominating event is found to be C{sub 1}-attachment for concave growth-front segments and C{sub 5}-attachment for others. This growth mechanism leads to an interesting time-resolved growth behavior which is well consistent with that observed in a recent scanning tunneling microscopy experiment.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Fast and Accurate Simulation of the Cray XMT Multithreaded Supercomputer

Irregular applications, such as data mining and analysis or graph-based computations, show unpredictable memory/network access patterns and control structures. Highly multithreaded architectures with large processor counts, like the Cray MTA-1, MTA-2 and XMT, appear to address their requirements better than commodity clusters. However, the research on highly multithreaded systems is currently limited by the lack of adequate architectural simulation infrastructures due to issues such as size of the machines, memory footprint, simulation speed, accuracy and customization. At the same time, Shared-memory MultiProcessors (SMPs) with multi-core processors have become an attractive platform to simulate large scale machines. In this paper, we introduce a cycle-level simulator of the highly multithreaded Cray XMT supercomputer. The simulator runs unmodified XMT applications. We discuss how we tackled the challenges posed by its development, detailing the techniques introduced to make the simulation as fast as possible while maintaining a high accuracy. By mapping XMT processors (ThreadStorm with 128 hardware threads) to host computing cores, the simulation speed remains constant as the number of simulated processors increases, up to the number of available host cores. The simulator supports zero-overhead switching among different accuracy levels at run-time and includes a network model that takes into account contention. On a modern 48-core SMP host, our infrastructure simulates a large set of irregular applications 500 to 2000 times slower than real time when compared to a 128-processor XMT, while remaining within 10\% of accuracy. Emulation is only from 25 to 200 times slower than real time.

Cray XMT↗

Simulations of Subsurface Flow and Transport at the Pore and Continuum Scales

This paper will present recent results of simulations of subsurface and flow using both pore scale and grid-based continuum methods. Large scale simulations of pore scale flow and transport using the Smoothed Particle Hydrodynamic method (SPH) using more than 14 million particles have been performed. These simulations are focused on tracking the behavior of contaminants and multiphase fluids in the subsurface. Simulations are also being performed at the field scale using the Subsurface Transport Over Multiple Phases code (STOMP) using a novel, highly-resolved synthetic model of a braided channel belt deposit to analyze the large scale transport of material in a deposit with multiscale heterogeneity. Both sets of simulations are being performed with codes that have been developed using component-based software engineering principles that result in highly modular codes with few dependencies between components.

99 GENERAL AND MISCELLANEOUS↗

Do Minihalos Affect Cosmic Reionization?

The role of unresolved structures (“minihalos”) in determining the consumption of ionizing photons during cosmic reionization remains an unsolved problem in modeling cosmic reionization, despite recent extensive studies with small-box high-resolution simulations by Park et al. and Chan et al., because the small-box studies are not able to fully sample all environments. In this paper these simulations are combined with large-box simulations from the “Cosmic Reionization On Computers” (CROC) project, allowing one to account for the full range of environments and to produce an estimate for the number of recombinations per hydrogen atom that are missed in large-scale simulations like CROC or Thesan. I find that recombinations in unresolved minihalos are unimportant compared to recombinations produced in large-scale cosmic structures and inside more massive, fully resolved halos. Since both the Park et al. and Chan et al. studies have severe limitations, the conclusions of this paper may need to be verified with more representative sets of small-box high-resolution simulations.

79 ASTRONOMY AND ASTROPHYSICS↗

The effect of the target structure and composition on the ejection and transport of polymer molecules and carbon nanotubes in matrix-assisted pulsed laser evaporation

Matrix-assisted pulsed laser evaporation (MAPLE) is a prominent member of a broad and expanding class of laser-driven deposition techniques where a matrix of volatile molecules absorbs laser irradiation and provides the driving force for the ejection and transport of the material to be deposited. The mechanisms of MAPLE are investigated in coarse-grained molecular dynamic simulations focused on establishing the physical regimes and limits of the molecular transfer from targets with different structures and compositions. The systems considered in the simulations include dilute solutions of polymer molecules and individual carbon nanotubes (CNTs), as well as continuous networks of carbon nanotubes impregnated with solvent. The polymer molecules and nanotubes are found to be ejected only in the ablation regime and are incorporated into matrix-polymer droplets generated in the process of the explosive disintegration of the overheated matrix. The ejection and deposition of droplets explain the experimental observations of complex surface morphologies in films deposited by MAPLE. In simulations performed for MAPLE targets loaded with CNTs, the ejection of individual nanotubes, CNT bundles, and tangles with sizes comparable or even exceeding the laser penetration depth is observed. The ejected CNTs align along the flow direction in the matrix plume and tend to agglomerate into bundles at the initial stage of the ablation plume expansion. In a large-scale simulation performed for a target containing a network of interconnected CNT bundles, a large tangle of CNT bundles with the total mass of 50 MDa is separated from the continuous network and entrained with the matrix plume. No significant splitting and thinning of CNT bundles in the ejection process is observed in the simulations, suggesting that fragile structural elements or molecular agglomerates with complex secondary structures may be transferred and deposited to the substrate with the MAPLE technique.

Materials Science↗