Search NASA⌕ Search

SEARCH · Search NASA

Results for “Large Scale Simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

An ultrahigh-resolution E3SM land model simulation framework and its first application to the Seward Peninsula in Alaska

The availability of supercomputers and state-of-science datasets has made it possible to conduct large-scale land simulations at an ultrahigh-resolution. This study reported a computational framework for land surface simulation using the E3SM land model (ELM) at an unprecedented resolution (1 km x 1 km gridcell). The ultrahigh-resolution ELM (uELM) simulation framework includes three parts: (1) high-resolution atmospheric forcing and surface properties dataset generation, (2) massive gridcell-based simulation, and (3) large-scale simulation results analysis. Additionally, we implemented the uELM simulation framework and completed the first 1 km x 1 km terrestrial ecosystem simulation (from 1850 to 2014) over the Seward Peninsula in Alaska (78,000 km 2 ). The experiment contained two phases: a spin-up simulation and a transient simulation, and required five weeks of calculations using 320 cores in a 44-node Linux HPC computer. It created approximately 1.3 TB of data from the transient simulation alone (1850 - present). We selected sample results (monthly and daily simulation outputs) to illustrate the temporal and spatial variations of several variables in high-latitude Arctic ecosystems’ water, energy, and carbon cycles. At last, we summarized the lessons learned and proposed new developments for full-scale uELM simulations over the entire North American continent (approximately 22,000,000 km 2 ).

54 ENVIRONMENTAL SCIENCES↗

Distributed Parareal in Time with Adaptive Coarse Solver for Large Scale Power System Simulations

This paper describes a distributed Parareal in time algorithm with the adaptive coarse solver. In the distributed algorithm, the propagation of a coarse solution is distributed among processors in addition to the fine solution propagation. In the adaptive coarse solver the complexity of the model is changed based on the size of generator rotor angle deviation. In addition, non-iterative approach to model a ZIP load is presented. The proposed method is tested on the large-scale 5617-machine 70285-bus Eastern Interconnection system.

Osipov, Denis↗

Rendezvous algorithms for large-scale modeling and simulation

Rendezvous algorithms encode a communication pattern that is useful when processors sending data do not know who the receiving processors should be, or vice versa. The idea is to define an intermediate decomposition where datums from different sending processors can ”rendezvous” to perform a computation, in a manner that both the senders and eventual receivers of the results can identify the appropriate rendezvous processor. Though they were originally designed for interpolating between overlaid grids with independent parallel decompositions (Plimpton et al., 2004), we have recently found rendezvous algorithms useful for a variety of operations in particle- or grid-based simulation codes when running large problems on large numbers of processors. In particular, we show they can perform well when a load-balanced intermediate decomposition is randomized and not spatial, requiring all-to-all communication to move data between processors. In this case rendezvous algorithms leverage the large bisection communication bandwidths which parallel machines provide. We describe how rendezvous algorithms work in a scientific computing context and give specific examples for molecular dynamics and Direct Simulation Monte Carlo codes which result in dramatic performance improvements versus simpler algorithms which do not scale as well. We explain how a generic rendezvous algorithm can be implemented, and also point out similarities with the MapReduce paradigm popularized by Google and Hadoop.

97 MATHEMATICS AND COMPUTING↗

Visual Data-Analytics of Large-Scale Parallel Discrete-Event Simulations

Parallel discrete-event simulation (PDES) is an important tool in the codesign of extreme-scale systems because PDES provides a cost-effective way to evaluate designs of highperformance computing systems. Optimistic synchronization algorithms for PDES, such as Time Warp, allow events to be processed without global synchronization among the processing elements. A rollback mechanism is provided when events are processed out of timestamp order. Although optimistic synchronization protocols enable the scalability of large-scale PDES, the performance of the simulations must be tuned to reduce the number of rollbacks and provide an improved simulation runtime. To enable efficient large-scale optimistic simulations, one has to gain insight into the factors that affect the rollback behavior and simulation performance. We developed a tool for ROSS model developers that gives them detailed metrics on the performance of their large-scale optimistic simulations at varying levels of simulation granularity. Model developers can use this information for parameter tuning of optimistic simulations in order to achieve better runtime and fewer rollbacks. In this work, we instrument the ROSS optimistic PDES framework to gather detailed statistics about the simulation engine. We have also developed an interactive visualization interface that uses the data collected by the ROSS instrumentation to understand the underlying behavior of the simulation engine. The interface connects real time to virtual time in the simulation and provides the ability to view simulation data at different granularities. We demonstrate the usefulness of our framework by performing a visual analysis of the dragonfly network topology model provided by the CODES simulation framework built on top of ROSS. The instrumentation needs to minimize overhead in order to accurately collect data about the simulation performance. To ensure that the instrumentation does not introduce unnecessary overhead, we perform a scaling study that compares instrumented ROSS simulations with their noninstrumented counterparts in order to determine the amount of perturbation when running at different simulation scales.

Ross, Caitlin↗

Visual Analytics for Deep Embeddings of Large Scale Molecular Dynamics Simulations

Molecular Dynamics (MD) simulation have been emerging as an excellent candidate for understanding complex atomic and molecular scale mechanism of bio-molecules that control essential bio-physical phenomenon in a living organism. But this MD technique produces large-size and long-timescale data that are inherently high-dimensional and occupies many terabytes of data. Processing this immense amount of data in a meaningful way is becoming increasingly difficult. Therefore, specific dimensionality reduction algorithm using deep learning technique has been employed here to embed the high-dimensional data in a lower-dimension latent space that still preserves the inherent molecular characteristics i.e. retains biologically meaningful information. Subsequently, the results of the embedding models are visualized for model evaluation and analysis of the extracted underlying features. However, most of the existing visualizations for embeddings have limitations in evaluating the embedding models and understanding the complex simulation data. We propose an interactive visual analytics system for embeddings of MD simulations to not only evaluate and explain an embedding model but also analyze various characteristics of the simulations. Our system enables exploration and discovery of meaningful and semantic embedding results and supports the understanding and evaluation of results by the quantitatively described features of the MD simulations (even without specific labels).

Chae, Junghoon↗

Intelligently Partitioned Phasor-EMT Hybrid Simulations of Large-Scale, High-IBR Power Systems

As the penetration level of power electronics-interfaced renewables such as photovoltaics (PV) and wind has surged in modern electric grids, new operational risks caused by the dynamics of those inverter-based resources (IBRs) are emerging in parallel. Lessons learned from various grid events include that the impact of IBRs on system-level grid stability will become prominent along with the increase of renewables and that the short-timescale dynamic impacts of IBRs on grid stability are not fully captured by current commercial dynamic simulation tools [1] [2]. For example, IBRs can be controlled to mitigate those destabilizing interactions, but conventional phasor-domain tools (e.g. PSS/E, PSLF) often cannot capture that; likewise, the existing electromagnetic transient (EMT) simulation tools (e.g. PSCAD, EMTP) can simulate detailed IBR controls, but for large power systems with many IBRs, slow simulation speeds severely impede the ability to study dynamic events [3] [4]. Massively paralleling simulations using high-performance computing (HPC) can help address this, especially now that cloud-based HPC capability is widely available, but today s EMT tools are not HPC-compatible, and parallelization of dynamic simulation solvers is not trivial because each region can dynamically affect the others. Thus, dynamic simulation of grids with very large numbers of IBRs potentially poses a barrier to the ongoing energy transition.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Simulations of Large-Scale Zero Boiloff, Densification, and Solidification of Hydrogen

An Integrated Refrigeration and Storage (IRAS) experimental system called the Ground Operations and Demonstration Unit for Liquid Hydrogen (GODU-LH2) demonstrated the ability store cryogens in a zero boiloff (ZBO) process, and to densify liquid hydrogen by reducing the temperature and pressure down to the triple point resulting in solidification. The incompressible Navier-Stokes was utilized to simulate ZBO, densification, and solidification of liquid hydrogen (LH2) in the IRAS tank. The simulations were performed using a commercially available Computational Fluid Dynamics (CFD) pressure-based mass and momentum flow model and an enthalpy-porosity energy model. Results demonstrated the simulation’s ability to predict time-dependent flow and temperature fields and solid-liquid phase locations for hydrogen during ZBO, densification, and solidification. The simulations showed good agreement with experimental data, with errors within acceptable ranges for temperature and pressure predictions, provided detailed insights into natural convection and solid-liquid phase change dynamics. These findings are critical for the design of future cryogenic fluid management systems.

Computational Fluid Dynamics↗

Large-scale molecular dynamics simulations of bubble collapse in water: Effects of system size, water model, and nitrogen

Molecular dynamics simulations in the microcanonical ensemble are performed to study the collapse of a bubble in liquid water using the single-site mW and the four-site TIP4P/2005 water models. To study system size effects, simulations for pure water systems are performed using periodically replicated simulation boxes with linear dimensions, L, ranging from 32 to 512 nm with the largest systems containing 8.7 × 10 6 and 4.5 × 10 9 molecules for the TIP4P/2005 and mW water models, respectively. The computationally more efficient mW water model allows us to reach converging behavior when the bubble dynamics results are plotted in reduced units, and the limiting behavior can be obtained through linear extrapolation in L –1 . Qualitative differences are observed between simulations with the mW and TIP4P/2005 water models, but they can be explained by the models’ differences in predicted viscosity and surface tension. Although bubble collapse occurs on time scales of only hundreds of picoseconds, the system sizes used here are sufficiently large to obtain bubble dynamics consistent with the Rayleigh–Plesset equation when using the models’ thermophysical properties as input. For the conditions explored here, extreme heating of the interfacial water molecules near the time of collapse is observed for the larger mW water systems (but the model underpredicts the viscosity), whereas heating is less pronounced for the TIP4P/2005 water systems because its larger viscosity contribution slows the collapse dynamics. The presence of nitrogen within the bubble only starts to affect bubble dynamics near the very end of the initial collapse, leading to an incomplete collapse and strong rebound for the mW water model. Although nitrogen is non-condensable at 300 K, it becomes highly compressed and reaches a liquid-like density near the collapse point. We find that the dissolution of nitrogen is much slower than the movement of the collapsing water front, and the re-expansion of the dense nitrogen droplet gives rise to bubble rebound. The incompatibility of the collapse and dissolution time scales should be considered for continuum-scale modeling of bubble dynamics. Finally, we also confirm that the diffusion coefficient for dissolved nitrogen is insensitive to pressure as the liquid transitions from a compressed to a stretched state.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Achieving High Efficiency in Reduced Order Modeling for Large Scale Polycrystal Plasticity Simulations

Reduced order models for the nonlinear response of heterogeneous microstructures typically require a construction (or training) stage to build the reduced order basis. In this manuscript, an efficient model construction strategy for the eigenstrain homogenization method (EHM) is presented. The proposed strategy relies on a parallel, element-by-element, conjugate gradient solver. Near linear scaling has been achieved with respect to the number of degrees of freedom used to resolve the microstructure. Linear scaling with respect to the number of pre-analyses required to construct the reduced order model (ROM) follows from the EHM formulation. Furthermore, a parallel implementation for fast evaluation of the constructed ROM has been developed using shared memory parallelization. It has been shown that for large microstructures with ≈ 10,000 grains, the total computational cost of evaluating the nonlinear response of a polycrystal could be reduced by approximately an order of magnitude using 32 cores with respect to serial ROM simulation. The present methodology has been verified using an additively manufactured polycrystalline microstructure of a nickel-based superalloy, Inconel 625. The capability of the developed framework to construct a ROM for such large microstructures, as well as the ability of the ROM to predict average and local quantities of interest has been demonstrated.

microscale↗

Numerical simulation of large-scale ocean-atmosphere coupling and the ocean's role in climate

The problem of reducing model generated sigma coordinate data to pressure levels is considered. A mass consistent scheme for performing budget analyses is proposed, wherein variables interpolated to a given pressure level are weighted according to the mass between a nominal pressure level above and either a nominal pressure level below or the Earth's surface, whichever is closer. The method is applied to the atmospheric energy cycle as simulated by the OSU two level atmospheric general circulation model. The results are more realistic than sigma coordinate analyses with respect to eddy decomposition, and are in agreement with the sigma coordinate evaluation of the numerical energy sink. Comparison with less sophisticated budget schemes indicates superiority locally, but not globally.

Gates, W. L.↗

JSC-Rocknest: A Large-Scale Mojave Mars Simulant (MMS) Based Soil Simulant for In-Situ Resource Utilization Water-Extraction Studies

The Johnson Space Center-Rocknest (JSC-RN) simulant was developed in response to a need by NASA's Advanced Exploration Systems (AES) In-Situ Resource Utilization (ISRU) project for a simulant to be used in component and system testing for water extraction from Mars regolith. JSC-RN was designed to be chemically and mineralogically similar to material from the aeolian sand shadow named Rocknest in Gale Crater, particularly the 1-3 wt.% low temperature (<450 ºC) water release as measured by the Sample Analysis at Mars (SAM) instrument on the Curiosity rover. Sodium perchlorate, goethite, pyrite, ferric sulfate, regular and high capacity granular ferric oxide, and forsterite were added to a Mojave Mars Simulant (MMS) base in order to match the mineralogy, evolved gases, and elemental chemistry of Rocknest. Mineral and rock components were sent to the United States Geological Survey (USGS) in Denver for mixing. Approximately 800 kg of JSC-RN was sent back to NASA in 5 gallon buckets, which were subsampled and characterized. All samples of the USGS-produced simulants had similar evolved gas profiles as a small prototype batch of JSC-RN made in JSC laboratories, with the exception of HCl, and were similar in terms of mineralogy and total chemistry. Also, all JSC-RN subsamples were homogenous and had similar mineralogy, total chemistry, and low-temperature evolved gas profiles as the Rocknest aeolian sand shadow examined with Curiosity’s instrument suite on Mars. In particular, the low temperature water releases were similar and the amount of water evolved from JSC-RN at <450 ºC was similar to the water content of Rocknest based on SAM water peak integrations. Overall, JSC-RN is ideally suited for ISRU studies of water extraction of global martian soil due to its excellent agreement with measured properties of martian soils and its proven feasibility for large-scale production.

Simulant↗

Modulating factors of hydrologic exchanges in a large-scale river reach: Insights from three-dimensional computational fluid dynamics simulations

Hyporheic exchange is a critical mechanism shaping hydrological and biogeochemical processes along a river corridor. Recent studies on quantifying the hyporheic exchange were mostly limited to local scales due to field inaccessibility, computational demand, and complexity of geomorphology and subsurface geology. Surface flow conditions and subsurface physical properties are well known factors on modulating the hyporheic exchange, but quantitative understanding of their impacts on the strength and direction of hyporheic exchanges at reach scales is absent. In this study, a high resolution computational fluid dynamics (CFD) model that couples surface and subsurface flow and transport is employed to simulate hyporheic exchanges in a 7-km long reach along the main-stem of the Columbia River. Assuming that the hyporheic exchange does not affect surface water flow conditions due to its negligible magnitude compared to the volume and velocity of river water, we developed a one-way coupled surface and subsurface water flow model using the commercial CFD software STAR-CCM+. The model integrates the Reynolds-averaged Navier-Stokes (RANS) equation solver with a realizable k-e two-layer turbulence model, a two-layer all y^+ wall treatment, and the volume of fluid (VOF) method, and is used to simulate hyporheic exchanges by tracking the free water-air interface as well as flow in the river and the subsurface porous media. The model is validated against measurements from acoustic Doppler current profiler (ADCP) in the stream water and hyporheic fluxes derived from a set of temperature profilers installed across the riverbed. The validated model is then employed to systematically investigate how hyporheic exchanges are influenced by surface water fluid dynamics strongly regulated by upstream dam operations, as well as subsurface structures (e.g. thickness of riverbed and subsurface formation layers) and hydrogeological properties (e.g. permeability). The results suggest that the thickness of riverbed alluvium layer is the dominant factor for reach-scale hyporheic exchanges, followed by the alluvium permeability, the depth of the underlying impermeable layer, and the assumption of hydrostatic pressure.

Bao, Jie↗

Numerical simulations of large-scale solar magnetic fields

A transport equation which describes the evolution of the large-scale magnetic field of the sun was solved numerically. Data derived from solar magnetic observations are used to initialize the computations and to account for the emergence of new magnetic flux during the sunspot cycle. The objective is to assess the ability of the model to reproduce the observed evolution of the field patterns. Recent results from simulations of individual active regions over a few solar rotations and of the magnetic field of the sun over sunspot cycle 21 are discussed.

Devore, C. R.↗

Nuclear EMP simulation for large-scale urban environments. FDTD for electrically large problems.

In case of a terrorist nuclear attack in a metropolitan area, EMP measurement could provide: (1) a prompt confirmation of the nature of the explosion (chemical or nuclear) for emergency response; and (2) and characterization parameters of the device (reaction history, yield) for technical forensics. However, urban environment could affect the fidelity of the prompt EMP measurement (as well as all other types of prompt measurement): (1) Nuclear EMP wavefront would no longer be coherent, due to incoherent production, attenuation, and propagation of gamma and electrons; and (2) EMP propagation from source region outward would undergo complicated transmission, reflection, and diffraction processes. EMP simulation for electrically-large urban environment: (1) Coupled MCNP/FDTD (Finite-difference time domain Maxwell solver) approach; and (2) FDTD tends to be limited to problems that are not 'too' large compared to the wavelengths of interest because of numerical dispersion and anisotropy. We use a higher-order low-dispersion, isotropic FDTD algorithm for EMP propagation.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Manufacturing Process Simulation of Large-Scale Cryotanks

NASA's Space Launch Initiative (SLI) is an effort to research and develop the technologies needed to build a second-generation reusable launch vehicle. It is required that this new launch vehicle be 100 times safer and 10 times cheaper to operate than current launch vehicles. Part of the SLI includes the development of reusable composite and metallic cryotanks. The size of these reusable tanks is far greater than anything ever developed and exceeds the design limits of current manufacturing tools. Several design and manufacturing approaches have been formulated, but many factors must be weighed during the selection process. Among these factors are tooling reachability, cycle times, feasibility, and facility impacts. The manufacturing process simulation capabilities available at NASA's Marshall Space Flight Center have played a key role in down selecting between the various manufacturing approaches. By creating 3-D manufacturing process simulations, the varying approaches can be analyzed in a virtual world before any hardware or infrastructure is built. This analysis can detect and eliminate costly flaws in the various manufacturing approaches. The simulations check for collisions between devices, verify that design limits on joints are not exceeded, and provide cycle times which aid in the development of an optimized process flow. In addition, new ideas and concerns are often raised after seeing the visual representation of a manufacturing process flow. The output of the manufacturing process simulations allows for cost and safety comparisons to be performed between the various manufacturing approaches. This output helps determine which manufacturing process options reach the safety and cost goals of the SLI.

Babai, Majid↗

Manufacturing Process Simulation of Large-Scale Cryotanks

NASA's Space Launch Initiative (SLI) is an effort to research and develop the technologies needed to build a second-generation reusable launch vehicle. It is required that this new launch vehicle be 100 times safer and 10 times cheaper to operate than current launch vehicles. Part of the SLI includes the development of reusable composite and metallic cryotanks. The size of these reusable tanks is far greater than anything ever developed and exceeds the design limits of current manufacturing tools. Several design and manufacturing approaches have been formulated, but many factors must be weighed during the selection process. Among these factors are tooling reachability, cycle times, feasibility, and facility impacts. The manufacturing process simulation capabilities available at NASA.s Marshall Space Flight Center have played a key role in down selecting between the various manufacturing approaches. By creating 3-D manufacturing process simulations, the varying approaches can be analyzed in a virtual world before any hardware or infrastructure is built. This analysis can detect and eliminate costly flaws in the various manufacturing approaches. The simulations check for collisions between devices, verify that design limits on joints are not exceeded, and provide cycle times which aide in the development of an optimized process flow. In addition, new ideas and concerns are often raised after seeing the visual representation of a manufacturing process flow. The output of the manufacturing process simulations allows for cost and safety comparisons to be performed between the various manufacturing approaches. This output helps determine which manufacturing process options reach the safety and cost goals of the SLI. As part of the SLI, The Boeing Company was awarded a basic period contract to research and propose options for both a metallic and a composite cryotank. Boeing then entered into a task agreement with the Marshall Space Flight Center to provide manufacturing simulation support. This paper highlights the accomplishments of this task agreement, while also introducing the capabilities of simulation software.

Babai, Majid↗

TrioSim: A Lightweight Simulator for Large-Scale DNN Workloads on Multi-GPU Systems

Deep Neural Networks (DNNs) have become increasingly capable of performing tasks ranging from image recognition to content generation. The training and inference of DNNs heavily rely on GPUs, as GPUs' massively parallel architecture delivers extremely high computing capability. With the growing complexity of DNNs and the size of training datasets, training DNNs with a large number of GPUs is becoming a prevalent strategy. Researchers have been exploring how to design software and hardware systems for GPU farms to achieve the best utilization, efficiency, and DNN accuracy during training or inference. However, when designing and deploying such systems, designers usually rely on testing on physical hardware platforms equipped with many GPUs, incurring high costs that are almost prohibitive for system designers to test different configurations and designs, even for highly resourceful companies. While an alternative solution is to test on GPU simulators, they are often too slow for these l

Li, Ying [William & Mary, Williamsburg, VA, USA] (↗

Helium flux effects on bubble growth and surface morphology in plasma-facing tungsten from large-scale molecular dynamics simulations

We investigate helium flux effects on helium transport and surface evolution in plasma-facing tungsten using molecular dynamics. The simulations span two orders of magnitude, from ITER-relevant levels to those more typical of simulations published to date. Simulation times of up to 2.5 µs (corresponding to actual fluences of 1.4 x 10 21 m -2 ) are achieved, revealing concerted bubble-bursting events that are responsible for significant and very sudden changes in surface morphology. The depth distribution of helium depends very strongly on helium flux: helium self-trapping becomes more probable near the surface at high flux, and a layer of near-surface bubbles forms. Helium retention prior to the onset of bubble bursting is also substantially lower at low flux than it is at high flux. Surface features at low fluence are correlated with the positions of bubbles, but at high fluence, bubbles tend to coalesce, venting to the surface at one or more locations and leaving large interconnected cavities below the surface. Ruptured bubbles may serve as pathways deeper into the material, allowing helium to bypass the layer of near-surface bubbles and fill deeper, potentially much larger, bubbles that can produce more substantial surface features. Deeper bubbles also emit prismatic dislocation loops that can fill in cavities closer to the surface. Our results suggest that nearly all molecular dynamics simulations published to date are hampered by finite-size effects, and that helium flux is a very important parameter in determining the behavior of helium in plasma-facing components.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗