Search NASA⌕ Search

SEARCH · Search NASA

Results for “Large Scale Simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Do We Know How to Model Reionization?

I compare the power spectra of the radiation fields from two recent sets of fully-coupled simulations that model cosmic reionization: “Cosmic Reionization On Computers” (CROC) and “Thesan”. While both simulations have similar power spectra of the radiation sources, the power spectra of the photoionization rate are significantly different at the same values of cosmic time or the same values of the mean neutral hydrogen fraction. However, the power spectra of the photoionization rate can be matched at large scales for the two simulations when the matching snapshots are allowed to vary independently. I.e., on large scales, the clustering of the radiation field in two simulations evolves similarly, but the exact timing of this evolution is different in different simulations and is not parameterized by an easily interpretable physical quantity like the mean neutral fraction or the mean free path. On small scales, large differences are present and remain partially unexplained. Both CROC and Thesan use the Variable Eddington Tensor approximation for modeling radiative transfer, but adopt different closure relations (optically thin OTVET versus M1). The role of this key difference is tested by using smaller simulations with a new cosmological simulation code that implements both closure relations in a controlled environment (the same hydro, cooling, and gravity solvers and the star formation recipe). In these controlled tests, both the M1 closure and the OTVET ansatz follow the expected behavior from a simple analytical approximation, demonstrating that the differences in the 2-point function of the radiation field induced by the choice of the Eddington tensor are not dominant.

79 ASTRONOMY AND ASTROPHYSICS↗

Thread Group Multithreading: Accelerating the Computation of an Agent-Based Power System Modeling and Simulation Tool -- C GridLAB-D

GridLAB-DTM is an open source next generation agent-based smart-grid simulator that provides unprecedented capability to model the performance of smart grid technologies. Over the past few years, GridLAB-D has been used to conduct important analyses of smart grid concepts, but it is still quite limited by its computational performance. In order to break through the performance bottleneck to meet the need for large scale power grid simulations, we develop a thread group mechanism to implement highly granular multithreaded computation in GridLAB-D. We achieve close to linear speedups on multithreading version compared against the single-thread version of the same code running on general purpose multi-core commodity for a benchmark simple house model. The performance of the multithreading code shows favorable scalability properties and resource utilization, and much shorter execution time for large-scale power grid simulations.

Jin, Shuangshuang↗

An improved multilevel Monte Carlo method for estimating probability distribution functions in stochastic oil reservoir simulations

In this paper, we develop an improved multilevel Monte Carlo (MLMC) method for estimating cumulative distribution functions (CDFs) of a quantity of interest, coming from numerical approximation of large-scale stochastic subsurface simulations. Compared with Monte Carlo (MC) methods, that require a significantly large number of high-fidelity model executions to achieve a prescribed accuracy when computing statistical expectations, MLMC methods were originally proposed to significantly reduce the computational cost with the use of multifidelity approximations. The improved performance of the MLMC methods depends strongly on the decay of the variance of the integrand as the level increases. However, the main challenge in estimating CDFs is that the integrand is a discontinuous indicator function whose variance decays slowly. To address this difficult task, we approximate the integrand using a smoothing function that accelerates the decay of the variance. In addition, we design a novel a posteriori optimization strategy to calibrate the smoothing function, so as to balance the computational gain and the approximation error. The combined proposed techniques are integrated into a very general and practical algorithm that can be applied to a wide range of subsurface problems for high-dimensional uncertainty quantification, such as a fine-grid oil reservoir model considered in this effort. The numerical results reveal that with the use of the calibrated smoothing function, the improved MLMC technique significantly reduces the computational complexity compared to the standard MC approach. Finally, we discuss several factors that affect the performance of the MLMC method and provide guidance for effective and efficient usage in practice.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Cross-scale covariance for material property prediction

A simulation can stand its ground against an experiment only if its prediction uncertainty is known. The unknown accuracy of interatomic potentials (IPs) is a major source of prediction uncertainty, severely limiting the use of large-scale classical atomistic simulations in a wide range of scientific and engineering applications. Here we explore covariance between predictions of metal plasticity, from 178 large-scale (~10 8 atoms) molecular dynamics (MD) simulations, and a variety of indicator properties computed at small-scales (≤10 2 atoms). All simulations use the same 178 IPs. In a manner similar to statistical studies in public health, we analyze correlations of strength with indicators, identify the best predictor properties, and build a cross-scale “strength-on-predictors” regression model. This model is then used to estimate regression error over the statistical pool of IPs. Small-scale predictors found to be highly covariant with strength are computed using expensive quantum-accurate calculations and used to predict flow strength, within the statistical error bounds established in our study.

36 MATERIALS SCIENCE↗

Intercomparison of methods of coupling between convection and large-scale circulation: 2. Comparison over nonuniform surface conditions

As part of an international intercomparison project, the weak temperature gradient (WTG) and damped gravity wave (DGW) methods are used to parameterize large-scale dynamics in a set of cloud-resolving models (CRMs) and single column models (SCMs). The WTG or DGW method is implemented using a configuration that couples a model to a reference state defined with profiles obtained from the same model in radiative-convective equilibrium. We investigated the sensitivity of each model to changes in SST, given a fixed reference state. We performed a systematic comparison of the WTG and DGW methods in different models, and a systematic comparison of the behavior of those models using the WTG method and the DGW method. The sensitivity to the SST depends on both the large-scale parameterization method and the choice of the cloud model. In general, SCMs display a wider range of behaviors than CRMs. All CRMs using either the WTG or DGW method show an increase of precipitation with SST, while SCMs show sensitivities which are not always monotonic. CRMs using either the WTG or DGW method show a similar relationship between mean precipitation rate and column-relative humidity, while SCMs exhibit a much wider range of behaviors. DGW simulations produce large-scale velocity profiles which are smoother and less top-heavy compared to those produced by the WTG simulations. Lastly, these large-scale parameterization methods provide a useful tool to identify the impact of parameterization differences on model behavior in the presence of two-way feedback between convection and the large-scale circulation.

54 ENVIRONMENTAL SCIENCES↗

Grain-Scale Simulations of Hot-Spot Initiation for Shocked TATB

High-explosive (HE) material consists of large-sized grains with micron-sized embedded impurities and pores. Under various mechanical/thermal insults, these pores collapse generating high-temperature regions leading to ignition. A computational study has been performed to investigate the mechanisms of pore collapse and hot spot initiation in TATB crystals, employing the thermohydrodynamics arbitrary-Lagrange-Eulerian code ALE3D. This initial study includes non-reactive dynamics to isolate the thermal and hydrodynamical effects. Two-dimensional high-resolution large-scale meso-scale simulations have been undertaken. We study an axisymmetric configuration for pore radii ranging from 0.5 to 2{micro}m, with initial shock pressures in the range from 3 to 11 GPa. A Mie-Gruneisen Equation of State (EOS) model is used for TATB, and includes a constant yield strength and shear modulus; while the air in the pore invokes a Livermore Equation of State (LEOS) model. The parameter space is systematically studied by considering various shock strengths, pore diameters and material properties. We find that thermal diffusion from the collapsed pores has an important effect in generating high-temperature hot spots in the TATB.

33 ADVANCED PROPULSION SYSTEMS↗

Nano-hillock formation in diamond-like carbon induced by swift heavy projectiles in the electronic stopping regime: Experiments and atomistic simulations

The formation of surface hillocks in diamond-like carbon is studied experimentally and by means of large-scale molecular dynamics simulations with 5 Multiplication-Sign 10{sup 6} atoms combined with a thermal spike model. The irradiation experiments with swift heavy ions cover a large electronic stopping range between {approx}12 and 72 keV/nm. Both experiments and simulations show that beyond a stopping power threshold, the hillock height increases linearly with the electronic stopping, and agree extremely well assuming an efficiency of approximately 20% in the transfer of electronic energy to the lattice. The simulations also show a transition of sp{sup 3} to sp{sup 2} bonding along the tracks with the hillocks containing almost no sp{sup 3} contribution.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Large-Eddy Simulations of Marine Boundary Layer Clouds Associated with Cold-Air Outbreaks during the ACTIVATE Campaign. Part I: Case Setup and Sensitivities to Large-Scale Forcings

Large-eddy simulation (LES) is able to capture key boundary layer (BL) turbulence and cloud processes. Yet, large-scale forcing and surface turbulent fluxes of sensible and latent heat are often poorly prescribed for LESs. We derive these quantities from measurements and reanalysis obtained for two cold-air outbreak (CAO) events during Phase I of the Aerosol Cloud Meteorology Interactions over the Western Atlantic Experiment (ACTIVATE) in February–March 2020. We study the two contrasting CAO cases by performing LES and test the sensitivity of BL structure and clouds to large-scale forcings and turbulent heat fluxes. Profiles of atmospheric state and large-scale divergence and surface turbulent heat fluxes obtained from ERA5 data agree reasonably well with those derived from ACTIVATE field measurements for both cases at the sampling time and location. Therefore, we adopt the time-evolving heat fluxes, wind, and advective tendencies profiles from ERA5 data to drive the LES. We find that large-scale thermodynamic advective tendencies and wind relaxations are important for the LES to capture the evolving observed BL meteorological states characterized by the hourly ERA5 data and validated by the observations. We show that the divergence (or vertical velocity) is important in regulating the BL growth driven by surface heat fluxes in LESs. The evolution of liquid water path is largely affected by the evolution of surface heat fluxes. The liquid water path simulated in LES agrees reasonably well with the ACTIVATE measurements. This study paves the path to investigate aerosol–cloud–meteorology interactions using LES informed and evaluated by ACTIVATE field measurements.

54 ENVIRONMENTAL SCIENCES↗

SEAS Communication Engine: An Extensible, Flexible Wrapper for Co-Simulation Agents

When modeling and analyzing the power grid and other large scale systems, researchers often express scenarios as optimization problems and feed them into advanced software solvers. In order to allow multiple solvers to communicate with each other and share data from different domains, the National Renewable Energy Laboratory (NREL) and associated Department of Energy (DOE) labs have developed a software framework called the Hierarchical Engine for Large-scale Infrastructure Co-Simulation (HELICS). HELICS allows cosimulation via a collection of client libraries for different languages that can be called from the appropriate optimization software. However, these client libraries do not provide a higher level of abstraction beyond reading and writing data off of the shared HELICS bus. In this paper, we describe a new software library called the SEAS Communication Engine that exposes a higher-level API for running cosimulation problems. The SEAS Engine provides a class-based abstraction on top of the Python HELICS client, in order to allow users to implement their domain-specific cosimulations without needing to interact with core HELICS primitives. This will make adoption of HELICS and cosimulation in general easier, by exposing a simpler API. In the second part of the paper, we validate our library on a collection of different simulation examples, including the canonical IEEE 13 Bus Feeder. Lastly, we demonstrate using the SEAS Engine to directly call domain-specific code written in the Julia programming language. Our hope is that this will serve as a template for easily calling software in different programming languages via the SEAS Engine, thereby avoiding code duplication and complexity.

co-simulation↗

Performance Debugging and Tuning of Flash-X with Data Analysis Tools

State-of-the-art multiphysics simulations running on large scale leadership computing platforms have many variables contributing to their performance and scaling behavior. We recently encountered an interesting performance anomaly in Flash-X, a multiphysics multicomponent simulation software, when characterizing its performance behavior on several large-scale HPC platforms. The anomaly was tracked down to the interaction between the use of dynamic allocation of scratch data and data locality in the cache hierarchy. In this paper we present the details of unexpected performance variability of Flash-X, its extensive analysis using the performance measurement tool TAU to collect the data and Python data analysis libraries to explore the data, and our insights from this experience. In this process, we discovered and removed or mitigated two additional performance limiting bottlenecks for performance tuning.

Huck, Kevin↗

A differentiable, physics-informed ecosystem modeling and learning framework for large-scale inverse problems: demonstration with photosynthesis simulations

Photosynthesis plays an important role in carbon, nitrogen, and water cycles. Ecosystem models for photosynthesis are characterized by many parameters that are obtained from limited in situ measurements and applied to the same plant types. Previous site-by-site calibration approaches could not leverage big data and faced issues like overfitting or parameter non-uniqueness. Here we developed an end-to-end programmatically differentiable (meaning gradients of outputs to variables used in the model can be obtained efficiently and accurately) version of the photosynthesis process representation within the Functionally Assembled Terrestrial Ecosystem Simulator (FATES) model. As a genre of physics-informed machine learning (ML), differentiable models couple physics-based formulations to neural networks (NNs) that learn parameterizations (and potentially processes) from observations, here photosynthesis rates. We first demonstrated that the framework was able to correctly recover multiple assumed parameter values concurrently using synthetic training data. Then, using a real-world dataset consisting of many different plant functional types (PFTs), we learned parameters that performed substantially better and greatly reduced biases compared to literature values. Further, the framework allowed us to gain insights at a large scale. Our results showed that the carboxylation rate at 25 °C (V c,max25 ) was more impactful than a factor representing water limitation, although tuning both was helpful in addressing biases with the default values. This framework could potentially enable substantial improvement in our capability to learn parameters and reduce biases for ecosystem modeling at large scales.

54 ENVIRONMENTAL SCIENCES↗

Deep Generative Models for Fast Photon Shower Simulation in ATLAS

The need for large-scale production of highly accurate simulated event samples for the extensive physics programme of the ATLAS experiment at the Large Hadron Collider motivates the development of new simulation techniques. Building on the recent success of deep learning algorithms, variational autoencoders and generative adversarial networks are investigated for modelling the response of the central region of the ATLAS electromagnetic calorimeter to photons of various energies. The properties of synthesised showers are compared with showers from a full detector simulation using GEANT4 . Both variational autoencoders and generative adversarial networks are capable of quickly simulating electromagnetic showers with correct total energies and stochasticity, though the modelling of some shower shape distributions requires more refinement. This feasibility study demonstrates the potential of using such algorithms for ATLAS fast calorimeter simulation in the future and shows a possible way to complement current simulation techniques.

97 MATHEMATICS AND COMPUTING↗

Impact of DER Communication Delay in AGC: Cyber-Physical Dynamic Co-Simulation: Preprint

Distributed energy resource (DER) frequency regulations are promising technologies for future grid operation. Unlike conventional generators, DERs might require open communication networks to exchange signals with control centers, possibly through DER aggregators; therefore, the impacts of the communication variations including the latency on the system frequency stability need to be investigated. This paper develops a cyber-physical dynamic simulation (CPDS) model based on the Hierarchical Engine for Large-Scale Co-Simulation (HELICS) to evaluate the impact of the communication variations, such as delays in DER frequency regulations. The feasible delay range can be obtained under different AGC parameter settings. The results show that the risk of instability generally increases with the communication delay and that the difference of AGC provided from DER and conventional generation units should be recognized when designing frequency regulation controllers.

61 RADIATION PROTECTION AND DOSIMETRY↗

First Order Colossal Magnetoresistance Transitions in the Two-Orbital Model for Manganites

Large-scale Monte Carlo simulation results for the two-orbital model for manganites, including Jahn- Teller lattice distortions, are presented here. At hole density x 1=4 and in the vicinity of the region of competition between the ferromagnetic metallic and spin-charge-orbital ordered insulating phases, the colossal magnetoresistance (CMR) phenomenon is observed with a magnetoresistance ratio 10 000%. Our main result is that this CMR transition is found to be of first order in some portions of the phase diagram, in agreement with early results from neutron scattering, specific heat, and magnetization, thus solving a notorious discrepancy between experiments and previous theoretical studies. The first order characteristics of the transition survive, and are actually enhanced, when weak quenched disorder is introduced.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Enabling Large-Scale Condensed-Phase Hybrid Density Functional Theory Based Ab Initio Molecular Dynamics. 1. Theory, Algorithm, and Performance

By including a fraction of exact exchange (EXX), hybrid functionals reduce the self-interaction error in semilocal density functional theory (DFT) and thereby furnish a more accurate and reliable description of the underlying electronic structure in systems throughout biology, chemistry, physics, and materials science. However, the high computational cost associated with the evaluation of all required EXX quantities has limited the applicability of hybrid DFT in the treatment of large molecules and complex condensed-phase materials. To overcome this limitation, we describe a linear-scaling approach that utilizes a local representation of the occupied orbitals (e.g., maximally localized Wannier functions (MLWFs)) to exploit the sparsity in the real-space evaluation of the quantum mechanical exchange interaction in finite-gap systems. In this work, we present a detailed description of the theoretical and algorithmic advances required to perform MLWF-based ab initio molecular dynamics (AIMD) simulations of large-scale condensed-phase systems of interest at the hybrid DFT level. We focus our theoretical discussion on the integration of this approach into the framework of Car–Parrinello AIMD, and highlight the central role played by the MLWF-product potential (i.e., the solution of Poisson’s equation for each corresponding MLWF-product density) in the evaluation of the EXX energy and wave function forces. We then provide a comprehensive description of the exx algorithm implemented in the open-source Quantum ESPRESSO program, which employs a hybrid MPI/OpenMP parallelization scheme to efficiently utilize the high-performance computing (HPC) resources available on current- and next-generation supercomputer architectures. Furthermore, this is followed by a critical assessment of the accuracy and parallel performance (e.g., strong and weak scaling) of this approach when AIMD simulations of liquid water are performed in the canonical (NVT) ensemble. With access to HPC resources, we demonstrate that exx enables hybrid DFT-based AIMD simulations of condensed-phase systems containing 500–1000 atoms (e.g., (H₂O)₂₅₆) with a wall time cost that is comparable to that of semilocal DFT. In doing so, exx takes us one step closer to routinely performing AIMD simulations of complex and large-scale condensed-phase systems for sufficiently long time scales at the hybrid DFT level of theory.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A comparative analysis of numerical approaches for the description of gas flow in clay-based repository systems: From a laboratory to a large-scale gas injection test

There is nowadays a consensus among many countries that geological disposal is a favourable solution for the long-term management. Although different host formations and different barrier systems are under consideration around the world, clay-based materials form an important component for waste isolation in most national programmes. Hence, a good comprehension of the effect of gas flow on the hydro-mechanical behaviour of clay-based soils is essential, both at laboratory and field scale. Task B under the international cooperative project DECOVALEX-2023 has recently shown that, after some enhancement, models can be employed to reproduce laboratory scale tests, even with different sample geometries 37 . However, further work is required to understand whether they can be applied to simulate a large-scale experiment. Up-scaling of models for the advective transport of gas through clay-based low permeable material presents a number of problems related to the difficulty in obtaining consistent hydrogeological parameters and constitutive relationships at both laboratory and field scale. Based on a unique dataset from a large-scale gas injection test (Lasgit) performed at the Äspö Hard Rock Laboratory (Sweden), Task B within DECOVALEX-2023 has explored the refinement of these numerical strategies applied to the simulation of gas flow. Work performed within the task reveals that codes do not need to be substantially modified from the laboratory models to reproduce full-scale tests: indeed, model parameters calibrated and validated at laboratory scale have been applied to predict field scale gas flow at Lasgit, including peak gas pressure and injected cumulative gas volume. By means of (1) the introduction of interfaces between blocks to reflect the experimental configuration and the (2) adjustment of some parameters (e.g., higher permeability), the updated models are able to represent most of the key features observed in the experimental data, even at a large scale.

Tamayo-Mas, E↗

Modeling of Carbon Tetrachloride Flow and Transport in the Subsurface of the 200 West Disposal Sites: Large-Scale Model Configuration and Prediction of Future Carbon Tetrachloride Distribution Beneath the 216-Z-9 Disposal Site

Three-dimensional simulations considered migration of dense, nonaqueous phase liquid (DNAPL) consisting of CT and co disposed organics in the subsurface as a function of the properties and distribution of subsurface sediments and of the properties and disposal history of the waste. Simulations of CT migration were conducted using the Water-Oil-Air mode of Subsurface Transport Over Multiple Phases (STOMP) simulator. A large-scale model was configured to model CT and waste water discharge from the major CT and waste-water disposal sites.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A CFD M&S PROCESS FOR FAST REACTOR FUEL ASSEMBLIES

A CFD modeling and simulation process for large-scale problems using an arbitrary fast reactor fuel assembly design was evaluated. Three dimensional flow distributions of sodium for several fast reactor fuel assembly pin spacing configurations were simulated on high performance computers using commercial CFD software. This research focused on 19-pin fuel assembly “benchmark” geometry, similar in design to the Advanced Burner Test Reactor, where each pin is separated by helical wire-wrap spacers. Several two-equation turbulence models including the k-e and SST (Menter) k-? were evaluated. Considerable effort was taken to resolve the momentum boundary layer, so as to eliminate the need for wall functions and reduce computational uncertainty. High performance computers were required to generate the hybrid meshes needed to predict secondary flows created by the wire-wrap spacers; computational meshes ranging from 65 to 85 million elements were common. A general validation methodology was followed, including mesh refinement and comparison of numerical results with empirical correlations. Predictions for velocity, temperature, and pressure distribution are shown. The uncertainty of numerical models, importance of high fidelity experimental data, and the challenges associated with simulating and validating large production-type problems are presented.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗