Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Anthropogenic extremely low volatility organics (ELVOCs) Govern the Growth of Molecular Clusters over the Southern Great Plains during the Springtime

New particle formation (NPF) and growth govern cloud condensation nuclei (CCN) concentrations in many regions. The mechanisms governing the nucleation of molecular clusters vary substantially in different regions of the atmosphere. Additionally, the growth of these clusters from ~2 to 20 nm sizes is often governed by the availability of extremely low volatility organic vapours (ELVOCs). While the pathways to ELVOC formation from the oxidation of biogenic monoterpenes with ozone is better understood, the chemical and mechanistic pathways for ELVOC formation from oxidation of anthropogenic organics are not well understood. We integrate measurements and three-dimensional regional model simulations with the Weather Research and Forecasting Model coupled to chemistry (WRF-Chem) to understand the processes governing new particle formation and growth and secondary organic aerosol (SOA) formation during the Holistic Interactions of Shallow Clouds, Aerosols and Land Ecosystems (HI-SCALE) field campaign at the Southern Great Plains (SGP) observatory in Oklahoma, and contrast it with a site within the Bankhead National Forest (BNF), Alabama in Southeast USA, where 5-year long measurements will begin in 2024. Simulations show that nucleation rates are at least an order of magnitude higher at SGP compared to BNF during the springtime days (April 28 and May 14, 2016), largely due to lower H2SO4 concentrations at BNF, which are needed for nucleation. In addition, the larger CS at BNF (compared to SGP) increase the loss of molecular clusters by coagulation to pre-existing particles. Among the 8 different nucleation mechanisms in WRF-Chem, we find that the amine+H2SO4 nucleation mechanism dominates at the SGP site, while the pure organic ion induced nucleation mechanism dominates over BNF. Through various WRF-Chem sensitivity simulations, we find that anthropogenic ELVOCs are critical for explaining the growth of newly formed particles and the resulting number size distribution observed near the surface at the SGP site during the daytime. In addition, we show that treating organic particles as semisolid, with strong diffusion-limited uptake of organic vapours, brings model predictions into closer agreement with the observed evolution of particle size distribution. Simulations also predict that anthropogenic SOA, formed by the oxidation of aromatic volatile organic compounds (VOCs), is the dominant organic aerosol component at SGP, while biogenic SOA dominates particle composition at the BNF site in Southeast USA on these days.

Shrivastava, ManishKumar B.↗
DOE OSTI2022

PythonFOAM: In-situ data analyses with OpenFOAM and Python

Here, we outline the development of a general-purpose Python-based data analysis tool for OpenFOAM. Our implementation relies on the construction of OpenFOAM applications that have bindings to data analysis libraries in Python. Double precision data in OpenFOAM is cast to a NumPy array using the NumPy C-API and Python modules may then be used for arbitrary data analysis and manipulation on flow-field information. We highlight how the proposed wrapper may be used for an in-situ online singular value decomposition (SVD) implemented in Python and accessed from the OpenFOAM solver PimpleFOAM. Here, 'in-situ' refers to a programming paradigm that allows for a concurrent computation of the data analysis on the same computational resources utilized for the partial differential equation solver. In addition, to demonstrate parallel deployments, we deploy a distributed SVD, which collects snapshot data across the ranks of a distributed simulation to compute the global left singular vectors. Crucially, both OpenFOAM and Python share the same message passing interface (MPI) communicator for this deployment which allows Python objects and functions to exchange NumPy arrays across ranks. Subsequently, we provide scaling assessments of this distributed SVD on multiple nodes of Intel Broadwell and KNL architectures for canonical test cases such as the large eddy simulations of a backward facing step and a channel flow at friction Reynolds number of 395. Finally, we demonstrate the deployment of a deep neural network for compressing the flow-field information using an autoencoder to demonstrate an ability to use state-of-the-art machine learning tools in the Python ecosystem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

A Sparse Distributed Gigascale Resolution Material Point Method

In this paper, we present a four-layer distributed simulation system and its adaptation to the Material Point Method (MPM). The system is built upon a performance portable C++ programming model targeting major High-Performance-Computing (HPC) platforms. A key ingredient of our system is a hierarchical block-tile-cell sparse grid data structure that is distributable to an arbitrary number of Message Passing Interface (MPI) ranks. We additionally propose strategies for efficient dynamic load balance optimization to maximize the efficiency of MPI tasks. Our simulation pipeline can easily switch among backend programming models, including OpenMP and CUDA, and can be effortlessly dispatched onto supercomputers and the cloud. Finally, we construct benchmark experiments and ablation studies on supercomputers and consumer workstations in a local network to evaluate the scalability and load balancing criteria. We demonstrate massively parallel, highly scalable, and gigascale resolution MPM simulations of up to 1.01 billion particles for less than 323.25 seconds per frame with 8 OpenSSH-connected workstations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

A New Capability of E4D For 3D Parallel Joint Inversion of DC Resistivity And Traveltime Data on Unstructured Mesh

A major challenge in interpreting geophysical data is how to derive consistent three-dimensional (3D) earth models of different physical properties from spatially and temporally limited measurements. Joint inversion with cross-gradient constraints is an approach to find such models by imposing structural similarities between different physical parameters. We have developed a parallel distributed-memory joint inversion code for direct-current (DC) resistivity and traveltime data using the cross-gradient constraint on unstructured mesh. The code utilizes existing E4D framework for parallel forward simulation, distributed storage and computation of the Jacobian matrix of forward operator, and parallel execution of matrix-vector multiplication during inversion. Besides, the joint inversion is solved by nonlinear conjugate gradient algorithm parallelized for DC resistivity and traveltime data. The joint inversion capability of E4D was tested using synthetic data from cross-borehole DC resistivity and traveltime data. The results indicate that the shape and size of the anomalies from the joint inversion are more reliable than those from separate inversions.

58 GEOSCIENCES↗
DOE OSTI2019

Chapter 16 - Simulating Discrete-Event Models in the Classic Worldviews: A New Approach to Simultaneous Events and Parallel Execution

This chapter describes a new approach to the activity scanning worldview of discrete-event simulation. With this new approach it becomes possible to realize activity scanning simulations with a parallel computer while resolving simultaneous events in a repeatable manner. The motivation for this approach is the two-phase simulation procedure intrinsic to cellular automata, coupled difference equations, and the discrete-event system specification. This new approach is introduced via an intuitively appealing construction of a new simulation procedure for activity scanning models, and this introduction is followed by an embedding of the new approach into the discrete-event system specification. In doing so, we illustrate a practical approach to distributed simulation and demonstrate how the proposed approach can be applied to the event scheduling and process-oriented worldviews.

Nutaro, James J.↗
DOE OSTI2021

Computational Fluid Dynamics (CFD) Simulations of Taylor Bubbles in Vertical and Inclined Pipes with Upward and Downward Liquid Flow

Summary Two-phase flow is a common occurrence in pipes of oil and gas developments. Current predictive tools are based on the mechanistic two-fluid model, which requires the use of closure relations to predict integral flow parameters such as liquid holdup (or void fraction) and pressure gradient. However, these closure relations carry the highest uncertainties in the model. In particular, significant discrepancies have been found between experimental data and closure relations for the Taylor bubble velocity in slug flow, which has been determined to strongly affect the mechanistic model predictions (Lizarraga-García 2016). In this work, we study the behavior of Taylor bubbles in vertical and inclined pipes with upward and downward flow using a validated 3D computational fluid dynamics (CFD) approach with level set method implemented in a commercial code. A total of 56 cases are simulated, covering a wide range of fluid properties, pipe diameters, and inclination angles: Eo ∈ [10, 700]; Mo ∈ [1×10–6, 5×103]; ReSL ∈ [–40, 10]; θ ∈ [5°, 90°]. For bubbles in vertical upward flows, the simulated distribution parameter, C0, is successfully compared with an existing model. However, the C0 values of downward and inclined slug flows where the bubble becomes asymmetric are shown to be significantly different from their respective vertical upward flow values, and no current model exists for the fluids simulated here. The main contributions of this work are (1) the relatively large 3D numerical database generated for this type of flow, (2) the study of the asymmetric nature of inclined and some vertical downward slug flows, and (3) the analysis of its impact on the distribution parameter, C0.

Engineering↗
DOE OSTI2018

CyDER – an FMI-based co-simulation platform for distributed energy resources

The increased integration of distributed energy resources (DERs) is bringing a number of challenges to the power grid. These include reverse power flows in distribution systems and potentially transmission systems and grid stability. So far, specialized tools have been developed to capture some of the impact of DERs at the distribution level. However, distribution system operators lack visibility into the overall system conditions. Furthermore, the impact of increasing DERs is not limited to the distribution level but also influences the transmission grid. To support the planning and operation of the grid, we developed a co-simulation platform called CyDER (A Cyber Physical Co-simulation Platform for Distributed Energy Resources in Smart Grids) that integrates various domain-specific simulation tools. CyDER is based on the functional mock-up interface standard. This paper gives an overview of CyDER and demonstrates its use based on two applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Performance Evaluation of a Novel Sequence-Based Directional Detection Strategy for Protection of Active Distribution Networks

Directional elements are relied on to achieve selectivity in fault detection in power systems. Although such elements have been deployed successfully for many years, there is an increased need for novel methods to deal with the unique challenges of directional protection in modern distribution networks. This article analyzes the impact of inverter-based resources (IBRs) on existing directional protection methods in distribution systems. It identifies parts of such elements that pose a risk of misoperation when IBRs are used in distribution networks. The authors have developed a new directional detection method for unbalanced faults in such networks using superimposed symmetrical sequence quantities. The phase angle of the superimposed negative sequence admittance is used to determine fault direction. The paper also presents a real-time co-simulation platform between a simulated distribution system and physical protection relay, using OPAL-RT. An SEL-411L relay is used to program the detection algorithm. This hardware-in-the-loop (HIL) setup is used to verify the performance of the method and the results are compared with existing directional methods

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2019

Load Modeling with Smart Meter Data for Advanced Volt-VAR Optimization Applications

This paper demonstrates the creation of time-varying, end-use electric load models with electric meter data for use by advanced, model-based volt-VAR optimization (VVO) control schemes. VVO has been shown to reduce energy consumption and peak demand in the electric distribution system. Modern VVO systems use power flow models to make control decisions. In order to make optimal decisions, these models must contain accurate load models. To improve these load models, this work uses active power, reactive power, and voltage magnitude measurements from advanced metering infrastructure (AMI) in a simulated distribution feeder to create electric load models for each customer meter. Three different modeling approaches are discussed, and their effectiveness is measured by comparing the optimality of VVO solutions with a base case. The results show that the models derived from AMI data can accurately represent some end-use load behavior like total energy costs, but lose accuracy when considering more dynamic system behavior like voltage violations over small time intervals. This work helps to advance state-of-the-art, model-based VVO by providing a data-driven modeling technique which acknowledges that optimal distribution system control requires a treatment of the system which is dependent on time, voltage, and system conditions.

Thayer, Brandon L.↗
DOE OSTI2022

E-Beam Irradiation Beamline at Jefferson Lab for Wastewater Treatment

Electron beam (e-beam) irradiation is an advanced method for removing the emerging organic contaminants in wastewater, such as 1,4-dioxane, and per- and polyfluoroalkyl sub?stances (PFAS), which have the potential to be regulated in the near future but are difficult to degrade by conventional treatment methods. This dissertation was based on a collabo?rating study between Jefferson Lab (Jlab) and Hampton Roads Sanitation District (HRSD) to evaluate the impacts of e-beam irradiation on the degradation of 1,4-dioxane and PFAS. It presents the detailed design of an e-beam irradiation beamline, the beamline simulation using general particle tracer (GPT), the installation, and the successful commissioning. The beamline is an extended section to the Upgraded Injector Test Facility (UITF) at Jlab, which is a continuous wave (CW), superconducting radio frequency (SRF) linear accelerator with an energy up to 10 MeV. To let the sample volume receive a significant and uniform dose distribution, the sample target was designed by investigating the dose distribution simulated with a Monte-Carlo code, FLUKA. The optimized beam energy was 8 MeV and the beam current for irradiation was ? 100 nA. With the use of a solenoid and a raster, the electron beam was expanded to the optimized size, 1? ? 15 mm, at the sample target. This dis?sertation also presents the irradiation experiments for 64 1,4-dioxane samples and 48 PFAS samples in different water matrices, including real wastewater, which were prepared and an?alyzed by HRSD. The absorbed doses of samples were obtained by designing a new method that combines the FLUKA simulation and dose mapping experiments. The irradiation re?sults showed that around 95% of 1,4-dioxane was removed at a low dose of ? 2 kGy, and PFAS was possibly removed at a lower dose compared to similar research. This work is a first implementation of SRF technology for wastewater irradiation. It pro?vides a valuable new research platform for wastewater remediation. This will be in support of future industrial applications of advanced SRF technologies and better understanding of the effect of e-beam irradiation on wastewater or water treatment.

Li, Xi↗
DOE OSTI2023

Optimizing Geant4 Hadronic Models

Geant4, the leading detector simulation toolkit used in high energy physics, employs a set of physics models to simulate interactions of particles with matter across a wide range of energies. These models, especially the hadronic ones, rely largely on directly measured cross-sections and inclusive characteristics, and use physically motivated parameters. However, they generally aim to cover a broad range of possible simulation tasks and may not always be optimized for a particular process or a given material. The Geant4 collaboration recently made many parameters of the models accessible via a configuration interface. This opens a possibility to fit simulated distributions to the thin target experimental datasets and extract optimal values of the model parameters and the associated uncertainties. Such efforts are currently undertaken by the Geant4 collaboration with the goal of offering alternative sets of model parameters, also known as "tunes", for certain applications. The effort should subsequently lead to more accurate estimates of the systematic errors in physics measurements given the detector simulation role in performing the physics measurements. Results of the study are presented to illustrate how Geant4 model parameters can be optimized through applying fitting techniques, to improve the agreement between the Geant4 and the experimental data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

High-Performance Transmission and Distribution Co-simulation with 10,000+ Inverter-Based Resources

The inverter-based resource (IBR) has become avery important component in the distribution system. The impacts on system transient stability introduced by high IBR penetration are not fully addressed because of the lack of high-fidelity models. The aggregate IBR model at the transmission level cannot precisely reproduce the dynamics of distributed IBR at the distribution system because of the oversimplification. In this paper, we will develop a high-penetration fully-connected transmission and distribution (T&D) co-simulation platform that supports the simulation of 10,000+ dispersed IBR models. The interfacing and iterative initialization techniques for the co-simulation have been implemented to maintain stable operation and simulation of large-multitude of IBR models. The phasor-domain IBR models with grid-forming (GFM) and grid-following (GFL) control are implemented in the distribution systems simulators. The developed platform is tested on high-performance computing (HPC) resources and can be utilized to explore the hierarchical control strategies of IBRs for the large-scale T&D hybrid system.

Liu, Yuan↗
DOE OSTI2020

IEEE 1547-2018 Based Interoperable PV Inverter with Advanced Grid-Support Functions

Grid integration of photovoltaic (PV) inverters has been increasing in the past decade. As a result of the uncertainties introduced with high penetrations of PV, better monitoring and control of the PV inverters becomes crucial for improving overall system stability. This paper focuses on the communications capability of the inverter controller and on enabling interoperability. Multiple standards are available to enable interoperability in PV inverters. In this paper, an interoperable controller, enabled by Distributed Network Protocol 3 (DNP3) communications protocols, is developed for a grid-connected, three-phase PV inverter. The DNP3 server for the PV inverter is programmed on the real-time layer of the field-programmable gate array (FPGA)-based inverter controller. Set points for advanced inverter control functions, such as volt/VAr curves, ride-through curves, are sent from a DNP3 client, a simulated distribution management system application, to the PV inverter through DNP3. This communications capability of the inverter controller is validated using a controller-hardware-in-the-loop experimental setup. The code developed to achieve the interoperability is available in the public domain through open-source software licensing. This interoperability will enable smoother grid integration of smart PV inverters with advanced grid-support functions as well as allow better monitoring and control of PV inverters for grid stability.

14 SOLAR ENERGY↗
DOE OSTI2021

A Multi-physics Computational Investigation of Droplet Pathogen Transport Eminating from Synthetic Coughs and Breathing

In response to the global SARS-CoV-2 transmission pandemic, Sandia National Laboratories Rapid Lab-Directed Research and Development (LDRD) COVID-19 initiative has deployed a multi-physics, droplet-laden, turbulent low-Mach simulation tool to model pathogen-containing water droplets that emanate from synthetic human coughing and breathing. The low-Mach turbulent Eulerian/point-particle Lagrangian methodology directly couples mass, momentum, energy, and species to capture droplet evaporation physics that supports the ability to distinguish between droplets that deposit and those that persist in the environment. Additionally, the cough mechanism is modeled as a pulsed-spray with a prescribed log-normal droplet size distribution. Simulations demonstrate direct droplet deposition lengths in excess of three meters while the persistence of a droplet nuclei entrained within a buoyant plume is noted. Including the effect of protective barriers demonstrates effective mitigation of large-droplet transport. For coughs into a protective barrier, jet impingement and large-scale re-circulation can drive droplets vertically and back towards the subject while supporting persistence of droplet nuclei. Simulations in quiescent conditions demonstrate droplet preferential concentrations due to the coupling between vortex ring shedding and the subsequent advection of a series of three-dimensional rings that tilt and rise vertically due to a misalignment between the initial principle vortex trajectory and gravity. These resolved coughing simulations note vortex ring formation, roll-up and breakdown, while entraining droplet nuclei for large distances and time scales.

42 ENGINEERING↗
DOE OSTI2023

Modeling Assessment of Residential Air-to-Water Heat Pumps Coupled with Cooling Thermal Storage

This study explored the performance and operating cost viability of air-to-water heat pumps (AWHPs) coupled with thermal energy storage (TES) in efficient new residential construction. AWHPs are an emerging technology in this country, but offer promise in terms of high efficiency, fully contained and factory charged outdoor refrigeration system, and hydronic delivery capabilities, which facilitates zoning, ducts in conditioned space, and TES integration for summer load-shifting. Although this AWHP+TES strategy is not yet mainstream, the authors feel that in ten years as decarbonization efforts proceed and TOU rates become more common, strategies such as this will be more accessible. Validated EnergyPlus simulation models were developed based on detailed monitoring data collected over several years at Pacific Gas and Electric's CVRH laboratory test homes located in Stockton, California. One of the CVRH test homes (1,962 ft 2 two-story) had been testing various AWHP systems and configurations over the past six years. The validated model was then updated with high efficiency IECC ZERH envelope and component requirements for climate zones 1-5, including ducts in conditioned space thermal distribution. Simulations were completed for the 1,962 ft 2 home in each climate zone for a minimum efficiency ASHP, an AWHP coupled with a fan coil, and an AWHP coupled with TES sized to eliminate summer on-peak compressor operation. To maintain consistency in reporting energy use estimates, all cases were run with a similar indoor thermostat control strategy to pre-cool the house below the nominal 76 degrees Fahrenheit set point prior to the on-peak period and float slightly above the set point during the peak period. The AWHP+TES configuration was controlled to alternately condition the indoor space or to charge the TES tanks prior to the beginning of the on-peak. Three composite TOU rates were developed based on existing TOU rates across the U.S. to provide differing economic scenarios to evaluate customer bill impacts throughout the summer. Two of the TOU rates had short three-hour peak periods, while the third rate had a longer seven-hour duration peak period. AWHP modeling projections were based on the observed field performance of the Chiltrix CX34 variable speed unit. Other products on the market or entering the market in the near term would likely perform differently.

25 ENERGY STORAGE↗
DOE OSTI2024

Data transfers for full core heterogeneous reactor high- fidelity multiphysics studies

Multiphysics simulations for nuclear reactor analysis are usually performed by resorting to operator splitting and fixed point iterations between single-physics solvers. This enables the separate solution of each physics, such as neutronics, fuel performance, and thermal hydraulics, on meshes tailored to the requirements of the respective numerical discretizations of the equations. As the equations are coupled, several fields must be transferred between single-physics solves. Projecting fields between meshes while preserving order of accuracy, conservation properties, and mapping non-overlapping geometries is a complex endeavor. This conference paper will present the transfers as implemented in MOOSE, which can handle arbitrary meshes, arbitrary mappings, conservation of integral quantities, and are made to scale with distributed simulations on both ends of the transfers. Their adequacy for advanced nuclear reactor multiphysics coupling is shown through examples and numerical studies.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Cyber-Physical Event Emulation-Based Transmission-and-Distribution Co-Simulation for Situational Awareness of Grid Anomalies (SAGA)

Energy management of transmission and distribution networks (T&D) is becoming more challenging with the accelerated adoption of distributed energy resources (DERs)-such as distributed photovoltaic generation and battery energy storage systems (BESS)-on the electric grid. To better analyze the impacts of DERs on both transmission and distribution systems, a comprehensive T&D co-simulation platform is developed. Further, with DERs more actively participating in system operation-e.g., by providing real-time grid services-their cyber vulnerability needs to be better understood to maintain system reliability. This paper discusses a cyber-physical events emulation-based T&D co-simulation platform to perform comprehensive cyber events emulations, physical simulation, and analysis of interdependent impacts. Results from the case studies-which show how cyber events on a synthetic distribution network can impact operations on the transmission and distribution network-validate that the proposed T&D cosimulation platform can perform cyber-physical events emulation and produce response in near realtime; therefore, with extensive simulation using the proposed co-simulation platform, the system operators can accumulate adequate training data for system situational awareness of grid anomalies.

anomalies detection↗