Search NASA⌕ Search

SEARCH · Search NASA

Results for “GRID MODERNIZATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

A State-Space Model of an Inverter-Based Microgrid for Multivariable Feedback Control Analysis and Design

In this work, a synchronous model for grid-connected and islanded microgrids is presented. The grid-connected model is based on the premise that the reference frame is synchronized with the AC bus. The quadrature component of the AC bus voltage can be cancelled, which allows to express output power as a linear equation for nominal values in the AC bus amplitude voltage. The model for the islanded microgrid is developed by integrating all the inverter dynamics using a state-space model for the load currents. This model is presented in a comprehensive way such that it could be scalable to any number of inverter-based generators using inductor–capacitor–inductor (LCL) output filters. The use of these models allows designers to assess microgrid stability and robustness using modern control methods such as eigenvalue analysis and singular value diagrams. Both models were tested and validated in an experimental setup to demonstrate their accuracy in describing microgrid dynamics. In addition, three scenarios are presented: non-controlled model, Linear-Quadratic Integrator (LQI) power control, and Power-Voltage (PQ/Vdq) droop–boost controller. Experimental results demonstrate the effectiveness of the control strategies and the accuracy of the models to describe microgrid dynamics.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A GPU-based compressible combustion solver for applications exhibiting disparate space and time scales

High-speed chemically active flows pose significant computational challenges due to their disparate space and time scales, with stiff chemistry often dominating simulation time. While modern scientific computing programs achieve exascale performance by leveraging graphics processing units (GPUs), existing GPU-based compressible combustion solvers face critical limitations in memory management, load balancing, and handling the highly localized nature of chemical reactions. To this end, we present a high-performance compressible reacting flow solver built on the AMReX framework and optimized for multi-GPU settings. Here, our approach addresses three GPU performance bottlenecks: memory access patterns through column-major storage optimization, computational workload variability via a bulk-sparse integration strategy for chemical kinetics, and multi-GPU load distribution for adaptive mesh refinement applications. The solver adapts existing matrix-based chemical kinetics formulations to multi-grid contexts. Using representative combustion applications, including 2D and 3D detonations and a 3D jet-in-crossflow configuration, we demonstrate 1.4–5× performance improvements over initial implementations on an in-house cluster of NVIDIA H100 GPUs, and near-ideal weak scaling on the Frontier supercomputer (Oak Ridge Leadership Computing Facility) with up to 1024 AMD Instinct MI250X GPUs. Roofline analysis reveals substantial improvements in arithmetic intensity for both convection (∼ 10 ×) and chemistry (∼ 4 ×) routines, confirming efficient utilization of GPU memory bandwidth and computational resources.

42 ENGINEERING↗

NARUC Resilience Framework

The NARUC Resilience Framework provides state regulators and other key stakeholders with a structured approach to considering policies and programs that will enhance grid resilience amid evolving technological, environmental and economic challenges. This Framework consolidates insights from nationwide workshops and peer discussions into six actionable components: (1) setting goals and objectives, (2) leveraging use cases, (3) establishing shared definitions, (4) ensuring inclusive process leadership, (5) addressing critical design questions, and (6) guiding implementation. This Framework is intended as a strategic tool for regulators to navigate resilience investments, prioritize affordability, integrate stakeholder needs, and foster collaboration across agencies, all while balancing cost-effectiveness with societal and economic resilience outcomes. By presenting a structured approach to decision-making rather than prescriptive solutions, the Framework supports nuanced, jurisdiction-specific resilience planning and is adaptable to the dynamic demands of modern energy systems

24 POWER TRANSMISSION AND DISTRIBUTION↗

Automated laser-based barely visible impact damage detection in honeycomb sandwich composite structures

Nondestructive evaluation (NDE) for detection and quantification of damage in composite materials is fundamental in the assessment of the overall structural integrity of modern aerospace systems. Conventional NDE systems have been extensively used to detect the location and size of damages by propagating ultrasonic waves normal to the surface. However they usually require physical contact with the structure and are time consuming and labor intensive. An automated, contactless laser ultrasonic imaging system for barely visible impact damage (BVID) detection in advanced composite structures has been developed to overcome these limitations. Lamb waves are generated by a Q-switched Nd:YAG laser, raster scanned by a set of galvano-mirrors over the damaged area. The out-of-plane vibrations are measured through a laser Doppler Vibrometer (LDV) that is stationary at a point on the corner of the grid. The ultrasonic wave field of the scanned area is reconstructed in polar coordinates and analyzed for high resolution characterization of impact damage in the composite honeycomb panel. Two methodologies are used for ultrasonic wave-field analysis: scattered wave field analysis (SWA) and standing wave energy analysis (SWEA) in the frequency domain. The SWA is employed for processing the wave field and estimate spatially dependent wavenumber values, related to discontinuities in the structural domain. The SWEA algorithm extracts standing waves trapped within damaged areas and, by studying the spectrum of the standing wave field, returns high fidelity damage imaging. While the SWA can be used to locate the impact damage in the honeycomb panel, the SWEA produces damage images in good agreement with X-ray computed tomographic (X-ray CT) scans. The results obtained prove that the laser-based nondestructive system is an effective alternative to overcome limitations of conventional NDI technologies.

36 MATERIALS SCIENCE↗

pyRMG: A framework for high-throughput, large-cell DFT calculations on supercomputers

Exascale computing delivers the raw power to simulate ever larger and more chemically realistic systems, but realizing this potential requires codes that can efficiently use thousands of processors. Our real-space multigrid (RMG) density functional theory (DFT) code’s grid-decomposition approach scales nearly linearly with the number of graphics processing units (GPUs), even for simulations exceeding thousands of atoms. This scalability makes RMG a compelling tool for high-throughput DFT studies of materials that would otherwise be bottlenecked in other codes (for example, by global fast Fourier transforms in plane-wave DFT). However, the limited workflow infrastructure for RMG has thus far constrained its adoption to a small user community. In this work, we present pyRMG, a Python package designed to streamline the setup and execution of RMG DFT calculations. Built on the pymatgen and ASE (Atomic Simulation Environment) computational materials science Python packages, pyRMG automates input generation and convergence checking, and it integrates with modern job schedulers (e.g., Flux) on leadership-class platforms such as Frontier and Perlmutter. Here, we demonstrate pyRMG for a high-throughput study of strain effects in 2D 2L-Bi 2 Se 3 /2L-NbSe 2 heterostructures, which offers chemical insights into this system and shows that RMG-based workflows can converge with limited user intervention.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multi-Timescale Integrated Dynamic and Scheduling Model (MIDAS-Solar)

Solar photovoltaic (PV) installations have experienced unprecedented growth in the United States. PV will become not only an energy producer but also a necessary provider of ancillary services at multiple timescales. Conventional methods to simulate power system operations - such as long-term production simulation (which typically considers schedules from hours to minutes by using an optimization framework) and short-term transient studies (which simulate dynamics from seconds to sub-seconds using state variables and differential equations) are not sufficient for studying the multiple-timescale variation of solar generation and its impact on system reliability. Long-term system economics and short-term system dynamics are highly coupled, particularly when the penetration level of renewable generation is extremely high, because the uncertainty and variability of solar generation will impact both power systems steady-state and dynamic performance. This project helps meet and exceed the Solar Energy Technologies Office goal of systems integration by directly addressing this stability and reliability challenge for electric grid planning and operation. This will be accomplished by developing temporally comprehensive, closed-loop simulation models that seamlessly simulate power systems operations from economic scheduling (day-ahead to hours) to dynamic response analysis (seconds to sub-seconds). Both a multi-timescale grid model and an integrated PV model will be developed in this project to accurately study the impacts of PV variability and uncertainty on system reliability at multiple timescales. Using quasi-dynamic simulation methods and data-driven security assessment (DSA) criteria will allow the dynamic characteristics of PV to be fed forward into longer-timescale scheduling models for a complete understanding of the effect of short-term PV dynamics on bulk systems operations (e.g., reserve scheduling and deployment). Upon completion of the proposed model, this project will help operators accurately assess system reliability by deploying energy and reserve scheduling under critical contingency conditions and studying interactions among all types of essential reliability services provided by modern PV power plants.

14 SOLAR ENERGY↗

NJOY21: Making NJOY Suitable for the 21. Century - 14409

NJOY has a long history of nuclear data processing. NJOY began as a successor to MINX (Multigroup Interpretation of Nuclear X-Sections), a Los Alamos code and was first publicly released in the summer of 1977. The initial version included modules such as RECONR for resonance reconstruction on a union energy grid, BROADR for Doppler broadening plus a new Multigroup averaging program, GROUPR and an associated output module, DTR. Soon thereafter the HEATR, ERRORR, and THERMR modules were added to NJOY. By the mid 1980's, NJOY had a worldwide user community. The current version of NJOY2012 was released in December 2012. NJOY2012 builds on the success of more than 45 years of nuclear data processing at Los Alamos National Laboratory. NJOY2012 was rewritten using Fortran 90/95, utilizing among other things the concepts of public and private variables, eliminating common blocks in lieu of Fortran modules and taking advantage of allocatable arrays. A new version of NJOY is being developed at Los Alamos National Laboratory; NJOY21: NJOY for the 21. Century. NJOY21 uses modern programming standards of quality, reliability, and maintainability. It is being designed from the ground up to utilize modern methods of interacting with computer codes by providing an interactive and scripting (e.g., Python) interface. This will allow scientists the ability to more easily work with the results of the various steps in the processing of nuclear data. NJOY21 will continue the legacy of NJOY by providing a trusted and verified processing code that is fast, flexible, easy to use and customize and capable of handling both modern and established nuclear data formats. This paper introduces NJOY21 by first relating the history of NJOY; the majority of the paper will discuss NJOY21. NJOY21 will take advantage of the many decades of nuclear data processing experience that is contained in NJOY2012 and previous versions of NJOY and extend the capabilities and convenience of processing nuclear data. We will discuss how NJOY21 will remain backwards compatible with NJOY2012 - i.e., how current NJOY2012 input decks will continue to work with NJOY21. We will also discuss the verification and validation of the NJOY21 code base. Finally we will discuss new features in NJOY21 that do not exist in NJOY2012. These features include changes in how a scientist can interact with NJOY to process and verify and validate nuclear data; and the ability to read and write new nuclear data formats. (authors)

42 ENGINEERING↗

Achieving Higher Order Accuracy in Space in Hydrodynamic Simulations of Self-Gravitating Gas

Modern astrophysical simulation codes employ a variety of numerical algorithms capable of achieving higher-order accuracy in both space and time. Albeit they succeed in achieving an effective higher spatial resolution and in suppressing the numerical damping of waves, to our knowledge, all current astrophysical simulations invoking self-gravity are limited to second-order accuracy in space. If we can devise an algorithm to evaluate self-gravity with a higher-order spatial accuracy, we can better the evaluation of the gravitational acceleration and gravitational energy release which dictate the evolution of many astrophysical systems. Herein, we present a numerical algorithm for self-gravitating hydrodynamics capable of achieving fourth order accuracy for a given density distribution on a Cartesian uniform grid. First, we derive the cell-averaged gravitational potential at fourth-order accuracy from the cell-averaged density by solving the Poisson equation. Next, we obtain the cell average of the product of the density and gravitational acceleration, which differs from the cell-averaged density multiplied by the cell-averaged gravitational acceleration. We then show the verification of the algorithm by applying it to critical test problems: (1) maintaining equilibria of self-gravitating slabs, even upon advection, (2) evolving a polytropic sphere with a massive power-law envelope, and (3) conservation of specific entropy during the propagation of a sound wave.

79 ASTRONOMY AND ASTROPHYSICS↗

Experimenting with the GMAO 4D Data Assimilation

The Global Modeling and Assimilation Office (GMAO) has been working to promote its prototype four-dimensional variational (4DVAR) system to a version that can be exercised at operationally desirable configurations. Beyond a general circulation model (GeM) and an analysis system, traditional 4DV AR requires availability of tangent linear (TL) and adjoint (AD) models of the corresponding GeM. The GMAO prototype 4DVAR uses the finite-volume-based GEOS GeM and the Grid-point Statistical Interpolation (GSI) system for the first two, and TL and AD models derived ITom an early version of the finite-volume hydrodynamics that is scientifically equivalent to the present GEOS nonlinear GeM but computationally rather outdated. Specifically, the TL and AD models hydrodynamics uses a simple (I-dimensional) latitudinal MPI domain decomposition, which has consequent low scalability and prevents the prototype 4DV AR ITom being used in realistic applications. In the near future, GMAO will be upgrading its operational GEOS GCM (and assimilation system) to use a cubed-sphere-based hydrodynamics. This versions of the dynamics scales to thousands of processes and has led to a decision to re-derive the TL and AD models for this more modern dynamics, thus taking advantage of a two-dimensional MPI decomposition and improved scalability properties. With the aid of the Transformation of Algorithms in FORTRAN (l'AF) automatic adjoint generation tool and some hand-coding, a version of the cubed-sphere-based TL and AD models, with a simplified vertical diffusion scheme, is now available, enabling multiple configurations of standard implementations of 4DV AR in GEOS. Concurrent to this development, collaboration with the National Centers for Environmental Prediction (NCEP) and the Earth System Research Laboratory (ESRL) has allowed GMAO to implement a hybrid-ensemble capability within the GEOS data assimilation system. Both 3Dand 4D-ensemble capabilities are presently available thus allowing GMAO to now evaluate the performance and benefit of various ensemble and variational assimilation strategies. This presentation will cover the most recent developments taking place at GMAO and show results from various comparisons from traditional techniques to more recent ensemble-based ones.

Todling, R.↗

Achieving Higher Order Accuracy in Space in Hydrodynamic Simulations of Self-Gravitating Gas

Modern astrophysical simulation codes employ a variety of numerical algorithms capable of achieving higher-order accuracy in both space and time. Albeit they succeed in achieving an effective higher spatial resolution and in suppressing the numerical damping of waves, to our knowledge, all current astrophysical simulations invoking self-gravity are limited to second-order accuracy in space. If we can devise an algorithm to evaluate self-gravity with a higher-order spatial accuracy, we can better the evaluation of the gravitational acceleration and gravitational energy release which dictate the evolution of many astrophysical systems. Herein, we present a numerical algorithm for self-gravitating hydrodynamics capable of achieving fourth-order accuracy for a given density distribution on a Cartesian uniform grid. First, we derive the cell-averaged gravitational potential at fourth-order accuracy from the cell-averaged density by solving the Poisson equation. Next, we obtain the cell average of the product of the density and gravitational acceleration, which differs from the cell-averaged density multiplied by the cell-averaged gravitational acceleration. We then show the verification of the algorithm by applying it to critical test problems: (1) maintaining equilibria of self-gravitating slabs, even upon advection, (2) evolving a polytropic sphere with a massive power-law envelope, and (3) conservation of specific entropy during the propagation of a sound wave.

79 ASTRONOMY AND ASTROPHYSICS↗

A Block-Structured Adaptive Mesh Framework to Solve Radiation Transfer Equation in Irregular Embedded Geometries

Radiation transport arises in various scientific, industrial, and medical fields, and understanding its effect in applications is needed to make accurate predictions, safety assessments and performance optimizations. Solving the Radiation Transport Equation (RTE) is challenging due to its integro-differential nature, which involves both differential and integral terms. The differential term describes the change in radiation intensity due to absorption and emission, while the integral term accounts for scattering. The accurate modeling of radiation is further complicated in many applications due to the complex, irregular geometries. Various methods exist for solving the RTE, including the zonal, Monte Carlo, spherical harmonics, discrete ordinates, and finite volume methods. Traditional mesh-based approaches, which rely on structured or unstructured meshes, struggle with irregular geometries due to: a) the difficulty of conforming structured grids to irregular domains, b) challenges in enforcing boundary conditions correctly, and c) the additional computational cost of unstructured mesh methods. This work presents a second-order accurate method for solving the RTE in irregular geometries. The radiation intensity is discretized using the finite-volume method in both spatial and angular directions on regular Cartesian grid blocks. Leveraging the block-structured adaptive mesh refinement (AMR) framework provided by AMReX, our method refines the grid locally to reduce spatial discretization error, ensuring a converged numerical solution while minimizing computational costs elsewhere. A two-stage deferred correction approach is employed: First, a first-order discretization on grid blocks is solved using an algebraic multigrid method in HYPRE. Second, a correction term is applied explicitly to achieve second-order accuracy. The correction term is calculated by approximating the radiation flux on cell faces using a Total Variation Diminishing (TVD) scheme. This approach ensures quick convergence of the multigrid method while preserving higher-order accuracy of the numerical solution. Irregular geometries are resolved as embedded boundaries (EB), resulting in both cut cells and regular cells. In cut cells, we modify the fluxes using face fractions and incorporate additional contributions from EB boundary conditions. To ensure higher-order convergence near the EB interface, the correction term is modified by interpolating the radiation intensity to fictitious ghost points. The implementation takes advantage of modern supercomputers by leveraging AMReX’sMPI/X parallelization strategy where X can be MPI or a GPU accelerator including CUDA, HIP and DPC++. We validate our solver using classical test cases, both with and without EB, demonstrating accuracy and efficiency. Additionally, we analyze the impact of adaptive mesh refinement on solution accuracy and computational cost, highlighting the advantages of our approach for high-resolution radiation transport simulations.

computational fluid dynamics (CFD)↗

A multiresolution adaptive wavelet method for nonlinear partial differential equations

We report the multiscale complexity of modern problems in computational science and engineering can prohibit the use of traditional numerical methods in multi-dimensional simulations. Therefore, novel algorithms are required in these situations to solve partial differential equations (PDEs) with features evolving on a wide range of spatial and temporal scales. To meet these challenges, we present a multiresolution wavelet algorithm to solve PDEs with significant data compression and explicit error control. We discretize in space by projecting fields and spatial derivative operators onto wavelet basis functions. We provide error estimates for the wavelet representation of fields and their derivatives. Then, our estimates are used to construct a sparse multiresolution discretization which guarantees the prescribed accuracy. Additionally, we embed a predictor-corrector procedure within the temporal integration to dynamically adapt the computational grid and maintain the accuracy of the solution of the PDE as it evolves. We present examples to highlight the accuracy and adaptivity of our approach.

97 MATHEMATICS AND COMPUTING↗

Pumped Storage Hydropower (PSH) FAST Commissioning Prize Technical Analysis

The US energy landscape has undergone major changes over the past 10 years and will continue to see significant changes in future decades as the power grid increases its reliance on variable renewable energy resources. Because of the inherent variability of these resources, renewable energy growth may require additional energy storage capacity to provide flexible load-following capabilities and other grid services that can quickly adjust to changes in energy demand and generation. Pumped storage hydropower (PSH)—one such energy storage technology—uses pumps to convey water from a lower reservoir to an upper reservoir for energy storage and releases water back to the lower reservoir via a powerhouse for hydropower generation. PSH facility pump and generation cycling often follows economic and energy demand conditions. Across the United States, 43 PSH facilities are in operation and 55 projects are in various permitting or licensing stages. Altogether, the 43 operational projects provide the wide majority (95%) of utility-scale electricity storage in the United States. These facilities also provide significant power and nonpower grid benefits, including large-scale electrical system reserve capacity, grid reliability support, and electricity supply-demand balancing through quick-response capabilities and operational flexibility. PSH systems can accomplish these at a scale (e.g., size) and cost that makes these systems highly attractive from a technical standpoint. Although these research concepts are still in their infancy, they demonstrate promising potential as future PSH energy storage technologies. Although PSH has many advantages, development in the United States has effectively stalled since the 1990s, partially because of the magnitude of project costs and financing interest during development and construction, the length of time from project investment until project revenue begins, permitting challenges, construction risks, competition from other storage technologies (e.g., batteries, hydrogen storage), and electricity market evolution and uncertainty. In short, the time, cost, and risk associated with modern PSH development have resulted in limited growth in the United States recently, despite the growing energy storage demand stemming from increased wind and solar power deployment. Technology innovation is needed to help reduce PSH commissioning time, cost, and risk, particularly during the post-licensing phase of project development. To address challenges facing the PSH industry and to improve PSH commissioning timelines, the US Department of Energy (DOE) Water Power Technologies Office (WPTO) initiated the PSH Furthering Advancements to Shorten Time to (FAST) Commissioning Prize project.

13 HYDRO ENERGY↗

Updraft Constraints on Entrainment: Insights from Amazonian Deep Convection

Abstract Mixing of environmental air into clouds, or entrainment, has been identified as a major contributor to erroneous climate predictions made by modern comprehensive climate and numerical weather prediction models. Despite receiving extensive attention, the ad hoc treatment of this convective-scale process in global models remains poor. On the other hand, while limited-area high-resolution nonhydrostatic models can directly resolve entrainment, their sensitivity to model resolution, especially with the lack of benchmark mass flux observations, limits their applicability. Here, the dataset from the Observations and Modeling of the Green Ocean Amazon (GoAmazon2014/5) campaign focusing on radar retrievals of convective updraft vertical velocities is used with the aid of cloud-resolving model simulations of four deep convective events over the Amazon to provide insights into entrainment. Entrainment and detrainment are diagnosed from the model simulations by applying the mass continuity equation over cloud volumes, in which grid cells are identified by some thresholds of updraft vertical velocity and cloud condensates, and accounting for the sources and sinks of the air mass. Entrainment is then defined as the environmental air intruding into convective cores causing cloud volume to shrink, while detrainment is defined as cloudy grid cells departing the convective core and causing cloud volume to expand. It is found that the diagnosed entrainment from the simulated convective events is strongly correlated to the inverse of the updraft vertical velocities in convective cores, which enables a more robust estimation of the mixing time scale. This highlights the need for improved observational capabilities for sampling updraft velocities across diverse geographic and cloud conditions. Evaluation of a number of assumptions used to represent entrainment in parameterization schemes is also presented, as contrasted against the diagnosed one.

54 ENVIRONMENTAL SCIENCES↗

Distributed Transient Safety Verification via Robust Control Invariant Sets: A Microgrid Application

Modern safety-critical energy infrastructures are increasingly operated in a hierarchical and modular control framework which allows for limited data exchange between the modules. In this context, it is important for each module to synthesize and communicate constraints on the values of exchanged information in order to assure system-wide safety. To ensure transient safety in inverter-based microgrids, we develop a set invariance-based distributed safety verification algorithm for each inverter module. Applying Nagumo's invariance condition, we construct a robust polynomial optimization problem to jointly search for safety-admissible set of control set-points and design parameters, under allowable disturbances from neighbors. We use sum-of-squares (SOS) programming to solve the verification problem and we perform numerical simulations using grid-forming inverters to illustrate the algorithm.

Bouvier, Jean-Baptiste H.↗

Rotated-Droop Control for Enhanced Stability and Power Decoupling in Microgrids With Complex Line Impedances

Classical droop control in microgrids predominantly assumes inductive line impedance, which simplifies implementation but causes power coupling and steady-state errors in systems with resistive and inductive lines. This paper proposes a rotated-droop control strategy for grid-forming inverters that reformulates the power equations by incorporating the magnitude and angle of the line impedance within a rotated reference frame. This method enhances the decoupling of active and reactive power dynamics without increasing complexity or requiring communication links. A small-signal state-space model was created to capture the dynamic behavior of the system under varying impedance parameters, preserving the original droop gains by rotating the power control structure. This allows eigenvalue-based stability analysis and enhances damping and transient performance. Simulation and experimental results validated the improved power-sharing performance, faster response, and robustness of the proposed method under different impedance conditions. This approach maintains the decentralized structure of the conventional droop control while enabling greater adaptability and scalability, making it suitable for modern inverter-based microgrids with dynamic topologies.

Campo-Ossa, Daniel Dario [Univ. of Puerto Rico, Ag↗

Study the Protection Improvements for a Weak Grid Area With High IBRs

NLR is collaborating with Florida Power & Light (FPL) and GE to investigate power system stability and protection reliability challenges in a weak-grid region with high penetration of inverter-based resources (IBRs). This presentation will primarily focus on the protection aspects of the study. We will share key insights from this real-world project, including best practices for developing high-fidelity fault study models, establishing a controller-hardware-in-the-loop (CHIL) platform for testing physical relays, identifying system-level protection challenges, and designing enhanced protection schemes to address those issues. Through this discussion, the audience will gain practical understanding of protection studies in IBR-dominated systems, the emerging challenges associated with reduced fault current and altered transient behavior, and effective mitigation strategies. In particular, we will highlight the critical importance of IBR compliance with IEEE 2800-2022 to ensure dependable and secure protection relay operation in modern transmission systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

BigPanDA: PanDA Workload Management System and its Applications beyond ATLAS

Modern experiments collect peta-scale volumes of data and utilize vast, geographically distributed computing infrastructure that serves thousands of scientists around the world. Requirements for rapid, near real-time data processing, fast analysis cycles and need to run massive detector simulations to support data analysis pose special premium on efficient use of available computational resources. A sophisticated Workload Management System (WMS) is needed to coordinate the distribution and processing of data and jobs in such environment. The ATLAS experiment at CERN uses PanDA (Production and Data Analysis) Workload Management System for managing the workflow for all data processing on over 150 data centers. While PanDAcurrently uses more than 250,000 cores with a peak performance of 0.3 petaFLOPS, it runs around 2 million jobs per day on hundreds of Grid sites and serving thousands of ATLAS users. In 2017 about 1.5 exabytes of data were processed with PanDA.In 2012 BigPanDA project project was started with aim to introduce new types of computing resources into ATLAS computing infrastructure, but also to offering PanDA features to different data-intensive applications for projects and experiments outside of ATLAS and High-Energy and Nuclear Physics. In this article we will present accomplishments and discuss possible directions for future work.

Svirin, Pavlo↗