ParaEMT: An Open Source, Parallelizable, and HPC-Compatible EMT Simulator for Large-Scale IBR-Rich Power Grids
Not Available
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Not Available
This report summarizes the Year 2 work of Pacific Northwest National Laboratory’s (PNNL’s) 5G Fabricated Resource and Asset Management Encompassment for energy infrastructure (Energy FRAME) project funded by the Department of Energy Office of Science’s Advanced Scientific Computing Research (ASCR) Program. In this report, newest 5G equipment testing results are presented, along with two 5G-enabled AI/ML examples for grid applications; in addition, the work flow of grid edge, cloud, and High Performance Computing (HPC) platform is introduced, to support and interface the cross-domain simulation for power system transmission, distribution, and communication networks. Last but not least, the outlook for Year 3 work and the overarching impact of 5G Energy FRAME work to a multitude of stakeholders are provided. Additional 5G performance data now is shared through the publicly available weblink, https://www.pnnl.gov/projects/5g-energy-frame/publications
The steady state solution of the linear quadratic optimal control problem with the constraint that only partial state information is available for feedback is derived. This development results in a systematic and computationally efficient approach for reducing the complexity of the control law for high order systems. Numerical examples and performance evaluation of (1) a simple fourth order system, and (2) a free-free flexible beam, are included.
An extensive numerical and experimental study of airframe noise mechanisms associated with a subsonic high-lift system has been performed at NASA Langley Research Center (LaRC). Investigations involving both steady and unsteady computations and experiments on small-scale models with part-span flaps and full-span flaps are presented. Both surface (steady and unsteady pressure measurements, hot films, oil flows, pressure sensitive paint) and off-surface (5 holeprobe, particle-imaged velocimetry, laser velocimetry, laser light sheet measurements) were taken in the LaRC Quiet Flow Facility (QFF) and several hard-wall tunnels. Experiments in the Low Turbulence Pressure Tunnel (LTPT) included Reynolds number variations up to flight conditions. Successful microphone array measurements were also taken providing both acoustic source maps on the model, and quantitative spectra. Critical directivity measurements were obtained in the QFF. NASA Langley unstructured and structured Reynolds-Averaged Navier-Stokes codes modeled the steady aspects of the flows. Excellent comparisons with surface and off-surface experimental data were obtained. Subsequently, these meanflow calculations were utilized in both linear stability and direct numerical simulations of the flow fields to calculate unsteady surface pressures and farfield acoustic spectra. Accurate calculations were critical in obtaining not only noise source characteristics, but shear layer correction data as well. Techniques utilized in these investigations as well as brief overviews of the results are given.
An extensive numerical and experimental study of airframe noise mechanisms associated with a subsonic high-lift system has been performed at NASA Langley Research Center (LaRC). Investigations involving both steady and unsteady computations and experiments on a small-scale, part-span flap model are presented. Both surface (steady and unsteady pressure measurements, hot films, oil flows, pressure sensitive paint) and off surface (5 hole-probe, particle-imaged velocimetry, laser velocimetry, laser light sheet measurements) were taken in the LaRC Quiet Flow Facility (QFF) and several hard-wall tunnels up to flight Reynolds number. Successful microphone array measurements were also taken providing both acoustic source maps on the model, and quantitative spectra. Critical directivity measurements were obtained in the QFF. NASA Langley unstructured and structured Reynolds- Averaged Navier-Stokes codes modeled the flap geometries excellent comparisons with surface and offsurface experimental data were obtained. Subsequently, these meanflow calculations were utilized in both linear stability and direct numerical simulations of the flap-edge flow field to calculate unsteady surface pressures and farfield acoustic spectra. Accurate calculations were critical in obtaining not only noise source characteristics, but shear layer correction data as well. Techniques utilized in these investigations as well as brief overviews of results will be given.
Conceptual aircraft design is usually based on simple analysis codes. Its objective is to provide an overall system performance of the developed concept, while preliminary aircraft design uses high-fidelity analysis tools such as computational fluid dynamics (CFD) analysis codes or finite element structural analysis codes. In some applications, such as low-boom supersonic concept development, it is important to be able to explore a variety of drastically different configurations while using CFD analysis to check whether a given configuration can be tailored to have a low-boom ground signature. It poses an extremely challenging problem of integrating CFD analysis in conceptual design. This presentation will discuss a computer code, called iPatch, for automatic conversion of conceptual geometry to CFD geometry. In general, conceptual aircraft geometry is not as well-defined as a CAD geometry model. In particular, a conceptual aircraft geometry model usually does not define the intersection curves for the connecting surfaces. The computer code iPatch eliminates the gap between conceptual geometry and CFD geometry by accomplishing the following three tasks automatically: (1) use bicubic B-splines to extrapolate (if necessary) each surface in a conceptual geometry so that all the independently defined geometry components (such as wing and fuselage) can be intersected to form a watertight CFD geometry, (2) compute the intersection curves of surface patches at any resolution (up to 10-7 accuracy) specified by users, and (3) write the B-spline surface patches and the corresponding boundary points for the watertight CFD geometry in the format that can be directly exported to the meshing tool VGRID in the CFD software TetrUSS. As a result, conceptual designers can get quick feedback on the aerodynamic characteristics of their concepts, which will allow them to understand some subtlety in their concepts and to be able to assess their concepts with a higher degree of confidence. This integration of CFD analysis in conceptual aircraft design will greatly eliminate some uncertainty due to simple analysis codes used to develop the concepts and improve the feasibility/credibility of the final concept. The presentation will highlight the mathematical challenges of accomplishing the aforementioned three tasks and the computational algorithms used by iPatch.
The Mars Pathfinder spacecraft, scheduled for launch in December 1996, is designed to validate a low cost Entry, Descent, and Landing system and to perform scientific surface operations. The Jet Propulsion Laboratory and Sandia National Laboratories teamed to design, fabricate, test and validate a prototype 0.38 scale model of an airbag impact attenuation system. A computer code was developed to predict the performance of the airbag system. A test program in Sandia's High Altitude Chamber was performed to validate the code and demonstrate the feasibility of the airbag concept and design. In addition, freefall tests were performed at representative velocities to demonstrate the structural integrity of the airbag system design. The feasibility program demonstrated that the airbag impact attenuation design will protect the lander upon impact with the Martian surface.
The advent of exascale supercomputers heralds a new era of scientific discovery, yet it introduces significant architectural challenges that must be overcome for MPI applications to fully exploit its potential. Among these challenges is the adoption of heterogeneous architectures, particularly the integration of GPUs to accelerate computation. Additionally, the complexity of multithreaded programming models has also become a critical factor in achieving performance at scale. The efficient utilization of hardware acceleration for communication, provided by modern NICs, is also essential for achieving low latency and high throughput communication in such complex systems. In response to these challenges, the MPICH library, a high-performance and widely used Message Passing Interface (MPI) implementation, has undergone significant enhancements. Here, this paper presents four major contributions that prepare MPICH for the exascale transition. First, we describe a lightweight communication stack that leverages the advanced features of modern NICs to maximize hardware acceleration. Second, our work showcases a highly scalable multithreaded communication model that addresses the complexities of concurrent environments. Third, we introduce GPU-aware communication capabilities that optimize data movement in GPU-integrated systems. Finally, we present a new datatype engine aimed at accelerating the use of MPI derived datatypes on GPUs. These improvements in the MPICH library not only address the immediate needs of exascale computing architectures but also set a foundation for exploiting future innovations in high-performance computing. By embracing these new designs and approaches, MPICH-derived libraries from HPE Cray and Intel were able to achieve real exascale performance on OLCF Frontier and ALCF Aurora respectively.
In situ visualization, i.e., visualizing simulation data as it is generated, is an emerging processing paradigm in response to trends in the area of high-performance computing. This paradigm holds great promise in its ability to access increased spatio-temporal resolution and leverage extensive computational power. However, the paradigm is also widely viewed as limiting when it comes to exploration-oriented use cases and further will require visualization systems to become more and more complicated and constrained. Additionally, there are many open research topics within situ visualization. The Dagstuhl seminar 18271 "In Situ Visualization for Computational Science" brought together researchers and practitioners from three communities (computational science, high-performance computing, and scientific visualization) to share interesting findings, to identify lines of open research, and to determine a medium-term research agenda that addresses the most pressing problems. This report summarizes the outcomes and findings of the seminar.
High-performance computing (HPC) researchers have long envisioned scenarios where application workflows could be improved through the use of programmable processing elements embedded in the network fabric. Recently, vendors have introduced programmable Smart Network Interface Cards (SmartNICs) that enable computations to be offloaded to the edge of the network. There is great interest in both the HPC and high-performance data analytics (HPDA) communities in understanding the roles these devices may play in the data paths of upcoming systems. This paper focuses on characterizing both the networking and computing aspects of NVIDIA’s new BlueField-2 SmartNIC when used in a 100Gb/s Ethernet environment. For the networking evaluation we conducted multiple transfer experiments between processors located at the host, the SmartNIC, and a remote host. These tests illuminate how much effort is required to saturate the network and help estimate the processing headroom available on the SmartNIC during transfers. For the computing evaluation we used the stress-ng benchmark to compare the BlueField-2 to other servers and place realistic bounds on the types of offload operations that are appropriate for the hardware. Our findings from this work indicate that while the BlueField-2 provides a flexible means of processing data at the network’s edge, great care must be taken to not overwhelm the hardware. While the host can easily saturate the network link, the SmartNIC’s embedded processors may not have enough computing resources to sustain more than half the expected bandwidth when using kernel-space packet processing. From a computational perspective, encryption operations, memory operations under contention, and on-card IPC operations on the SmartNIC perform significantly better than the general-purpose servers used for comparisons in our experiments. Therefore, applications that mainly focus on these operations may be good candidates for offloading to the SmartNIC.
The studies examined for imposed sinusoidal and random motions of the shuttle skin and/or applied tile pressure. Studies are performed using the computer code DYNOTA which takes into account the highly nonlinear stiffening hysteresis and viscous behavior of the pad joining the tile to the shuttle skin. Where available, experimental data are used to confirm the validity of the analysis. Both analytical and experimental studies reveal that the system resonant frequency is very high for low amplitude oscillations but decreases rapidly to a minimum value with increasing amplitude.
Bayesian finite element (FE) model updating using direct model evaluations of large-scale high-fidelity FE models is extremely computationally expensive. Surrogate models can be used as fast emulators of FE models to accelerate the model calibration process. The physics/mechanics-based FE models are still the underpinning behind the surrogate models. Here, this paper evaluates the loss in accuracy and the gain in computational time while performing Bayesian model updating by using surrogate model evaluations compared to using direct FE model evaluations. This evaluation is crucial before entirely relying on surrogate models in model updating for structural health monitoring (SHM) and damage prognosis (DP) purposes. This paper also demonstrates Bayesian updating and surrogate model construction of large-scale high-fidelity FE models of infrastructure systems. In this regard, the miter gate structural system is considered as the testbed structure. Three predominant damage modes (loss of contact between gate and wall, loss of thickness due to corrosion, and loss of tension in the diagonal rods) are considered for model updating purposes. Bayesian model updating is performed using direct FE evaluations by leveraging parallel computing. Two types of surrogates, namely polynomial chaos expansion (PCE) and Gaussian process regression (GPR), are developed for the miter gate. Model updating is performed again using the trained surrogate models, and the updating results are compared with their counterparts obtained using the direct FE evaluation results. The posterior distribution of the FE model parameters obtained using the trained surrogates are sufficiently accurate with respect to the posterior obtained utilizing the direct FE evaluations. In addition, an approximate 4-fold decrease in the computational time was observed when using surrogate model evaluations instead of direct FE evaluations for model updating.
Being an infrastructure system, the computer network has a fundamental role in the day to day activities of personnel working at KSC. It is easily appreciated that the lack of 'satisfactory' network performance can have a high 'cost' for KSC. Yet, this seemingly obvious concept is quite difficult to demonstrate. At what point do we say that performance is below the lowest tolerable level? How do we know when the 'cost' of using the system at the current level of degraded performance exceeds the cost of upgrading it? In this research, we consider the cost and performance factors that may have an effect in decision making in regards to upgrading computer networks. Cost factors are detailed in terms of 'direct costs' and 'subjective costs'. Performance factors are examined in terms of 'required performance' and 'offered performance.' Required performance is further examined by presenting a methodology for trend analysis based on applying interpolation methods to observed traffic levels. Offered performance levels are analyzed by deriving simple equations to evaluate network performance. The results are evaluated in the light of recommended upgrade policies currently in use for telephone exchange systems, similarities and differences between the two types of services are discussed.
In situ visualization, i.e., visualizing simulation data as it is generated, is an emerging processing paradigm in response to trends in the area of high-performance computing. This paradigm holds great promise in its ability to access increased spatio-temporal resolution and leverage extensive computational power. However, the paradigm is also widely viewed as limiting when it comes to exploration-oriented use cases and further will require visualization systems to become more and more complicated and constrained. Additionally, there are many open research topics with in situ visualization. The Dagstuhl seminar 18271 “In Situ Visualization for Computational Science” brought together researchers and practitioners from three communities (computational science, high-performance computing, and scientific visualization) to share interesting findings, to identify lines of open research, and to determine a medium-term research agenda that addresses the most pressing problems. This report summarizes the outcomes and findings of the seminar.
In situ visualization, i.e., visualizing simulation data as it is generated, is an emerging processing paradigm in response to trends in the area of high-performance computing. This paradigm holds great promise in its ability to access increased spatio-temporal resolution and leverage extensive computational power. However, the paradigm is also widely viewed as limiting when it comes to exploration-oriented use cases and further will require visualization systems to become more and more complicated and constrained. Additionally, there are many open research topics with in situ visualization. The Dagstuhl seminar 18271 "In Situ Visualization for Computational Science" brought together researchers and practitioners from three communities (computational science, high-performance computing, and scientific visualization) to share interesting findings, to identify lines of open research, and to determine a medium-term research agenda that addresses the most pressing problems. This report summarizes the outcomes and findings of the seminar.
Faults in the transmission grid have led to reduced power generation from power electronics resources that are typically not connected to the faulted transmission line. In many of the cases, partial loss of power is observed within the power electronics resources like large photovoltaic (PV) power plants. This phenomena is not captured in existing simulation models and/or simulators. High-fidelity switched system electromagnetic transient (EMT) dynamic models of PV power plants can improve the fidelity of models available for accurate analysis of the impact on PV plants during simulation of faults. However, these models are extremely computationally expensive and take a long time to simulate. Long simulation times limit the ability to use these models as larger regions are studied in EMT simulations with more power electronics resources. In this paper, numerical simulation algorithms are combined with high-performance computing techniques and applied to the high-fidelity switched system EMT model of PV plants. Using these techniques, a speed-up of up to 58x is obtained, while preserving the accuracy of the simulation at greater than 98%.
The distribution and transmission grids are observing an increased penetration of power electronics in loads and generations. For example, there is increasing interest in integrating in extreme fast charging (XFC) systems for fast charging of electrical vehicles. As these systems are integrated, developing high-fidelity electromagnetic transient model of XFC systems in distribution grids and evaluating their interactions with the power grid would be of significant interest. This model will be utilized for design of XFC systems, to identify upgrades in distribution and/or transmission grids, for planning purposes by transmission planners or operators or owners, among others. It can also be utilized in operations for improved reliable performance of the grid and/or XFC station. The challenge with simulating these models is the high computational complexity introduced by the large number of states present in the system and the time-step needed to simulate the system. In this paper, advanced simulations algorithms are applied to reduce the computational complexity of simulating large-scale XFC systems. The algorithms include numerical stiffness-based segregation, time constant-based segregation, clustering and aggregation on differential algebraic equations (DAEs), and multi-order integration approaches. While the first three algorithms split the matrix that needs to be inverted from a large matrix to much smaller matrices, the final algorithm reduces the computational burden of applying higher-order integration approaches in the complete system. The comparison made in the previous sentence is with respect to use of homogeneous integration approaches used in conventional electromagnetic transient simulators like power systems computer aided design (PSCAD). The approaches mentioned here have resulted in speed-up of 36x in the simulation of a single distribution system with 15 XFCs.
The Multi-KiloHertz Micro-Laser Altimeter (MMLA) is an aircraft based instrument developed by NASA Goddard Space Flight Center with several potential spaceflight applications. This presentation describes how reconfigurable computing technology was employed to perform MMLA signal extraction in real-time under realistic operating constraints. The MMLA is a "single-photon-counting" airborne laser altimeter that is used to measure land surface features such as topography and vegetation canopy height. This instrument has to date flown a number of times aboard the NASA P3 aircraft acquiring data at a number of sites in the Mid-Atlantic region. This instrument pulses a relatively low-powered laser at a very high rate (10 kHz) and then measures the time-of-flight of discrete returns from the target surface. The instrument then bins these measurements into a two-dimensional array (vertical height vs. horizontal ground track) and selects the most likely signal path through the array. Return data that does not correspond to the selected signal path are classified as noise returns and are then discarded. The MMLA signal extraction algorithm is very compute intensive in that a score must be computed for every possible path through the two dimensional array in order to select the most likely signal path. Given a typical array size with 50 x 6, up to 33 arrays must be processed per second. And for each of these arrays, roughly 12,000 individual paths must be scored. Furthermore, the number of paths increases exponentially with the horizontal size of the array, and linearly with the vertical size. Yet, increasing the horizontal and vertical sizes of the array offer science advantages such as improved range, resolution, and noise rejection. Due to the volume of return data and the compute intensive signal extraction algorithm, the existing PC-based MMLA data system has been unable to perform signal extraction in real-time unless the array is limited in size to one column, This limits the ability of the MMLA to operate in environments with sparse signal returns and a high number of noise return. However, under an IR&D project, an FPGA-based, reconfigurable computing data system has been developed that has been demonstrated to perform real-time signal extraction under realistic operating constraints. This reconfigurable data system is based on the commercially available Firebird Board from Annapolis Microsystems. This PCI board consists of a Xilinx Virtex 2000E FPGA along with 36 MB of SRAM arranged in five separately addressable banks. This board is housed in a rackmount PC with dual 850MHz Pentium processors running the Windows 2000 operating system. This data system performs all signal extraction in hardware on the Firebird, but also runs the existing "software based" signal extraction in tandem for comparison purposes. Using a relatively small amount of the Virtex XCV2000E resources, the reconfigurable data system has demonstrated to improve performance improvement over the existing software based data system by an order of magnitude. Performance could be further improved by employing parallelism. Ground testing and a preliminary engineering test flight aboard the NASA P3 has been performed, during which the reconfigurable data system has been demonstrated to match the results of the existing data system.