Deep Learning Architecture for Processing Cyber-Physical Data in the Electric Grid.
Abstract not provided.
Calzada, Daniel↗
SEARCH · Search NASA
Results for “gridded data”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Experiments and Data Requirements to Validate Grid Energy Storage Systems at Different Stages of Development
Explore the source record for details and available documents.
Preger, Yuliya↗
Toward Statistical Real-Time Power Fault Detection
We propose statistical fault detection methodology based on high-frequency data streams that are becoming available in modern power grids. Our approach can be treated as an online (sequential) change point monitoring methodology. However, due to the mostly unexplored and very nonstandard structure of high-frequency power grid streaming data, substantial new statistical development is required to make this methodology practically applicable. The paper includes development of scalar detectors based on multichannel data streams, determination of data-driven alarm thresholds and investigation of the performance and robustness of the new tools. Due to a reasonably large database of faults, we can calculate frequencies of false and correct fault signals, and recommend implementations that optimize these empirical success rates.
bolted faults↗
E-transit-bench: simulation platform for analyzing electric public transit bus fleet operations
When electrified transit systems make grid aware choices, improved social welfare is achieved by reducing grid stress, reducing system loss, and minimizing power quality issues. Electrifying transit fleet has numerous challenges like non availability of buses during charging, varying charging costs and so on, that are related the electric grid behavior. However, transit systems do not have access to the information about the co-evolution of the grid's power flow and therefore cannot account for the power grid's needs in its day-to-day operation. In this paper we propose a framework of transportation-grid co-simulation, analyzing the spatio-temporal interaction between the transit operations with electric buses and the power distribution grid. Real-world data for a day's traffic from Chattanooga city's transit system is simulated in SUMO and integrated with a realistic distribution grid simulation (using GridLAB-D) to understand the grid impact due to transit electrification. Charging information is obtained from the transportation simulation to feed into grid simulation to assess the impact of charging. We also discuss the impact to the grid with higher degree of transit electrification that further necessitates such an integrated transportation-grid co-simulation to operate the integrated system optimally. Our future work includes extending the platform for optimizing the charging and trip assignment operations.
Sen, Rishav↗
Seismic Tomographic Modeling of the Crust and Upper Mantle beneath Israel and the Middle East: Improved Resolution through Optimized Model Parameterization
Accurate regional seismic travel-time (RSTT) predictions rely on regional phases (e.g., Pg, Lg, Pn, Sn ) to account for 3D effects in the crust and upper mantle that are not captured by 1D models traditionally used for real-time location. The RSTT prediction model accounts for regional-scale crust and upper mantle structure globally by incorporating regional seismic phases into its travel-time calculations. Previous versions of the RSTT model have used a constant grid cell size of 1°. To improve the tomographic accuracy of recovering velocity structure at regional scales, we, in this study, perform data-driven grid refinement on the RSTT model down to a 0.125° grid (~14 km) in pursuit of two main goals: (1) to test the limits of RSTT capability and accuracy of determined velocity structure through variable grid refinement and (2) to image smaller structures in Israel and the Middle East and illuminate upper mantle dynamics operating in this complex tectonic area. We investigate the effects of model parameterization as grid cell size decreases and the trade-offs between recovered velocity structures. Our final dataset includes 4751 events and 499 stations that recorded 79,344 Pn and 7489 Pg . The variable grid refinement method allows recovery of finer-scale velocity structures and reduces travel-time residuals in areas with the highest data coverage. At smaller grid cell sizes, longer paths need to be upweighted to stabilize the inversion. Results illuminate tectonic features undefined in coarser grid-size models; in particular, we observe mantle perturbations related to the subduction zone around the Cyprian arc and crustal anomalies near the Dead Sea fault and throughout the Anatolian plate.
58 GEOSCIENCES↗
Detecting and Analyzing Power System Disturbances in PMU Data with the Open-Source Archive Walker Tool
As the number of Phasor Measurement Units (PMUs) deployed in power systems increases, so do the archives of synchrophasor measurements stored by utilities. Significant value can be extracted from these archives by using them to support studies such as frequency response analysis, small-signal stability analysis, and power plant model validation. To better enable utilities to perform these studies, the open-source Archive Walker tool was developed. This tool examines PMU data for grid disturbances and periods of interest. Once identified, the data can be further analyzed inside Archive Walker or exported to specialty tools. In this paper, the various disturbance detectors available in Archive Walker are described, and its interactions with other openly-available tools are highlighted.
Follum, James D.↗
Power System Feature-Based Event Classification by Means of Multiple PMU Data
Abstract—Phasor Measurement Units (PMUs) provide time synchronized measurements across the power grid, enabling data driven event detection and classification for enhanced system monitoring and situational awareness. However, variations in event duration, spatial extent, and severity, along with coincident events, pose challenges for conventional classification models that require fixed-size inputs. This paper presents a feature-based framework that aggregates diverse attributes from all available PMUs for each event into a fixed-length vector, facilitating the application of standard machine learning classifiers, including Random Forest, XGBoost, and Multilayer Perceptron. A probabilistic post-processing scheme is further introduced to enable multi-label classification in the presence of overlapping events. Experiments using real-world PMU data demonstrate that the Random Forest model achieves 95% accuracy, while the proposed post-processing method yields an additional 3% improvement.
Nematirad, Reza↗
Detecting False Data Injection Attacks in Smart Grids: A Semi-Supervised Deep Learning Approach
The dependence on advanced information and communication technology increases the vulnerability in smart grids under cyber-attacks. Recent research on unobservable false data injection attacks (FDIAs) reveals the high risk of secure system operation, since these attacks can bypass current bad data detection mechanisms. To mitigate this risk, this paper proposes a data-driven learning-based algorithm for detecting unobservable FDIAs in distribution systems. We use autoencoders for efficient dimension reduction and feature extraction of measurement datasets. Further, we integrate the autoencoders into an advanced generative adversarial network (GAN) framework, which successfully detects anomalies under FDIAs by capturing the unconformity between abnormal and secure measurements. Also, considering that the datasets collected from practical power systems are partially labeled due to expensive labeling costs and missing labels, the proposed method only requires a few labeled measurement data in addition to unlabeled data for training. Numerical simulations in three-phase unbalanced IEEE 13-bus and 123-bus distribution systems validate the detection accuracy and efficiency of this method.
97 MATHEMATICS AND COMPUTING↗
pnnl/archive-sprinter
The Archive Sprinter tool is designed to efficiently process synchrophasor measurements from electric power grids and export data signatures that summarize the grid's behavior. Parallel processing will allow data to be processed quickly to enable practical analyses of archives spanning years. The grid's behavior will be summarized using a wide-array of signatures calculated from the input data.
Follum, Jim↗
Point-spread Function Deconvolution of the IFU Data and Restoration of Galaxy Stellar Kinematics
We present a performance test of the point-spread function (PSF) deconvolution algorithm applied to astronomical integral field unit (IFU) spectroscopy data for restoration of galaxy kinematics. We deconvolve the IFU data by applying the Lucy–Richardson algorithm to the 2D image slice at each wavelength. We demonstrate that the algorithm can effectively recover the true stellar kinematics of the galaxy, by using mock IFU data with a diverse combination of surface brightness profile, signal-to-noise ratio, line-of-sight geometry, and line-of-sight velocity distribution (LOSVD). In addition, we show that the proxy of the spin parameter ${\lambda }_{{R}_{e}}$ can be accurately measured from the deconvolved IFU data. We apply the deconvolution algorithm to the actual SDSS-IV MaNGA IFU survey data. The 2D LOSVD, geometry, and ${\lambda }_{{R}_{e}}$ measured from the deconvolved MaNGA IFU data exhibit noticeable differences compared to the ones measured from the original IFU data. The method can be applied to any other regular-grid IFU data to extract the PSF-deconvolved spatial information.
79 ASTRONOMY AND ASTROPHYSICS↗
Parallax-corrected VISST-derived pixel-level products from satellite GOES-16
The NASA Langley group led by William Smith produced GOES-16 satellite cloud retrievals over an approximate 10 by 10 degree region over the CACTI field campaign location. These retrievals are described here: https://www.arm.gov/capabilities/vaps/visst and are available for download here . They use algorithms historically called VISST that are now referred to as SatCORPS. More information can be found in Trepte et al. (2019), Minnis et al. (2021), and Yost et al. (2021). If using this dataset, please cite these references, the CACTI VISST dataset DOI found at the download link above, and this dataset’s DOI. The CACTI VISST pixel-level retrievals are on a 2 km spatial grid and available every 15 minutes (every 10 minutes late in the campaign), producing 21,765 files for the entire field campaign between October 2018 and April 2019. They are not corrected for parallax error, which is an offset in the actual geographical location of a cloud above the surface due to the satellite viewing the cloud partly from the side off nadir. This dataset applies a correction for parallax using the location relative to the satellite and the retrieved cloud top height above the surface, which allows the dataset to be geo-located with surface-based observations. The parallax correction for each location depends on the longitude, latitude and cloud top height above ground level (AGL) for that longitude and latitude in the original VISST files. The cloud top height AGL requires first computing the surface elevation at each VISST grid point. Data from the Advanced Spaceborne Thermal Emission and Reflection (ASTER) Global Digital Elevation Map Version 3 at 30-m resolution is projected onto the VISST grid using conservative coarsening (conserving surface elevation) in the xESMF Python package. The surface elevation is then subtracted from the VISST-retrieved cloud top height above mean sea level. These cloud top heights AGL are then combined with longitude and latitude to estimate the latitude and longitude corrections. Due to variability in cloud top height, the parallax shifts produce an irregular grid of values since higher cloud tops are shifted further than lower cloud tops. A ball tree-based neighbor search with Haversine distance is performed using the Python-based scikit-learn library to find the nearest VISST grid point to each parallax correction-shifted point. The data value of the shifted point is then assigned to that VISST grid point. In this manner, the irregular geographical shifts to correct for parallax are projected back to the rectilinear VISST grid. Because relatively higher clouds should obscure lower clouds, the variable values for the highest cloud top are preferentially chosen if two or more values are assigned to a grid point. The parallax correction should be viewed as an improved but still imperfect estimation of the cloud top locations, largely because the cloud top height is an imperfect retrieval. Please see the attached README document for further information. Users are encouraged to contact the authors with any additional questions.
54 ENVIRONMENTAL SCIENCES↗
rmap: An R package to plot and compare tabular data on customizable maps across scenarios and time
`rmap` is an R package that allows users to easily plot tabular data (CSV or R data frames) on maps without any Geographic Information Systems (GIS) knowledge. Maps produced by `rmap` are `ggplot` objects and thus capitalize on the flexibility and advancements of the `ggplot2` package and all elements of each map are thus fully customizable. Additionally `rmap` automatically detects and produces comparison maps if the data has multiple scenarios or time periods as well as animations for time series data. Advanced users can load their own shapefiles if desired. `rmap` comes with a range of pre-built color palettes but users can also provide any `R` color palette or create their own as needed. Four different legend types are available to highlight different kinds of data distributions. The input spatial data can be both gridded or polygon data. `rmap` is desgined in particular for comparing spatial data across scenarios and time periods and comes preloaded with standard country, state, and basin maps as well as custom maps compatible with the Global Change Analysis Model (GCAM) spatial boundaries. `rmap` has a growing number of users and its products have been used in multiple multisector dynamics publications as well as a required dependency in other R packages such as `rfasst` and `metis`. `rmap's` automatic processing of tabular data using pre-built map selection, difference map calculations, faceting, and animations offers unique functionality which makes it a powerful and yet simple tool for users looking to explore multi-sector, multi-scenario data across space and time.
58 GEOSCIENCES↗
DISTRIBUTION TRANSFORMER ASSET MONITORING ON THE GRID EDGE USING SMART SENSOR DATA
As new loads such as rooftop photovoltaics, electric vehicles and other distributed energy resources become commonplace on the distribution grid, the stress on already aging assets begins to escalate. This increased loading and changing dynamics can exacerbate failure rates. While traditional monitoring efforts focus on transmission and generation assets, utilities are now beginning to pay close attention to distribution assets in order to increase reliability indices and reduce cost from unexpected outages. This research develops low-cost and scalable methods to monitoring the health of a critical distribution grid asset: the service transformer. Existing methods in literature are either invasive and thus difficult to implement or require the device to be tested offline in an expensive lab setting. Data from the ubiquitous smart meter as well as a novel Bluetooth based transformer monitor are leveraged to automatically notify the utility of deteriorating or damaged transformers. Voltage, temperature, and vibration are some of the signals measured and analyzed by the proposed algorithms to predict transformer failures. Furthermore, these algorithms are designed to keep the implementation and processing costs low by taking advantage of edge computing where possible.
24 POWER TRANSMISSION AND DISTRIBUTION↗
A Simple and Accurate Energy-Detector-Based Transient Waveform Detection for Smart Grids: Real-World Field Data Performance
Integration of distributed energy sources, advanced meshed operation, sensors, automation, and communication networks all contribute to autonomous operations and decision-making processes utilized in the grid. Therefore, smart grid systems require sophisticated supporting structures. Furthermore, rapid detection and identification of disturbances and transients are a necessary first step towards situationally aware smart grid systems. This way, high-level monitoring is achieved and the entire system kept operational. Even though smart grid systems are unavoidably sophisticated, low-complexity algorithms need to be developed for real-time sensing on the edge and online applications to alert stakeholders in the event of an anomaly. In this study, the simplest form of anomaly detection mechanism in the absence of any a priori knowledge, namely, the energy detector (also known as radiometer in the field of wireless communications and signal processing), is investigated as a triggering mechanism, which may include automated alerts and notifications for grid anomalies. In contrast to the mainstream literature, it does not rely on transform domain tools; therefore, utmost design and implementation simplicity are attained. Performance results of the proposed energy detector algorithm are validated by real power system data obtained from the DOE/EPRI National Database of power system events and the Grid Signature Library.
24 POWER TRANSMISSION AND DISTRIBUTION↗
TuckerMPI: A Parallel C++/MPI Software Package for Large-scale Data Compression via the Tucker Tensor Decomposition
With this study, our goal is compression of massive-scale grid-structured data, such as the multi-terabyte output of a high-fidelity computational simulation. For such data sets, we have developed a new software package called TuckerMPI, a parallel C++/MPI software package for compressing distributed data. The approach is based on treating the data as a tensor, i.e., a multidimensional array, and computing its truncated Tucker decomposition, a higher-order analogue to the truncated singular value decomposition of a matrix. The result is a low-rank approximation of the original tensor-structured data. Compression efficiency is achieved by detecting latent global structure within the data, which we contrast to most compression methods that are focused on local structure. In this work, we describe TuckerMPI, our implementation of the truncated Tucker decomposition, including details of the data distribution and in-memory layouts, the parallel and serial implementations of the key kernels, and analysis of the storage, communication, and computational costs. We test the software on 4.5 and 6.7 terabyte data sets distributed across 100 s of nodes (1,000 s of MPI processes), achieving compression ratios between 100 and 200,000×, which equates to 99--99.999% compression (depending on the desired accuracy) in substantially less time than it would take to even read the same dataset from a parallel file system. Moreover, we show that our method also allows for reconstruction of partial or down-sampled data on a single node, without a parallel computer so long as the reconstructed portion is small enough to fit on a single machine, e.g., in the instance of reconstructing/visualizing a single down-sampled time step or computing summary statistics. The code is available at https://gitlab.com/tensors/TuckerMPI.
97 MATHEMATICS AND COMPUTING↗
Metrics for evaluating tropical cyclones in climate data
This manuscript describes a software suite that can be used for objective evaluation of tropical cyclones (TCs) in gridded climate data. Using cyclone trajectories derived from 6-hourly data, a comprehensive set of metrics is defined to systematically compare and contrast products to one another. In addition to annual TC climatologies, attention is paid to spatial and temporal patterns of storm occurrence and intensity. Assessment can be performed either on the global scale or regional domains. Simple to visualize ‘scorecards’ allow for rapid credibility assessment. We showcase three key findings enabled by this suite. First, we compare the representation of TCs in seven current-generation global reanalyses and conclude that higher resolution models and those with TC-specific assimilation contain more accurate storm climatologies. Second, using a free-running Earth system model (ESM) we find that full basin refinement is required in variable-resolution configurations to adequately simulate North Atlantic TC frequency. Furthermore, upstream refinement over northern Africa offers little benefit in simulating storm occurrence but spatial genesis patterns are improved. Finally, we show that TCs simulated by ESMs can be highly sensitive to individual parameterizations in climate models, with North Atlantic TC metrics varying greatly depending on version of the Morrison-Gettelman microphysics package.
54 ENVIRONMENTAL SCIENCES↗
Digital Filter Design for Point-on-Wave Sensors: Highlighting Frequency Response Limitations and Enhancing Grid Simulation Accuracy
Data is proving to be the backbone of today's and, more importantly, tomorrow's grid. As the system changes and introduces fast-acting devices like power electronics, overall observability tends to decrease from the utility point-of-view. This can be mitigated by adding more high-fidelity sensors onto the grid, although this incurs a cost. These sensors are never ideal, and each have unique frequency responses that may influence the data produced. This may, in turn, impact the protection and control of the power grid. This paper presents a methodology of representing these point-on-wave sensors digitally by estimating digital-filter representations of them, thereby introducing means of improving the sensor models used in electromagnetic-transient (EMT) simulations. This may help with identifying potential high-frequency, sensor-induced distortions, and system resonance compensation. Three commercial-grade medium-voltage point-on-wave sensors are utilized in a lab environment to obtain experimental frequency responses with a frequency sweep, and it is shown that both Infinite Impulse Response (IIR) and Finite Impulse Response (FIR) filter representations may approximate these responses with varying degrees of accuracy, though each has their own strengths and weaknesses. It is found that, in general, FIR estimation better approximates these sensors than IIR estimation does.
Wilson, Aaron [ORNL] (ORCID:0000000327331697)↗
Lightning Characteristics Associated With Storm Modes Observed During RELAMPAGO
Global satellite studies show a maximum in deep convection and lightning downstream of the Andes in subtropical South America. The Remote sensing of Electrification, Lightning, And Mesoscale/microscale Processes with Adaptive Ground Observations (RELAMPAGO) field campaign was designed to investigate the physical processes that contribute to the rapid development of deep convection and mesoscale convective systems (MCSs) in Argentina. A lightning mapping array (LMA) was deployed to Argentina as part of RELAMPAGO to collect lightning observations from extreme storms in the region. This study combines lightning data from the LMA and the Geostationary Lightning Mapper onboard GOES-16 with 1-km gridded radar data to examine the electrical characteristics of a variety of convective storms throughout their life cycle observed during RELAMPAGO. Results from the full campaign show 48% of flashes are associated with deep convection that occurs along the eastern edge of the Sierras de Córdoba (SDC) overnight. These flashes are 65 km 2 smaller on average compared to stratiform flashes, which occur most frequently 50–100 km east of the SDC in the early morning hours, consistent with the upscale growth of MCSs off the terrain. Analysis of the 13–14 December MCS shows that sharp increases in flash rates correspond to deep and wide convective cores that have high graupel and hail mass, 35-dBZ volume, and ice water path. This work validates previous satellite studies of lightning in the region, but also provides higher spatial and temporal resolution information across the convective life cycle that has not been available in previous studies.
54 ENVIRONMENTAL SCIENCES↗