Search NASA⌕ Search

SEARCH · Search NASA

Results for “Cloud detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Feasibility Study of Millimeter Wave Radars For Safeguards Applications

Containment and surveillance are fundamental measures in nuclear safeguards. Techniques such as video surveillance and laser curtain for containment provide effective monitoring in areas where maintaining continuity of knowledge is required. These systems, however, can be susceptible to loss of monitoring capabilities under certain environmental conditions such as poor visibility (i.e. low light conditions, smoke, fog, etc.) or extended power loss past the duration that the backup power system is designed for. Brookhaven National Laboratory has been investigating the feasibility of millimeter waves (mmWave) as a new perimeter seal in which radio frequency waves in the range of 60-64 GHz are used to detect and monitor objects of interest. Signals in this frequency range are not susceptible to environmental conditions. For proof-of-concept tests, mmWave sensors from Texas Instruments (TI), specificallyIWR6843, are used in a test bed at BNL's Waste Management facility to simulate the operations at nuclear facilities. The unique design of TI mmWave sensors requires less memory and power consumption compared to counterpart systems. These devices are capable of exporting 3D point-cloud data, which is visualized graphically and compared to videos recorded at the same time to validate the performance of the mmWave sensor. A set of experiments were planned to test the feasibility of the mmWave in this application, including monitoring static containers in a storage area and detecting intrusions at the boundaries of the area. In addition, the experiments also identify potential blind spots relative to sensor position and utilize multiple operating sensors simultaneously to reduce or eliminate such blind spots. The optimal positioning of multiple sensors was determined for the experimental room configuration. In this paper, we will discuss the details of this novel perimeter sealing concept and present the test results.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2021

ARES IV: Probing the Atmospheres of the Two Warm Small Planets HD 106315c and HD 3167c with the HST/WFC3 Camera

We present an atmospheric characterization study of two medium-sized planets bracketing the radius of Neptune: HD 106315c (R {sub P} = 4.98 ± 0.23 R {sub ⊕}) and HD 3167c (R{sub P}=2.740{sub −0.100}{sup +0.106} R {sub ⊕}). We analyze spatially scanned spectroscopic observations obtained with the G141 grism (1.125–1.650 μm) of the Wide Field Camera 3 (WFC3) on board the Hubble Space Telescope. We use the publicly available Iraclis pipeline and TauREx3 atmospheric retrieval code and detect water vapor in the atmosphere of both planets, with an abundance of log{sub 10}[H{sub 2}O]=−2.1{sub −1.3}{sup +0.7} (∼5.68σ) and log{sub 10}[H{sub 2}O]=−4.1{sub −0.9}{sup +0.9} (∼3.17σ) for HD 106315c and HD 3167c, respectively. The transmission spectrum of HD 106315c also shows possible evidence of ammonia absorption (log{sub 10}[NH{sub 3}]=−4.3{sub −2.0}{sup +0.7},∼1.97σ, even if it is not significant), while carbon dioxide absorption features may be present in the atmosphere of HD 3167c in the ∼1.1–1.6 μm wavelength range (log{sub 10}[CO{sub 2}]=−2.4{sub −1.0}{sup +0.7}, ∼3.28σ). However, the CO{sub 2} detection appears significant, and it must be considered carefully and put into perspective. Indeed, CO{sub 2} presence is not explained by 1D equilibrium chemistry models, and it could be due to possible systematics. The additional contributions of clouds, CO, and CH{sub 4} are discussed. HD 106315c and HD 3167c will be interesting targets for upcoming telescopes such as the James Webb Space Telescope and the Atmospheric Remote-sensing Infrared Exoplanet Large-survey.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Interstellar gas heating by primordial black holes

Interstellar gas heating is a powerful cosmology-independent observable for exploring the parameter space of primordial black holes (PBHs) formed in the early Universe that could constitute part of the dark matter (DM). We provide a detailed analysis of the various aspects for this observable, such as PBH emission mechanisms. Using observational data from the Leo T dwarf galaxy, we constrain the PBH abundance over a broad mass-range, M PBH ~ O(1)M ⊙ – 10 7 M ⊙ , relevant for the recently detected gravitational wave signals from intermediate-mass BHs. Here, we also consider PBH gas heating of systems with bulk relative velocity with respect to the DM, such as Galactic clouds.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Watermarks in stream processing systems: semantics and comparative analysis of Apache Flink and Google cloud dataflow

Streaming data processing is an exercise in taming disorder: from oftentimes huge torrents of information, we hope to extract powerful and timely analyses. But when dealing with streaming data, the unbounded and temporally disordered nature of real-world streams introduces a critical challenge: how does one reason about the completeness of a stream that never ends? In this paper, we present a comprehensive definition and analysis of watermarks, a key tool for reasoning about temporal completeness in infinite streams.First, we describe what watermarks are and why they are important, highlighting how they address a suite of stream processing needs that are poorly served by eventually-consistent approaches:• Computing a single correct answer, as in notifications.• Reasoning about a lack of data, as in dip detection.• Performing non-incremental processing over temporal subsets of an infinite stream, as in statistical anomaly detection with cubic spline models.• Safely and punctually garbage collecting obsolete inputs and intermediate state.• Surfacing a reliable signal of overall pipeline health.Second, we describe, evaluate, and compare the semantically equivalent, but starkly different, watermark implementations in two modern stream processing engines: Apache Flink and Google Cloud Dataflow.

Akidau, Tyler↗
DOE OSTI2024

Environmental Quenching of Low-surface-brightness Galaxies Near Hosts from Large Magellanic Cloud to Milky Way Mass Scales

Low-surface-brightness galaxies (LSBGs) are excellent probes of quenching and other environmental processes near massive galaxies. We study an extensive sample of LSBGs near massive hosts in the local universe that are distributed across a diverse range of environments. The LSBGs with surface-brightness ${\mu }_{\mathrm{eff},{g}}\gt 24.2\,\mathrm{mag}\,{\mathrm{arcsec}}^{-2}$ are drawn from the Dark Energy Survey Year 3 catalog while the hosts with masses $9.0\lt \mathrm{log}({{ \mathcal M }}_{\star }/{M}_{\odot })\lt 11.0$ comparable to the Milky Way and the Large Magellanic Cloud are selected from the z0MGS sample. We study the projected radial density profiles of LSBGs as a function of their color and surface brightness around hosts in both the rich Fornax–Eridanus cluster environment and the low-density field. We detect an overdensity with respect to the background density, out to 2.5 times the virial radius for both hosts in the cluster environment and the isolated field galaxies. When the LSBG sample is split by g − i color or surface brightness μ eff, g , we find the LSBGs closer to their hosts are significantly redder and brighter, like their high-surface-brightness counterparts. The LSBGs form a clear “red sequence” in both the cluster and isolated environments that is visible beyond the virial radius of the hosts. This suggests preprocessing of infalling LSBGs and a quenched backsplash population around both host samples. More so, the relative prominence of the “blue cloud” feature implies that preprocessing is ongoing near the isolated hosts compared to the cluster environment where the LSBGs are already well processed.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Nuclear Quadrupole Resonance for Substance Detection

This review paper provides a comprehensive overview of recent advances in nuclear quadrupole resonance (NQR) spectroscopy for substance detection, highlighting its principles, methodologies, and applications. The paper elucidates the fundamental physics underlying NQR spectroscopy, emphasizing the interaction between nuclear quadrupole moments and electric field gradients. It explores the various experimental techniques and instrumentation developments that have enabled the sensitive detection and precise characterization of substances containing quadrupolar nuclei. A significant portion of the survey is dedicated to discussing the diverse applications of NQR spectroscopy, including the detection of explosives, drug pharmaceuticals, and material authentication. Furthermore, the survey examines the challenges and limitations associated with NQR spectroscopy, including issues related to signal-to-noise ratio (SNR), temperature dependency, and substance restrictions. Strategies to overcome these challenges are discussed, offering insights into the future directions of NQR spectroscopy research that includes artificial intelligence (AI), internet of things (IoT) integration, incorporating a cloud database for NQR parameter storage, and multi-modal analysis.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Containers on Switches: A Cluster School Experience

Network switches, such as those from Arista and Mellanox, often have underutilized computational resources in the form of built-in processors and memory. By leveraging these untapped resources, we can optimize functionality and efficiency of computational cluster networks. Our research focuses on deploying containers directly onto these switches to execute various auxiliary tasks ranging from metric logging to system-wide management via post-boot configuration. By doing so, we can significantly enchance the capabilities of the cluster without the need for additional dedicated hardware. Our research involved five distinct scenarios where switch utilization could have a profound impact on HPC Clusters: run cloud-init services via link-local connection; configuring a Telegraf container to export metrics; deploying a caching proxy; creating a reconfigurable IPv6 DHCP/DNS provider for VLAN; and implementing a client detection with Magellan discovery. These scenarios were containerized with podman and docker, and tested both physically on the switch virtually on a QEMU VM both running SONiC OS. Testing and findings indicate that network switches can indeed be used for these scenarios. They offer a wide range of possibilities beyond these applications. They run as expected as containers on the switches, and although there were some minor issues, work-arounds were implemented. Overall, this is a positive result that can be further explored with more scenarios.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

An Explainable Machine-Learning Model for Compensatory Reserve Measurement: Methods for Feature Selection and the Effects of Subject Variability

Tracking vital signs accurately is critical for triaging a patient and ensuring timely therapeutic intervention. The patient’s status is often clouded by compensatory mechanisms that can mask injury severity. The compensatory reserve measurement (CRM) is a triaging tool derived from an arterial waveform that has been shown to allow for earlier detection of hemorrhagic shock. However, the deep-learning artificial neural networks developed for its estimation do not explain how specific arterial waveform elements lead to predicting CRM due to the large number of parameters needed to tune these models. Alternatively, we investigate how classical machine-learning models driven by specific features extracted from the arterial waveform can be used to estimate CRM. More than 50 features were extracted from human arterial blood pressure data sets collected during simulated hypovolemic shock resulting from exposure to progressive levels of lower body negative pressure. A bagged decision tree design using the ten most significant features was selected as optimal for CRM estimation. This resulted in an average root mean squared error in all test data of 0.171, similar to the error for a deep-learning CRM algorithm at 0.159. By separating the dataset into sub-groups based on the severity of simulated hypovolemic shock withstood, large subject variability was observed, and the key features identified for these sub-groups differed. This methodology could allow for the identification of unique features and machine-learning models to differentiate individuals with good compensatory mechanisms against hypovolemia from those that might be poor compensators, leading to improved triage of trauma patients and ultimately enhancing military and emergency medicine.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Multi-scale integration of satellite remote sensing improves characterization of dry-season green-up in an Amazon tropical evergreen forest

In tropical forests, leaf phenology-particularly the pronounced dry-season green-up-strongly regulates biogeochemical cycles of carbon and water fluxes. However, uncertainties remain in the understanding of tropical forest leaf phenology at different spatial scales. Phenocams accurately characterize leaf phenology at the crown and ecosystem scales but are limited to a few sites and time spans of a few years. Time-series satellite observations might fill this gap, but the commonly used satellites (e.g. MODIS, Landsat and Sentinel-2) have resolutions too coarse to characterize single crowns. To resolve this observational challenge, we used the PlanetScope constellation with a 3m resolution and near daily nadir-view coverage. We first developed a rigorous method to cross-calibrate PlanetScope surface reflectance using daily BRDF-adjusted MODIS as the reference. We then used linear spectral unmixing of calibrated PlanetScope to obtain dry-season change in the fractional cover of green vegetation (GV) and non-photosynthetic vegetation (NPV) at the PlanetScope pixel level. We used the Central Amazon Tapajos National Forest k67 site, as all necessary data (from field to phenocam and satellite observations) was available. For this proof of concept, we chose a set of 22 dates of PlanetScope measurements in 2018 and 16 in 2019, all from the six drier months of the year to provide the highest possible cloud-free temporal resolution. Our results show that MODIS-calibrated dry-season PlanetScope data (1) accurately assessed seasonal changes in ecosystem-scale and crown-scale spectral reflectance; (2) detected an increase in ecosystem-scale GV fraction (and a decrease in NPV fraction) from June to November of both years, consistent with local phenocam observations with R 2 around 0.8; and (3) monitored large seasonal trend variability in crown-scale NPV fraction. Finally, our results highlight the potential of integrating multi-scale satellite observations to extend fine-scale leaf phenology monitoring beyond the spatial limits of phenocams.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Tethered balloon system and High-Resolution Mass Spectrometry Reveal Increased Organonitrates Aloft Compared to the Ground Level

Atmospheric particles play critical roles in climate. However, significant knowledge gaps remain regarding the vertically resolved organic molecular-level composition of atmospheric particles due to aloft sampling challenges. To address this, we use a tethered balloon system at the Southern Great Plains Observatory and high-resolution mass spectrometry to, respectively, collect and characterize organic molecular formulas (MF) in the ground level and aloft (up to 750 m) samples. We show that organic MF uniquely detected aloft were dominated by organonitrates (139 MF; 54% of all uniquely detected aloft MF). Organonitrates that were uniquely detected aloft featured elevated O/C ratios (0.73 ± 0.23) compared to aloft organonitrates that were commonly observed at the ground level (0.63 ± 0.22). Unique aloft organic molecular composition was positively associated with increased cloud coverage, increased aloft relative humidity (~40% increase compared to ground level), and decreased vertical wind variance. Furthermore, 29% of extremely low volatility organic compounds in the aloft sample were truly unique to the aloft sample compared to the ground level, emphasizing potential oligomer formation at higher altitudes. Overall, this study highlights the importance of considering vertically resolved organic molecular composition (particularly for organonitrates) and hypothesizes that aqueous phase transformations and vertical wind variance may be key variables affecting the molecular composition of aloft organic aerosol.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

A Search of the Full Six Years of the Dark Energy Survey for Outer Solar System Objects

We present a search for outer solar system objects in the 6 yr of data from the Dark Energy Survey (DES). The DES covered a contiguous 5000 deg 2 of the southern sky with ≈80,000 3 deg 2 exposures in the grizY filters between 2013 and 2019. This search yielded 812 trans-Neptunian objects (TNOs), one Centaur and one Oort cloud comet, 458 reported here for the first time. We present methodology that builds upon our previous search on the first 4 yr of data. All images were reprocessed with an optimized detection pipeline that leads to an average completeness gain of 0.47 mag per exposure, as well as improved transient catalog production and algorithms for linkage of detections into orbits. All objects were verified by visual inspection and by the “sub-threshold significance,” the signal-to-noise ratio in the stack of images in which its presence is indicated by the orbit, but no detection was reported. This yields a pure catalog complete to r ≈ 23.8 mag and distances 29 < d < 2500 au. The TNOs have minimum (median) of 7 (12) nights’ detections and arcs of 1.1 (4.2) yr, and will have grizY magnitudes available in a further publication. We present software for simulating our observational biases for comparisons of models to our detections. Initial inferences demonstrating the catalog’s statistical power are: the data are inconsistent with the CFEPS-L7 model for the classical Kuiper Belt; the 16 “extreme” TNOs (a > 150 au, q > 30 au) are consistent with the null hypothesis of azimuthal isotropy; and nonresonant TNOs with q > 38 au, a > 50 au show a significant tendency to be sunward of major mean-motion resonances.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Can we observe the ion-neutral drift velocity in prestellar cores?

Given the low-ionization fraction of molecular clouds, ambipolar diffusion is thought to be an integral process in star formation. However, chemical and radiative-transfer effects, observational challenges, and the fact that the ion-neutral drift velocity is inherently very small render a definite detection of ambipolar diffusion extremely non-trivial. Here, we study the ion-neutral drift velocity in a suite of chemodynamical, non-ideal magnetohydrodynamic (MHD), two-dimensional axisymmetric simulations of prestellar cores where we alter the temperature, cosmic-ray ionization rate, visual extinction, mass-to-flux ratio, and chemical evolution. Subsequently, we perform a number of non-local thermodynamic equilibrium (non-LTE) radiative-transfer calculations considering various idealized and non-idealized scenarios in order to assess which factor (chemistry, radiative transfer, and/or observational difficulties) is the most challenging to overcome in our efforts to detect the ion-neutral drift velocity. We find that temperature has a significant effect in the amplitude of the drift velocity with the coldest modelled cores (T = 6 K) exhibiting drift velocities comparable to the sound speed. Against expectations, we find that in idealized scenarios (where two species are perfectly chemically co-evolving) the drift velocity ‘survives’ radiative-transfer effects and can in principle be observed. However, we find that observational challenges and chemical effects can significantly hinder our view of the ion-neutral drift velocity. Finally, we propose that HCN and HCNH + ⁠, being chemically co-evolving, could be used in future observational studies aiming to measure the ion-neutral drift velocity.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Newly discovered Ca ii absorbers in the early Universe: statistics, element abundances, and dust

ABSTRACT We report discoveries of 165 new quasar Ca ii absorbers from the Sloan Digital Sky Survey (SDSS) Data Releases 7 and 12. Our ca ii rest-frame equivalent width distribution supports the weak and strong subpopulations, split at ${W}^{\lambda 3934}_{0}=0.7$ Å. Comparison of both populations’ dust depletion shows clear consistency for weak absorber association with halo-type gas in the Milky Way (MW), while strong absorbers have environments consistent with halo and disc-type gas. We probed our high-redshift Ca ii absorbers for 2175 Å dust bumps, discovering 12 2175 Å dust absorbers (2DAs). This clearly shows that some Ca ii absorbers follow the Large Magellanic Cloud (LMC) extinction law rather than the Small Magellanic Cloud extinction law. About 33 per cent of our strong Ca ii absorbers exhibit the 2175 Å dust bump, while only 6 per cent of weak Ca ii absorbers show this bump. 2DA detection further supports the theory that strong Ca ii absorbers are associated with disc components and are dustier than the weak population. Comparing average Ca ii absorber dust depletion patterns to that of Damped Ly α absorbers (DLAs), Mg ii absorbers, and 2DAs shows that Ca ii absorbers generally have environments with more dust than DLAs and Mg ii absorbers, but less dust than 2DAs. Comparing 2175 Å dust bump strengths from different samples and also the MW and LMC, the bump strength appears to grow stronger as the redshift decreases, indicating dust growth and the global chemical enrichment of galaxies in the Universe over time.

Astronomy & Astrophysics↗
DOE OSTI2020

Spectral Variability of VHS J1256–1257b from 1 to 5 μm

Multiwavelength time-resolved observations of rotationally modulated variability from brown dwarfs and giant exoplanets are the most effective method for constraining their heterogeneous atmospheric structures. In a companion paper, we reported the discovery of strong near-infrared variability in HST/WFC3/G141 light curves of the very red L-dwarf companion VHS J1256–1257b. In this paper, we present a follow-up 36 hr Spitzer/IRAC Channel 2 light curve together with an in-depth analysis of the Hubble space telescope (HST) and the Spitzer data. The combined data set provides time-resolved light curves of VHS1256b sampling 1.1 to 4.5 μm. The Spitzer light curve is best fit with a single sine wave with a period of 22.04 ± 0.05 hr and a peak-to-peak amplitude of 5.76 ± 0.04%. Combining the period with a previously measured projected rotational velocity (v sin i), we find that VHS1256b is most consistent with equatorial viewing geometry. The HST/G141+Spitzer spectral energy distribution favors a model with a T{sub eff} of 1000 K and low surface gravity with disequilibrium chemistry. The spectral variability of VHS1256b is consistent with predictions from partly cloudy models, suggesting that heterogeneous clouds are the dominant source of the observed modulations. We find evidence at the 3.3σ level for amplitude variations within the 1.67 μm CH{sub 4} band, which is the first such detection for a variable L-dwarf. We compare the HST/G141 time-resolved spectra of three red L-dwarfs with high-amplitude near-infrared rotational modulations and find that although their time-averaged spectra are similar, their spectroscopic variabilities exhibit notable differences. This diversity reinforces the advantage of time-resolved spectroscopic observations for understanding the atmospheres of brown dwarfs and directly imaged exoplanets.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Confidentiality-preserving machine learning algorithms for soft-failure detection in optical communication networks

Automated fault management is at the forefront of next-generation optical communication networks. The increase in complexity of modern networks has triggered the need for programmable and software-driven architectures to support the operation of agile and self-managed systems. In these scenarios, the European Telecommunications Standards Institute zero-touch network and service management approach is imperative. The need for machine learning algorithms to process the large volume of telemetry data brings safety concerns as distributed cloud-computing solutions become the preferred approach for deploying reliable communication network automation. This paper’s contribution is twofold. First, we propose a simple yet effective method to guarantee the confidentiality of the telemetry data based on feature scrambling. The method allows the operation of third-party computational services without direct access to the full content of the collected data. Additionally, the effectiveness of four unsupervised machine learning algorithms for soft-failure detection is evaluated when applied to the scrambled telemetry data. The methods are based on factor analysis, principal component analysis, nonlinear principal component analysis, and singular value decomposition. Most dimensionality reduction algorithms have the common property that they can maintain similar levels of fault classification performance while hiding the data structure from unauthorized access. Evaluations of the proposed algorithms demonstrate this capability.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Atmospheric fungal nanoparticle bursts

Aerosol nanoparticles play an important role in the climate system by affecting cloud formation and properties, as well as in human health because of their deep reach into lungs and the circulatory system. Determining nanoparticle sources and composition is a major challenge in assessing their impacts in these areas. The sudden appearance of large numbers of atmospheric nanoparticles is commonly attributed to secondary formation from gas-phase precursors, but in many cases, the evidence for this is equivocal. We report the detection of a mode of fungal fragments with a mobility diameter of roughly 30 nm released in episodic bursts in ambient air over an agricultural area in northern Oklahoma. These events reached concentrations orders of magnitude higher than other reports of biological particles and show similarities to unclarified events reported previously in the Amazon. These particles potentially represent a large source of both cloud-forming ice nuclei and respirable allergens in a variety of ecosystems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Testing and validating SMDS algorithms implemented in the cloud

Pacific Northwest National Laboratory (PNNL) provided technical assistance to NorthWrite Inc. under the Small Business Vouchers (SBV) Pilot. NorthWrite delivered services to owners of small commercial buildings, using a cloud-based service to monitor, control, and optimize building operations, saving energy and reducing operating costs for the owners while ensuring that occupant comfort needs were consistently met. NorthWrite had a longstanding desire to add a new suite of diagnostic capabilities to their service offering and had been trying, without success, to incorporate several diagnostic algorithms published by PNNL. These algorithms arise from research previously supported by BTO. Through the SBV awarded to NorthWrite, PNNL made available technical knowledge regarding the derivation and application of the following sets of algorithms for use in the NorthWrite Cloud-based service delivery system: • algorithms for monitoring rooftop packaged air conditioners and heat pumps (often referred to as rooftop units or RTUs) and diagnosing faults in these units, • advanced algorithms for automated fault detection and diagnosis of other equipment found in small buildings, and • algorithms for identifying, prioritizing, and assessing the economic effectiveness of implementing energy saving measures in small commercial buildings based on sensed data. The PNNL researchers involved were the original developers of these algorithms, had a unique understanding of the derivation of the algorithms, and had the source data used for this derivation. Further, the PNNL researchers had extensive experience using these algorithms in the laboratory, unique experience applying these algorithms in real-world small commercial buildings and could solve a number of key problems that NorthWrite and other users faced in using these algorithms at scale. In addition, PNNL had recently installed a pair of RTUs in a laboratory setting that were instrumented and connected with data acquisition systems that provided a unique test rig for validating the algorithms before NorthWrite began to deploy their new services in the field.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

MindSynchro

This report presents the developments and results of MindSynchro project as part of DOE OE FOA 1861. DOE and Pacific Northwest National Laboratory (PNNL) have made available to FOA awardees datasets containing years of real historical data recorded from various phasor measurement units (PMUs) which are installed in three large US interconnections: Texas (IC A), Western (IC B), and Eastern (IC C). The main goal of the project, which was successfully achieved, was to develop methods for detection and identification of events which are relevant for power grid operation. Tasks performed for achieving the project goals included data exploration and pre-processing, the development and application of physics-based features, data analysis and labeling based on unsupervised learning approaches, training and testing of DSSL models for classification of events which are relevant for power grid operation, and deployment of solutions to cloud environments. The methods developed in the project can potentially provide relevant benefits to power grid asset owners/operators in general in terms of situational awareness. Two main types of outcomes can be provided by these tools: Identification of specific relevant power grid event types: Semi-supervised ML methods developed in the project can adequately employ not only the relatively scarce labeled data but also the large amount of available unlabeled data to train models for detection of specific event types. Such methods enable the application of trained models for the detection of events in a population of PMUs much larger than that associated to the labeled events. Support in data labeling / label validation: Labels are critical for training of models for identification of specific types of events. However, labeling large amounts of data is a manual and tedious process. This means that such process is error prone and is not scalable. Methods developed in the project, based on ensembles of clustering models, have been successfully employed for turning manual labeling into a scalable process. Accurate identification of specific relevant events can provide the operators with immediate situational awareness that could otherwise require hours or days of analysis from domain experts. We envision that such methods could be initially employed in support of post-mortem analysis of events and, as confidence is gained, they could be employed for online/real-time support, providing, among other benefits, insights for avoiding major events which could happen due to a combination of smaller ones. On the longer term, related methods could potentially be employed to improve protection and control.

24 POWER TRANSMISSION AND DISTRIBUTION↗