Search NASA⌕ Search

SEARCH · Search NASA

Results for “data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Two-Stream Multi-Channel Convolutional Neural Network for Multi-Lane Traffic Speed Prediction Considering Traffic Volume Impact

Traffic speed prediction is a critically important component of intelligent transportation systems. Recently, with the rapid development of deep learning and transportation data science, a growing body of new traffic speed prediction models have been designed that achieved high accuracy and large-scale prediction. However, existing studies have two major limitations. First, they predict aggregated traffic speed rather than lane-level traffic speed; second, most studies ignore the impact of other traffic flow parameters in speed prediction. To address these issues, the authors propose a two-stream multi-channel convolutional neural network (TM-CNN) model for multi-lane traffic speed prediction considering traffic volume impact. In this model, the authors first introduce a new data conversion method that converts raw traffic speed data and volume data into spatial–temporal multi-channel matrices. Then the authors carefully design a two-stream deep neural network to effectively learn the features and correlations between individual lanes, in the spatial–temporal dimensions, and between speed and volume. Accordingly, a new loss function that considers the volume impact in speed prediction is developed. A case study using 1-year data validates the TM-CNN model and demonstrates its superiority. This paper contributes to two research areas: (1) traffic speed prediction, and (2) multi-lane traffic flow study.

97 MATHEMATICS AND COMPUTING↗

Shear-induced aggregation or disaggregation in edible oils: Models, computer simulation, and USAXS measurements

The effects of shear upon the aggregation of solid objects formed from solid triacylglycerols (TAGs) immersed in liquid TAG oils were modeled using Dissipative Particle Dynamics (DPD) and the predictions compared to experimental data using Ultra-Small Angle X-ray Scattering (USAXS). The solid components were represented by spheres interacting via attractive van der Waals forces and short range repulsive forces. A velocity was applied to the liquid particles nearest to the boundary, and Lees-Edwards boundary conditions were used to transmit this motion to non-boundary layers via dissipative interactions. The shear was created through the dissipative forces acting between liquid particles. Translational diffusion was simulated, and the Stokes-Einstein equation was used to relate DPD length and time scales to SI units for comparison with USAXS results. The SI values depended on how large the spherical particles were (250 nm vs. 25 nm). Aggregation was studied by (a) computing the Structure Function and (b) quantifying the number of pairs of solid spheres formed. Solid aggregation was found to be enhanced by low shear rates. As the shear rate was increased, a transition shear region was manifested in which aggregation was inhibited and shear banding was observed. Aggregation was inhibited, and eventually eliminated, by further increases in the shear rate. The magnitude of the transition region shear, $\dot{γ}_t$, depended on the size of the solid particles, which was confirmed experimentally.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Data Locality Enhancement of Dynamic Simulations for Exascale Computing (Final Report)

The development of modern processors exhibits two trends that complicate the optimizations of modern software. The first is the increasing sensitivity of processors' throughput to irregularities in computation. With more processors produced through a massive integration of simple cores, future systems will increasingly favor regular data-level parallel computations, but deviate from the needs of applications with complex patterns. Some evidences are already shown on Graphic Processing Units (GPU): Irregular data accesses (e.g., indirect references A[D[i]]) and conditional branches are limiting many GPU applications' performance at a level an order of magnitude lower than the peak of GPU. The second hardware trend is the growing gap between memory bandwidth and the aggregate speed—that is, the sum of all cores' computing power—of a Chip Multiprocessor (CMP). Despite the capped growth of the peak CPU speed, the aggregate speed of a CMP keeps increasing as more cores get into a single chip. It is expected that by 2018, node concurrency in an exascale system will increase by hundreds of times, whereas, memory bandwidth will expand by only 10 to 20 times. Consequently, data movement and storage is expected to consume more than 70% of the total system power. Bridging this gap is difficult; the complexities of modern CMP memory hierarchy make it even harder: Data cache becomes shared among computing units, and the sharing is often non-uniform—whether two computing units share a cache depends on their proximity and the level of the cache. On the recent IBM Power7 architecture, for instance, four hardware contexts (or SMT threads) in a core share the entire memory hierarchy, all cores in one chip share an on-chip L3 cache, and cores across chips share L3 and main memory through off-chip connections. These two trends complicate the translation of computing power into performance, especially for a program with either intensive data accesses or complex patterns in data accesses or control flow paths. Unfortunately, both attributes present and will persist in a class of important applications. For instance, many scientific simulations deal with a large volume of data. And meanwhile, as most real-world processes are non-uniform and evolving (e.g., the evolution of a galaxy or the process of a drug injection), both the computations and data accesses of these programs tend to be irregular and dynamically changing. Currently, the lack of support to these applications on modern CMP severely limits their performance. On GPU, as our recent study shows and other studies echo, performance enhancement of a factor of integers is possible when memory accesses or control flows are streamlined for a set of GPU applications. On multicore CPU, our studies show that traditional locality enhancement, for being oblivious to the new features of multicore memory hierarchy, may even cause large slowdown to data-intensive dynamic applications. The severity of the issues is expected to worsen as the two hardware trends continue. Some recent studies try to match software with the trends, but in a limited scope or manner. For irregularities on GPU, most studies focus on irregularities analyzable through static analysis (e.g., data accesses in regular loops). Dynamic irregularities are harder to address because the needed analysis and transformations typically have to happen at run time. Some other research resorts to hardware extensions, an actual adoption of which is unclear for the entailed space cost and complexity. For data locality, recent years have seen some exploitations of the new memory hierarchy on multicore for performance, but most of them are on process or thread scheduling, rather than program transformations. Our recent study reveals that program-level transformations may magnify the scheduling benefits by a factor of seven, concluding that program-level transformation should play a central role for data locality enhancement on modern CMP. But research in this direction has been sparse, and most have focused on data layout or cache performance modeling, rather than program transformations to match with the new memory hierarchy features. Overall, it is still an open question how to bridge the gap between dynamic computations and the two prominent properties of modern processors. The goal of this project is to develop a set of techniques and software tools to enhance the matching between memory accesses in dynamic simulations and the prominent features of modern and future CMP, alleviating the memory performance issues for petascale and exascale computing. This report summarizes the discoveries and products produced throughout this project. It includes free launch, a new software approach to overcoming the shortcomings of both methods; coherence-free multiview, an approach that allows multiple views of a single data object to co-exist on GPU memory during a GPU kernel execution; algorithmic optimizations to data analytics problems, especially those that involve lots of distance calculations. Supporting dynamic parallelism is important for GPU to benefit a broad range of applications. There are currently two fundamental ways for programs to exploit dynamic parallelism on GPU: a software-based approach with software-managed worklists, and a hardware-based approach through dynamic subkernel launches. Neither is satisfactory. The former is complicated to program and is often subject to some load imbalance; the latter suffers large runtime overhead. In this work, we propose free launch, a new software approach to overcoming the shortcomings of both methods. It allows programmers to use subkernel launches to express dynamic parallelism. It employs a novel compiler-based code transformation named subkernel launch removal to replace the subkernel launches with the reuse of parent threads. Coupled with an adaptive task assignment mechanism, the transformation reassigns the tasks in the subkernels to the parent threads with a good load balance. The technique requires no hardware extensions, immediately deployable on existing GPUs. It keeps the programming convenience of the subkernel launch-based approach while avoiding its large runtime overhead. Meanwhile, its superior load balancing makes it outperform manual worklist-based techniques by 3X on average. The work was published at the 48th Annual IEEE/ACM International Symposium on Microarchitecture (Micro'2015). A Graphic Processing Unit (GPU) system is typically equipped with many types of memory (e.g., global, constant, texture, shared, cache). Data placement determines what data are placed on which type of memory, essential for GPU memory performance. Prior optimizations of data placement always require a single view of a data object on memory, which limits the optimization effectiveness. In this work, we propose coherence-free multiview, an approach that allows multiple views of a single data object to co-exist on GPU memory during a GPU kernel execution. We demonstrate that under certain conditions, the multiple views can remain incoherent while facilitating enhanced data placement. We present a theorem and some compiler support to ensure the soundness of the usage of coherence-free multiview. We further develop reference-discerning data placement, a new way to enhance data placements on GPU. It enables more flexible data placements by using coherence-free multiview to leverage the slack in coherence requirement of some GPU programs. Experiments on three types of GPU systems show that, with less than 200KB space cost, the new data placement technique can provide a 1.6X average (up to 4.27X) speedup. In addition, we have examined algorithmic optimizations to data analytics problems, especially those that involve lots of distance calculations. Computing distances among data points is an essential part of many important algorithms in data analytics, graph analysis, and other domains. In each of these domains, developers have spent significant manual effort optimizing algorithms, often through novel applications of the triangle equality, in order to minimize the number of distance computations in the algorithms. In this work, we observe that many algorithms across these domains can be generalized as an instance of a generic distance-related abstraction. Based on this abstraction, we derive seven principles for correctly applying the triangular inequality to optimize distance-related algorithms. Guided by the findings, we develop Triangular OPtimizer (TOP), the first software framework that is able to automatically produce optimized algorithms that either matches or outperforms manually designed algorithms for solving distance-related problems. TOP achieves up to 237x speedups and 2.5X on average. The work has been published at the 32nd International Conference on Machine Learning (ICML'15) and the 41st International Conference on Very Large Data Bases (VLDB'15).

42 ENGINEERING↗

Why Vascular Surgeons and Interventional Radiologists Collaborate or Compete: A Look at Endovascular Stent Placements

PurposeTo understand how cultural differences between vascular surgeons (VSs) and interventional radiologists (IRs) affect their clinical decision making and inter-specialty relationships.MethodsTwenty-four conversational interviews were conducted with IRs and VSs about their approaches to patient care, views of their specialty and others, and solutions to any expressed concerns. Interview transcripts were systematically analyzed to identify and compare key themes according to the constructivist grounded theory and content analysis using NVivo 10 software. These data were supplemented with a retrospective analysis of 3658 endovascular stent placements performed at a large medical academic center over 11 years. Aggregate counts were divided by provider specialty, and trends were assessed via correlation coefficients.ResultsEndovascular stent placements were relatively equally divided between IR and VS over 11 years with some variability from placements by cardiology. IRs tend to lay claim to treatments as masters of procedures, whereas VSs base their claims on being masters of the treated diseases, leading to collaboration in some practices and bitter competition in others. The level of perceived competition was most associated with specialists’ awareness of and appreciation for specialty-specific values rather than differences in practice structure/reimbursement.ConclusionsUnderstanding cultural differences between IRs and VSs is imperative for fostering better collaboration to grow shared territory rather than competing for the same slice of the pie.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Defect kinetics and dopant activation in submicrosecond laser thermal processes

Defect evolution in ion implanted c-Si at the submicrosecond time scales during a laser thermal annealing process is investigated by means of kinetic simulations. Nonmelting, melting, and partial melting regimes are simulated. Our modeling considers irradiation, heat diffusion, and phase transition together with defect diffusion, annihilation, and clustering. The reduction in the implantation damage and its reorganization in defect aggregates are studied as a function of the process conditions. The approach is applied to double implanted Si and compared to experimental data, indicating a relationship between damage reduction and dopant activation.

36 MATERIALS SCIENCE↗

U.S. Geological Survery Oil and Gas Resource Assessment of the Russian Arctic

The U.S. Geological Survey (USGS) recently completed a study of undiscovered petroleum resources in the Russian Arctic as a part of its Circum-Arctic Resource Appraisal (CARA), which comprised three broad areas of work: geological mapping, basin analysis, and quantitative assessment. The CARA was a probabilistic, geologically based study that used existing USGS methodology, modified somewhat for the circumstances of the Arctic. New map compilation was used to identify assessment units. The CARA relied heavily on geological analysis and analog modeling, with numerical input consisting of lognormal distributions of sizes and numbers of undiscovered accumulations. Probabilistic results for individual assessment units were statistically aggregated, taking geological dependencies into account. The U.S. Department of Energy (DOE) funds were used to support the purchase of crucial seismic data collected in the Barents Sea, East Siberian Sea, and Chukchi Sea for use by USGS in its assessment of the Russian Arctic. DOE funds were also used to purchase a commercial study, which interpreted seismic data from the northern Kara Sea, and for geographic information system (GIS) support of USGS mapping of geological features, province boundaries, total petroleum systems, and assessment units used in the USGS assessment.

02 PETROLEUM↗

A Novel Approach to Simulate Realistic Concrete Microstructures under Irradiation

The concrete biological shield of light water reactors is exposed to high neutron and gamma irradiation doses in the long term. Irradiation deteriorates the physical and mechanical properties of concrete. Such effects need to be investigated to predict the concrete’s performance in the event of a lifetime extension of a nuclear power plant. This work combines high-resolution characterization techniques with fast-Fourier transform (FFT)-based 2-D simulations to evaluate the radiation-induced volumetric expansion (RIVE) and damage in concrete microstructures under neutron irradiation. Two concrete microstructures from samples provided by the Japan Concrete Aging Management Program (JCAMP) were characterized using micro x-ray fluorescence (mXRF) to obtain elemental intensity maps, and energy-dispersive x-ray spectroscopy to complement mXRF with local elemental information for Na. Minerals and cement paste are then identified based on the elemental composition to produce high-resolution phase maps, resulting in a more accurate representation of the microstructures compared to previous work. Simulations of radiation-induced volumetric expansion (RIVE), creep, and damage in JCAMP concrete use the fast Fourier transform (FFT)-based code Microstructure Oriented Scientific Analysis of Irradiated Concrete (MOSAIC) combined with the irradiated minerals, aggregates, and concrete (IMAC) database, which contains mineral-specific RIVE models. Overall, the simulation results are in fair agreement with experimental data.

Cheniour, Amani↗

OT Operational Anomaly Detection (OAD) T&D + DER

The growth of utility-scale renewable energy resources, distributed energy resources (DER), and transportation electrification has increased uncertainty and cybersecurity risks in power grids. The Purdue Enterprise Reference Architecture model which is widely adopted by the utility industry is now insufficient to protect the power grid against cyber-attacks. There is a need to identify what cybersecurity model is effective on Energy Management System (EMS), Advanced Distribution Management System (ADMS), and DER Management System (DERMS) to address the fundamental cybersecurity challenges in the age of increasing renewable energy and DER share as well as consumer participation in the electric energy industry. The next generation of cybersecurity model for OT network should be able to detect inside attackers, mitigate the cybersecurity risks arising from the new grid participants including DER aggregators, electric vehicle owners, and behind-the-meter consumers outside the utility company, and develop the strategy to trust consumer measurement data. This panel will discuss the challenges and pathways for the development of an ensemble cybersecurity model based on predictive state estimation to detect cybersecurity anomalies in OT network including EMS, ADMS, and DERMS.

cybersecurity↗

Random Forest Regressor-Based Approach for Detecting Fault Location and Duration in Power Systems

Power system failures or outages due to short-circuits or “faults” can result in long service interruptions leading to significant socio-economic consequences. It is critical for electrical utilities to quickly ascertain fault characteristics, including location, type, and duration, to reduce the service time of an outage. Existing fault detection mechanisms (relays and digital fault recorders) are slow to communicate the fault characteristics upstream to the substations and control centers for action to be taken quickly. Fortunately, due to availability of high-resolution phasor measurement units (PMUs), more event-driven solutions can be captured in real time. In this paper, we propose a data-driven approach for determining fault characteristics using samples of fault trajectories. A random forest regressor (RFR)-based model is used to detect real-time fault location and its duration simultaneously. This model is based on combining multiple uncorrelated trees with state-of-the-art boosting and aggregating techniques in order to obtain robust generalizations and greater accuracy without overfitting or underfitting. Four cases were studied to evaluate the performance of RFR: 1. Detecting fault location (case 1), 2. Predicting fault duration (case 2), 3. Handling missing data (case 3), and 4. Identifying fault location and length in a real-time streaming environment (case 4). A comparative analysis was conducted between the RFR algorithm and state-of-the-art models, including deep neural network, Hoeffding tree, neural network, support vector machine, decision tree, naive Bayesian, and K-nearest neighborhood. Experiments revealed that RFR consistently outperformed the other models in detection accuracy, prediction error, and processing time.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The temperature and size distribution of large water clusters from a non-equilibrium model

A hybrid Lagrangian-Eulerian approach is used to examine the properties of water clusters formed in neon-water vapor mixtures expanding through microscale conical nozzles. Experimental size distributions were reliably determined by the sodium doping technique in a molecular beam machine. The comparison of computed size distributions and experimental data shows satisfactory agreement, especially for (H{sub 2}O){sub n} clusters with n larger than 50. Thus validated simulations provide size selected cluster temperature profiles in and outside the nozzle. This information is used for an in-depth analysis of the crystallization and water cluster aggregation dynamics of recently reported supersonic jet expansion experiments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

On the formation of copper nanoparticles in nanocluster aggregation source

The influence of pressure and type of inert gas (Ar and Kr) on the morphology and size distribution of nanoparticles produced in a nanocluster source is studied experimentally. The experimental data are used to validate the model of cluster formation from a supersaturated atomic vapor in an inert buffer gas, which has been developed in our previous paper. The model predictions are in accordance with the experimental findings.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DECIPHERING CONTRIBUTIONS TO THE EXTRAGALACTIC GAMMA-RAY BACKGROUND FROM 2 GeV TO 2 TeV

Astrophysical sources outside the Milky Way, such as active galactic nuclei and star-forming galaxies, leave their imprint on the gamma-ray sky as nearly isotropic emission referred to as the extragalactic gamma-ray background (EGB). While the brightest of these sources may be individually resolved, their fainter counterparts contribute diffusely. In this work, we use a recently developed analysis method, called the Non-Poissonian Template Fit, on up to 93 months of publicly available data from the Fermi Large Area Telescope to determine the properties of the point sources (PSs) that comprise the EGB. This analysis takes advantage of photon-count statistics to probe the aggregate properties of these source populations below the sensitivity threshold of published catalogs. We measure the source-count distributions and PS intensities, as a function of energy, from ∼2 GeV to 2 TeV. We find that the EGB is dominated by PSs, likely blazars, in all seven energy sub-bins considered. These results have implications for the interpretation of IceCube’s PeV neutrinos, which may originate from sources that contribute to the non-blazar component of the EGB. Additionally, we comment on implications for future TeV observatories such as the Cherenkov Telescope Array. We provide sky maps showing locations most likely to contain these new sources at both low (≲50 GeV) and high (≳50 GeV) energies for use in future observations and cross-correlation studies.

79 ASTRONOMY AND ASTROPHYSICS↗

Simulated building energy demand biases resulting from the use of representative weather stations

Numerical building models are typically forced with weather data from a limited number of “representative cities” or weather stations representing different climate regions. The use of representative weather stations reduces computational costs, but often fails to capture spatial heterogeneity in weather that may be important for simulations aimed at understanding how building stocks respond to a changing climate. We quantify the potential reduction in bias from using an increasing number of weather stations over the western U.S. The approach is based on deriving temperature and load time series using incrementally more weather stations, ranging from 8 to roughly 150, to capture weather across different seasons. Using 8 stations, one from each climate zone, across the western U.S. results in an average absolute summertime temperature bias of 7.2°F with respect to a spatially-resolved gridded dataset. The mean absolute bias drops to 2.8°F using all available weather stations. Temperature biases of this magnitude could translate to absolute summertime mean simulated load biases as high as 13.8%, a significant error for capacity expansion planners who may use these types of simulations. Increasing the size of the domain over which biases are calculated reduces their magnitude as positive and negative biases may cancel out. Using 8 representative weather stations can lead to a 20-40% overestimation of peak building loads during both summer and winter. Using weather stations close to population centers reduces both mean and peak load biases. This approach could be used by others designing aggregate building simulations to understand the sensitivity to their choice of weather stations used to drive the models.

Burleyson, Casey D.↗

A Scalable Monitoring for the CMS Filter Farm Based on Elasticsearch

A flexible monitoring system has been designed for the CMS File-based Filter Farm making use of modern data mining and analytics components. All the metadata and monitoring information concerning data flow and execution of the HLT are generated locally in the form of small documents using the JSON encoding. These documents are indexed into a hierarchy of elasticsearch (es) clusters along with process and system log information. Elasticsearch is a search server based on Apache Lucene. It provides a distributed, multitenant-capable search and aggregation engine. Since es is schema-free, any new information can be added seamlessly and the unstructured information can be queried in non-predetermined ways. The leaf es clusters consist of the very same nodes that form the Filter Farm thus providing natural horizontal scaling. A separate central” es cluster is used to collect and index aggregated information. The fine-grained information, all the way to individual processes, remains available in the leaf clusters. The central es cluster provides quasi-real-time high-level monitoring information to any kind of client. Historical data can be retrieved to analyse past problems or correlate them with external information. We discuss the design and performance of this system in the context of the CMS DAQ commissioning for LHC Run 2.

Andre, J. M.↗

A Bayesian Approach to Predict Solubility Parameters

Abstract Solubility is a ubiquitous phenomenon in many aspects of material science. While solubility can be determined by considering the cohesive forces in a liquid via the Hansen solubility parameters (HSP), quantitative structure–property relationship models are often used for prediction, notably due to their low computational cost. Here, gpHSP, an interpretable and versatile probabilistic approach to determining HSP, is reported. Our model is based on Gaussian processes, a Bayesian machine learning approach that provides uncertainty bounds to prediction. gpHSP achieves its flexibility by leveraging a variety of input data, such as SMILES strings, COSMOtherm simulations, and quantum chemistry calculations. gpHSP is built on experimentally determined HSP, including a general solvents set aggregated from the literature, and a polymer set experimentally characterized by this group of authors. In all sets, a high degree of agreement is obtained, surpassing well‐established machine learning methods. The general applicability of gpHSP to miscibility of organic semiconductors, drug compounds, and in general solvents is demonstrated, which can be further extended to other domains. gpHSP is a fast and accurate toolbox, which could be applied to molecular design for solution processing technologies.

Sanchez‐Lengeling, Benjamin↗

ACToR - Aggregated Computational Toxicology Resource

ACToR (Aggregated Computational Toxicology Resource) is a database and set of software applications that bring into one central location many types and sources of data on environmental chemicals. Currently, the ACToR chemical database contains information on chemical structure, in vitro bioassays and in vivo toxicology assays derived from more than 150 sources including the U.S. Environmental Protection Agency (EPA), Centers for Disease Control (CDC), U.S. Food and Drug Administration (FDA), National Institutes of Health (NIH), state agencies, corresponding government agencies in Canada, Europe and Japan, universities, the World Health Organization (WHO) and non-governmental organizations (NGOs). At the EPA National Center for Computational Toxicology, ACToR helps manage large data sets being used in a high-throughput environmental chemical screening and prioritization program called ToxCast{sup TM}.

60 APPLIED LIFE SCIENCES↗

Novel Synthesis and Structural Analysis of Ferrihydrite

Naturally occurring ferrihydrite is both impure and difficult to isolate, so the numerous applications and interesting properties of ferrihydrite have spurred the development of various synthetic techniques. Nearly all techniques are based on the hydrolysis of an iron salt and require careful control of temperature, pH, and concentration. In this Article, we report a new synthetic method which does not require such control and is perhaps the fastest and simplest route to synthesizing ferrhydrite. XRD, TEM, BET, and chemical purity characterizations show that the chemically pure, 2-line ferrihydrite product consists of crystallites 2-6 nm in diameter which aggregate to form mesoporous, high surface area agglomerates that are attractive candidates for the many adsorption applications of ferrihydrite. X-ray PDF data were also collected for the ferrihydrite product and refined against the hexagonal structural model recently proposed by Michel et al. These analyses suggest that ferrihydrite has a consistent, repeatable structure independent of variation in the synthetic method, water content of the sample, or particle size of the crystallites, and this structure can be adequately described by the proposed hexagonal model.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Semi-Supervised Disaggregation of Load Profiles at Transmission Buses with Significant Behind-the-Meter Solar Generations

It is of imperative interests for regional transmission organizations (RTOs) to effectively extract daily load profiles at transmission buses, which remains a gap in existing technology paradigm. This digest proposes an explicit yet efficient linear estimator, to disaggregate metered load profiles at buses with significant behind-the-meter (BTM) solar generations in a data driven manner. The proposed estimator is based on utility zonal load profiles and proxy solar irradiance profiles, which in reality is the aggregated waveform at each transmission bus and equivalent to the mix of summed load profiles minus actual BTM solar generation. To overcome technical challenges in the lack of “ground truth” and validate the performance of supervised learning algorithms, we propose semi-supervised mechanisms with parameter tuning, and leverage the unique characteristics of zero-crossing points in BTM solar peaking behaviors.

machine leaning, behind-the-meter, power grid anal↗