Search NASA⌕ Search

SEARCH · Search NASA

Results for “temporal learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Phasor-Measurement-Unit-Based Data Analytics Using Digital Twin and PhasorAnalytics Software

A major objective of this project was to apply GE’s commercial machine learning and data analytics toolsets to large-scale, real-world, anonymized Phasor Measurement Unit (PMU) datasets in order to extract signatures, correlated and/or causal factors, and precursor patterns associated with significant power system phenomena. The project had a particular emphasis on extraction of insights relevant to asset health monitoring, real-time load modeling and cybersecurity monitoring. Additionally, the team was directed to undertake a comprehensive data quality analysis for the provided datasets and encouraged to estimate the ‘machine-learning readiness’ of the datasets by documenting any major obstacles to the application of commercial machine learning algorithms. To accomplish the aforementioned objectives, the project team’s work centered around the identification of key event signatures and application of the identified event signatures for event detection and event classification. The industry-validated, semi-supervised machine learning strategy employed for event signature identification involved several major tasks, including data-preprocessing, generation of an overabundance of features, normal data identification, normality modeling, and event signature identification through a methodical, quantitative ranking of features in order of relevance to each studied event type. Throughout the project, data quality issues and mitigation techniques were investigated. In this report, insights are provided regarding the readiness of the provided synchrophasor datasets for application of machine learning and data analytics. The methodologies employed for this technical strategy are summarized in this report. With regards to data preprocessing and feature generation, the provided Training and Test Datasets were ingested into GE’s big data environment. Subsequently, the team applied bad data cleansing and data imputation scripts, event detection scripts, and application programming interfaces (APIs) to the datasets for convenient data access. The project team completed development and validation of dozens of physics-based, statistics-based and transformation-based feature functions used for the extraction of over 60 synchrophasor features. Using a new parallel feature generation technology developed on this project, over 60 features have been rapidly generated for the full two years’ worth of Training and Test Dataset data associated with both the Eastern and Western interconnects. Even accommodating for temporal down-sampling inherent to the feature extraction procedure, this parallel feature generation activity resulted in a massive feature set with a storage requirement approximately equal to that of the raw training dataset itself. With regards to normal data identification and normality modeling, a normality model was built using the feature data extracted from the Training Dataset and iteratively refined subsequent to incremental adjustments and expansions of the Training Dataset feature data. With respect to event characterization and signature identification, an event signature identification pipeline was developed and used in conjunction with the normality model to identify over 15 event signatures for key event categories within the Training Dataset. The identified event signatures were used to characterize hundreds of key events in terms of relative severity, duration, and location of the event. An investigation was undertaken to identify correlated and causal factors involved in transformer events. A separate investigation into temporal trends in ring-down analysis results was undertaken to determine possible associations between system dynamics and various other factors such as loading, season or year. To validate the identified event signatures, additional work was undertaken to develop signature-based anomaly detection and classification tools suitable for convenient application to the synchrophasor datasets. The anomaly detection and classification tools, suitable for online application, were then applied to the entirety of the Eastern Interconnect Training and Test Datasets. Performance of the event detection and classification tools was evaluated upon receipt of the Test Dataset event logs (i.e., the labels for events contained in the Test Dataset), and promising results were obtained despite several challenges (documented herein) associated with application of supervised or semi-supervised machine learning methods to large-scale, anonymized datasets. Finally, the detection and classification tools were used to detect, classify, and characterize thousands of new events not included in the original event logs provided by the DOE within both the Training and Test Datasets.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Anomaly analysis and visualization for dynamic networks through spatiotemporal graph segmentations

With recent technology advance in Internet of Things (IoT) that involves human, sensors, and mobile devices, networks are not only growing much larger but more complex and dynamic in nature. The spatiotemporal dynamics of networks are represented by both topological changes and temporal shifts of attribute information associated with network components. Understanding the pattern and trend of dynamic networks is increasingly important. While data mining approaches are generally useful in analyzing the statistical properties of networks, there has been recent trend to consider bringing human into the loop, and to examine how feedback from visualizations of large-scale dynamic networks can further improve data mining and machine learning. Traditional visualization methods based on animation and sequences of snapshot graphs are also limited by human cognitive capability. Here, we present a dynamic network analysis and visualization (DNAV) tool which explores the spatiotemporal dimensions of graph components. In particular, nodes and edges are augmented with spatiotemporal segmentation based on both topological and attribute dynamics (e.g., time and locations of connectivity). To further facilitate analysis of large dynamic networks, DNAV includes statistical dynamic overviews alongside graph views, as well as data filtering modules for scalable analysis. Using case studies on public datasets, we demonstrate the effectiveness of DNAV in understanding and analyzing anomalies in dynamic networks such as computer communication networks.

97 MATHEMATICS AND COMPUTING↗

Data-Driven Clustering and Classification of Outage Patterns with Insights into their Links to Extreme Events

At a global level extreme events have increased in both scale and impact. These events have the potential to affect the electrical grid infrastructure and cause a wide range of outages, which can lead to a disruption in daily patterns, cost millions of dollars and also the loss of life. Currently, to track these outage events there have been various approaches developed ranging from regional to national level quantifications for what defines an outage. However, this variation in methods can potentially lead to subjective decision-making and a lack of proper management in relation to the event. While previous work has made strides in determining spatio-temporal patterns, minimal attention has been given to the type and number of outages an area may be exposed to. The differences in incurred cost and the overall severity of an event between a transformer box malfunction and a hurricane are drastic, and by finding historical signals, we can allow for more efficient management, potentially saving lives and millions of dollars. Here, we leverage unsupervised machine learning techniques to delineate outage patterns among 22 counties within the United States and find that there are clear, segregated clusters (0.93 silhouette) of data which are related by event behavior and underlying cause. This finding will allow for energy stakeholders, policy makers, and researchers to gain a deeper understanding of the extent and severity of historic events and to better prepare for electrical grid infrastructure planning and management.

Koob, Benjamin [ORNL]↗

Trapped particles and waves, and what can be learned from multisatellite experiments

Calculations concerning the pitch-angle diffusion resulting from resonant wave-particle interactions can lead to definitive predictions of equatorial pitch-angle distributions and rates of particle loss as a function of particle energy and L-value. Thus, given simultaneous high-altitude measurements of pitch-angle distributions and low-altitude measurements of precipitating fluxes as a function of energy and L, the importance of proposed wave-particle interactions can be verified or discarded. Since many wave-particle phenomena occur over large spatial and temporal scales, exact simultaneity in longitude and time is not necessary. Simultaneous low and high altitude (preferably nearly equatorial) particle measurements could thus greatly increase our understanding of trapped particles and their effects on the ionosphere. Furthermore, given a verified pitch-angle diffusion mechanism and simultaneous low- and high-altitude measurements, accurate lowto high-altitude mappings of field lines and magnetospheric boundaries (such as the plasmapause) could be obtained.

Lyons, L. R.↗

Layer-wise Imaging Dataset from Powder Bed Additive Manufacturing Processes for Machine Learning Applications (Peregrine v2022-10.1)

This release consists of six datasets which together include multi-modal layer-wise powder bed images from two different powder bed printing technologies. These datasets are designed primarily to facilitate the development and testing of new computer vision and machine learning based anomaly and defect detection algorithms. The authors provide both training data with corresponding ground truth pixel masks and evaluation data with corresponding baseline prediction pixel masks made by a trained neural network. The laser powder bed fusion (L-PBF) datasets are sourced from EOS M290 and AddUp FormUp 350 printers and the binder jet (BJ) dataset is sourced from an ExOne M-Flex printer. The materials represented in these datasets include 17-4 PH Stainless Steel, GammaPrint-700, Inconel 718, Maraging Steel, and H13 Steel. The sensor imaging modalities represented include visible-light (VL), temporally-integrated (i.e., long duration exposure) near-infrared (TI-NIR), and wide-band infrared (IR). To download the dataset: (1) Create a Globus account. (2) Create a Globus Endpoint on your computer. (3) Transfer the dataset from the OLCF DOI-DOWNLOADS Collection to your Collection. Common troubleshooting steps: (a) Confirm that the transfer is going from OLCF DOI-DOWNLOADS to your Collection. (b) Create an exception for Globus in your antivirus software so that it can create an Endpoint. (c) Manually create a Globus access directory (where the data will be downloaded) by going to the Preferences > Access tab.

36 MATERIALS SCIENCE↗

Failure Analysis on Multivariate Time-series Data given Uncertain Labels

Machine failure analysis and detection is critical to today’s industrial society. Given a number of failure events on multivariate temporal data, the ability to identify 1) the discriminative patterns prior to the events and 2) the most relevant features to the failure has practical use for early warning and root cause analysis. However, since these patterns are not necessarily adjacent to the onset of failure in time, faulty labels are often with uncertainty, which makes traditional supervised detection methods inapplicable. To address the label uncertainty and learn the complicated correlation in multivariate time series, we design Failure Analysis on Multivariate Time-series Data (MAMT) that jointly selects the most failure-relevant features and time-instances by a novel dynamic and directional label diffusion process. Extensive experiments demonstrate that MAMT is more effective while more efficient than popular baselines.

97 MATHEMATICS AND COMPUTING↗

Learning from learning machines: improving the predictive power of energy-water-land nexus models with insights from complex measured and simulated data

Focal Area(s): Insights gleaned from complex data (observed and simulated) using AI; Predictive modeling through the use of AI techniques and AI-derived model components, including physics- and knowledge-informed models; Energy-water-land nexus and integrated energy systems – models of MultiSector dynamics. Science Challenge: Scientific communities are in need of tools for the computational integration of physics-based models, experimental data, and empirical/observational studies across a broad range of temporal and spatial scales to explore and meet EESSD grand challenges. We require AI algorithms for the discovery of process-drivers in the Earth-energy-human system and to link them with complex measured and simulated data. We aim to understand the energy-water-land nexus, particularly under extreme forcing scenarios and rare events, leveraging scale-aware AI process models, including probabilistic uncertainties, and benefiting from the emerging 5G-enabled landscape-scale sensing and edge computing capabilities. These models are needed to identify instabilities and tipping points that manifest extreme system behaviors with consequences for integrated energy systems and the environment. This work requires fundamental advances in uncertainty quantification, in particular, to identify and model unlikely but catastrophic outliers. Specifically, we need models that are interpretable to domain scientists and, essentially, explainable to public and private stake holders.

54 ENVIRONMENTAL SCIENCES↗

Use of Machine Learning on PMU Data for Transmission System Fault Analysis

Synchrophasor technology has been used for monitoring, control, and protection of bulk power system for over 10 years. Deployment of phasor measurement units (PMUs) in the USA power system has surpassed 3000 units installed in the transmission substations as stand-alone intelligent electronic devices (IEDs) or as a software add-on to other devices such as digital protective relays (DPRs) or digital fault recorders (DFRs). By now, thousands of terabytes of PMU data may have been captured and stored by various transmission system operators (TSOs) and independent system operators (ISOs). This creates an opportunity to deploy advanced machine learning (ML) techniques to detect and classify faults recorded by PMUs automatically to be used by the system operators for rapid, critical decision-making when manual analysis of the past or unfolding events is not feasible. In this paper we offer a brief background on how the automated fault analysis may be done using DPR and/or DFR data, and compare some of the legacy approaches to the new ML approaches in the context of the system-wide PMU recordings. We then offer insights from developing practical ML solutions that have been applied on field recordings captured by close to 450 PMUs from all three US interconnections (Western, Eastern and ERCOT) over two years (2016-2017). We identify and illustrate ML challenges we addressed: inaccurate data, data with scarce and temporally imprecise fault labels, data recorded by PMUs sparsely located at substations resulting in the fault records taken afar from the ends of the faulted lines, data containing only positive sequence values, and data taken at different voltage levels. We then illustrate the ML model results for fault analysis under different application scenarios. The novelty of this study is not only in the design, implementation, and performance analysis of the ML algorithms, but also in the use of advanced fault modelling and simulation approaches to improve the training results when developing supervised ML models for fault detection and classification. Extensive simulations of faults were conducted on a 14-bus power system to create a training dataset with over 1400 accurately labelled faults. This dataset was applied to enhance the accuracy of fault detection and classification of machine learning-based models trained with small number of labelled faults in large datasets recorded in the grid interconnections ranging from 5,000 to 70,000 buses.

Synchrophasors, Machine Learning, Fault Analysis, ↗

Spatial Transferability of Machine Learning Based Volume Estimation Models

High-quality traffic volume data is essential for efficient transportation planning and operations. However, such high-quality data is expensive to collect, owing primarily to the high capital cost of installing and maintaining continuous counting stations (CCSs). Recent availability of probe-based vehicle data offers a cost-effective solution for increasing the observability of traffic volumes. However, having ample ground truth traffic data is a prerequisite for developing robust volume estimation models. Though this might not be a big issue in many states, states with scarce CCS data might be able to benefit from robust volume estimation models developed in (adjacent) data-rich states. While there is a reasonable amount of spatial transferability research in the transportation domain, there is a dearth of knowledge on the spatial transferability of probe-based volume estimation models. To address this gap, this paper explores spatial transferability of volume estimation models developed from data in three states (Colorado, North Carolina, and Pennsylvania). Results indicate that it is extremely important to maintain temporal consistency when attempting spatial transferability of volume estimation models. It was also found that models trained on regions with lower peak traffic volumes will limit the performance of models transferred to states with higher peak hourly traffic volumes. Corroborating findings from existing spatial transferability research on other topics, it was found that a meta-model (developed using data from multiple states) performs better than volume estimation models developed within any one of the states.

ADVANCED PROPULSION SYSTEMS↗

Xylella fastidiosa causes transcriptional shifts that precede tylose formation and starch depletion in xylem

Abstract Pierce's disease (PD) in grapevine ( Vitis vinifera ) is caused by the bacterial pathogen Xylella fastidiosa . X. fastidiosa is limited to the xylem tissue and following infection induces extensive plant‐derived xylem blockages, primarily in the form of tyloses. Tylose‐mediated vessel occlusions are a hallmark of PD, particularly in susceptible V. vinifera . We temporally monitored tylose development over the course of the disease to link symptom severity to the level of tylose occlusion and the presence/absence of the bacterial pathogen at fine‐scale resolution. The majority of vessels containing tyloses were devoid of bacterial cells, indicating that direct, localized perception of X. fastidiosa was not a primary cause of tylose formation. In addition, we used X‐ray computed microtomography and machine‐learning to determine that X. fastidiosa induces significant starch depletion in xylem ray parenchyma cells. This suggests that a signalling mechanism emanating from the vessels colonized by bacteria enables a systemic response to X. fastidiosa infection. To understand the transcriptional changes underlying these phenotypes, we integrated global transcriptomics into the phenotypes we tracked over the disease spectrum. Differential gene expression analysis revealed that considerable transcriptomic reprogramming occurred during early PD before symptom appearance. Specifically, we determined that many genes associated with tylose formation (ethylene signalling and cell wall biogenesis) and drought stress were up‐regulated during both Phase I and Phase II of PD. On the contrary, several genes related to photosynthesis and carbon fixation were down‐regulated during both phases. These responses correlate with significant starch depletion observed in ray cells and tylose synthesis in vessels.

59 BASIC BIOLOGICAL SCIENCES↗

Validation of the Version 1 NOAA/NASA Pathfinder Sea Surface Temperature Data Set

A high-resolution, global satellite-derived sea surface temperature (SST) data set called Pathfinder, from the Advanced Very High Resolution Radiometer (AVHRR) aboard the NOAA Polar Orbiters, is available from the Jet Propulsion Laboratory Physical Oceanography Distributed Active Archive Center (JPL PO.DAAC). Suitable for research as well as education, the Pathfinder SST data set is a result of a collaboration between the National Oceanographic and Atmospheric Administration (NOAA), the National Aeronautics and Space Administration (NASA) and investigators at several universities. NOAA and NASA are the sponsors of the Pathfinder Program, which takes advantage of currently archived Earth science data from satellites. Where necessary, satellite sensors have been intercalibrated, algorithms improved and processing procedures revised, in order to produce long time-series, global measurements of ocean, land and atmospheric properties necessary for climate research. Many Pathfinder data sets are available to researchers now, nearly a decade before the first launch of NASA's Earth Observing System (EOS). The lessons learned from the Pathfinder programs will facilitate the processing and management of terabytes of data from EOS. The Oceans component of Pathfinder has undertaken to reprocess all Global Area Coverage (GAC) data acquired by the 5-channel AVHRRs since 1981. The resultant data products are consistent and stably calibrated [Rao, 1993a, Rao, 1993b, Brown et al., 1993], Earth-gridded SST fields at a variety of spatial and temporal resolutions.

Smith, Elizabeth A.↗

Using Neural Networks to Describe Tracer Correlations

Neural networks are ideally suited to describe the spatial and temporal dependence of tracer-tracer correlations. The neural network performs well even in regions where the correlations are less compact and normally a family of correlation curves would be required. For example, the CH4-N2O correlation can be well described using a neural network trained with the latitude, pressure, time of year, and CH4 volume mixing ratio (v.m.r.). In this study a neural network using Quickprop learning and one hidden layer with eight nodes was able to reproduce the CH4-N2O correlation with a correlation co- efficient of 0.9995. Such an accurate representation of tracer-tracer correlations allows more use to be made of long-term datasets to constrain chemical models. Such as the dataset from the Halogen Occultation Experiment (HALOE) which has continuously observed CH4, (but not N2O) from 1991 till the present. The neural network Fortran code used is available for download.

Lary, D. J.↗

Development of Automated Pipeline for Time-Resolved Link-Wise Vehicular Energy Consumption in the Chattanooga, TN Road Network

The Department of Energy (DOE) has shown strong interest in detecting energy inefficiencies in regional road networks, so as to derive energy consumed at a high spatial temporal resolution. We have developed a workflow to automate the estimation of time-resolved vehicular energy consumption over each link in a road network of interest. The road network used in the current work is centered around the city of Chattanooga, Tennessee and its bordering regions. Utilizing the most mature road network for the Chattanooga, TN region, vehicle speed & count data from TomTom in conjunction with machine learning methods, we have developed an automated pipeline to estimate energy consumption for every link in the network. The first step in the pipeline is ingesting vehicle probe counts and speed estimates from TomTom API. In the next step, the probe counts, speed profiles and other exogenous data (i.e. road types, weather data, ground-truth volume counts and more) were used as input to a supervised learning algorithm to estimate the number of vehicles throughout the entire region for each road segment. These volume estimates were then mapped to a unified road network that contained additional important information such as percentage change in gradient across a link, number of lanes and link lengths that are features in pre-trained single vehicle energy-consumption models available with the RouteE software developed at NREL. The per vehicle energy consumption on each road link predicted using appropriate RouteE vehicular models were multiplied by the volume estimate for the corresponding link over a given time period to predict energy consumed per link for the time interval of interest. Currently, work is underway to improve both the RouteE per vehicle energy estimate and the volume estimates derived from TomTom probe counts. We have also explored the correlation of the link-wise energy estimates with the features of the pre-trained RouteE machine learning model in order to gain insight into what factors contribute most to the link-wise energy consumption.

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION,↗

Critical needs to close monitoring gaps in pan-tropical wetland CH 4 emissions

Global wetlands are the largest and most uncertain natural source of atmospheric methane (CH 4 ). The FLUXNET-CH 4 synthesis initiative has established a global network of flux tower infrastructure, offering valuable data products and fostering a dedicated community for the measurement and analysis of methane flux data. Existing studies using the FLUXNET-CH 4 Community Product v1.0 have provided invaluable insights into the drivers of ecosystem-to-regional spatial patterns and daily-to-decadal temporal dynamics in temperate, boreal, and Arctic climate regions. However, as the wetland CH 4 monitoring network grows, there is a critical knowledge gap about where new monitoring infrastructure ought to be located to improve understanding of the global wetland CH 4 budget. Here we address this gap with a spatial representativeness analysis at existing and hypothetical observation sites, using 16 process-based wetland biogeochemistry models and machine learning. We find that, in addition to eddy covariance monitoring sites, existing chamber sites are important complements, especially over high latitudes and the tropics. Furthermore, expanding the current monitoring network for wetland CH 4 emissions should prioritize, first, tropical and second, sub-tropical semi-arid wetland regions. Considering those new hypothetical wetland sites from tropical and semi-arid climate zones could significantly improve global estimates of wetland CH 4 emissions and reduce bias by 79% (from 76 to 16 TgCH 4 y -1 ), compared with using solely existing monitoring networks. Our study thus demonstrates an approach for long-term strategic expansion of flux observations.

54 ENVIRONMENTAL SCIENCES↗

Deep convolutional neural networks for multi-scale time-series classification and application to disruption prediction in fusion devices

The multi-scale, mutli-physics nature of fusion plasmas makes predicting plasma events challenging. Recent advances in deep convolutional neural network architectures (CNN) utilizing dilated convolutions enable accurate predictions on sequences which have long-range, multi-scale characteristics, such as the time-series generated by diagnostic instruments observing fusion plasmas. Here we apply this neural network architecture to the popular problem of disruption prediction in fusion tokamaks, utilizing raw data from a single diagnostic, the Electron Cyclotron Emission imaging (ECEi) diagnostic from the DIII-D tokamak. ECEi measures a fundamental plasma quantity (electron temperature) with high temporal resolution over the entire plasma discharge, making it sensitive to a number of potential pre-disruptions markers with different temporal and spatial scales. Promising, initial disruption prediction results are obtained training a deep CNN with large receptive field ({$\sim$}30k), achieving an $F_1$-score of {$\sim$}91\% on individual time-slices using only the ECEi data.

convolutional neural networks↗

UAV-based multispectral time-series imagery of biomass sorghum - 2019

UAV-based high-resolution multispectral time-series orthophotos utilized to understand the relation between growth dynamics, imagery temporal resolution, and end-of-season biomass productivity of biomass sorghum as bioenergy crop. Sensor utilized is a RedEdge Micasense flown at 40 meters above ground level at the Energy Farm- UIUC in 2019.

Bioenergy crops↗

Sparse distributed memory overview

The Sparse Distributed Memory (SDM) project is investigating the theory and applications of massively parallel computing architecture, called sparse distributed memory, that will support the storage and retrieval of sensory and motor patterns characteristic of autonomous systems. The immediate objectives of the project are centered in studies of the memory itself and in the use of the memory to solve problems in speech, vision, and robotics. Investigation of methods for encoding sensory data is an important part of the research. Examples of NASA missions that may benefit from this work are Space Station, planetary rovers, and solar exploration. Sparse distributed memory offers promising technology for systems that must learn through experience and be capable of adapting to new circumstances, and for operating any large complex system requiring automatic monitoring and control. Sparse distributed memory is a massively parallel architecture motivated by efforts to understand how the human brain works. Sparse distributed memory is an associative memory, able to retrieve information from cues that only partially match patterns stored in the memory. It is able to store long temporal sequences derived from the behavior of a complex system, such as progressive records of the system's sensory data and correlated records of the system's motor controls.

Raugh, Mike↗

Possible Stick-Slip Mechanism for Whillans Ice Stream

Tidally-induced stick-slip motion in the mouth of Whillans Ice Stream provides a unique natural experiment in ice-stream response behavior and fiom which we might learn a great deal about subglacial till properties and sub-ice-stream conditions. At the IGS Symposium on Fast Glacier Flow (Yakutat, 2002), we reported our observations of stick- slip motion and demonstrated its synchronicity with tidal forcing. Recently, we have completed additional processing of our GPS data in differential mode. It reveals more details of the stick-slip events and illustrates that within 30 seconds, the temporal interval of our data, the ice stream accelerates to a speed corresponding to a completely lubricated bed. While details of individual events vary, there seems to be strong evidence of an elastic rebound on the time scale of one hour following most events. This suggests the event involves the release of stored elastic strain energy in the ice. The similar displacements of events suggest further that till or subglacial hydrologic properties limit the amount of elastic strain released in any single event. We follow a line of reasoning that dilatant strengthening limits the slip displacement and present model of the stick-slip process. To match the observed delay between the peak ocean tide and stick-slip events, our model includes a propagating pressure wave in the subglacial hydrologic system between the grounding line, where the rising tide first increases the subglacial water pressure and regions upstream where stored elastic strain increases the basal shear stress. This high-tide event is released when the increased water pressure reaches the region of increased shear stress. Dilatant strengthening stops the event by increasing pore volume and lowering the water pressure. Following this event, falling tide increases the normal forces, compresses the till and increases pore pressure again, leading to the second falling-tide event we observe every tidal cycle.

Bindschadler, Robert↗