Search NASA⌕ Search

SEARCH · Search NASA

Results for “temporal network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Differential Trends in Iron Concentrations of Boreal Streams Linked to Catchment Characteristics

Increasing iron (Fe) concentrations have been reported for freshwaters across northern Europe over the last decades. This increase, together with elevated concentrations of dissolved organic carbon (DOC), leads to browning of freshwaters, which affects aquatic organisms, ecosystem functioning, biogeochemical cycles, and brings challenges to drinking water production. However, how such increasing trends in stream Fe concentrations reflect the contribution of different catchment sources remains poorly resolved. Here, we explored how catchment characteristics, that is, mires and coniferous soils, regulate spatial and temporal patterns of Fe in a boreal stream network. For this, we determined Fe speciation in riparian and mire soils, and studied temporal Fe dynamics in soil-water and stream-water over a span of 18 years. Positive Fe trends were found in the solution of the riparian soil, while no long-term trend was observed in the mire. These differences were reflected in stream-water, where three headwater streams dominated by coniferous cover also displayed positive Fe trends, whereas the mire dominated stream showed no trend. Surprisingly, the majority of higher order streams showed declining Fe trends, despite long-term increases in DOC. In addition, we found that an extreme drought event led to a prolonged release of Fe and DOC from the riparian soils, that could have long-term effects on stream Fe concentrations. Our results show that riparian forest soils can be major contributors to ongoing increases in freshwater Fe concentrations and that drought can further promote the release of Fe from organic soils.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

listenr

SAND2024-13902O listenr is an R package containing code that allows users to fit echo state networks (a machine learning model) on data to obtain predictions. The code also allows users to compute spatio-temporal feature importance on the echo state network, as described in “Characterizing Climate Pathways Using Feature Importance on Echo State Networks.” The package also provides a function for computing principal components.

Ries, Daniel↗
DOE OSTI2020

Observational Study of the Thermodynamics and Morphological Characteristics of a Midlatitude Continental Cold Pool Event

Abstract Convectively generated cold pools are important to the Earth system as they exert strong controls on deep convective-storm initiation, intensity, and life cycle. Despite their importance, efforts to introduce such cold pool controls into weather and climate models lack guidance and/or physical constraints from cold pool observations. This work presents a detailed, purely observational analysis of a cold pool event that took place on 23–24 May 2011 in north-central Oklahoma. The characteristics of the cold pool, and the spatiotemporal evolution of the hydrometeors and dynamics in the proximity of the cold pool, are studied with high-resolution observations. The unprecedented dataset used in this work to study cold pool characteristics includes an enhanced network of surface weather stations, a high-temporal-frequency sounding array, and the NEXRAD and Atmospheric Radiation Measurement (ARM) Southern Great Plains radar networks. The potential use of NEXRAD surveillance scans to estimate height and propagation speed of the leading edge of the cold pool (LECP) is presented in this work. Manual identification and tracking of the LECP from NEXRAD imagery shows a spatial and temporal heterogeneity of the LECP properties. Surprisingly, over its detected life cycle, the LECP speed remains almost constant, even though the strength of the cold pool diminishes in time and its height varies. Radar analysis shows that pulses of graupel and hail within downdrafts in the convective system generating the cold pool appeared to be related to temporary increases in the LECP height.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

A Deep Learning Approach for TNC Trip Demand Prediction Considering Spatial-Temporal Features: Preprint

Ride-hailing or transportation network companies (TNCs), such as Uber, Lyft, DiDi Chuxing, or RideAustin, are emerging as a new and disruptive on-demand mobility service in recent years. However, the methods for developing predictive analytics to explore the nature and dynamics of TNCs across cities in the United States are still nascent due to the lack of publicly available data. Recently available public datasets on TNCs by RideAustin offer a unique opportunity to examine spatial, temporal, environmental, and special event factors associated with TNC trip demand. This study explores the use of a deep learning approach - Long Short-Term Memory (LSTM) - to predict TNC trip demand at the ZIP Code level using data from Austin, Texas. The analysis includes key predictive factors such as time of day, day of week, precipitation, and temperature, indicating their corresponding associations with TNC trip demand. Results from initial analysis show that LSTM is able to predict the TNC trip demand for the upcoming hour accurately. LSTM, when compared to other prediction methods, such as historical average and instantaneous trip demand, reduces the mean absolute error (MAE) of the model predictions by 37% and 24%, respectively. This novel method offers significant potential for scaling up and/or replicability across cities where data are available for understanding TNC trip demand to inform emerging mobility system operators. Predicting trip demand can help TNC drivers make informed decisions on how to be more efficient by maximizing passenger pickups and minimizing wait times and deadheading.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2019

Spatial and temporal variation in river corridor exchange across a 5th-order mountain stream network

Although most field and modeling studies of river corridor exchange have been conducted at scales ranging from tens to hundreds of meters, results of these studies are used to predict their ecological and hydrological influences at the scale of river networks. Further complicating prediction, exchanges are expected to vary with hydrologic forcing and the local geomorphic setting. While we desire predictive power, we lack a complete spatiotemporal relationship relating discharge to the variation in geologic setting and hydrologic forcing that is expected across a river basin. Indeed, the conceptual model of Wondzell (2011) predicts systematic variation in river corridor exchange as a function of (1) variation in baseflow over time at a fixed location, (2) variation in discharge with location in the river network, and (3) local geomorphic setting. To test this conceptual model we conducted more than 60 solute tracer studies including a synoptic campaign in the 5th-order river network of the H. J. Andrews Experimental Forest (Oregon, USA) and replicate-in-time experiments in four watersheds. We interpret the data using a series of metrics describing river corridor exchange and solute transport, testing for consistent direction and magnitude of relationships relating these metrics to discharge and local geomorphic setting. We confirmed systematic decrease in river corridor exchange space through the river networks, from headwaters to the larger main stem. However, we did not find systematic variation with changes in discharge through time or with local geomorphic setting. While interpretation of our results is complicated by problems with the analytical methods, the results are sufficiently robust for us to conclude that space-for-time and time-for-space substitutions are not appropriate in our study system. Finally, we suggest two strategies that will improve the interpretability of tracer test results and help the hyporheic community develop robust datasets that will enable comparisons across multiple sites and/or discharge conditions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

A Moist Physics Parameterization Based on Deep Learning

Abstract Current moist physics parameterization schemes in general circulation models (GCMs) are the main source of biases in simulated precipitation and atmospheric circulation. Recent advances in machine learning make it possible to explore data‐driven approaches to developing parameterization for moist physics processes such as convection and clouds. This study aims to develop a new moist physics parameterization scheme based on deep learning. We use a residual convolutional neural network (ResNet) for this purpose. It is trained with 1‐year simulation from a superparameterized GCM, SPCAM. An independent year of SPCAM simulation is used for evaluation. In the design of the neural network, referred to as ResCu, the moist static energy conservation during moist processes is considered. In addition, the past history of the atmospheric states, convection, and clouds is also considered. The predicted variables from the neural network are GCM grid‐scale heating and drying rates by convection and clouds, and cloud liquid and ice water contents. Precipitation is derived from predicted moisture tendency. In the independent data test, ResCu can accurately reproduce the SPCAM simulation in both time mean and temporal variance. Comparison with other neural networks demonstrates the superior performance of ResNet architecture. ResCu is further tested in a single‐column model for both continental midlatitude warm season convection and tropical monsoonal convection. In both cases, it simulates the timing and intensity of convective events well. In the prognostic test of tropical convection case, the simulated temperature and moisture biases with ResCu are smaller than those using conventional convection and cloud parameterizations.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

Runtime Monitoring with R2U2 for Aircraft Systems with Neural Networks

R2U2 (Realizable, Responsive, Unobtrusive Unit) is a hardware-supported tool and framework for real-time system monitoring and software health management of cyber-physical systems. During system operation, R2U2 continuously monitors properties about safety, performance, and security of the vehicle and its vital components and can perform diagnostic reasoning. Efficient observers for past-time and future-time Metric Temporal Logic, fast reasoners for Bayesian Networks, and model-based prognostics algorithms are key components of R2U2 and designed for minimal computational footprint. R2U2 has been implemented in software supporting ROS, NASA's cFS/cFE, and Simulink and as an FPGA configuration. The synergistic combination of monitors and observers in R2U2 makes it possible to design powerful models for system runtime monitoring, diagnostics, software health management, prognostics, and security monitoring. In this presentation, I will give a detailed overview of the R2U2 architecture and its features and will discuss the application of R2U2 for safety-monitoring of a neural-network based autonomous centerline tracking system (ACT) for autonomous aircraft.

Runtime Monitoring↗
DOE OSTI2025

Multi-Omics Reveals Temporal Scales of Carbon Metabolism in Synechococcus Elongatus PCC 7942 Under Light Disturbance

Central carbon metabolism in model cyanobacteria involves multiple pathways to adapt to energy-light limitations across diel cycles. However, the success in mechanistic modeling for phenotypic prediction of the protein regulators in the metabolic state depends on capturing the vast possibilities emerging from multiple regulatory pathways in complex biological processes. Here, we developed a physics-informed machine learning approach based on energy-landscape concepts to predict regulatory proteins responding to cyclic circadian and unforeseen light perturbations in cyanobacterial metabolic networks. Our approach provides interpretable de novo models for inferring gene expression dynamics from Synechococcus elongatus over diel cycles and using redox proteome analysis to distinguish immediate light-responsive elements from circadian-regulated processes in carbon metabolism pathways. We identified distinct temporal signatures with the analysis of the redox proteome: there was an immediate shift in cysteine redox states accompanied by a limited change in protein abundance under constant illumination and after 2 hours of darkness. This discovery indicates that the generation of reductants coordinates photoinduced electron transport with redox metabolic pathways in two discernable molecular mechanisms: fast redox-based protein modifications occur immediately after the light disturbance, followed by slow transcriptional regulations across networks. This temporal regulation reveals how metabolic networks integrate rapid light responses with programmed circadian rhythms to maintain cellular homeostasis under the light-energy limitations over the diel cycle.

Biomolecular & subcellular processes↗
DOE OSTI2024

Uncertainty quantification of graph convolution neural network models of evolving processes

The application of neural network models to scientific machine learning tasks has proliferated in recent years. In particular, neural networks have proved to be adept at modeling processes with spatial–temporal complexity. Nevertheless, these highly parameterized models have garnered skepticism in their ability to produce outputs with quantified error bounds over the regimes of interest. Hence there is a need to find uncertainty quantification methods that are suitable for neural networks. In this work we present comparisons of the parametric uncertainty quantification of neural networks modeling complex spatial–temporal processes with Hamiltonian Monte Carlo and Stein variational gradient descent and its projected variant. Specifically we apply these methods to graph convolutional neural network models of evolving systems modeled with recurrent neural network and neural ordinary differential equations architectures. We show that Stein variational inference is a viable alternative to Monte Carlo methods with some clear advantages for complex neural network models. For our exemplars, Stein variational interference gave similar pushed forward uncertainty profiles through time compared to Hamiltonian Monte Carlo, albeit with generally more generous variance. As a result, projected Stein variational gradient descent also produced similar uncertainty profiles to the non-projected counterpart, but large reductions in the active weight space were confounded by the stability of the neural network predictions and the convoluted likelihood landscape.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Structure-Informed Graph Learning of Networked Dependencies for Online Prediction of Power System Transient Dynamics

Online transient analysis plays an increasingly important role in dynamic power grids as the renewable generation continues growing. Traditional numerical methods for transient analysis not only are computationally intensive but also require precise contingency information as input, and therefore, are not suitable for online applications. Existing online transient assessment studies focus on the determination of post-contingency system stability or stability margin. Here, this paper develops a novel graph-learning framework, Deep-learning Neural Representation or DNR, for online prediction, of the time-series trajectories of the system states using initial system responses that can be measured by phasor measurement units (PMUs). The proposed DNR framework consists of two sequential modules: a Network Constructor that captures network dependencies among generators, and a Dynamics Predictor that predicts the system trajectories. The key to improved prediction performance is the introduction of the spatio-temporal message-passing operations into graph neural networks with structural knowledge. Its effectiveness and scalability are validated through comparative studies, demonstrating the prediction performance under different contingency scenarios for systems of different sizes. This framework provides a solution to online predicting post-fault system dynamics based on real-time PMU measurements. Additionally, it can also be applied to facilitate the offline transient simulation without simulating the entire trajectories.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2018

Modular Spiking Neural Circuits for Mapping Long Short-Term Memory on a Neurosynaptic Processor

Due to the distributed and asynchronous nature of neural computation through low-energy spikes, brain-inspired hardware systems offer high energy efficiency and massive parallelism. One such platform is the IBM TrueNorth neurosynaptic system. Recently, TrueNorth compatible representation learning algorithms have emerged, achieving close to the state-of-the-art performance in various data sets. However, its application in temporal sequence processing models, such as recurrent neural networks (RNNs), is still only at the proof of concept level. There is an inherent difficulty in capturing temporal dynamics of an RNN using spiking neurons, which is only exasperated by the hardware constraints in connectivity and synaptic weight resolution. This paper presents a design flow that overcomes these difficulties and maps a special case of recurrent networks called long short-term memory (LSTM) onto a spike-based platform. The framework utilizes various approximation techniques, such as activation discretization, weight quantization, and scaling and rounding, spiking neural circuits that implement the complex gating mechanisms, and a store-and-release technique to enable neuron synchronization and faithful storage. While the presented techniques can be applied to map LSTM to any spiking neural network (SNN) simulator/emulator, here we choose the TrueNorth chip as the target platform by adhering to its hardware constraints. Three LSTM applications, parity check, extended Reber grammar, and question classification, are evaluated. The tradeoffs among accuracy, performance, and energy tradeoffs achieved on TrueNorth are demonstrated. Finally, this is compared with the performance on an SNN platform without hardware constraints, which represents the upper bound of the achievable accuracy.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

Temporal Interpolation of Geostationary Satellite Imagery with Task Specific Optical Flow

Applications of satellite data in areas such as weather tracking and modeling, ecosystem monitoring, wildfire detection, and land-cover change are heavily dependent on the trade-offs to spatial, spectral and temporal resolutions of observations. In weather tracking, high-frequency temporal observations are critical and used to improve forecasts, study severe events, and extract atmospheric motion, among others. However, while the current generation of geostationary satellites have hemispheric coverage at 10-15 minute intervals, higher temporal frequency observations are ideal for studying mesoscale severe weather events. In this work, we apply a task specific optical flow approach to temporal up-sampling using deep convolutional neural networks. We apply this technique to 16-bands of GOES-R/Advanced Baseline Imager mesoscale dataset to temporally enhance full disk hemispheric snapshots of different spatial resolutions from 15 minutes to 1 minute. Experiments show the effectiveness of task specific optical flow and multi-scale blocks for interpolating high-frequency severe weather events relative to bilinear and global optical flow baselines. Lastly, we demonstrate strong performance in capturing variability during convective precipitation events.

Optical flow, temporal interpolation, geostationar↗
DOE OSTI2024

PhyML

Python scripts for physics informed machine learning for time-dependent problems. The code implements hard constrained sequential physics-informed neural networks (HCSPINNs) using JAX library. The details of the method and implementation can be found in the following paper: Roy, P., & Castonguay, S. (2024). Exact Enforcement of Temporal Continuity in Sequential Physics- Informed Neural Networks. arXiv preprint arXiv:2403.03223. (https://arxiv.org/abs/2403.03223)

Roy, Pratanu↗
DOE OSTI2023

1-D Convolutional Graph Convolutional Networks for Fault Detection in Distributed Energy Systems

This paper presents a 1-D convolutional and graph convolutional networks for fault detection in microgrids. The combination of 1-D convolutional neural networks (1D-CNN) and graph convolutional networks (GCN) helps extract both spatial-temporal correlations from the voltage measurements in microgrids. The fault detection scheme includes fault event detection, fault type and phase classification, and fault location. There are five neural network model training to handle these tasks. Transfer learning and fine-tuning are applied to reduce training efforts. The combined 1-D convolutional and graph convolutional networks (1D-CGCN) is compared with the traditional ANN structure on the Potsdam 13-bus microgrid dataset. The accuracy of 99.5%, 98.4%, 99.2%, and 95.5% are achieved in fault event detection, fault type classification, fault phase identification, and fault location respectively. The detailed confusion matrices of fault type and fault phase classification are provided for validation.

deep neural network↗
NASA NTRS1992

Fast temporal neural learning using teacher forcing

A neural network is trained to output a time dependent target vector defined over a predetermined time interval in response to a time dependent input vector defined over the same time interval by applying corresponding elements of the error vector, or difference between the target vector and the actual neuron output vector, to the inputs of corresponding output neurons of the network as corrective feedback. This feedback decreases the error and quickens the learning process, so that a much smaller number of training cycles are required to complete the learning process. A conventional gradient descent algorithm is employed to update the neural network parameters at the end of the predetermined time interval. The foregoing process is repeated in repetitive cycles until the actual output vector corresponds to the target vector. In the preferred embodiment, as the overall error of the neural network output decreasing during successive training cycles, the portion of the error fed back to the output neurons is decreased accordingly, allowing the network to learn with greater freedom from teacher forcing as the network parameters converge to their optimum values. The invention may also be used to train a neural network with stationary training and target vectors.

Toomarian, Nikzad↗
NASA NTRS1995

Fast temporal neural learning using teacher forcing

A neural network is trained to output a time dependent target vector defined over a predetermined time interval in response to a time dependent input vector defined over the same time interval by applying corresponding elements of the error vector, or difference between the target vector and the actual neuron output vector, to the inputs of corresponding output neurons of the network as corrective feedback. This feedback decreases the error and quickens the learning process, so that a much smaller number of training cycles are required to complete the learning process. A conventional gradient descent algorithm is employed to update the neural network parameters at the end of the predetermined time interval. The foregoing process is repeated in repetitive cycles until the actual output vector corresponds to the target vector. In the preferred embodiment, as the overall error of the neural network output decreasing during successive training cycles, the portion of the error fed back to the output neurons is decreased accordingly, allowing the network to learn with greater freedom from teacher forcing as the network parameters converge to their optimum values. The invention may also be used to train a neural network with stationary training and target vectors.

Toomarian, Nikzad↗
DOE OSTI2018

Applying Temporal Data Mining (TDM) on the Baseline Data Acquired by the In-Situ Decommissioning (ISD) Sensor Network Test Bed - 18093

Researchers at Savannah River National Laboratory (SRNL) have established an In-Situ Decommissioning (ISD) Sensor Network Test Bed-a unique, small scale, configurable environment - for the assessment of prospective sensors on actual ISD system material at minimal cost. The data collected by the ISD sensors are ideal for applying temporal data mining (TDM) technique since they are time-specific, age-specific, and developmental stage-specific. In this research, TDM algorithms were applied on the baseline data collected by ISD test bed in the recent few years to seek frequency episodes in event stream. The tentative results prove that TDM techniques are effective tools for validating ISD performance. Frequent episodes in the data stream have confirmed the daily cycle of the sensor responses and establish sequences of different types of sensors, which was verified by the experimental setup of ISD Sensor Network Test Bed. The abnormal episodes in the data stream may lead to the early indicators of ISD system failures. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗