Search NASA⌕ Search

SEARCH · Search NASA

Results for “temporal network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

TANTE: Time-adaptive operator learning via neural Taylor expansion

Operator learning for time-dependent partial differential equations (PDEs) has seen rapid progress in recent years, enabling efficient approximation of complex spatiotemporal dynamics. However, most existing methods rely on fixed time step sizes during rollout, which limits their ability to adapt to varying temporal complexity and often leads to error accumulation. In this work, we propose the Time-Adaptive Transformer with Neural Taylor Expansion (TANTE), a novel operator-learning framework that produces continuous-time predictions with adaptive step sizes. TANTE predicts future states by performing a Taylor expansion at the current state, where neural networks learn both the higher-order temporal derivatives and the local radius of convergence. This allows the model to dynamically adjust its rollout based on the local behavior of the solution, thereby reducing cumulative error and improving computational efficiency. We demonstrate the effectiveness of TANTE across a wide range of PDE benchmarks, achieving superior accuracy and adaptability compared to fixed-step baselines, delivering accuracy gains of 60-80 % and speed-ups of 30-40 % at inference time.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

STFM: Accurate Spatio-Temporal Fusion Model for Weather Forecasting

Meteorological prediction is crucial for various sectors, including agriculture, navigation, daily life, disaster prevention, and scientific research. However, traditional numerical weather prediction (NWP) models are constrained by their high computational resource requirements, while the accuracy of deep learning models remains suboptimal. In response to these challenges, we propose a novel deep learning-based model, the Spatiotemporal Fusion Model (STFM), designed to enhance the accuracy of meteorological predictions. Our model leverages Fifth-Generation ECMWF Reanalysis (ERA5) data and introduces two key components: a spatiotemporal encoder module and a spatiotemporal fusion module. The spatiotemporal encoder integrates the strengths of convolutional neural networks (CNNs) and recurrent neural networks (RNNs), effectively capturing both spatial and temporal dependencies. Meanwhile, the spatiotemporal fusion module employs a dual attention mechanism, decomposing spatial attention into global static attention and channel dynamic attention. This approach ensures comprehensive extraction of spatial features from meteorological data. The combination of these modules significantly improves prediction performance. Experimental results demonstrate that STFM excels in extracting spatiotemporal features from reanalysis data, yielding predictions that closely align with observed values. In comparative studies, STFM outperformed other models, achieving a 7% improvement in ground and high-altitude temperature predictions, a 5% enhancement in the prediction of the u/v components of 10 m wind speed, and an increase in the accuracy of potential height and relative humidity predictions by 3% and 1%, respectively. This enhanced performance highlights STFM’s potential to advance the accuracy and reliability of meteorological forecasting.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1992

Inter- and intra-plate deformation at North American plate boundaries

A geodetic network which spans the region between San Francisco and Lake Tahoe has been measured 5 times completely with triangulation in 1880, 1922, 1929, 1943, 1963. A resurvey with the Global Positioning System (GPS) in 1991 allows the formation of 1 coseismic and 4 interseismic epochs. The data from this network provide a unique opportunity to examine the temporal and spatial evolution of the strain field associated with the 1906 San Francisco earthquake in particular and with the Pacific-North American plate boundary in general. Calculations of strain rate from the network data lead to the following conclusions. (1) There is no resolvable (greater than 0.05 microradians/yr) strain in between Sutter Buttes and the Sierra Nevada. (2) Throughout the time since the 1906 earthquake, a region extending at least as far east as the westernmost Great Valley has been undergoing deformation related to Pac:Nam interaction and the associated earthquake cycle. (3) In the time and space of overlap, our results agree with those from the United States Geological Survey (USGS) trilateration data. Both data sets indicate that strain must be accumulating to the east of Vaca. (4) The San Andreas discrepancy cannot be accommodated in the Great Valley at the 1 sigma level of our results. It is possible to absorb it in that region at the 2 sigma level. (5) Strain rate is elevated in the years following the earthquake and decays slowly with time. It is possible that the rate in the Coast Ranges increases until around 1950 and then decays. With the exception of one epoch, strain rate in the Coast Ranges is consistently fault parallel, shows no sign changes, and is consistent with monotonic strain accumulation.

Beavan, John↗
NASA NTRS2017

UAV Trajectory Modeling Using Neural Networks

Massive small unmanned aerial vehicles are envisioned to operate in the near future. While there are lots of research problems need to be addressed before dense operations can happen, trajectory modeling remains as one of the keys to understand and develop policies, regulations, and requirements for safe and efficient unmanned aerial vehicle operations. The fidelity requirement of a small unmanned vehicle trajectory model is high because these vehicles are sensitive to winds due to their small size and low operational altitude. Both vehicle control systems and dynamic models are needed for trajectory modeling, which makes the modeling a great challenge, especially considering the fact that manufactures are not willing to share their control systems. This work proposed to use a neural network approach for modelling small unmanned vehicle's trajectory without knowing its control system and bypassing exhaustive efforts for aerodynamic parameter identification. As a proof of concept, instead of collecting data from flight tests, this work used the trajectory data generated by a mathematical vehicle model for training and testing the neural network. The results showed great promise because the trained neural network can predict 4D trajectories accurately, and prediction errors were less than 2:0 meters in both temporal and spatial dimensions.

Neural Networks↗
NASA NTRS1994

Optimizing tertiary storage organization and access for spatio-temporal datasets

We address in this paper data management techniques for efficiently retrieving requested subsets of large datasets stored on mass storage devices. This problem represents a major bottleneck that can negate the benefits of fast networks, because the time to access a subset from a large dataset stored on a mass storage system is much greater that the time to transmit that subset over a network. This paper focuses on very large spatial and temporal datasets generated by simulation programs in the area of climate modeling, but the techniques developed can be applied to other applications that deal with large multidimensional datasets. The main requirement we have addressed is the efficient access of subsets of information contained within much larger datasets, for the purpose of analysis and interactive visualization. We have developed data partitioning techniques that partition datasets into 'clusters' based on analysis of data access patterns and storage device characteristics. The goal is to minimize the number of clusters read from mass storage systems when subsets are requested. We emphasize in this paper proposed enhancements to current storage server protocols to permit control over physical placement of data on storage devices. We also discuss in some detail the aspects of the interface between the application programs and the mass storage system, as well as a workbench to help scientists to design the best reorganization of a dataset for anticipated access patterns.

Chen, Ling Tony↗
DOE OSTI2021

Neural Network Approaches for Mobile Spectroscopic Gamma-Ray Source Detection

Artificial neural networks (ANNs) for performing spectroscopic gamma-ray source identification have been previously introduced, primarily for applications in controlled laboratory settings. To understand the utility of these methods in scenarios and environments more relevant to nuclear safety and security, this work examines the use of ANNs for mobile detection, which involves highly variable gamma-ray background, low signal-to-noise ratio measurements, and low false alarm rates. Simulated data from a 2” × 4” × 16” NaI(Tl) detector are used in this work for demonstrating these concepts, and the minimum detectable activity (MDA) is used as a performance metric in assessing model performance.In addition to examining simultaneous detection and identification, binary spectral anomaly detection using autoencoders is introduced in this work, and benchmarked using detection methods based on Non-negative Matrix Factorization (NMF) and Principal Component Analysis (PCA). On average, the autoencoder provides a 12% and 23% improvement over NMF- and PCA-based detection methods, respectively. Additionally, source identification using ANNs is extended to leverage temporal dynamics by means of recurrent neural networks, and these time-dependent models outperform their time-independent counterparts by 17% for the analysis examined here. The paper concludes with a discussion on tradeoffs between the ANN-based approaches and the benchmark methods examined here.

Bilton, Kyle J. (ORCID:0000000184553689)↗
DOE OSTI2025

Examining Daily Temporal Characteristics of Oil and Gas Methane Emissions in the Delaware Basin Using Continuous Tower Observations

Top-down studies have found consistent underestimations in the United States Environmental Protection Agency (EPA) methane emissions inventory from the oil and gas (O&G) sector. Many of these studies use observations that bias toward hours when worktime activity occurs. In this study, we analyze over 2 years of methane measurements from a tower network in the Delaware basin to analyze hourly temporal emission patterns. Inversion results suggest a range in emissions from 137 Mg/hr at night to 197 Mg/hr during the day, present during both weekdays and weekends. If these results are applicable to other basins, daytime-influenced methodologies may overestimate daily emission rates by up to 27%. This bias does not reconcile the more than 200% difference between the EPA inventory and top-down estimates in the Delaware basin. This study demonstrates how continuous measurement networks can be combined with detailed activity data to improve bottom-up inventories.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1993

Image and Video Compression with VLSI Neural Networks

An advanced motion-compensated predictive video compression system based on artificial neural networks has been developed to effectively eliminate the temporal and spatial redundancy of video image sequences and thus reduce the bandwidth and storage required for the transmission and recording of the video signal. The VLSI neuroprocessor for high-speed high-ratio image compression based upon a self-organization network and the conventional algorithm for vector quantization are compared. The proposed method is quite efficient and can achieve near-optimal results.

compression artificial neural networks VLSI↗
NASA NTRS2021

A Robust Hybrid Deep Learning Model for Spatiotemporal Image Fusion

Dense time-series remote sensing data with detailed spatial information are highly desired for the monitoring of dynamic earth systems. Due to the sensor tradeoff, most remote sensing systems cannot provide images with both high spatial and temporal resolutions. Spatiotemporal image fusion models provide a feasible solution to generate such a type of satellite imagery, yet existing fusion methods are limited in predicting rapid and/or transient phenological changes. Additionally, a systematic approach to assessing and understanding how varying levels of temporal phenological changes affect fusion results is lacking in spatiotemporal fusion research. The objective of this study is to develop an innovative hybrid deep learning model that can effectively and robustly fuse the satellite imagery of various spatial and temporal resolutions. The proposed model integrates two types of network models: super-resolution convolutional neural network (SRCNN) and long short-term memory (LSTM). SRCNN can enhance the coarse images by restoring degraded spatial details, while LSTM can learn and extract the temporal changing patterns from the time-series images. To systematically assess the effects of varying levels of phenological changes, we identify image phenological transition dates and design three temporal phenological change scenarios representing rapid, moderate, and minimal phenological changes. The hybrid deep learning model, alongside three benchmark fusion models, is assessed in different scenarios of phenological changes. Results indicate the hybrid deep learning model yields significantly better results when rapid or moderate phenological changes are present. It holds great potential in generating high-quality time-series datasets of both high spatial and temporal resolutions, which can further benefit terrestrial system dynamic studies. The innovative approach to understanding phenological changes’ effect will help us better comprehend the strengths and weaknesses of current and future fusion models.

spatiotemporal fusion↗
DOE OSTI2025

Backpropagation-based learning with local derivative approximation and memory replay in biologically plausible neural systems

When learning, the brain modifies individual synaptic connections to reach a desired behavior. Animal and human brains have been shown to be incredibly capable of learning complex and varied functions across a wide variety of tasks. In recent years, artificial neural networks, inspired by human and animal brains, have shown great capabilities in learning a wide variety of difficult tasks. However, artificial neural networks primarily teach themselves through the use of backpropagation, a learning method which has no clear analogue within the brain. Additionally, Artificial Neural Networks primarily use continuous activation functions, which differ significantly from the spiking neuronal behavior present in the brain. In this paper, we discuss and demonstrate a biologically plausible learning method that approximates backpropagation through two techniques on Spiking Neural Networks. First, we show that the local temporal derivatives that are necessary for backpropagation can be approximately recovered through reconstruction using spike timings. Second, we show that through learning during a sleep phase, inspired by neuroscience research into memory replay, the localized parallel feedback path can learn to approximate the derivative through the forward path weight matrix, thus solving the weight transport problem. Lastly, we demonstrate that the combination of these two methods can approach or exceed the accuracy of backpropagation-based methods for a variety of neuromorphic vision tasks while maintaining biological plausibility.

42 ENGINEERING↗
DOE OSTI2018

Temporal Dynamics of Aerodynamic Canopy Height Derived From Eddy Covariance Momentum Flux Data Across North American Flux Networks

Aerodynamic canopy height ( h a ) is the effective height of vegetation canopy for its influence on atmospheric fluxes and is a key parameter of surface-atmosphere coupling. However, methods to estimate h a from data are limited. This synthesis evaluates the applicability and robustness of the calculation of h a from eddy covariance momentum-flux data. At 69 forest sites, annual h a robustly predicted site-to-site and year-to-year differences in canopy heights ( R 2 = 0.88, 111 site-years). At 23 cropland/grassland sites, weekly h a successfully captured the dynamics of vegetation canopies over growing seasons ( R 2 > 0.70 in 74 site-years). Our results demonstrate the potential of flux-derived h a determination for tracking the seasonal, interannual, and/or decadal dynamics of vegetation canopies including growth, harvest, land use change, and disturbance. The large-scale and time-varying h a derived from flux networks worldwide provides a new benchmark for regional and global Earth system models and satellite remote sensing of canopy structure.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2020

Exploring Carbon Mineral Systems: Recent Advances in C Mineral Evolution, Mineral Ecology, and Network Analysis

Large and growing data resources on the spatial and temporal diversity and distribution of the more than 400 carbon-bearing mineral species reveal patterns of mineral evolution and ecology. Recent advances in analytical and visualization techniques leverage these data and are propelling mineralogy from a largely descriptive field into one of prediction within complex, integrated, multidimensional systems. These discoveries include: (1) systematic changes in the character of carbon minerals and their networks of coexisting species through deep time; (2) improved statistical predictions of the number and types of carbon minerals that occur on Earth but are yet to be discovered and described; and (3) a range of proposed and ongoing studies related to the quantification of network structures and trends, relation of mineral “natural kinds” to their genetic environments, prediction of the location of mineral species across the globe, examination of the tectonic drivers of mineralization through deep time, quantification of preservational and sampling bias in the mineralogical record, and characterization of feedback relationships between minerals and geochemical environments with microbial populations. These aspects of Earth’s carbon mineralogy underscore the complex coevolution of the geosphere and biosphere and highlight the possibility for scientific discovery in Earth and planetary systems.

Carbon↗
DOE OSTI2022

An interpretable machine learning model for advancing terrestrial ecosystem predictions

We apply an interpretable Long Short-Term Memory (iLSTM) network for land-atmosphere carbon flux predictions based on time series observations of seven environmental variables. iLSTM enables interpretability of variable importance and variable-wise temporal importance to the prediction of targets by exploring internal network structures. The application results indicate that iLSTM not only improves prediction performance by capturing different dynamics of individual variables, but also reasonably interprets the different contribution of each variable to the target and its different temporal relevance to the target. This variable and temporal importance interpretation of iLSTM advances terrestrial ecosystem model development as well as our predictive understanding of the system.

Lu, Dan↗
NASA NTRS1998

Emulating the visual receptive-field properties of MST neurons with a template model of heading estimation

We have proposed previously a computational neural-network model by which the complex patterns of retinal image motion generated during locomotion (optic flow) can be processed by specialized detectors acting as templates for specific instances of self-motion. The detectors in this template model respond to global optic flow by sampling image motion over a large portion of the visual field through networks of local motion sensors with properties similar to those of neurons found in the middle temporal (MT) area of primate extrastriate visual cortex. These detectors, arranged within cortical-like maps, were designed to extract self-translation (heading) and self-rotation, as well as the scene layout (relative distances) ahead of a moving observer. We then postulated that heading from optic flow is directly encoded by individual neurons acting as heading detectors within the medial superior temporal (MST) area. Others have questioned whether individual MST neurons can perform this function because some of their receptive-field properties seem inconsistent with this role. To resolve this issue, we systematically compared MST responses with those of detectors from two different configurations of the model under matched stimulus conditions. We found that the characteristic physiological properties of MST neurons can be explained by the template model. We conclude that MST neurons are well suited to support self-motion estimation via a direct encoding of heading and that the template model provides an explicit set of testable hypotheses that can guide future exploration of MST and adjacent areas within the superior temporal sulcus.

NASA Discipline Neuroscience↗
DOE OSTI2011

Transient dynamics around unstable periodic orbits in the generalized repressilator model

We study the temporal dynamics of the generalized repressilator, a network of coupled repressing genes arranged in a directed ring topology, and give analytical conditions for the emergence of a finite sequence of unstable periodic orbits that lead to reachable long-lived oscillating transients. Such transients dominate the finite time horizon dynamics that is relevant in confined, noisy environments such as bacterial cells (see our previous work [Strelkowa and Barahona, J. R. Soc. Interface 7, 1071 (2010)]), and are therefore of interest for bioengineering and synthetic biology. We show that the family of unstable orbits possesses spatial symmetries and can also be understood in terms of traveling wave solutions of kink-like topological defects. The long-lived oscillatory transients correspond to the propagation of quasistable two-kink configurations that unravel over a long time. We also assess the similarities between the generalized repressilator model and other unidirectionally coupled electronic systems, such as magnetic flux gates, which have been implemented experimentally.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2014

Scaling Irregular Applications through Data Aggregation and Software Multithreading

Bioinformatics, data analytics, semantic databases, knowledge discovery are emerging high performance application areas that exploit dynamic, linked data structures such as graphs, unbalanced trees or unstructured grids. These data structures usually are very large, requiring significantly more memory than available on single shared memory systems. Additionally, these data structures are difficult to partition on distributed memory systems. They also present poor spatial and temporal locality, thus generating unpredictable memory and network accesses. The Partitioned Global Address Space (PGAS) programming model seems suitable for these applications, because it allows using a shared memory abstraction across distributed-memory clusters. However, current PGAS languages and libraries are built to target regular remote data accesses and block transfers. Furthermore, they usually rely on the Single Program Multiple Data (SPMD) parallel control model, which is not well suited to the fine grained, dynamic and unbalanced parallelism of irregular applications. In this paper we present {\bf GMT} (Global Memory and Threading library), a custom runtime library that enables efficient execution of irregular applications on commodity clusters. GMT integrates a PGAS data substrate with simple fork/join parallelism and provides automatic load balancing on a per node basis. It implements multi-level aggregation and lightweight multithreading to maximize memory and network bandwidth with fine-grained data accesses and tolerate long data access latencies. A key innovation in the GMT runtime is its thread specialization (workers, helpers and communication threads) that realize the overall functionality. We compare our approach with other PGAS models, such as UPC running using GASNet, and hand-optimized MPI code on a set of typical large-scale irregular applications, demonstrating speedups of an order of magnitude.

Aggregation↗
DOE OSTI2022

Information Content of a Synergy of Ground-Based and Space-Based Infrared Sounders. Part I: Clear-Sky Environments

Abstract Profiles of atmospheric temperature and water vapor from remotely sensed platforms provide critical observations within the temporal and spatial gaps of the radiosonde network. The 2017 National Academies of Science Decadal Survey highlighted that observations of the planetary boundary layer (PBL) from the current space-based observing system are not of the necessary accuracy or resolution for monitoring and predicting high-impact weather phenomena. One possible solution to improving observations of the PBL is supplementing the existing space-based observing system with a network of ground-based profilers. A synthetic information content study is developed utilizing profiles from the Atmospheric Radiation Measurement (ARM) program sites at the Southern Great Plains (SGP), east North Atlantic (ENA), and North Slope of Alaska (NSA) to assess the benefits, in terms of degrees of freedom (DOF), vertical resolution, and uncertainties, of a synergy between the ground-based Atmospheric Emitted Radiance Interferometer (AERI) with space-based hyperspectral infrared (IR) sounders. A combination of AERI with any of the three polar-orbiting IR sounders: the Atmospheric Infrared Sounder (AIRS), the Cross-track Infrared Sounder (CrIS), or the Infrared Atmospheric Sounding Interferometer (IASI), results in a DOF increase of 30%–40% in the surface-to-700-hPa layer compared to the space-based instrument alone. Introducing AERI measurements to the observing system also results in significant improvements to vertical resolution and uncertainties in the bottom 1000 m of the atmosphere compared to CrIS measurements alone. A synergy of CrIS and AERI exceeds the 1-km-vertical-resolution goal set by the Decadal Survey in the lowest 1000 m.

54 ENVIRONMENTAL SCIENCES↗