Evaluating a spatiotemporal shape-matching model for the generation of synthetic high spatiotemporal resolution time series of multiple satellite data
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
1. The ability of the vestibuloocular reflex (VOR) to undergo adaptive modification after selective changes in the peripheral vestibular system was investigated in rhesus monkeys by recording three-dimensional eye movements before and after inactivation of selective semicircular canals. In the preceding paper we showed that the horizontal VOR gain evoked by passive yaw oscillations after lateral semicircular canal inactivation recovers gradually over time in a frequency-specific manner. Here we present the spatial tuning of the adapted slow-phase eye velocity and describe its spatiotemporal properties as a function of time after canal inactivation. 2. The spatial organization of the VOR was investigated during oscillations at different head positions in the pitch, roll, and yaw planes, as well as in the right anterior/left posterior and left anterior/right posterior canal planes. Acutely after bilateral inactivation of the lateral semicircular canals, a small horizontal response could still be elicited that peaked during rotations in pitched head positions that would maximally stimulate vertical semicircular canals. In addition, the phase of horizontal slow-phase velocity abruptly reversed through 180 degrees at positions close to upright, similarly to torsional slow-phase velocity. These spatial response properties suggest that the small, residual horizontal response components that are present acutely after plugging of both lateral canals originate from vertical semicircular canal signals. 3. As the horizontal response amplitude increased over time, consistent changes were also observed in the spatiotemporal tuning of horizontal slow-phase velocity. 1) The spatiotemporal response properties of horizontal slow-phase velocity acquired noncosine tuning characteristics, primarily in the pitch plane, in the right anterior/left posterior and left anterior/right posterior canal planes. Accordingly, horizontal response amplitude was nonzero during rotation in any head position in these planes and response phase varied significantly as a function of head orientation. 2) The peak horizontal response amplitude shifted spatially over time, such that 5-10 mo after plugging it was maximal during rotations at head positions close to upright. 4. In parallel to these unique spatiotemporal response properties characterizing the adapted horizontal VOR, torsional slow-phase velocity also exhibited small spatiotemporal changes after lateral canal inactivation that tended to precede in time the changes associated with the horizontal response components. In contrast, vertical slow-phase velocity in the plugged animals was unaltered and continued to be characterized by cosine-tuned spatial properties in three dimensions. 5. Recovery of the horizontal response gain during yaw oscillations in upright position, as well as the unique, noncosine spatiotemporal characteristics of the adapted horizontal VOR, were also observed in an animal with all but one vertical semicircular canals inactivated. There was, however, no sign of VOR gain recovery up to 2 mo after all semicircular canals were inactivated. These results suggest that the observed recovery of horizontal VOR is at least partly due to signals originating from the remaining intact vertical canal(s). Even in the presence of a single intact vertical canal, the improvement in horizontal gaze stability is at least partly restored through spatiotemporal changes in the processing of vestibuloocular signals that improve the gain and spatial tuning of horizontal VOR at the expense of temporal response properties.
Abstract Implementations of neurons, delays, and synapse circuits are presented with simulations. These neural elements are used to create two small spiking neural networks, the Rate-Window and Order-Biased clusters, which are capable of detecting simple two-spike spatiotemporal patterns. A simple pattern detecting network (SPDN) is created by combining the Rate-Window and Order-Biased clusters, where clusters are small spiking neural networks, and its simple pattern detection ability is demonstrated in simulation. The SPDN is used to implement a complex pattern detecting network (CPDN) and its complex pattern detection ability is demonstrated in simulation. Methods for generating arbitrary spatiotemporal patterns are presented. The CPDN and spatiotemporal pattern generation methods are then used to implement a novel spatiotemporal computing paradigm based on detecting and responding to spatiotemporal symbols. A simulation of a spatiotemporal half adder is presented to demonstrate the computing paradigm.
We present a novel flexible bi-level spatiotemporal clustering algorithm to extract events based on their intensity and spatiotemporal structures. Our algorithm consists of using (i) a novel space-time k-means clustering to obtain spatiotemporally coherent intensity clusters, and (ii) a density-based spatial clustering of applications with noise (DBSCAN) to spatiotemporally section the intensity clusters into individual events. We discuss the development of the algorithm, the selection, tuning and meaning of the parameters within each step, as well as its validation. Finally, we apply the algorithm to a spatiotemporal drought index, standardized vapor pressure deficit drought index (SVDI), over the continental United States (US) from 1980–2021 and show that it captures historical drought events over the continental United States and their spatiotemporal extents.
Widespread bioenergy cropping can transform landscapes, strongly affecting biodiversity. However, the impact of bioenergy cropping on the spatiotemporal scaling of soil biodiversity remains virtually unknown, despite its profound implications for the functioning of the ecological community. Here, we investigated how bioenergy cropping influenced the spatiotemporal scaling of soil bacterial biodiversity in marginal soils (sandy loam and clay loam soils) in Oklahoma, USA. We detected strong, significant species-time-area relationships (STARs) and phylogenetic-time-area relationships (PTARs) in bacterial communities and their lineages, suggesting that STARs and PTARs exist in microbial ecology within the studied system. Also, spatiotemporal scaling rates (the slopes of STAR and PTAR models) varied substantially among bacterial lineages and were positively correlated with their 16S rRNA gene copy numbers, a genomic trait indicative of microbial growth potentials. Strikingly, bioenergy cropping significantly reduced spatiotemporal scaling rates by 6.8%-14.1%, with a more pronounced reduction observed in sandy loam soils, where those rates were significantly lower than in clay loam soils. The heterogeneity of soil phosphorus and carbon resulted in variations in bacterial spatiotemporal scaling rates. Collectively, our findings suggest that bioenergy cropping may alleviate rapid shifts in soil biodiversity across space and time, thereby stabilizing soil biodiversity and supporting its role as part of sustainable land management and climate mitigation strategies.
Climate observations and model simulations are producing vast amounts of array-based spatiotemporal data. Efficient processing of these data is essential for assessing global challenges such as climate change, natural disasters, and diseases. This is challenging not only because of the large data volume, but also because of the intrinsic high-dimensional nature of geoscience data. To tackle this challenge, we propose a spatiotemporal indexing approach to efficiently manage and process big climate data with MapReduce in a highly scalable environment. Using this approach, big climate data are directly stored in a Hadoop Distributed File System in its original, native file format. A spatiotemporal index is built to bridge the logical array-based data model and the physical data layout, which enables fast data retrieval when performing spatiotemporal queries. Based on the index, a data-partitioning algorithm is applied to enable MapReduce to achieve high data locality, as well as balancing the workload. The proposed indexing approach is evaluated using the National Aeronautics and Space Administration (NASA) Modern-Era Retrospective Analysis for Research and Applications (MERRA) climate reanalysis dataset. The experimental results show that the index can significantly accelerate querying and processing (10 speedup compared to the baseline test using the same computing cluster), while keeping the index-to-data ratio small (0.0328). The applicability of the indexing approach is demonstrated by a climate anomaly detection deployed on a NASA Hadoop cluster. This approach is also able to support efficient processing of general array-based spatiotemporal data in various geoscience domains without special configuration on a Hadoop cluster.
Current data processing practice limits the volume and variety of relevant geoscience data that can practically be applied to important problems. File archives in centralized data centers are the principal means by which Earth Science data are accessed. This approach, however, requires laborious search, retrieval, and eventual customization/adaptation for the data to be used. Such fractionation makes it even more difficult to share outcomes, i.e. research artifacts and data products, hampering reusability and repeatability, since end users generally have their own research agenda and preferences as well as scarce resources. Thus, while finding and downloading data files from central data centers are already costly for end users working in their own field, using data products from other disciplines rapidly becomes prohibitive. This curtails scientific productivity, limits avenues of study, and endangers quality and reproducibility. The Spatio-Temporal Adaptive Resolution Encoding (STARE) is a unifying scheme that facilitates the indexing, access, and fusion of diverse Earth Science data. STARE implements an innovative encoding of geo-spatiotemporal information, originally developed for aligning datasets with diverse spatiotemporal characteristics in an array database. The spatial component of STARE recursively quadfurcates a root polyhedron, producing a hierarchical scheme for addressing geographic locations and regions. The temporal component of STARE uses conventional date-time units as an indexing hierarchy. The additional encoding of spatial and temporal resolution information in STARE enables comparisons and conditional selections across diverse datasets. Moreover, spatiotemporal set-operations, e.g. union and intersection, are mapped to efficient integer operations with STARE. Applied to existing data models (point, grid, spacecraft swath) and corresponding granules, STARE indexes provide a streamlined description usable as geo-spatiotemporal metadata. When coupled with large scale, distributed hardware and software, STARE-based data access reduces pre-analysis data preparation costs by offering a convenient means to align different datasets spatiotemporally without specialized effort in parallel computing or distributed data management.
Ensuring power grid resiliency, forecasting climate conditions, and optimization of transportation infrastructure are some of the many application areas where data is collected in both space and time. Spatiotemporal modeling is about modeling those patterns for forecasting future trends and carrying out critical decision-making by leveraging machine learning/deep learning. Once trained offline, field deployment of trained models for near real-time inference could be challenging because performance can vary significantly depending on the environment, available compute resources and tolerance to ambiguity in results. Users deploying spatiotemporal models for solving complex problems can benefit from analytical studies considering a plethora of system adaptations to understand the associated performance-quality trade-offs. To facilitate the co-design of next-generation hardware architectures for field deployment of trained models, it is critical to characterize the workloads of these deep learning (DL) applications during inference and assess their computational patterns at different levels of the execution stack. In this paper, we develop several variants of deep learning applications that use spatiotemporal data from dynamical systems. We study the associated computational patterns for inference workloads at different levels, considering relevant models (Long short-term Memory, Convolutional Neural Network and Spatio-Temporal Graph Convolution Network), DL frameworks (Tensorflow and PyTorch), precision (FP16, FP32, AMP, INT16 and INT8), inference runtime (ONNX and AI Template), post-training quantization (TensorRT) and platforms (Nvidia DGX A100 and Sambanova SN10 RDU). Overall, our findings indicate that although there is potential in mixed-precision models and post-training quantization for spatiotemporal modeling, extracting efficiency from contemporary GPU systems might be challenging. Instead, co-designing custom accelerators by leveraging optimized High Level Synthesis frameworks (such as SODA High-Level Synthesizer for customized FPGA/ASIC targets) can make workload-specific adjustments to enhance the efficiency.
Reconstructing the distribution of fine particulate matter (PM 2.5 ) in space and time, even far from ground monitoring sites, is an important exposure science contribution to epidemiologic analyses of PM 2.5 health impacts. Flexible statistical methods for prediction have demonstrated the integration of satellite observations with other predictors, yet these algorithms are susceptible to overfitting the spatiotemporal structure of the training datasets. We present a new approach for predicting PM 2.5 using machine-learning methods and evaluating prediction models for the goal of making predictions where they were not previously available. We apply extreme gradient boosting (XGBoost) modeling to predict daily PM 2.5 on a 1 x 1 km 2 resolution for a 13 state region in the Northeastern USA for the years 2000–2015 using satellite-derived aerosol optical depth and implement a recursive feature selection to develop a parsimonious model. We demonstrate excellent predictions of withheld observations but also contrast an RMSE of 3.11 μg/m 3 in our spatial cross-validation withholding nearby sites versus an overfit RMSE of 2.10 μg/m 3 using a more conventional random ten-fold splitting of the dataset. As the field of exposure science moves forward with the use of advanced machine-learning approaches for spatiotemporal modeling of air pollutants, our results show the importance of addressing data leakage in training, overfitting to spatiotemporal structure, and the impact of the predominance of ground monitoring sites in dense urban sub-networks on model evaluation. The strengths of our resultant modeling approach for exposure in epidemiologic studies of PM 2.5 include improved efficiency, parsimony, and interpretability with robust validation while still accommodating complex spatiotemporal relationships.
Accurate representation of the multiscale features in spatiotemporal physical systems using vision transformer architectures requires extremely long, computationally prohibitive token sequences. To address this issue, we propose two novel adaptive tokenization schemes that dynamically adjust patch sizes based on local features: one ensures convergent behavior to uniform patch refinement, while the other offers better computational efficiency. Moreover, we present a set of spatiotemporal attention schemes, where the temporal or axial spatial dimensions are decoupled, to evaluate their baseline computational and data efficiencies and to determine whether adaptive tokenization can improve this performance. We assess the performance of the proposed multiscale adaptive model, MATEY, in a sequence of experiments. Compared to a full spatiotemporal attention scheme or a scheme that decouples only the temporal dimension, we find that fully decoupled axial attention is less efficient and expressive, requiring more training time and model parameters to achieve the same accuracy. The experiments on the adaptive tokenization schemes show that, compared to a uniformly refined model, the proposed schemes achieve comparable or improved accuracy at a much lower cost in the tested two-dimensional settings. While the asymptotic analysis suggests the potential for favorable scaling, empirical validation at substantially longer sequence lengths remains to be performed in future work. Finally, we demonstrate in two fine-tuning tasks featuring different physics that models pretrained on PDEBench data outperform the ones trained from scratch, especially in the low data regime with frozen attention.
Industrial accidents, chemical spills, and structural fires can release large amounts of harmful materials that disperse into urban atmospheres and impact populated areas. Computer models are typically used to predict the transport of toxic plumes by solving fluid dynamical equations. However, these models can be computationally expensive due to the need for many grid cells to simulate turbulent flow and resolve individual buildings and streets. In emergency response situations, alternative methods are needed that can run quickly and adequately capture important spatiotemporal features. Here, we present a novel deep learning model called ST-GasNet inspired by the mathematical equations that govern the behavior of plumes as they disperse through the atmosphere. ST-GasNet learns the spatiotemporal dependencies from a limited set of temporal sequences of ground-level toxic urban plumes generated by a high-resolution large eddy simulation model. On independent sequences, ST-GasNet accurately predicts the late-time spatiotemporal evolution, given the early-time behavior as an input, even when a building splits a large plume into smaller plumes. By incorporating large-scale wind boundary condition information, ST-GasNet achieves a prediction accuracy of at least 90% on test data for the entire prediction period.
Crop phenology represents an integrative indicator of climate change and plays a vital role in terrestrial carbon dynamics and sustainable agricultural development. However, spatiotemporal variations of crop phenology remain unclear at large scales. This knowledge gap has hindered our ability to realistically quantify the biogeochemical dynamics in agroecosystems, predict future climate, and make informed decisions for climate change mitigation and adaptation. In this study, we improved an EVI-curve-based approach and used it to detect spatiotemporal patterns in cropping intensity and five major phenological stages over North America during 2000–2016 using vegetation index in combination with agricultural survey data and other ancillary maps. Our predicted crop phenological stages showed strong linear relationships with the survey-based datasets, with R(exp 2), RMSEs, and MAEs in the ranges of 0.35 –0.99, three to ten days, and two to eight days, respectively. During the study period, the planting dates were advanced by 0.60 days/year (p < 0.01), and harvesting dates were delayed by 0.78 days/year (p < 0.01) over North America. A minimum temperature increase by 1 °C caused a 4.26-day planting advance (r = −0.50, p < 0. 01) or a 0.66-day harvest delay (r = 0.10, p < 0.01). While, a higher maximum temperature resulted in a planting advance by 4.48 days/°C (r = −0.62, p < 0.01) or a harvest advance by 2.22 days/°C (r = −0.40, p < 0.01). Our analysis illustrated evident spatiotemporal variations in crop phenology in response to climate change and management practices. The derived crop phenological datasets and cropping intensity maps can be used in regional climate assessments and in developing adaptation strategies.
Inland aquatic systems, such as lakes and reservoirs, contribute substantially to global methane (CH4) emissions; yet are among the most uncertain components of the total CH4 budget. Lakes and reservoirs have received recent attention as they may generate high CH4 fluxes. Improved quantification of these CH4 fluxes, particularly their spatiotemporal distribution, is key to realistically incorporating them in CH4 modeling and budget studies. Here we report on a new global, gridded (0.25° lat × 0.25° lon) study of lake and reservoir CH4 emissions, accounting for new knowledge regarding lake and reservoir areal extent and distribution, and spatiotemporal emission patterns influenced by diurnal variability, temperature-dependent seasonality, satellite-derived freeze-thaw dynamics, and eco-climatic and physical CH4-centric type classification. The results of this new data set comprise daily CH4 emissions from lake and reservoirs throughout the full annual cycle and are tightly anchored to field observations, in situ measurements, and remote-sensing observations. Results show that reservoirs cover 297 × 103 km2 globally and emit 10.1 Tg CH4 yr-1 from diffusive (1.2 Tg CH4 yr-1) and ebullitive (8.9 Tg CH4 yr-1) emission pathways. On a global scale, CH4 emitting areas of lakes cover 1853 × 103 km2 and emit 37.1 Tg CH4 yr-1 from diffusive (17.1 Tg CH4 yr-1) and ebullitive (23.0 Tg CH4 yr-1) emission pathways and an additional ebullition flux of 5.2 Tg CH4 yr-1 upon ice-melt due to the accumulation of bubbles during the freeze period. This analysis of lakes and reservoir CH4 emission addresses multiple gaps and uncertainties in previous studies and represents an important contribution to studies of the global CH4 budget. The new data sets and methodologies from this study provide a framework to better understand and model the current and future role of lakes and reservoirs in the global CH4 budget and to guide efforts to mitigate inland aquatic system CH4 emissions. This presentation will describe the methodologies applied and the major results of this study focusing on the spatiotemporal distribution of lake and reservoir type classification, processes driving lake and reservoir emission seasonality, and the contribution of individual lake and reservoir types to the annual cycle of inland aquatic CH4 emissions.
This study summarizes the results from fitting a Bayesian hierarchical spatiotemporal model to coronavirus disease 2019 (COVID-19) cases and deaths at the county level in the United States for the year 2020. Two models were created, one for cases and one for deaths, utilizing a scaled Besag, York, Mollié model with Type I spatial-temporal interaction. Each model accounts for 16 social vulnerability and 7 environmental variables as fixed effects. The spatial pattern between COVID-19 cases and deaths is significantly different in many ways. The spatiotemporal trend of the pandemic in the United States illustrates a shift out of many of the major metropolitan areas into the United States Southeast and Southwest during the summer months and into the upper Midwest beginning in autumn. Analysis of the major social vulnerability predictors of COVID-19 infection and death found that counties with higher percentages of those not having a high school diploma, having non-White status and being Age 65 and over to be significant. Among the environmental variables, above ground level temperature had the strongest effect on relative risk to both cases and deaths. Hot and cold spots, areas of statistically significant high and low COVID-19 cases and deaths respectively, derived from the convolutional spatial effect show that areas with a high probability of above average relative risk have significantly higher Social Vulnerability Index composite scores. The same analysis utilizing the spatiotemporal interaction term exemplifies a more complex relationship between social vulnerability, environmental measurements, COVID-19 cases, and COVID-19 deaths.
Prior research on climate change impacts on flooding has primarily focused on changes in extreme rainfall magnitudes, often neglecting snow processes and spatiotemporal storm patterns, such as hyetograph shapes and areal reduction factors (ARFs). This study examines projected changes in extreme water available for runoff (W) events in two snow-dominated basins in the western United States: the Yakima River Basin (YRB) in Washington State and the Walker River Basin (WRB) spanning the California-Nevada border. We analyze changes in W magnitudes, mechanisms, hyetograph shapes, and ARFs, and study their compounded impacts on flood hazard. Our findings suggest increased extreme W magnitudes across a large portion of the basins, with steeper or flatter hyetographs, and higher ARF values under the future climate. These changes are driven by a shift from seasonal snowmelt to more rain-on-snow events at higher elevations and by increased rainfall at lower elevations. We then use a single event-based rainfall-runoff model to estimate flood hazard changes based on extreme W magnitudes, hyetograph shapes, ARFs, and their compounded impacts. Our analysis reveals that focusing solely on the magnitude of changes in extreme W can significantly underestimate future flood hazards and uncertainties. Ignoring future changes in spatiotemporal patterns can underestimate future flood hazards by 63% and underestimate the uncertainty in future flood events by 18% in the WRB. These results underscore the necessity of incorporating spatiotemporal dynamics into future flood hazard assessments to provide a more accurate evaluation of potential impacts.
Spatiotemporal optical vortices (STOVs) are space–time structured light pulses with a unique topology that couples spatial and temporal domains and carry transverse orbital angular momentum (OAM). Up to now, their generation has been limited to the visible and infrared regions of the spectrum. During the last decade, it was shown that through the process of high-order harmonic generation, it is possible to upconvert spatial optical vortices that carry longitudinal OAM from the near-infrared into the extreme-ultraviolet (EUV), thereby producing vortices with distinct femtosecond and attosecond structure. In this work, we demonstrate theoretically and experimentally the generation of EUV spatiotemporal and spatiospectral vortices using near-infrared STOV driving laser pulses. Here, we use analytical expressions for focused STOVs to perform macroscopic calculations of high-order harmonic generation that are directly compared to the experimental results. As STOV beams are not eigenmodes of propagation, we characterize the highly charged EUV STOVs in both the near and far fields to show that they represent conjugated spatiotemporal and spatiospectral vortex pairs. Our work provides high-frequency light beams topologically coupled at the nanometre/attosecond scales domains with transverse OAM that could be suitable to explore electronic dynamics in magnetic materials, chiral media and nanostructures.
Optical techniques for spatiotemporal control can produce laser pulses with custom amplitude, phase, or polarization structure. In nonlinear optics and plasma physics, the use of structured pulses typically follows a forward design approach, in which the efficacy of a known structure is analyzed for a particular application. Inverse approaches, in contrast, enable the discovery of new structures with the potential for superior performance. Here, an implementation of the unidirectional pulse propagation equation that supports automatic differentiation is combined with gradient-based optimization to design structured pulses with features that are advantageous for a range of nonlinear optical and plasma-based applications: (1) a longitudinally uniform intensity over an extended region, (2) a superluminal intensity peak that travels many Rayleigh ranges with constant duration, spot size, and amplitude, and (3) a laser pulse that ionizes a gas to form a uniform column of plasma. In the final case, optimizing the full spatiotemporal structure improves the performance by a factor of 15 compared to optimizing only spatial or only temporal structure, highlighting the advantage of spatiotemporal control.
Quantum simulators have the potential to shed light on the study of quantum many-body systems and materials, offering unique insights into various quantum phenomena. Although adiabatic evolution has been conventionally employed for state preparation, it faces challenges when the system evolves too quickly or the coherence time is limited. In such cases, shortcuts to adiabaticity, such as spatiotemporal quenches, provide a promising alternative. This paper numerically investigates the application of spatiotemporal quenches in the two-dimensional transverse field Ising model with ferromagnetic interactions, focusing on the emergence of the ground state and its correlation properties at criticality when the gap vanishes. We demonstrate the effectiveness of these quenches in rapidly preparing ground states in critical systems. Our simulations reveal the existence of an optimal quench front velocity at the emergent speed of light, leading to minimal excitation energy density and correlation lengths of the order of finite system sizes we can simulate. These findings emphasize the potential of spatiotemporal quenches for efficient ground state preparation in quantum systems, with implications for the exploration of strongly correlated phases and programmable quantum computing.