MATEY: multiscale adaptive foundation models for spatiotemporal physical systems
Explore the source record for details and available documents.
Zhang, Pei [ORNL] (ORCID:0000000283510529)↗
SEARCH · Search NASA
Results for “Spatiotemporal model”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Spatiotemporal Associations Between Social Vulnerability, Environmental Measurements, and COVID-19 in the Conterminous United States
This study summarizes the results from fitting a Bayesian hierarchical spatiotemporal model to coronavirus disease 2019 (COVID-19) cases and deaths at the county level in the United States for the year 2020. Two models were created, one for cases and one for deaths, utilizing a scaled Besag, York, Mollié model with Type I spatial-temporal interaction. Each model accounts for 16 social vulnerability and 7 environmental variables as fixed effects. The spatial pattern between COVID-19 cases and deaths is significantly different in many ways. The spatiotemporal trend of the pandemic in the United States illustrates a shift out of many of the major metropolitan areas into the United States Southeast and Southwest during the summer months and into the upper Midwest beginning in autumn. Analysis of the major social vulnerability predictors of COVID-19 infection and death found that counties with higher percentages of those not having a high school diploma, having non-White status and being Age 65 and over to be significant. Among the environmental variables, above ground level temperature had the strongest effect on relative risk to both cases and deaths. Hot and cold spots, areas of statistically significant high and low COVID-19 cases and deaths respectively, derived from the convolutional spatial effect show that areas with a high probability of above average relative risk have significantly higher Social Vulnerability Index composite scores. The same analysis utilizing the spatiotemporal interaction term exemplifies a more complex relationship between social vulnerability, environmental measurements, COVID-19 cases, and COVID-19 deaths.
spatial epidemiology↗
O'Hare Airport roadway traffic prediction via data fusion and Gaussian process regression
This study proposes an approach of leveraging information gathered from multiple traffic data sources at different resolutions to obtain approximate inference on the traffic distribution of Chicago's O'Hare Airport area. Specifically, it proposes the ingestion of traffic datasets at different resolutions to build spatiotemporal models for predicting the distribution of traffic volume on the road network. Due to its good adaptability and flexibility for spatiotemporal data, the Gaussian process (GP) regression was employed to provide short-term forecasts using data collected by loop detectors (sensors) and supplemented by telematics data. The GP regression is used to make predictions of the distribution of the proportion of sensor data traffic volume represented by the telematics data for each location of the sensors. Consequently, the fitted GP model can be used to determine the approximate traffic distribution for a testing location outside of the training points. Policymakers in the transportation sector can find the results of this work helpful for making informed decisions relating to current and future transportation conditions in the area.
42 ENGINEERING↗
Variational multiscale reinforcement learning for discovering reduced order closure models of nonlinear spatiotemporal transport systems
Abstract A central challenge in the computational modeling and simulation of a multitude of science applications is to achieve robust and accurate closures for their coarse-grained representations due to underlying highly nonlinear multiscale interactions. These closure models are common in many nonlinear spatiotemporal systems to account for losses due to reduced order representations, including many transport phenomena in fluids. Previous data-driven closure modeling efforts have mostly focused on supervised learning approaches using high fidelity simulation data. On the other hand, reinforcement learning (RL) is a powerful yet relatively uncharted method in spatiotemporally extended systems. In this study, we put forth a modular dynamic closure modeling and discovery framework to stabilize the Galerkin projection based reduced order models that may arise in many nonlinear spatiotemporal dynamical systems with quadratic nonlinearity. However, a key element in creating a robust RL agent is to introduce a feasible reward function, which can be constituted of any difference metrics between the RL model and high fidelity simulation data. First, we introduce a multi-modal RL to discover mode-dependant closure policies that utilize the high fidelity data in rewarding our RL agent. We then formulate a variational multiscale RL (VMRL) approach to discover closure models without requiring access to the high fidelity data in designing the reward function. Specifically, our chief innovation is to leverage variational multiscale formalism to quantify the difference between modal interactions in Galerkin systems. Our results in simulating the viscous Burgers equation indicate that the proposed VMRL method leads to robust and accurate closure parameterizations, and it may potentially be used to discover scale-aware closure models for complex dynamical systems.
97 MATHEMATICS AND COMPUTING↗
Epidemiology, Clinical Features, and Outcomes of Coccidioidomycosis, Utah, 2006–2015
On the basis of a 1957 geographic Coccidioides seropositivity survey, 3 counties in southwestern Utah, USA, were considered coccidioidomycosis-endemic, but there has been a paucity of information on the disease burden in Utah since. We report findings from a recent clinical and epidemiologic study of coccidioidomycosis in Utah. To describe clinical characteristics, we identified all coccidioidomycosis cases in an integrated health system in the state during 2006–2015. For epidemiologic analysis, we used cases reported to the Utah Department of Health during 2009–2015. Mean state incidence was 1.83 cases/100,000 population/year. Washington County, in southwestern Utah, had the highest incidence, 17.2 cases/100,000 population/year. In a generalized linear model with time as a fixed effect, mean annual temperature, population, and new construction were associated with regional variations in incidence. Using these variables in a spatiotemporal model, we estimated the adjusted regional variation by county to predict areas where Coccidioides infections might increase.
60 APPLIED LIFE SCIENCES↗
Inferring Plant Acclimation and Improving Model Generalizability With Differentiable Physics‐Informed Machine Learning of Photosynthesis
Net photosynthesis (A N ) is a key component of the global carbon cycle influencing climate feedback over decadal scales. Although plant acclimation to environmental changes can modify A N , traditional vegetation models in Earth system models (ESMs) often rely on plant functional type (PFT)-specific parameterizations or simplified acclimation assumptions limiting generalizability across time, space, and PFTs. In this study, we developed a differentiable photosynthesis model to learn the environmental dependencies of V c,max25 (maximum carboxylation rate at 25°C, representing photosynthetic capacity), as this genre of hybrid physics-informed machine learning can seamlessly train neural networks and process-based equations together. Compared to PFT-specific parameterization of V c,max25 , learning the environment dependencies of key photosynthetic parameters improved model spatiotemporal generalizability. Applying environmental acclimation to V c,max25 led to substantial variations in global mean A N indicating the need to address acclimation in ESMs. The model effectively captured multivariate observations (V c,max25 , A N , and stomatal conductance (g s )) simultaneously with multivariate constraints, improving generalization across space and PFTs. It also learned sensible acclimation relationships of V c,max25 to different environmental conditions. The model explained more than 54%, 57%, and 62% of the variance of A N , g s , and V c,max25 , respectively, presenting a first global-scale spatial test benchmark of A N and g s . These results highlight the potential for differentiable modeling to enhance process-based modules in ESMs and effectively leverage information from large, multivariate data sets.
54 ENVIRONMENTAL SCIENCES↗
STFM: Accurate Spatio-Temporal Fusion Model for Weather Forecasting
Meteorological prediction is crucial for various sectors, including agriculture, navigation, daily life, disaster prevention, and scientific research. However, traditional numerical weather prediction (NWP) models are constrained by their high computational resource requirements, while the accuracy of deep learning models remains suboptimal. In response to these challenges, we propose a novel deep learning-based model, the Spatiotemporal Fusion Model (STFM), designed to enhance the accuracy of meteorological predictions. Our model leverages Fifth-Generation ECMWF Reanalysis (ERA5) data and introduces two key components: a spatiotemporal encoder module and a spatiotemporal fusion module. The spatiotemporal encoder integrates the strengths of convolutional neural networks (CNNs) and recurrent neural networks (RNNs), effectively capturing both spatial and temporal dependencies. Meanwhile, the spatiotemporal fusion module employs a dual attention mechanism, decomposing spatial attention into global static attention and channel dynamic attention. This approach ensures comprehensive extraction of spatial features from meteorological data. The combination of these modules significantly improves prediction performance. Experimental results demonstrate that STFM excels in extracting spatiotemporal features from reanalysis data, yielding predictions that closely align with observed values. In comparative studies, STFM outperformed other models, achieving a 7% improvement in ground and high-altitude temperature predictions, a 5% enhancement in the prediction of the u/v components of 10 m wind speed, and an increase in the accuracy of potential height and relative humidity predictions by 3% and 1%, respectively. This enhanced performance highlights STFM’s potential to advance the accuracy and reliability of meteorological forecasting.
54 ENVIRONMENTAL SCIENCES↗
Coupled Hydromechanical Modeling of Induced Seismicity From CO 2 Injection in the Illinois Basin
Injection of CO 2 for geologic carbon sequestration into deep sedimentary formations involves fluid pressure increases that engage hydromechanical processes that can cause seismicity by activation of existing faults. In this work, we use a coupled multiphase fluid flow and geomechanical simulator to model spatiotemporal fluid pressure and stress changes in order to study the poroelastic effect of CO 2 injection on faults in crystalline basement rock below the injection zone. The seismicity rate along features interpreted to be basement faults is modeled using Dieterich's rate-and-state earthquake nucleation model. The methodology is applied to microseismicity detected during CO 2 injection into the Mount Simon formation during the Illinois Basin—Decatur Project. The modeling accurately captures an observed reduction in seismicity rate when the injection in the second well was into a slightly shallower zone above the base of the Mount Simon formation. Moreover, the modeling shows that it is important to consider poroelastic stress changes, in addition to fluid pressure changes for accurately modeling of the observed seismicity rate.
58 GEOSCIENCES↗
Spatially dependent modeling and simulation of runaway electron mitigation in DIII-D
New simulations with the Kinetic Orbit Runaway electron (RE) Code (KORC) show RE deconfinement losses to the wall during plasma scrape off are the primary current dissipation mechanism in DIII-D experiments with high-Z impurity injection, and not collisional slowing down. The majority of simulations also exhibit an increase in the RE beam energy due to acceleration by the induced toroidal electric field, even while the RE beam current is decreasing. In this study, KORC integrates RE orbits using the relativistic guiding center equations of motion and incorporates time-sequenced, experimental reconstructions of the magnetic and electric fields and line integrated electron density to construct spatiotemporal models of electron and partially ionized impurity transport in the companion plasma. Comparisons of experimental current evolution and KORC results demonstrate the importance of including Coulomb collisions with partially ionized impurity physics, initial RE energy, pitch angle, and spatial distributions, and spatiotemporal electron and partially ionized impurity transport. The research presented here provides an initial quantification of the efficacy of RE mitigation via injected impurities and identification of the critical role played by loss of confinement due to plasma scrape off on the inner wall as compared to the relatively slow collisional damping.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Scaling kinetic Monte-Carlo simulations of grain growth with combined convolutional and graph neural networks
Graph neural networks (GNN) have emerged as a promising machine learning method for microstructure simulations such as grain growth. However, accurate modeling of realistic grain boundary networks requires large simulation cells, which GNN has difficulty scaling up to. To alleviate the computational costs and memory footprint of GNN, we suggest a hybrid architecture combining a convolutional neural network (CNN) based bijective autoencoder to compress the spatial dimensions, and a GNN that evolves the microstructure in the latent space of reduced spatial sizes. Our results demonstrate that the new design significantly reduces computational costs with using fewer message passing layer (from 12 down to 3) compared with GNN alone. The reduction in computational cost becomes more pronounced as the spatial size increases, indicating strong computational scalability. For the largest mesh evaluated (160 3 ), our method reduces memory usage and runtime in inference by 117× and 115×, respectively, compared with GNN-only baseline. More importantly, it shows higher accuracy and stronger spatiotemporal capability than the GNN-only baseline, especially in long-term testing. Such combination of scalability and accuracy is essential for simulating realistic material microstructures over extended time scales. The improvements can be attributed to the bijective autoencoder’s ability to compress information losslessly from spatial domain into a high dimensional feature space, thereby producing more expressive latent features for the GNN to learn from, while also contributing its own spatiotemporal modeling capability. Training data are generated from stochastic grain growth simulations, providing realistic variability for learning robust microstructure evolution. Comprehensive system validation confirms that the model is accurate, robust, and scalable.
36 MATERIALS SCIENCE↗
Subsurface heatwaves in lakes
Abstract Lake heatwaves (extreme hot water events) can substantially disrupt aquatic ecosystems. Although surface heatwaves are well studied, their vertical structures within lakes remain largely unexplored. Here we analyse the characteristics of subsurface lake heatwaves (extreme hot events occurring below the surface) using a spatiotemporal modelling framework. Our findings reveal that subsurface heatwaves are frequent, often longer lasting but less intense than surface events. Deep-water heatwaves (bottom heatwaves) have increased in frequency (7.2 days decade −1 ), duration (2.1 days decade −1 ) and intensity (0.2 °C days decade −1 ) over the past 40 years. Moreover, vertically compounding heatwaves, where extreme heat occurs simultaneously at the surface and bottom, have risen by 3.3 days decade −1 . By the end of the century, changes in heatwave patterns, particularly under high emissions, are projected to intensify. These findings highlight the need for subsurface monitoring to fully understand and predict the ecological impacts of lake heatwaves.
Environmental Sciences & Ecology↗
A Clustering-Based Scenario Generation Framework for Power Market Simulation with Wind Integration
A critical step in stochastic optimization models of power system analysis is to select a set of appropriate scenarios and significant numbers of scenario generation methods exist in the literature. This paper develops a clustering based scenario generation method, which aims to improve the performance of existing scenario generation techniques by grouping a set of correlated wind sites into clusters according to their cross-correlations. Copula based models are utilized to model spatiotemporal correlations and the Gibbs sampling is then used to generate scenarios for day-ahead markets. Our results show that the generated scenarios based on clustered wind sites outperform existing approaches in terms of reliability and sharpness and can reduce the total computational time for scenario generation and reduction significantly. The clustering-based framework can therefore provide a better support for real-world market simulations with high wind penetration.
data visualization↗
A space-time neural network
Introduced here is a novel technique which adds the dimension of time to the well known back propagation neural network algorithm. Cited here are several reasons why the inclusion of automated spatial and temporal associations are crucial to effective systems modeling. An overview of other works which also model spatiotemporal dynamics is furnished. A detailed description is given of the processes necessary to implement the space-time network algorithm. Several demonstrations that illustrate the capabilities and performance of this new architecture are given.
Villarreal, James A.↗
Spatiotemporal Metabolic Network Models Reveal Complex Autotroph-Heterotroph Biofilm Interactions Governed by Photon Incidences
Autotroph-heterotroph interactions are ubiquitous in natural environment and play a key role in controlling various essential ecosystem functions, such as production and utilization of organic matter, cycling of nitrogen, sulfur, and other chemical elements. Understanding how these biofilm metabolic interactions are constrained in space and time remains challenging because fully predictive models designed for this purpose are currently limited. Toward filling this gap, here we developed community metabolic network models for two autotroph-heterotroph biofilm consortia (termed UCC-A and UCC-O), which share a suite of common heterotrophic members but have a single distinct photoautotrophic cyanobacterium (Phormidesmis priestleyi str. ANA and Phormidium sp. OSCR) that provides organic carbon and nitrogen sources to support the growth of heterotrophic partners. After determining model parameters by data fitting using the spatiotemporal distributions of microbial abundances, we comparatively analyzed the resulting biofilm models to examine any fundamental differences in microbial interactions between the two consortia under the variation of key environmental variables: CO2 and photon levels. The UCC-A model predicted generally expected responses, i.e., the autotroph population increased in response to elevated levels of CO2 and photon, followed by increase in the heterotroph population. In contrast, the UCC-O model showed somewhat complicated dynamics, e.g., higher photon incidence rates resulted in the increase in autotroph population but decrease in heterotroph population due to the lowered provision of glucose from the autotroph. A further analysis showed that species coexistence was governed by the photon incidences rather than the carbon availability for UCC-O, which was the opposite for UCC-A.
Phalak, Poonam↗
Evaluating a spatiotemporal shape-matching model for the generation of synthetic high spatiotemporal resolution time series of multiple satellite data
Explore the source record for details and available documents.
Xiaoyang Zhang↗
Using spatiotemporal correlative niche models for evaluating the effects of climate change on mountain pine beetle
Explore the source record for details and available documents.
Aaron M. Sidder↗
Multimodel ensemble predictions of precipitation using bayesian neural networks
Multimodel ensembling improves predictions and considers model uncertainties. In this study, we present a Bayesian Neural Network (BNN) ensemble approach for large-scale precipitation predictions based on a set of climate models. BNN infers spatiotemporally varying model weights and biases through the calibration against observations. This ensemble scheme of BNN sufficiently leverages individual model skill for accurate predictions as well as provides interpretability about which models contribute more to the ensemble prediction at which locations and times to inform model development. Additionally, BNN accurately quantifies epistemic uncertainty to avoid overconfident projections. We demonstrate BNN’s superior prediction performance to three state-of-the-art ensemble approaches and discuss its interpretability and uncertainty quantification.
Fan, Patrick↗