Search NASA⌕ Search

SEARCH · Search NASA

Results for “spatiotemporal data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Studying drought-induced forest mortality using high spatiotemporal resolution evapotranspiration data from thermal satellite imaging

Drought can have pervasive and wide-spread impacts to forest health, as evidenced in several severe events occurring over the recent decades. Extensive forest die-off due to drought can impair the ecological functioning of forests, impacting habitat, water yield and quality from forested lands, and altering forest fire dynamics and intensity. Satellite remote sensing provides an effective means for detecting and monitoring spatial patterns of forest mortality over large areas, exploiting free and open long-term image archives available at a range in spatial and temporal resolutions. While remotely sensed surface reflectances and vegetation indices have been widely used to study optical response of forest canopies to drought events, retrievals of evapotranspiration (ET) derived from thermal satellite imagery – particularly at resolutions approaching crown scale - can provide insights into cumulative tree stresses that can incite disease and trigger mortality. In this study, we applied a multi-sensor satellite data fusion approach to estimate daily 30-m resolution ET and an associated Evaporative Stress Index (ESI) to study drought-induced mortality in a temperate forest at the Missouri Ozark AmeriFlux (MOFLUX) site, located in the central United States. The study covered the period from 2010 to 2014, including an exceptional drought year of 2012. Modeled ET agreed well with eddy flux measurements from the MOFLUX tower, with average monthly relative errors of 15%. Plot-scale ESI, describing temporal anomalies in the ratio of actual-to-reference ET, was used as an index of relative forest health to investigate relationships between forest mortality and drought severity. ESI showed good agreement with observed predawn leaf water potential, especially during the drought year. Furthermore, plot-scale ESI was also correlated with the subsequent year's tree mortality, suggesting the importance of considering the forest health condition prior to drought when studying drought-induced forest impacts. This study demonstrates the utility of multi-year ET remote sensing data at the stand or plot scale as an indicator of forest health and as a predictor of future mortality due to drought.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Characterization of turbulence under different stability conditions using lidar scanning data

The spatiotemporal scales of turbulence in the boundary layer flow vary with the static stability of the atmosphere. For example, turbulence structures in unstable conditions are often found to be large and coherent, whereas the turbulent structures in stable conditions are relatively small and sporadic. To better understand the behavior of such turbulent structures under different atmospheric stability conditions in the lower atmosphere, herein, we use scanning lidar data collected over several months during the US Department of Energy's second Wind Forecast Improvement Project (WFIP 2) in 2016. The radial velocity data from scanning lidar were gathered along the horizontal plane (PPI mode) and were analyzed using proper orthogonal decomposition (POD) and spectral energy methods. The results from these analyses show that the turbulent structures in daytime unstable conditions are different from those present during nighttime stable conditions in terms of amount of energy and coherent structures. The POD energy is distributed more evenly in all the higher spatial modes in the daytime unstable case compared to the nighttime stable case. Besides characterizing the turbulence in the flow, the lidar data were also used to compare the simulated flow field generated from the WRF-LES framework (Weather Research and Forecasting - large-eddy simulation) with the scanning lidar data. The results from both simulated and lidar scanned data show similar structures orienting the streak-like structure along the mean wind. This indicates that the streak-like structures can exist in the real atmosphere during unstable atmospheric condition cases.

Rai, Raj K.↗
DOE OSTI2023

A General Spatiotemporal Imputation Framework for Missing Sensor Data

Many applications from precision agriculture, environmental monitoring and transportation networks rely on data collected across space and time over a large geographic area. Missing data poses a significant challenge for any data-driven inference and control tasks. Data imputation or the estimation of missing data can help fill these gaps by utilizing inherent spatial relationships and temporal patterns. A variety of spatiotemporal imputation models have been developed to address missing data in spatiotemporal datasets. However, these classical methods rely on the assumption that the underlying data follows a smooth trend and fail to provide accurate estimates when there is a large number of missing points in the data. Even though there are machine learning driven tensor completion approaches such as convolutional neural network based tensor completion (CoSTCo) that capture the non-linear relationships in the dataset, the transductive nature makes the algorithm less scalable. Thus, existing approaches for estimating the missing information do not effectively capture all dimensions of the spatiotemporal data structure, resulting in erroneous predictions and poor performance. The main contributions of this paper are: (1) We propose a novel inductive framework (G-LSTM) for missing data imputation that integrates a graph neural network with LSTMs to effectively capture both spatial and temporal dependencies. (2) Experimental results on a traffic dataset demonstrate that the proposed GNN integrated with an LSTM framework achieves improved imputation and maintains steady performance even when there are extreme missing conditions in comparison with the state-of-the-art imputation framework (i.e, CoSTCo). (3) The simulation results on a traffic network show up to 69% reduction in mean absolute error and 61% reduction in root mean square error when compared to CoSTCo.

Tharzeen, Aabila↗
DOE OSTI2020

Framework For Spatial Agricultural Crop Yield Prediction Model Development

This framework was developed to provide data preprocessing for spatiotemporal agricultural yield data and remote sensing data for modelling using artificial neural networks (ANNs) to predict subfield crop yield estimates. The software includes methods to train, validate, and test ANN models. It also include methods to infer on new remote sensing data.

Griffel, LloydM.↗
NASA NTRSDate not supplied

Deriving a Suite of Climate Data Records from 21-years of Sounder Observations

Two retrieval algorithms, a Single Field-of-view Sounder Atmospheric Product (SiFSAP) Level 2 algorithm and a Climate Fingerprinting Sounder Product (ClimFiSP) Level 3 algorithm, have been developed at NASA Langley Research Center. In this presentation, we will demonstrate the radiance closure build into these two algorithms. This is possible due to the use of a principal-component-based radiative transfer model (PCRTM). The PCRTM enables the inclusion of all available spectral information from hyperspectral IR sounders. It also has fast and accurate capability of modeling observed cloudy radiance spectra directly. The SiFSAP, which fits sounder radiance spectra using PCRTM as forward model and an optimal estimation as inverse model, has 3-times higher spatial resolution and 9-times denser data products comparing to current NASA and NOAA operational IR sounder products. With great support from NASA sounder SIPS, the SiFSAP algorithm has been delivered to NASA GES DISC for L2 and L3 data generation and releasing. The ClimFiSP uses a spectral fingerprinting method to directly generate L3 data products from spatiotemporally averaged L1 data. The goal of ClimFiSP is to generate high-quality climate data records (CDRs) from multiple IR sounders (e.g. Aqua AIRS, SNPP CrIS, NOAA-20 and NOAA-21 CrIS) using a consistent retrieval methodology. Using CHIRP L1 data, we have generated 20-years of CDRs for atmospheric temperature, water vapor, and trace gas profiles, as well as cloud and surface properties. The algorithm will be transitioned to Sounder SIPS soon and eventually to NASA GES DISC.

Xu Liu↗
NASA NTRSDate not supplied

Geophysical Retrievals and Cloud Analyses from Merged Airborne Radiometer Datasets Covering 10–684 GHz

Airborne microwave radiometers provide insight about numerous aspects of Earth’s atmosphere and yield critical validation datasets for spaceborne radiometers. Three radiometers that are important to NASA’s airborne remote-sensing arsenal include: the Advanced Microwave Precipitation Radiometer (AMPR), covering 10–85 GHz; the Conical Scanning Millimeter-wave Imaging Radiometer (CoSMIR), covering 50–183 GHz; and the Compact Scanning Submillimeter-wave Imaging Radiometer (CoSSIR), covering 170–684 GHz. The NASA field campaigns of interest to this study include: the Integrated Precipitation and Hydrology Experiment (IPHEx) in 2014, the Olympic Mountains Experiment and Radar Definition Experiment (OLYMPEX/RADEX) in 2015–2016, the Investigation of Microphysics and Precipitation for Atlantic Coast-Threatening Snowstorms (IMPACTS) in 2020–2023, and the Airborne Lightning Observatory for FEGS and TGFs (ALOFT) in 2023. To provide a more comprehensive perspective on clouds and precipitation observed during these airborne field campaigns, AMPR data were merged spatiotemporally with CoSMIR data for IPHEx, OLYMPEX/RADEX, and IMPACTS (2020 and 2022), while considering differences in instrument characteristics and operations, providing brightness temperature (Tb) values from 10–183 GHz in a common background grid throughout each flight. AMPR and CoSSIR data were similarly merged for IMPACTS (2023) and ALOFT, providing a common background grid with Tb values covering 10–684 GHz throughout each flight. These merged Tb data were employed in geophysical retrievals using the Community Radiative Transfer Model (CRTM), an Eddington radiative transfer model, and a one-dimensional variational (1DVAR) inversion method. Retrievals of cloud liquid water path were of primary interest. This presentation will include an overview of the methods for the radiometer data mergers, the radiative transfer methods, the geophysical retrievals, and detailed results from examining trends in Tb and cloud liquid water path in clouds, precipitation, and cloud-to-precipitation transition zones.

Corey G Amiot↗
DOE OSTI2023

Scalable Incremental Checkpointing using GPU-Accelerated De-Duplication

Writing large amounts of data concurrently to stable storage is a typical I/O pattern of many HPC workflows. This pattern introduces high I/O overheads and results in increased storage space utilization especially for workflows that need to capture the evolution of data structures with high frequency as checkpoints. In this context, many applications, such as graph pattern matching, perform sparse updates to large data structures between checkpoints. For these applications, incremental checkpointing techniques that save only the differences from one checkpoint to another can dramatically reduce the checkpoint sizes, I/O bottlenecks, and storage space utilization. However, such techniques are not without challenges: it is non-trivial to transparently determine what data has changed since a previous checkpoint and assemble the differences in a compact fashion that does not result in excessive metadata. State-of-art data reduction techniques (e.g., compression and de-duplication) have significant limitations when applied to modern HPC applications that leverage GPUs: slow at detecting the differences, generate a large amount of metadata to keep track of the differences, and ignore crucial spatiotemporal checkpoint data redundancy. This paper addresses these challenges by proposing a Merkle tree-based incremental checkpointing method to exploit GPUs' high memory bandwidth and massive parallelism. Experimental results at scale show a significant reduction of the I/O overhead and space utilization of checkpointing compared with state-of-the-art incremental checkpointing and compression techniques.

Tan, Nigel↗
NASA NTRS2016

A Spatiotemporal Indexing Approach for Efficient Processing of Big Array-Based Climate Data with MapReduce

Climate observations and model simulations are producing vast amounts of array-based spatiotemporal data. Efficient processing of these data is essential for assessing global challenges such as climate change, natural disasters, and diseases. This is challenging not only because of the large data volume, but also because of the intrinsic high-dimensional nature of geoscience data. To tackle this challenge, we propose a spatiotemporal indexing approach to efficiently manage and process big climate data with MapReduce in a highly scalable environment. Using this approach, big climate data are directly stored in a Hadoop Distributed File System in its original, native file format. A spatiotemporal index is built to bridge the logical array-based data model and the physical data layout, which enables fast data retrieval when performing spatiotemporal queries. Based on the index, a data-partitioning algorithm is applied to enable MapReduce to achieve high data locality, as well as balancing the workload. The proposed indexing approach is evaluated using the National Aeronautics and Space Administration (NASA) Modern-Era Retrospective Analysis for Research and Applications (MERRA) climate reanalysis dataset. The experimental results show that the index can significantly accelerate querying and processing (10 speedup compared to the baseline test using the same computing cluster), while keeping the index-to-data ratio small (0.0328). The applicability of the indexing approach is demonstrated by a climate anomaly detection deployed on a NASA Hadoop cluster. This approach is also able to support efficient processing of general array-based spatiotemporal data in various geoscience domains without special configuration on a Hadoop cluster.

big data↗
NASA NTRS2019

Surface erythemal UV irradiance in the continental United States derived from ground-based and OMI observations: quality assessment, trend analysis and sampling issues

Surface full-sky erythemal dose rate (EDR) from the Ozone Monitoring Instrument (OMI) at both satellite overpass time and local noon time is evaluated against ground measurements at 31 sites from the US Department of Agriculture's (USDA) UV-B Monitoring and Research Program (UVMRP) over the period of 2005–2017. We find that both OMI overpass and solar noon time EDR are highly correlated with the measured counterparts (with a linear correlation coefficient of 0.90 and 0.88, respectively). Although the comparison statistics are improved with a longer time window (0.5–1.0 h) for pairing surface and OMI measurements, both OMI overpass and local noon time EDRs have 7 % overestimation that is larger than 6 % uncertainty in the ground measurements and show different levels of dependence on solar zenith angle (SZA) and to lesser extent on cloud optical depth. The ratio of EDR between local noon and OMI overpass time is often (95 % in frequency) larger than 1 with a mean of 1.18 in the OMI product; in contrast, the same ratio from surface observation is normally distributed with 22 % of the times less than 1 and a mean of 1.38. This contrast in part reflects the deficiency in the OMI surface UV algorithm that assumes constant atmospheric conditions between overpass and noon time. The probability density functions (PDFs) for both OMI and ground measurements of noontime EDR are in statistically significant agreement, showing dual peaks at ∼20 and ∼200 mW/sq. m, respectively; the latter is lower than 220 mW/ sq. m, the value at which the PDF of daily EDR from ground measurements peaks, and this difference indicates that the largest EDR value for a given day may not often occur at local noon. Lastly, statistically significant positive trends of EDR are found in the northeastern US in OMI data, but opposite trends are found within ground-based data (regardless of sampling for either noontime or daily averages). While positive trends are consistently found between OMI and surface data for EDR over the southern Great Plains (Texas and Oklahoma), their values are within the uncertainty of ground measurements. Overall, no scientifically sound trends can be found among OMI data for aerosol total and absorbing optical depth, cloud optical depth and total ozone to explain coherently the surface UV trends revealed either by OMI or ground-based estimates; these data also cannot reconcile trend differences between the two estimates (of EDR from OMI and surface observations). Future geostationary satellites with better spatiotemporal resolution data should help overcome spatiotemporal sampling issues inherent in OMI data products and therefore improve the estimates of surface UV flux and EDR from space.

Ozone Monitoring Instrument (OMI)↗
DOE OSTI2022

Unsupervised learning from three-component accelerometer data to monitor the spatiotemporal evolution of meso-scale hydraulic fractures

Enhanced geothermal systems can provide a substantial share of the global energy demand. There exist several hurdles in the engineering implementations of such geothermal systems. One such hurdle is the accurate monitoring of the fracture networks created in subsurface through hydraulic stimulation of these systems. Micro seismicity associated with the stimulation is the primary means to locate the event hypocenters for estimating the stimulated rock volume. Existing methods for location the hypocenters are restricted to only the highest amplitude impulsive signals that are simultaneously detected on several sensors. Consequently, a large portion (usually ~99%) of the measurements are left unused. In this paper, an unsupervised manifold-approximation followed by clustering of 3-component accelerometer data is used to analyze the seismicity recorded on a monitoring well. With this method, a larger portion of the measured signal is used for the monitoring of the hydraulic fracture network. We analyze the EGS Collab experiment 1 microseismic data, recorded at the Sanford Underground Research Facility, South Dakota. Using the data from a single three-component accelerometer, the polarization features viz. Azimuth, incidence, rectilinearity, and planarity are used as inputs for the unsupervised manifold approximation followed by clustering. Our study shows that density-based clusters in the projected 3D space correspond to distinct types of hydraulically fractured zones around the injection point. Finally, we show that the temporal evolution of these clusters can be used to track fracture creation and propagation.

58 GEOSCIENCES↗
DOE OSTI2025

A Multivariate Space‐Time Dynamic Model for Characterizing the Atmospheric Impacts Following the Mt. Pinatubo Eruption

The June 1991 Mt. Pinatubo eruption resulted in a massive increase of sulfate aerosols in the atmosphere, absorbing radiation and leading to global changes in surface and stratospheric temperatures. A volcanic eruption of this magnitude serves as a natural analog for stratospheric aerosol injection, a proposed solar radiation modification method to combat a warming climate. The impacts of such an event are multifaceted and region-specific. Our goal is to characterize the multivariate and dynamic nature of the atmospheric impacts following the Mt. Pinatubo eruption. We developed a multivariate space-time dynamic linear model to understand the full extent of the spatially- and temporally-varying impacts. Specifically, spatial variation is modeled using a flexible set of basis functions for which the basis coefficients are allowed to vary in time through a vector autoregressive (VAR) structure. This novel model is cast in a Dynamic Linear Model (DLM) framework and estimated via a customized MCMC approach. We demonstrate how the model quantifies the relationships between key atmospheric parameters prior to and following the Mt. Pinatubo eruption with reanalysis data from MERRA-2 and highlight when such a model is advantageous over univariate models.

Dynamic Linear Model↗
DOE OSTI2020

Big-Data-Driven Geo-Spatiotemporal Correlation Analysis between Precursor Pollen and Influenza and its Implication to Novel Coronavirus Outbreak

Although studies of many respiratory viruses and pollens are often framed by both seasonal and health related perspectives, pollen has yet to be extensively examined as an important covariate to seasonal respiratory viruses (SRVs) in any context, including a causal one. This study contributes to those goals through an investigation of SRVs and pollen counts at selected regions across the Western Hemisphere. Two complementary decadal-scaled geospatial profiles were developed. One laterally spanned the US and was anchored by detailed pollen information for Albuquerque, New Mexico. The other straddled the equator to include Fortaleza, Brazil. We found that the geospatial and climatological patterns of pollen advancement and decline across the US every year presented a statistically significant correlation to the subsequent emergence and decline of SRVs. Other significant covariates included winds, temperatures, and atmospheric moisture. Our study indicates that areas of the US with lower geostrophic wind baselines are typically areas of persistently higher and earlier influenza like illness (ILI) cases. In addition to that continental- scaled contrast, many sites indicated seasonal highs of geostrophic winds and ILI which were closely aligned. These observations suggest extensive scale-dependent connectivity of viruses to geostrophic circulation. Pollen emergence and its own scale-dependent circulation may contribute to the geospatial and seasonal patterns of ILI. We explore some uncertainties associated with this investigation, and consider the possibility that in a temperate climate, following a Spring pollen emergence, a resulting increase in pollen triggered human Immunoglobulin E (IgE) antibodies may suppress ILIs for several months.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Equation-Free Coarse Control of Distributed Parameter Systems via Local Neural Operators

The control of high-dimensional distributed parameter systems (DPS) remains a challenge when explicit coarse-grained equations are unavailable. Classical equation-free (EF) approaches rely on fine-scale simulators treated as black-box timesteppers. However, repeated simulations for steady-state computation, linearization, and control design are often computationally prohibitive, or the microscopic timestepper may not even be available, leaving us with data as the only resource. We propose a data-driven alternative that uses local neural operators, trained on spatiotemporal microscopic/mesoscopic data, to obtain efficient short-time solution operators. These surrogates are employed within Krylov subspace methods to compute coarse steady and unsteady-states, while also providing Jacobian information in a matrix-free manner. Krylov-Arnoldi iterations then approximate the dominant eigenspectrum, yielding reduced models that capture the open-loop slow dynamics without explicit Jacobian assembly. Both discrete-time Linear Quadratic Regulator (dLQR) and pole-placement (PP) controllers are based on this reduced system and lifted back to the full nonlinear dynamics, thereby closing the feedback loop.

93B52, 93C20, 47N70, 65J15, 65M32, 68T07, 68T20, 6↗
DOE OSTI2021

Quantifying experimental edge plasma evolution via multidimensional adaptive Gaussian process regression

The edge density and temperature of tokamak plasmas are strongly correlated with energy and particle confinement and their quantification is fundamental to understanding edge dynamics. These quantities exhibit behaviours ranging from sharp plasma gradients and fast transient phenomena (e.g. transitions between low and high confinement regimes) to nominal stationary phases. Analysis of experimental edge measurements therefore require robust fitting techniques to capture potentially stiff spatiotemporal evolution. Additionally, fusion plasma diagnostics inevitably involve measurement errors and data analysis requires a statistical framework to accurately quantify uncertainties. This paper outlines a generalized multidimensional adaptive Gaussian process routine capable of automatically handling noisy data and spatiotemporal correlations. We focus on the edge-pedestal region in order to underline advancements in quantifying time-dependent plasma profiles including transport barrier formation on the Alcator C-Mod tokamak.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Deriving spatially explicit direct and indirect interaction networks from animal movement data

Abstract Quantifying spatiotemporally explicit interactions within animal populations facilitates the understanding of social structure and its relationship with ecological processes. Data from animal tracking technologies (Global Positioning Systems [“GPS”]) can circumvent longstanding challenges in the estimation of spatiotemporally explicit interactions, but the discrete nature and coarse temporal resolution of data mean that ephemeral interactions that occur between consecutive GPS locations go undetected. Here, we developed a method to quantify individual and spatial patterns of interaction using continuous‐time movement models (CTMMs) fit to GPS tracking data. We first applied CTMMs to infer the full movement trajectories at an arbitrarily fine temporal scale before estimating interactions, thus allowing inference of interactions occurring between observed GPS locations. Our framework then infers indirect interactions—individuals occurring at the same location, but at different times—while allowing the identification of indirect interactions to vary with ecological context based on CTMM outputs. We assessed the performance of our new method using simulations and illustrated its implementation by deriving disease‐relevant interaction networks for two behaviorally differentiated species, wild pigs ( Sus scrofa ) that can host African Swine Fever and mule deer ( Odocoileus hemionus ) that can host chronic wasting disease. Simulations showed that interactions derived from observed GPS data can be substantially underestimated when temporal resolution of movement data exceeds 30‐min intervals. Empirical application suggested that underestimation occurred in both interaction rates and their spatial distributions. CTMM‐Interaction method, which can introduce uncertainties, recovered majority of true interactions. Our method leverages advances in movement ecology to quantify fine‐scale spatiotemporal interactions between individuals from lower temporal resolution GPS data. It can be leveraged to infer dynamic social networks, transmission potential in disease systems, consumer–resource interactions, information sharing, and beyond. The method also sets the stage for future predictive models linking observed spatiotemporal interaction patterns to environmental drivers.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

California - Quality-Controlled Reanalysis and Observational Data for Buoy (130), Morro Bay / Derived Data

This collection provides spatiotemporally paired reanalysis and satellite data to supplement the lidar buoy observations during the California deployments. Point time series of observed and reanalysis data are provided, using inverse distance weighting to geolocate the reanalysis data to the buoy location. Gridded time series of reanalysis data are provided, covering the California coast and extending into the Pacific Ocean. Satellite data in the coastal California region are also provided. The reanalysis collection includes the Modern-Era Retrospective Analysis for Research and Applications version 2 (MERRA-2), the Climate Forecast System version 2 (CFSv2), the North American Regional Reanalysis (NARR), the European Centre for Medium-Range Weather Forecasts Reanalysis version 5 (ERA5), and the analysis system of the Rapid Refresh (RAP). The satellite data collection is that of Ribal and Young (2019). All datasets are publicly available with the sources provided in the References section.

17 WIND ENERGY↗