Search NASA⌕ Search

SEARCH · Search NASA

Results for “temporal”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Role of Updraft Velocity in Temporal Variability of Global Cloud Hydrometeor Number

Understanding how dynamical and aerosol inputs affect the temporal variability of hydrometeor formation in climate models will help to explain sources of model diversity in cloud forcing, to provide robust comparisons with data, and, ultimately, to reduce the uncertainty in estimates of the aerosol indirect effect. This variability attribution can be done at various spatial and temporal resolutions with metrics derived from online adjoint sensitivities of droplet and crystal number to relevant inputs. Such metrics are defined and calculated from simulations using the NASA Goddard Earth Observing System Model, Version 5 (GEOS-5) and the National Center for Atmospheric Research Community Atmosphere Model Version 5.1 (CAM5.1). Input updraft velocity fluctuations can explain as much as 48% of temporal variability in output ice crystal number and 61% in droplet number in GEOS-5 and up to 89% of temporal variability in output ice crystal number in CAM5.1. In both models, this vertical velocity attribution depends strongly on altitude. Despite its importance for hydrometeor formation, simulated vertical velocity distributions are rarely evaluated against observations due to the sparsity of relevant data. Coordinated effort by the atmospheric community to develop more consistent, observationally based updraft treatments will help to close this knowledge gap.

cloud condensation nuclei↗

Mapping Pine Plantations in the Southeastern U.S. Using Structural, Spectral, and Temporal Remote Sensing Data

The southeastern U.S. produces the most industrial roundwood in the U.S. each year, largely from commercial pine plantations. The extent of plantation forests and management dynamics can be difficult to ascertain from periodic forest inventories, yet short-rotation tree plantations also present challenges for remote sensing. Here, we integrated spectral, temporal, and structural information from airborne and satellite platforms to distinguish pine plantations from natural forests and evaluate the contribution from planted forests to regional forest coverin the southeastern U.S. Within flight lines from NASA Goddard's Lidar, Hyperspectral, and Thermal (G-LiHT) Airborne Imager, lidar metrics of forest structure had the highest overall accuracy for pine plantations among single-source classifications (90%), but the combination of spectral and temporal metrics from Landsat generated comparable accuracy (91%). Combined structural, temporal, and spectral information from G-LiHT and Landsat had the highest accuracy for plantations (92%) and natural forests (88%). At a regional scale, classifications using Landsat spectral and temporal metrics had between 74 and 82% mean class accuracy for plantations.Regionally, plantations accounted for 28% of forest cover in the southeastern U.S., a result similar to plot-based estimates, albeit with greater spatial detail. Regional maps of plantation forests differed from existing map products, including the National Land Cover Database. Combining plantation extent in 2011 with Landsat based forest change data identified strong regional gradients in plantation dynamics since 1985, with distinct spatial patterns of rotation age (east-west) and plantation expansion (interior). Our analysis demonstrates the potential to improve the characterization of dynamic land cover classes, including economically important timber plantations, by integrating diverse remote sensing datasets. Critically, multi-source remote sensing provides an approach to leverage periodic forest inventory data for annual monitoring of managed forest landscapes.

Fagan, M. E.↗

Design of Safe Separation Bounds for Temporally Deconflicted Trajectories Under Bounded Uncertainties

This paper explores the derivation of safe separation bounds for a heterogeneous group of~$n$ Uncrewed Aerial Systems (UAS) that are assigned temporally deconflicted trajectories. Compared to spatially deconflicted trajectories, temporal deconfliction can lead to higher traffic capacities and a more efficient use of the available airspace. One challenge with this type of deconfliction is that collisions can occur if some cooperating UAS are behind or ahead of schedule. To overcome this risk, this paper derives a lower bound on the safety distance between two heterogeneous UAS in the presence of bounded uncertainties. This safety distance can be leveraged to inform trajectory generation algorithms. The proposed bound establishes a rigorous safety margin when the fleet deviates from the planned trajectories, both temporally and spatially. For its derivation the paper assumes the UAS implement a distributed coordination algorithm that allows the fleet to maintain their schedules synchronized within a bounded temporal error, and a path-following algorithm that lets the vehicles track a target that moves along the planned trajectory with a bounded spatial error.

autonomy↗

How do tradeoffs in satellite spatial and temporal resolution impact snow water equivalent reconstruction?

Given the tradeoffs between spatial and temporal resolution, questions about resolution optimality are fundamental to the study of global snow. Answers to these questions will inform future scientific priorities and mission specifications. Heterogeneity of mountain snowpacks drives a need for daily snow cover mapping at the slope scale (≤30 m) that is unmet for a variety of scientific users, ranging from hydrologists to the military to wildlife biologists. But finer spatial resolution usually requires coarser temporal or spectral resolution. Thus, no single sensor can meet all these needs. Recently, constellations of satellites and fusion techniques have made noteworthy progress. The efficacy of two such recent advances is examined: (1) a fused MODIS–Landsat product with daily 30 m spatial resolution and (2) a harmonized Landsat 8 and Sentinel 2A and B (HLS) product with 3–4 d temporal and 30 m spatial resolution. State-of-the-art spectral unmixing techniques are applied to surface reflectance products from 1 and 2 to create snow cover and albedo maps. Then an energy balance model was run to reconstruct snow water equivalent (SWE). For validation, lidar-based Airborne Snow Observatory SWE estimates were used. Results show that reconstructed SWE forced with 30 m resolution snow cover has lower bias, a measure of basin-wide accuracy, than the baseline case using MODIS (463 m cell size) but greater mean absolute error, a measure of per-pixel accuracy. However, the differences in errors may be within uncertainties from scaling artifacts, e.g., basin boundary delineation. Other explanations are (1) the importance of daily acquisitions and (2) the limitations of downscaled forcings for reconstruction. Conclusions are as follows: (1) spectrally unmixed snow cover and snow albedo from MODIS continue to provide accurate forcings for snow models and (2) finer spatial and temporal resolution through sensor design, fusion techniques, and satellite constellations are the future for Earth observations, but existing moderate-resolution sensors still offer value.

Edward H. Bair↗

Evaluation of Temporal Diagnostic Techniques for Two-Bunch Facet Beam

Three temporal diagnostic techniques are considered for use in the FACET facility at SLAC, which will incorporate a unique two-bunch beam for plasma wakefield acceleration experiments. The results of these experiments will depend strongly on the the inter-bunch spacing as well as the longitudinal profiles of the two bunches. A reliable, singleshot, high resolution measurement of the beam's temporal profile is necessary to fully quantify the physical mechanisms underlying the beam driven plasma wakefield acceleration. In this study we show that a transverse deflecting cavity is the diagnostic which best meets our criteria. Based on our laboratory testing, numerical calculations, and simulations of the three single-shot temporal diagnostic devices, the X-band TCAV system is the best candidate for resolving FACET's two-bunch beam, with an estimated resolution of 7 {micro}m. Both the S-band TCAV system and the EO system could resolve the peak-to-peak separation of the two bunches in the FACET beam with estimated resolutions of 25 {micro}m and 30 {micro}m, respectively, but would be unable to resolve the temporal profiles of the individual bunches themselves. Because the TCAV signal is more easily interpreted and because the reliability of the EO system is less well known, however, the S-band TCAV system would be the next preferred option after the X-band TCAV system. The Fesca-200 streak camera, though simple, compact, and reliable, is unable to achieve a resolution that would be of use to FACET.

43 PARTICLE ACCELERATORS↗

Ultra-Short Electron Bunch and X-Ray Temporal Diagnostics with an X-Band Transverse Deflector

The measurement of ultra-short electron bunches on the femtosecond time scale constitutes a very challenging problem. In X-ray free-electron laser facilities such as the Linac Coherent Light Source (LCLS), generation of sub-ten femtosecond X-ray pulses is possible, and some efforts have been put into both ultra-short electron and X-ray beam diagnostics. Here we propose a single-shot method using a transverse rf deflector (X-band) after the undulator to reconstruct both the electron bunch and X-ray temporal profiles. Simulation studies show that about 1 fs (rms) time resolution may be achievable in the LCLS and is applicable to a wide range of FEL wavelengths and pulse lengths. The jitter, resolution and other related issues will be discussed. The successful operation of the Linac Coherent Light Source (LCLS), with its capability of generating free-electron laser (FEL) X-ray pulses from a few femtoseconds (fs) up to a few hundred fs, opens up vast opportunities for studying atoms and molecules on this unprecedented ultrashort time scale. However, tremendous challenges remain in the measurement and control of these ultrashort pulses with femtosecond precision, for both the electron beam (e-beam) and the X-ray pulses. For ultrashort e-beam bunch length measurements, a standard method has been established at LCLS using an S-band radio-frequency (rf) deflector, which works like a streak camera for electrons and is capable of resolving bunch lengths as short as {approx} 10 fs rms. However, the e-beam with low charges of 20 pC at LCLS, which is expected to be less than 10 fs in duration, is too short to be measured using this transverse deflector. The measurement of the electron bunch length is helpful in estimating the FEL X-ray pulse duration. However, for a realistic beam, such as that with a Gaussian shape or even a spiky profile, the FEL amplification varies along the bunch due to peak current or emittance variation. This will cause differences between the temporal shape or duration of the electron bunch and the X-ray pulse. Initial experiments at LCLS have revealed that characterization of the X-ray pulse duration on a shot-by-shot basis is critical for the interpretation of the data. However, a reliable x-ray pulse temporal diagnostic tool is not available so far at the LCLS. We propose a novel method in this paper to characterize the FEL X-ray pulse duration and shape. A transverse rf deflector is used in conjunction with an e-beam energy spectrometer, located after the FEL undulator. By measuring the difference in the e-beam longitudinal phase space between FEL-on and FEL-off, we can obtain the time-resolved energy loss and energy spread induced from the FEL radiation, allowing the FEL X-ray temporal shape to be reconstructed.

43 PARTICLE ACCELERATORS↗

Higher order treatment on temporal derivative of angular flux for time-dependent MOC

A new kinetic analysis method, whose angular dependence of temporal derivative for angular flux is accurately treated within practical memory requirement, is proposed. The method of characteristics (MOC) is being widely used for reactor analysis thanks to the advances of numerical algorithms and computer hardware. However, the computational resources, i.e., the memory capacity, can be still a crucial problem for rigorous kinetic calculations using MOC. In the straightforward approach for kinetic calculation using MOC, the segment-averaged angular fluxes should be stored on the memory in order to explicitly calculate the temporal derivative of the angular flux, which would require huge memory. Thus, in the conventional kinetic calculation code using MOC, the temporal derivative of the angular flux has been approximated as angularly isotropic in order to reduce the memory requirement (isotropic assumption). However, the approximation error caused by the conventional isotropic assumption has not been thoroughly and quantitatively investigated so far and an accurate kinetic calculation method, which can quantitatively estimate the above approximation error within practical memory storage, has not been developed. The present study tries to address this issue with a newly developed approach. Effect of the approximate treatment for the temporal derivative of angular flux is evaluated through benchmark calculations. (authors)

97 MATHEMATICS AND COMPUTING↗

Spatio-Temporal Signal Twice-Whitening Algorithms on the hx3100 Ultra-Low Power Multicore Processor

While modern signal detection theory fully accounts for spatially distributed sensors, exploiting these techniques for real-time sensing using large, underwater acoustic arrays requires advances in the spatio-temporal signal processing algorithms. In particular, the computational complexity of many spatio-temporal processing techniques is so large that conventional computer processors lack sufficient throughput to provide real-time processing of large spatio-temporal data sets. These limits are exacerbated when constraints, such as power consumption or footprint, reduce the available computational resources. In this report, we demonstrate an implementation of a signal twice-whitening algorithm that is better suited for processing spatio-temporal data in real time. We emphasize these advances by implementing data whitening on the Coherent Logix hx3100 processor, a programmable multicore processor intended for low-power and high-throughput signal processing. These results serve as an example of how the novel capabilities available from emerging multicore processor platforms can provide real-time, software-defined processing of large data sets acquired by spatially distributed sensing.

99 GENERAL AND MISCELLANEOUS↗

A staged deep learning approach to spatial refinement in 3D temporal atmospheric transport

High-resolution spatiotemporal simulations effectively capture the complexities of atmospheric plume dispersion in complex terrain. However, their high computational cost makes them impractical for applications requiring rapid responses or iterative processes, such as optimization, uncertainty quantification, or inverse modeling. To address this challenge, this work introduces the Dual-Stage Temporal Three-dimensional UNet Super-resolution (DST3D-UNet-SR) model, a highly efficient deep learning model for plume dispersion predictions. DST3D-UNet-SR is composed of two sequential modules: the temporal module (TM), which predicts the transient evolution of a plume in complex terrain from low-resolution temporal data, and the spatial refinement module (SRM), which subsequently enhances the spatial resolution of the TM predictions. We train DST3D-UNet-SR using a comprehensive dataset derived from high-resolution large eddy simulations (LES) of plume transport. We propose the DST3D-UNet-SR model to significantly accelerate LES of three-dimensional (3D) plume dispersion by three orders of magnitude. Additionally, the model demonstrates the ability to dynamically adapt to evolving conditions through the incorporation of new observational data, substantially improving prediction accuracy in high-concentration regions near the source.

3D temporal sequences↗

A semiparametric latent factor model for large scale temporal data with heteroscedasticity

Large scale temporal data have flourished in a vast array of applications, and their sophisticated structures, especially the heteroscedasticity among subjects with inter- and intra-temporal dependence, have fueled a great demand for new statistical models. In this paper, with covariate information, we consider a flexible model for large scale temporal data with subject-specific heteroscedasticity. Formally, the model employs latent semiparametric factors to simultaneously account for the subject-specific heteroscedasticity and the contemporaneous and/or serial correlations. The subject-specific heteroscedasticity is modeled as the product of the unobserved factor process and subject’s covariate effect, which is further characterized via additive models. For estimation, we propose a two-step procedure. First, the latent factor process and nonparametric loading are recovered through projection-based methods, and following, we estimate the regression components by approaches motivated from the generalized least squares. By scrupulously examining the non-asymptotic rates for recovering the factor process and its loading, we show the consistency and efficiency of estimated regression coefficients in the absence of prior knowledge of latent factor process and subject’s covariate effect. Here, the statistical guarantees remain valid even for finite time points that makes our method particularly appealing when the subjects significantly outnumber the observation time points. Using comprehensive simulations, we demonstrate the finite sample performance of our method, which corroborates the theoretical findings. Finally, we apply our method to a data set of air quality and energy consumption collected at 129 monitoring sites in the United States in 2015.

97 MATHEMATICS AND COMPUTING↗

A semiparametric spatio-temporal model for solar irradiance data

Here, we evaluate semiparametric spatio-temporal models for global horizontal irradiance at high spatial and temporal resolution. These models represent the spatial domain as a lattice and are capable of predicting irradiance at lattice points, given data measured at other lattice points. Using data from a 1.2 MW PV plant located in Lanai, Hawaii, we show that a semiparametric model can be more accurate than simple interpolation between sensor locations. We investigate spatio-temporal models with separable and nonseparable covariance structures and find no evidence to support assuming a separable covariance structure. These results indicate a promising approach for modeling irradiance at high spatial resolution consistent with available ground-based measurements. Moreover, this kind of modeling may find application in design, valuation, and operation of fleets of utility-scale photovoltaic power systems.

14 SOLAR ENERGY↗

Temporal dynamics of hot desert microbial communities reveal structural and functional responses to water input

The temporal dynamics of desert soil microbial communities are poorly understood. Given the implications for ecosystem functioning under a global change scenario, a better understanding of desert microbial community stability is crucial. Here, we sampled soils in the central Namib Desert on sixteen different occasions over a one-year period. Using Illumina-based amplicon sequencing of the 16S rRNA gene, we found that α-diversity (richness) was more variable at a given sampling date (spatial variability) than over the course of one year (temporal variability). Community composition remained essentially unchanged across the first 10 months, indicating that spatial sampling might be more important than temporal sampling when assessing β-diversity patterns in desert soils. However, a major shift in microbial community composition was found following a single precipitation event. This shift in composition was associated with a rapid increase in CO2 respiration and productivity, supporting the view that desert soil microbial communities respond rapidly to re-wetting and that this response may be the result of both taxon-specific selection and changes in the availability or accessibility of organic substrates. Recovery to quasi pre-disturbance community composition was achieved within one month after rainfall.

desert soil↗

A Statistician’s Overview of Physics-Informed Neural Networks for Spatio-Temporal Data

The recent success of deep neural network models with physical constraints (so-called, Physics-Informed Neural Networks, PINNs) has led to renewed interest in the incorporation of mechanistic information in predictive models. Statisticians and others have long been interested in this problem, which has led to several practical and innovative solutions dating back decades. In this overview, we focus on the problem of data-driven prediction and inference of dynamic spatio-temporal processes that include mechanistic information, such as would be available from partial differential equations, with a strong focus on the quantification of uncertainty associated with data, process, and parameters. Here, we give a brief review of several paradigms and focus our attention on Bayesian implementations given they naturally accommodate uncertainty quantification. We then show that it is straight-forward to include the Bayesian PINN (B-PINN) within the Bayesian hierarchical model (BHM) framework that has long been considered for modeling dynamic spatio-temporal processes. Such a BHM-PINN is illustrated via a simulation study in which a latent nonlinear Burgers’ equation PDE governs the dynamics of Poisson distributed spatio-temporal data. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.

Bayesian↗

Time-series RNA metabarcoding of the active Populus tremuloides root microbiome reveals hidden temporal dynamics and dormant core members

The rhizosphere is a critical interface between plant roots and soil, harboring diverse microbial communities that are essential to plant and ecosystem health. Although these communities exhibit stark temporal dynamics, their dormancy/activity transitions remain poorly understood. Such transitions may enable microbes to rapidly adjust functional contributions faster than community turnover alone would allow. Here, we used RNA metabarcoding to characterize the active fraction of microbial communities on the roots of quaking aspen (Populus tremuloides) in a time-series study across a natural environmental gradient. We explore cryptic temporal microbial community dynamics of rhizosphere communities at the ecosystem scale. The active rhizosphere bacterial and fungal communities were more temporally dynamic than total communities, while total communities exhibited a stronger response to site-specific conditions. Notably, some core microbiome members were often inactive, yielding a smaller “active core” subset. The fungal endophyte Hyaloscypha finlandica was the only microbe that was both present and active in all plots across all timepoints. Soil temperature strongly influenced both total and active community composition, with the fungal class Eurotiomycetes showing a temperature-dependent seasonal decline in abundance. Together, these results reveal that modulation of microbial activity levels is a key mechanism by which the plant root holobiont responds to environmental variation, and that even dominant symbionts may frequently persist in dormancy within the rhizosphere.

Community Structure and Diversity↗

Robust Importance Sampling for Bayesian Model Calibration with Spatio-Temporal Data

This paper addresses two challenges in Bayesian calibration: 1) computational speed of existing sampling algorithms, and 2) calibration with spatio-temporal responses. The commonly used Markov Chain Monte Carlo (MCMC) approaches require many sequential model evaluations making the computational expense prohibitive. This paper proposes an efficient sampling algorithm: iterative importance sampling with genetic algorithm (IISGA). While iterative importance sampling enables computational efficiency, the genetic algorithm enables robustness by preventing sample degeneration and avoids getting stuck in multimodal search spaces. An inflated likelihood further enables robustness in high-dimensional parameter spaces by enlarging the target distribution. Spatio-temporal data complicate both surrogate modeling, which is necessary for expensive computational models, and the likelihood estimation. In this work, singular value decomposition is investigated for reducing the high-dimensional field data to a lower-dimensional space prior to Bayesian calibration. Then the likelihood is formulated and Bayesian inference is performed in the lower-dimension, latent space. An illustrative example is provided to demonstrate IISGA relative to existing sampling methods, and then IISGA is employed to calibrate a thermal battery model with 26 uncertain calibration parameters and spatio-temporal response data.

97 MATHEMATICS AND COMPUTING↗

Seismic Analysis of Spatio-Temporal Fracture Generation During EGS Resource Development

This DOE GTO funded project was a collaborative effort between Array Information Technology and the University of California at Berkeley. The project goal is to improve technology to assess in-situ stress magnitude and orientation, kinematic fracture parameters, rupture size, rupture orientation as well as temporal changes and volumetric distribution of the injected fluid during Enhanced Geothermal System (EGS) resource development. The project leveraged high-frequency seismic data recorded by the LBNL 34-station permanent geophone network and seismic broadband data recorded by a temporary 33-station seismometer network that operated in The Geysers during the injection phase of the DOE GTO funded EGS demonstration project at the well Prati-32. The operation of the broadband network with high station density and good azimuthal coverage to monitor the injection phase produced an unprecedented dataset that is typically unavailable for EGS operations. The two datasets offer the advantages of studying the parameters under investigation over a broader frequency band and the higher sensitivity of the broadband seismometers resulted in a richer dataset with a lower magnitude of completeness. Moment tensor (MT) inversion have been employed to develop a catalog of earthquake source solutions including moment tensor and finite source rupture area. This resulted in a 168-event waveform-based seismic moment tensor catalog for events 0.7≤Mw≤3.9 based on a semi-automated moment tensor analysis technique. The MT solutions were used for in-situ stress estimation during the EGS injection phases. We found an approximate 15-degree counterclockwise rotation of the least compressive stress sigma-3, and a rotation of the maximum compressive stress sigma-1 toward the vertical as the injected volume of water increased. We developed a rupture-area magnitude scaling relationship of The Geysers earthquakes obtained from finite-source inversion for fault slip that reveals a very high correlation to published results. Based on the rupture area-magnitude relationship we mapped Mw from the LBNL earthquake catalog to estimate the activated fracture area, its location and orientation within the injection volume of Prati-32. The double-difference Wadati (DDW) technique was applied to high-accuracy P- and S-wave differential travel times derived from waveform cross correlation to image fluid saturation in the subsurface based on Vp/Vs-ratio. The recently developed technique has been applied to estimate temporal changes of fluid distribution in fault zones and in volcanic regions but not yet in engineered geo-reservoirs. The improvement of the technology includes high-resolution waveform cross correlation applied to the high-quality datasets with lower magnitude of completeness resulting in a higher number of recorded events. The improvement allowed to estimate both, the spatial and temporal distribution of injected fluids and the state of the injected fluid during reservoir stimulation. Results of the DDW analysis revealed the development of an injection-derived steam plume during the early injection phase, particularly in the northern part of the Prati-32 study area.

15 GEOTHERMAL ENERGY↗

Exploring Multidimensional Spatial-Temporal Hydropower Operational Flexibilities by Modeling and Optimizing Water-Constrained Cascading Hydroelectric Systems

Because of unique characteristics such as clean and cost-competitive electricity as well as fast-ramping and storage abilities, the power industry continues to evolve its operation strategies for cascading hydroelectric (CHE) systems for providing enhanced values to the grid, especially under the deeper renewable resource integration. However, existing operation practices of CHEs predate the integration of renewables, which could prohibit the effective utilization of their inherent flexibilities in delivering maximum financial benefits and providing valuable grid services to the power system and electricity market operations. Indeed, modeling and optimizing these resource-limited while flexible CHE assets with uncertainties and imperfect information across multiple spatial-temporal dimensions present significant challenges. To facilitate CHE facility operators in effectively coordinating water usage and hydropower plant operations across multiple timescales, this project aims to fill the existing gaps by developing a suite of accurate water inflow (WI) forecast models as well as enhanced CHE modeling and optimization approaches with proper consideration of their unique characteristics, which would help explore their multidimensional spatial-temporal operational flexibility potentials. The developed approaches could better align reservoir operation strategies with variability and uncertainty of future water availability. They can also promote more effective utilization of multidimensional spatial-temporal hydropower operational flexibility potentials by designing long-term evacuation plans of reservoirs and short-term operation of CHEs, along with their coordination with other types of renewables. The project leverages various resources to facilitate the research and development activities, including actual characteristics data of CHE systems and a library of current and future cases of Portland General Electric (PGE). These realistic data enable the project team to study how to maximize the value of CHEs under current and future portfolios and evaluate opportunities to improve operation practices.

13 HYDRO ENERGY↗

A Lightweight I/O Scheme to Facilitate Spatial and Temporal Queries of Scientific Data Analytics

In the era of petascale computing, more scientific applications are being deployed on leadership scale computing platforms to enhance the scientific productivity. Many I/O techniques have been designed to address the growing I/O bottleneck on large-scale systems by handling massive scientific data in a holistic manner. While such techniques have been leveraged in a wide range of applications, they have not been shown as adequate for many mission critical applications, particularly in data post-processing stage. One of the examples is that some scientific applications generate datasets composed of a vast amount of small data elements that are organized along many spatial and temporal dimensions but require sophisticated data analytics on one or more dimensions. Including such dimensional knowledge into data organization can be beneficial to the efficiency of data post-processing, which is often missing from exiting I/O techniques. In this study, we propose a novel I/O scheme named STAR (Spatial and Temporal AggRegation) to enable high performance data queries for scientific analytics. STAR is able to dive into the massive data, identify the spatial and temporal relationships among data variables, and accordingly organize them into an optimized multi-dimensional data structure before storing to the storage. This technique not only facilitates the common access patterns of data analytics, but also further reduces the application turnaround time. In particular, STAR is able to enable efficient data queries along the time dimension, a practice common in scientific analytics but not yet supported by existing I/O techniques. In our case study with a critical climate modeling application GEOS-5, the experimental results on Jaguar supercomputer demonstrate an improvement up to 73 times for the read performance compared to the original I/O method.

Temporal Queries↗