Search NASA⌕ Search

SEARCH · Search NASA

Results for “Time Series Prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

A species’ response to spatial climatic variation does not predict its response to climate change

The dominant paradigm for assessing ecological responses to climate change assumes that future states of individuals and populations can be predicted by current, species-wide performance variation across spatial climatic gradients. However, if the fates of ecological systems are better predicted by past responses to in situ climatic variation through time, this current analytical paradigm may be severely misleading. Empirically testing whether spatial or temporal climate responses better predict how species respond to climate change has been elusive, largely due to restrictive data requirements. Here, we leverage a newly collected network of ponderosa pine tree-ring time series to test whether statistically inferred responses to spatial versus temporal climatic variation better predict how trees have responded to recent climate change. When compared to observed tree growth responses to climate change since 1980, predictions derived from spatial climatic variation were wrong in both magnitude and direction. This was not the case for predictions derived from climatic variation through time, which were able to replicate observed responses well. Future climate scenarios through the end of the 21st century exacerbated these disparities. These results suggest that the currently dominant paradigm of forecasting the ecological impacts of climate change based on spatial climatic variation may be severely misleading over decadal to centennial timescales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

BASIN-3D: A brokering framework to integrate diverse environmental data

Diverse observational and simulation datasets are needed to understand and predict complex ecosystem behavior over seasonal to decadal and century time-scales. Integration of these datasets poses a major barrier towards advancing environmental science, particularly due to differences in the structure and formats of data provided by various sources. Here, we describe BASIN-3D (Broker for Assimilation, Synthesis and Integration of eNvironmental Diverse, Distributed Datasets), a data integration framework designed to dynamically retrieve and transform heterogeneous data from different sources into a common format to provide an integrated view. BASIN-3D enables users to adopt a standardized approach for data retrieval and avoid customizations for the data type or source. We demonstrate the value of BASIN-3D with two use cases that require integration of data from regional to watershed spatial scales. The first application uses the BASIN-3D Python library to integrate time-series hydrological and meteorological data to provide standardized inputs to analytical and machine learning codes in order to predict the impacts of hydrological disturbances on large river corridors of the United States. The second application uses the BASIN-3D Django framework to integrate diverse time-series data in a mountainous watershed in East River, Colorado, United States to enable scientific researchers to explore and download data through an interactive web portal. Thus, BASIN-3D can be used to support data integration for both web-based tools, as well as data analytics using Python scripting and extensions like Jupyter notebooks. The framework is expected to be transferable to and useful for many other field and modeling studies.

Varadharajan, C↗
DOE OSTI2021

Challenging problems of quality assurance and quality control (QA/QC) of meteorological time series data

Abstract Representativeness and quality of collected meteorological data impact accuracy and precision of climate, hydrological, and biogeochemical analyses and predictions. We developed a comprehensive Quality Assurance (QA) and Quality Control (QC) statistical framework, consisting of three major phases: Phase I—Preliminary data exploration, i.e., processing of raw datasets, with the challenging problems of time formatting and combining datasets of different lengths and different time intervals; Phase II—QA of the datasets, including detecting and flagging of duplicates, outliers, and extreme data; and Phase III—the development of time series of a desired frequency, imputation of missing values, visualization and a final statistical summary. The paper includes two use cases based on the time series data collected at the Billy Barr meteorological station (East River Watershed, Colorado), and the Barro Colorado Island (BCI, Panama) meteorological station. The developed statistical framework is suitable for both real-time and post-data-collection QA/QC analysis of meteorological datasets.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Machine learning surrogate of physics-based building-stock simulator for end-use load forecasting

Building energy models are used to simulate heat and mass transfer and estimate end-use load in buildings. With the proliferation of solar photovoltaics on residential and commercial buildings, increasingly, buildings are expected to provide grid services, for which accurate and computationally efficient building energy simulations and end-use load prediction are imperative. Existing building energy simulation tools, however, have significant computational overhead that make them less practical in real-time deployment for optimization, design, uncertainty quantification and control in building energy management systems. Here this article presents a data-driven machine learning model based on light gradient boosting method (LightGBM) as a surrogate for a physics-based simulator for residential buildings to predict end-use load. The machine learning based surrogate model accounts for time-series related variables, seasonality and trend component of end-use load, and history of end-use load. The accuracy of the surrogate model is assessed on the prediction of the load profiles of 100 different houses in Cook County, Illinois, USA. The LightGBM surrogate model is shown to reduce the root-mean-squared error by 53% relative to a reference decision tree (DT) based model reported previously in the literature. Moreover, the model predicts the load spikes and high-ramp rate events throughout the year which are often the Achilles heel of other models in the literature. The machine learning based surrogate model is demonstrated to be computationally efficient, with a ten-fold reduction in the computational time compared to a physics-based building energy simulation, and suitable for uncertainty analysis and real-time control of building characteristics in response to uncertainty.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Generalized and Mechanistic PV Module Performance Prediction From Computer Vision and Machine Learning on Electroluminescence Images

Electroluminescence (EL) imaging of photovoltiac (PV) modules offers high-speed, high-resolution information about device performance, affording opportunities for greater insight and efficiency in module characterization across manufacturing, research and development, and power plant operations and management. Predicting module electrical properties from EL image features is a critical step toward these applications. In this article, we demonstrate quantification of both generalized and performance mechanism-specific EL image features, using pixel intensity-based and machine learning classification algorithms. From EL image features, we build predictive models for PV module power and series resistance, using time-series current-voltage (I-V) and EL data obtained stepwise on five brands of modules spanning three Si cell types through two accelerated exposures: damp heat (DH) (85°C/85% RH) and thermal cycling (TC) (IEC 61215). Overall, 195 pairs of EL images and I-V characteristics were analyzed, yielding 11700 individual PV cell images. A convolutional neural network was built to classify cells by the severity of busbar corrosion with high accuracy (95%). Generalized power predictive models estimated the maximum power of PV modules from EL images with high confidence and an adjusted-R 2 of 0.88, across all module brands and cell types in extended DH and TC exposures. Mechanistic degradation prediction was demonstrated by quantification of busbar corrosion in EL images of three module brands in DH, and subsequent modeling of series resistance using these mechanism-specific EL image features. For modules exhibiting busbar corrosion, we demonstrated series resistance predictive models with adjusted-R 2 of up to 0.73.

14 SOLAR ENERGY↗
DOE OSTI2025

Hydrologic Model Data for the East Fork Poplar Creek Watershed Simulated with the Advanced Terrestrial Simulator (ATS): Streamflow and Network Expansion–Contraction Dynamics

This dataset supports hydrologic modeling and stream network expansion–contraction analysis for the East Fork Poplar Creek (EFPC) Watershed in Tennessee. It includes a Jupyter notebook for model setup, model configuration files, simulation outputs, and derived products used to evaluate model performance and investigate stream dynamics under varying hydrologic conditions. The dataset was generated using the Watershed Workflow Python package and the Advanced Terrestrial Simulator (ATS), enabling integrated surface–subsurface hydrologic simulations using a stream-aligned mesh. Outputs include high-resolution time series of streamflow, active network length, water table depth, and related hydrologic variables. Also included are spatially explicit stream persistency indices and classifications of reaches as perennial or non-perennial. These data facilitate reproducibility and support further research on stream intermittency and variability in network extent.The model data archive is organized in following directories:1) model_setup_inputsContains the Watershed Workflow Jupyter notebooks (accessed through any open source code editor), selected input datasets, and resulting ATS input files, including XML files (access through any open source code editor), computational mesh (.exo files can be viewed using Paraview), and meteorological forcing files (.h5 files can be accessed through h5py python package and HDFView open source software). 2) model_outputsIncludes ATS simulation outputs relevant to this study. Time series of spatially integrated or averaged variables (e.g., streamflow, water table depth) are provided as CSV files. Select spatial fields (e.g., ponded depth and water table depth) are saved as pickled Python objects to reduce file size, and can be accessed through pickle package in Python. Key geometry objects from Watershed Workflow—such as the surface mesh and river tree—are also included to support analysis of streamflow persistency and expansion–contraction dynamics. These files can also be accessed through Watershed Workflow Python package.3) model_evaluationProvides observed streamflow time series and field survey-based flow regime classifications used to evaluate model performance. Jupyter notebooks for processing ATS outputs and comparing model predictions with observations to build confidence in the model prior to scientific analysis are also included.4) Q_L_relationshipsContains workflows for generating time series of discharge, active network length, and related hydrologic variables used in the stream network expansion–contraction analysis. Includes routines for delineating baseflow-dominated periods. For each catchment, notebooks and processed data (as pickled DataFrames accessed through Pandas Python package) are provided. 5) figure_scriptsProvides the Jupyter notebooks used to generate the figures presented in the paper.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Deterministic incident-wave elevation prediction in intermediate water depth

Potential performance gains from optimal (non-causal) impedance-matching control of wave energy devices in irregular ocean waves are dependent on deterministic wave elevation prediction techniques that work well in practical applications. Although a number of devices are designed for operation in intermediate water depths, little work has been reported on deterministic wave prediction in such depths. Here, we investigated a deterministic wave-prediction technique based on an approximate propagation model that leads to an analytical formulation, which may be convenient to implement in practice. To improve accuracy, an approach to combine predictions based on multiple up-wave measurement points is evaluated. The overall method is tested using experimental time-series measurements recorded in the U.S. Navy MASK basin in Carderock, MD, USA. For comparison, an alternative prediction approach based on Fourier coefficients is also tested with the same data. Comparison of prediction approaches with direct measurements suggest room for improvement. Possible sources of error including tank reflections are estimated, and potential mitigation approaches are discussed.

16 TIDAL AND WAVE POWER↗
DOE OSTI2020

Automated fault detection of residential air-conditioning systems using thermostat drive cycles

Residential air conditioning equipment comprises a significant portion of the total energy consumption of a home. Unfortunately, air-conditioning systems can be susceptible to faulty operation either from installation errors or faults that accrue over the equipment’s lifetime. This paper presents a novel automated fault detection algorithm for residential air-conditioning systems that can alert the homeowner of the presence of these faults. The proposed algorithm utilizes only the home’s thermostat and outside air temperature to perform automated fault detection over the course of the equipment’s lifetime, including immediately after installation. The algorithm uses an extended Kalman filter approach to identify a three-resistor, two-capacitor (3R2C) electrical equivalent thermodynamic model. The identified 3R2C model is used to predict cooling times during a testing period comprising of a series of thermostat drive-cycle experiments. We tested the algorithm on an EnergyPlus™ model of a typical residential building in Orlando, Florida. Duct faults, indoor airflow faults, and refrigerant undercharge faults were introduced into the building model one at a time. The algorithm was able to accurately determine duct-leak faults, 40% airflow faults, 40% undercharge faults, and no-fault cases with an accuracy of 70%, 77%, 82%, and 87%, respectively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Autotrophic and mixotrophic metabolism of an anammox bacterium revealed by in vivo 13 C and 2 H metabolic network mapping

Anaerobic ammonium-oxidizing (anammox) bacteria mediate a key step in the biogeochemical nitrogen cycle and have been applied worldwide for the energy-efficient removal of nitrogen from wastewater. However, outside their core energy metabolism, little is known about the metabolic networks driving anammox bacterial anabolism and use of different carbon and energy substrates beyond genome-based predictions. Here, we experimentally resolved the central carbon metabolism of the anammox bacterium Candidatus ‘Kuenenia stuttgartiensis’ using time-series 13 C and 2 H isotope tracing, metabolomics, and isotopically nonstationary metabolic flux analysis. Our findings confirm predicted metabolic pathways used for CO 2 fixation, central metabolism, and amino acid biosynthesis in K. stuttgartiensis , and reveal several instances where genomic predictions are not supported by in vivo metabolic fluxes. This includes the use of the oxidative branch of an incomplete tricarboxylic acid cycle for alpha-ketoglutarate biosynthesis, despite the genome not having an annotated citrate synthase. We also demonstrate that K. stuttgartiensis is able to directly assimilate extracellular formate via the Wood–Ljungdahl pathway instead of oxidizing it completely to CO 2 followed by reassimilation. In contrast, our data suggest that K. stuttgartiensis is not capable of using acetate as a carbon or energy source in situ and that acetate oxidation occurred via the metabolic activity of a low-abundance microorganism in the bioreactor’s side population. Together, these findings provide a foundation for understanding the carbon metabolism of anammox bacteria at a systems-level and will inform future studies aimed at elucidating factors governing their function and niche differentiation in natural and engineered ecosystems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Multimodal sensor fusion framework for residential building occupancy detection

For several years now, smart building energy systems have been a research area of intensive activity. In light of the increasing need for sustainable buildings and energy systems, this trend motivates an increasing need for a solution to reduce carbon dioxide emissions and improve energy efficiency. This work proposes a high-performing and transferable occupancy detection framework that combines sensor data from different data modalities, including time series environmental data (temperature, humidity, and illuminance), image data, and acoustic energy data using ensemble method. To draw out the best prediction performance in each modality, the proposed framework was developed, including various models that were designed to learn the occupancy patterns reflected in the physical data streams. To tackle the time series environmental data, we designed two variants of an occupancy detection spatiotemporal pattern network (Occ-STPN) that performs both feature level and decision level fusion, respectively. We also propose a new metric; the fading memory mean square error (FMMSE), that provides a fair evaluation and penalization of delayed occupancy predictions. Multiple open-sourced datasets, including the Electricity Consumption and Occupancy and the University of California, Irvine's (UCI) building occupancy detection dataset, along with our own real data collected from six different houses, were used to validate the algorithms' performance. The experimental results presented herein break down the performance for each sensing modality, and a detailed analysis of the performance is also discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Sub-daily virus sampling at the Bermuda Atlantic Time Series reveals diel and depth-structured population dynamics without community-level shifts

Ocean microbes contribute to biogeochemical cycles and ecosystem function, but they do so under top-down pressure imposed by viruses. While viruses are increasingly understood spatially and beginning to be incorporated into predictive modeling, high-frequency ocean virus dynamics remain understudied due to methodological challenges. Here we sampled stratified Bermuda Atlantic Time Series (BATS) waters for 112 hours at sub-daily 4- (surface) or 12- (deep chlorophyll maximum) hour intervals, purified viral particles from these samples, sequenced their metagenomes, and used the resulting data to characterize high-frequency virus community dynamics. Aggregated community diversity metrics changed with depth, but were not statistically significant temporally at a fixed location. However, finer-scale population-level analyses revealed both depth and temporal change, including physicochemical depth-driven differences and, in surface waters, thousands of viral populations that exhibited statistically significant diel rhythms. Statistical analyses revealed three main archetypes of temporal dynamics that themselves differed in abundance patterns, host predictions, viral taxonomy, and gene functions. Among these, highlights include viruses resembling an archetype with a night peaking pattern in activity that include an over-representation of viruses that putatively infect Prochlorococcus, a phototrophic cyanobacteria. Together, these efforts provide baseline community- and population-scale short-time-frame observations relevant to future climate state modeling.

Carrillo, Alfonso [The Ohio State University, Colu↗
DOE OSTI2026

Safe Deep Reinforcement Learning for Active Distribution System Model Predictive Control with EVs and DERs

The temporal and spatial mismatch between PV generation and electric vehicle (EV) charging and discharging may cause voltage violations in active distribution networks. Despite the widespread use of deep reinforcement learning (DRL) in power system optimization and control, it lacks guarantees on constraint satisfaction during both training and deployment. This paper proposes a Lagrangian-based safe DRL approach for model predictive control (MPC) of active distribution systems with large-scale integration of PVs, EVs, and energy storage systems (ESSs). A Transformer-LSTM time-series model is proposed to forecast EV charging demand, which is then formulated as a constraint to ensure charging requirements are met. Using this prediction, a Lagrangian-based safe soft actor-critic (SAC) framework is developed for real-time control in a three-phase unbalanced distribution system, enforcing voltage safety constraints while optimizing the cumulative net reward. By integrating the forecasting model with multi-period constraints, the proposed framework jointly coordinates PV systems, EV charging and discharging, and ESS scheduling within the MPC horizon. Numerical experiments on a modified IEEE 123-bus system with real-world data show that, under a high PV penetration scenario, the proposed method increases the net reward by 30.74% and reduces average voltage violations from 0.0011 p.u. to 0.0002 p.u. compared with standard SAC. Compared with the optimal power flow (OPF) approach, it achieves similar voltage security while yielding lower line losses. It also maintains real-time control capability, reducing operation latency to 53.21 ms per 15-minute control interval. The proposed method remains effective under varying PV/EV penetrations and load conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

The L-CAPE Project at FNAL

The controls system at FNAL records data asynchronously from several thousand Linac devices at their respective cadences, ranging from 15Hz down to once per minute. In case of downtimes, current operations are mostly reactive, investigating the cause of an outage and labeling it after the fact. However, as one of the most upstream systems at the FNAL accelerator complex, the Linac’s foreknowledge of an impending downtime as well as its duration could prompt downstream systems to go into standby, potentially leading to energy savings. The goals of the Linac Condition Anomaly Prediction of Emergence (L-CAPE) project that started in late 2020 are (1) to apply data-analytic methods to improve the information that is available to operators in the control room, and (2) to use machine learning to automate the labeling of outage types as they occur and discover patterns in the data that could lead to the prediction of outages. We present an overview of the challenges in dealing with time-series data from 2000+ devices, our approach to developing an ML-based automated outage labeling system, and the status of augmenting operations by identifying the most likely devices predicting an outage.

43 PARTICLE ACCELERATORS↗
DOE OSTI2022

Monitoring of Temperature Measurements for Different Flow Regimes in Water and Galinstan with Long Short-Term Memory Networks and Transfer Learning of Sensors

Temperature sensing is one of the most common measurements of a nuclear reactor monitoring system. The coolant fluid flow in a reactor core depends on the reactor power state. We investigated the monitoring and estimation of the thermocouple time series using machine learning for a range of flow regimes. Measurement data were obtained, in two separate experiments, in a flow loop filled with water and with liquid metal Galinstan. We developed long short-term memory (LSTM) recurrent neural networks (RNNs) for sensor predictions by training on the sensor’s own prior history, and transfer learning LSTM (TL-LSTM) by training on a correlated sensor’s prior history. Sensor cross-correlations were identified by calculating the Pearson correlation coefficient of the time series. The accuracy of LSTM and TL-LSTM predictions of temperature was studied as a function of Reynolds number (Re). The root-mean-square error (RMSE) for the test segment of time series of each sensor was shown to linearly increase with Re for both water and Galinstan fluids. Using linear correlations, we estimated the range of values of Re for which RMSE is smaller than the thermocouple measurement uncertainty. For both water and Galinstan fluids, we showed that both LSTM and TL-LSTM provide reliable estimations of temperature for typical flow regimes in a nuclear reactor. The LSTM runtime was shown to be substantially smaller than the data acquisition rate, which allows for performing estimation and validation of sensor measurements in real time.

Pantopoulou, Stella↗
DOE OSTI2024

Complexity-calibrated benchmarks for machine learning reveal when prediction algorithms succeed and mislead

Abstract Recurrent neural networks are used to forecast time series in finance, climate, language, and from many other domains. Reservoir computers are a particularly easily trainable form of recurrent neural network. Recently, a “next-generation” reservoir computer was introduced in which the memory trace involves only a finite number of previous symbols. We explore the inherent limitations of finite-past memory traces in this intriguing proposal. A lower bound from Fano’s inequality shows that, on highly non-Markovian processes generated by large probabilistic state machines, next-generation reservoir computers with reasonably long memory traces have an error probability that is at least $$\sim 60\%$$ ∼ 60 % higher than the minimal attainable error probability in predicting the next observation. More generally, it appears that popular recurrent neural networks fall far short of optimally predicting such complex processes. These results highlight the need for a new generation of optimized recurrent neural network architectures. Alongside this finding, we present concentration-of-measure results for randomly-generated but complex processes. One conclusion is that large probabilistic state machines—specifically, large $$\epsilon$$ ϵ -machines—are key to generating challenging and structurally-unbiased stimuli for ground-truthing recurrent neural network architectures.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

An Assessment of the Influence of Uncertainty in Temporally Evolving Streamflow Forecasts on Riverine Inundation Modeling

Continental-scale river forecasting platforms forecast streamflow at reaches that can be used as boundary conditions to drive a local-scale flood inundation model. Uncertainty accumulated during this process stems not only from any part of the forecasting chain but can also be caused by the daily variations in weather forcing that keeps evolving as the event advances. This work aims to examine the influence of the evolving forecast streamflow on predicting the maximum inundation for extreme floods. A diagnostic case study was made on the basis of a hindcast of Hurricane Matthew striking the eastern U.S. in 2016. The U.S. National Water Model was one-way coupled to a hydrodynamic inundation model through a developed automated workflow. Although the river forcing has significantly mismatched hydrographs versus observations, the simulated peak water surface elevations and maximum extents were validated to be comparable with the observations, which indicates that the inundation model may not be sensitive to the inherited uncertainty from the weather forcing. Moreover, the uncertainty of the forecast streamflow time series caused only one order of magnitude fewer variations in inundation prediction; this dampening effect may become clearer for extreme events with large areas inundated. In addition, the forecast total volume of stream discharge appears to be an important metric for assessing the performance of river forcing for inundation mapping, as a linear correlation between the total volume and the accuracy of the predicted peak water surface elevation and maximum extent was found, with the coefficients of determination all above 0.8. Extra best-practice experience of running similar operational tasks demonstrated the tradeoff between the cost and accuracy gain.

flood, national water model, RIFT↗
DOE OSTI2024

Probabilistic data fusion and physics-informed machine learning: A new paradigm for modeling under uncertainty, and its application to accelerating the discovery of new materials

In this report we summarize the work conducted by PI Perdikaris and his group under this Early Career project DE–SC0019116 during the period of 09/01/2018 – 08/31/2023. The central aim of the work was to introduce a new paradigm for scientific data analysis that can seamlessly synthesize rigorous mathematical modeling with data of variable fidelity (e.g., measurements at multiple scales/resolutions or predictions of variable fidelity models) and multiple modalities (e.g., images, time–series, or scattered measurements). The setting we are interested in involves complex systems that are partially observed and whose dynamical behavior could be hard to model or totally unknown. The inherent uncertainty associated with this setting necessitates a departure from the classical deterministic realm of modeling and scientific computation, and, consequently, our main building blocks can no longer be crisp deterministic numbers and governing laws, but instead we must operate with probabilistic models.

97 MATHEMATICS AND COMPUTING↗