Search NASA⌕ Search

SEARCH · Search NASA

Results for “TIME SERIES”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Trend Detection of Atmospheric Time Series: Incorporating Appropriate Uncertainty Estimates and Handling Extreme Events

This paper is aimed at atmospheric scientists without formal training in statistical theory. Its goal is to, 1) provide a critical review of the rationale for trend analysis of the time series typically encountered in the field of atmospheric chemistry; 2) describe a range of trend-detection methods; and 3) demonstrate effective means of conveying the results to a general audience. Trend detections in atmospheric chemical composition data are often challenged by a variety of sources of uncertainty, which often behave differently to other environmental phenomena such as temperature, precipitation rate, or stream flow, and may require specific methods depending on the science questions to be addressed. Some sources of uncertainty can be explicitly included in the model specification, such as autocorrelation and seasonality, but some inherent uncertainties are difficult to quantify, such as data heterogeneity and measurement uncertainty due to the combined effect of short- and long-term natural variability, instrumental stability, and aggregation of data from sparse sampling frequency. Failure to account for these uncertainties might result in an inappropriate inference of the trends and their estimation errors. On the other hand, the variation in extreme events might be interesting for different scientific questions, for example, the frequency of extremely high surface ozone events and their relevance to human health. In this study we aim to, 1) review trend detection methods for addressing different levels of data complexity in different chemical species; 2) demonstrate that the incorporation of scientifically interpretable covariates can outperform pure numerical curve fitting techniques in terms of uncertainty reduction and improved predictability; 3) illustrate the study of trends based on extreme quantiles that can provide insight beyond standard mean or median based trend estimates; and 4) present an advanced method of quantifying regional trends based on the inter-site correlations of multi-site data. All demonstrations are based on time series of observed trace gases relevant to atmospheric chemistry, but the methods can be applied to other environmental data sets.

Trace gas↗

Time-Series Ratio Algorithm for Nisar Soil Moisture Retrieval

The NASA ISRO Synthetic Aperture Radar (NISAR) mission is currently under development and will provide global L-band radar observations that will be helpful for various soil moisture applications. The final NISAR soil moisture product will have 200m spatial resolution with 12-day exact revisit time. A time-series ratio algorithm was implemented using NISAR simulated UAVSAR data collected during the SMAPVEX12 field experiment. In this paper, the performance of the time series ratio algorithm was assessed using in situ observations. Performance of the soil moisture retrieval algorithm was also assessed for dual polarization and quad-polarization observations modes.

Jeonghwan Park↗

Extraction and Analysis of Time Series Data from Building Automation Systems Using Large Language Models

Semantic schemas like Haystack 4, Brick and ASHRAE standard 223 enable the structured, standardized, and machine-readable representation of building data, facilitating interoperability, data integration, and advanced analytics. However, extracting information from these models requires specialized expertise in SPARQL and other programming languages, skills that are not commonly found among building professionals. Recent advancements in Large Language Models (LLMs), such as ChatGPT, enable the construction of queries using natural language, making it easier for individuals to interact with these systems in a manner that resembles everyday speech. However, these methods have not yet been tested on building semantic ontologies. This paper introduces a novel workflow and tool for enabling users to ask questions about a specific building's data, using natural language and receive answers automatically generated by GPT-4o. Our approach integrates semantic ontologies with advanced LLM capabilities to automate three critical steps: (1) generating SPARQL queries to retrieve time series references from ontological models, (2) extracting the corresponding time series data from the Building Automation System, and (3) performing computations and visualizations tailored to the user's query. The proposed method simplifies access to BAS data, allowing both domain experts and non-specialists to conduct sophisticated analyses without needing extensive technical knowledge of semantic web technologies. By demonstrating this pipeline, we facilitate more accessible and scalable data-driven decision-making in building operations and management.

Mulayim, Ozan Baris↗

Extraction and Analysis of Time Series Data from Building Automation Systems Using Large Language Models

Semantic schemas like Haystack 4, Brick and ASHRAE standard 223 enable the structured, standardized, and machine-readable representation of building data, facilitating interoperability, data integration, and advanced analytics. However, extracting information from these models requires specialized expertise in SPARQL and other programming languages, skills that are not commonly found among building professionals. Recent advancements in Large Language Models (LLMs), such as ChatGPT, enable the construction of queries using natural language, making it easier for individuals to interact with these systems in a manner that resembles everyday speech. However, these methods have not yet been tested on building semantic ontologies. This paper introduces a novel workflow and tool for enabling users to ask questions about a specific building's data, using natural language and receive answers automatically generated by GPT-4o. Our approach integrates semantic ontologies with advanced LLM capabilities to automate three critical steps: (1) generating SPARQL queries to retrieve time series references from ontological models, (2) extracting the corresponding time series data from the Building Automation System, and (3) performing computations and visualizations tailored to the user's query. The proposed method simplifies access to BAS data, allowing both domain experts and non-specialists to conduct sophisticated analyses without needing extensive technical knowledge of semantic web technologies. By demonstrating this pipeline, we facilitate more accessible and scalable data-driven decision-making in building operations and management.

Mulayim, Ozan Baris↗

Time Series Surface Temperature of Variably Inundated Sediment across 30 North American Rivers

This dataset supports a broader study examining drivers of organic matter chemistry in variably inundated hyporheic zone sediments and further linking that chemistry to biogeochemical rates. The dataset provides surficial temperature time series that can be used to infer the dynamics of inundation prior to the collection of sediments. Those inferred inundation histories can then be used to help interpret variation in the organic matter chemistry. There are related data that will be published, such as FTICR-MS data on organic matter chemistry and sediment moisture. A data package with those data is forthcoming.This dataset is comprised of two folders: (1) ECA1_iButtonData and (2) ECA1_SitePhotos. The ECA1_iButtonData folder contains: (1) file-level metadata, (2) data dictionary, (3) field metadata, (4) installation methods, (5) iButton deployment protocol, (6) readme, and (7) folder of individual time series temperature csv files for each iButton sensor deployed. The ECA1_SitePhotos folder contains site photographs taken in the field. All files are .csv, .txt, .pdf, or .jpg.

54 ENVIRONMENTAL SCIENCES↗

Comparison of Multivariate Time Series Prediction Techniques for Emulating Noah-LSM Soil Moisture Outputs

Land surface models are crucial tools for many earth science applications including numerical weather prediction, water resource and crop monitoring, and climatological analysis. Given a set of atmospheric forcings, seasonal data, and static parameters, models like Noah-LSM solve for land surface quantities including skin temperature, sensible heat flux, and soil moisture. While these calculations are theoretically robust, they are often computationally expensive. Since artificial neural networks (ANNs) are universal function approximators, they can learn to emulate the output of a deterministic numerical model given a time series of input forcings, with the learned ANN having substantially shorter execution time. The ANN could efficiently parameterize other models, generate ensembles, and provide first-guess inputs for retrievals. As such, with the goal of developing a model that efficiently mimics the output of Noah-LSM given NLDAS2 forcings on a region covering much of the central US, we examine and compare several neural network architectures for the multi-horizon multivariate time series forecasting problem. Recent literature includes a diverse set of approaches including autoregressive architectures like LSTM and GRU, parametric and non-parametric statistical predictors (ForecastNet and MQRNN), self-attention (LSTM-attention-LSTM), and temporal convovlution (DeepTCN). We implement several of these models for the Noah-LSM prediction task, highlighting the features and challenges for each and providing practical insight on the training process.

Mitchell Dodson↗

Update on EMD and Hilbert-Spectra Analysis of Time Series

This method is especially well suited for analyzing time-series data that represent nonstationary and nonlinear physical phenomena. The method is based principally on the concept of empirical mode decomposition (EMD), according to which any complicated signal (as represented by digital samples) can be decomposed into a finite number of functions, called "intrinsic mode functions" (IMFs), that admit well-behaved Hilbert transforms. The local energies and the instantaneous frequencies derived from the IMFs through Hilbert transforms can be used to construct an energy-frequency-time distribution, denoted a Hilbert spectrum.

Huang, Norden E.↗

High Frequency, Long Time Series Measurements from the Bermuda Testbed Mooring in Support of SIMBIOS

It has been recognized that optical moorings are important platforms for the validation of Sea-Viewing Wide Field-of-view Sensor (SeaWiFS). It was recommended that optical moorings be maintained in order to: (1) provide long-term time series comparisons between in situ and SeaWIFS measurements of normalized water-leaving radiance; (2) develop and test algorithms for pigment biomass and phytoplankton primary productivity; and (3) provide long-term, virtually continuous in situ observations which can be used to determine and optimize the accuracy of derived satellite products. These applications require the use of in situ radiometers for long periods of time to evaluate and correct for inherent satellite undersampling (aliasing and biasing) and degradation of satellite color sensors (e.g., drifts as experienced by the Coastal Zone Color Scanner). The Bermuda Testbed Mooring (BTM) program was initiated in 1994 at a site located about 80km southeast of Bermuda in waters of about 4530 m depth. In August 1997, with NASA's support, we started to provide the Sensor Intercomparison and Merger for Biological and Interdisciplinary Oceanic Studies (SIMBIOS) program with large volumes of high frequency, long-term time-series bio-optical data from the BTM for SeaWiFS satellite ocean color groundtruthing and algorithm development. This NASA supported portion of the BTM activity spanned three years and covered five BTM deployments. During these three years, the quality of radiometric data has improved dramatically. Excellent agreement between BTM moored data and both SeaWiFS and nearby ship profile radiometric data demonstrate that technical advances in the moored optical observations have reduced the major difficulties that moored platforms face: biofouling and less frequent calibration.

Dickey, Tommy↗

Singular spectrum analysis in nonlinear dynamics, with applications to paleoclimatic time series

Two dimensions of a dynamical system given by experimental time series are distinguished. Statistical dimension gives a theoretical upper bound for the minimal number of degrees of freedom required to describe the attractor up to the accuracy of the data, taking into account sampling and noise problems. The dynamical dimension is the intrinsic dimension of the attractor and does not depend on the quality of the data. Singular Spectrum Analysis (SSA) provides estimates of the statistical dimension. SSA also describes the main physical phenomena reflected by the data. It gives adaptive spectral filters associated with the dominant oscillations of the system and clarifies the noise characteristics of the data. SSA is applied to four paleoclimatic records. The principal climatic oscillations and the regime changes in their amplitude are detected. About 10 degrees of freedom are statistically significant in the data. Large noise and insufficient sample length do not allow reliable estimates of the dynamical dimension.

Vautard, R.↗

JWST Noise Floor. II. Systematic Error Sources in JWST NIRCam Time Series

The James Webb Space Telescope (JWST) holds great promise for characterizing atmospheres of transiting exoplanets, potentially providing insights into Earth-sized planets within the habitable zones of M-dwarf host stars if photon-limited performance can be achieved. Here, we discuss the systematic error sources that are expected to be present in grism time-series observations with the NIRCam instrument. We find that pointing jitter and high-gain antenna moves in addition to the detectors’ subpixel crosshatch patterns will produce relatively small variations (less than 6 parts per million, ppm). The time-dependent aperture losses due to thermal instabilities in the optics can also be kept to below 2 ppm. To achieve these low noise values, it is important to employ a sufficiently large (more than 11) extraction aperture. Persistence due to charge-trapping will have a minor (less than 3 ppm) effect on the time series 20 minutes into an exposure and is expected to play a much smaller role than it does for the Hubble Space Telescope WFC3 detectors. We expect detector temperature fluctuations to contribute less than 3 ppm. In total, our estimated noise floor from known systematic error sources is only 9 ppm per visit. We urge caution, however, because unknown systematic error sources could be present in flight and will only be measurable on astrophysical sources such as quiescent stars. We find that reciprocity failure may introduce a perennial instrument offset at the 40 ppm level, so corrections may be needed when a multi-instrument multi-observatory spectrum is stitched together over wide wavelength ranges.

47 OTHER INSTRUMENTATION↗

JWST Noise Floor. II. Systematic Error Sources in JWST NIRCam Time Series

The James Webb Space Telescope (JWST) holds great promise for characterizing atmospheres of transiting exoplanets, potentially providing insights into Earth-sized planets within the habitable zones of M-dwarf host stars if photon-limited performance can be achieved. Here, we discuss the systematic error sources that are expected to be present in grism time-series observations with the NIRCam instrument. We find that pointing jitter and high-gain antenna moves in addition to the detectors' subpixel crosshatch patterns will produce relatively small variations (less than 6 parts per million, ppm). The time-dependent aperture losses due to thermal instabilities in the optics can also be kept to below 2 ppm. To achieve these low noise values, it is important to employ a sufficiently large (more than 1farcs1) extraction aperture. Persistence due to charge-trapping will have a minor (less than 3 ppm) effect on the time series 20 minutes into an exposure and is expected to play a much smaller role than it does for the Hubble Space Telescope WFC3 detectors. We expect detector temperature fluctuations to contribute less than 3 ppm. In total, our estimated noise floor from known systematic error sources is only 9 ppm per visit. We urge caution, however, because unknown systematic error sources could be present in flight and will only be measurable on astrophysical sources such as quiescent stars. We find that reciprocity failure may introduce a perennial instrument offset at the 40 ppm level, so corrections may be needed when a multi-instrument multi-observatory spectrum is stitched together over wide wavelength ranges.

Everett Schlawin↗

Optimal Frequency-domain Analysis for Spacecraft Time Series: Introducing the Missing-data Multitaper Power Spectrum Estimator

While the Lomb–Scargle periodogram is foundational to astronomy, it has a significant shortcoming: the variance in the estimated power spectrum does not decrease as more data are acquired. Statisticians have a 60 yr history of developing variance-suppressing power spectrum estimators, but most are not used in astronomy because they are formulated for time series with uniform observing cadence and without seasonal or daily gaps. Here we demonstrate how to apply the missing-data multitaper power spectrum estimator to spacecraft data with uniform time intervals between observations but missing data during thruster fires or momentum dumps. The F-test for harmonic components may be applied to multitaper power spectrum estimates to identify statistically significant oscillations that would not rise above a white noise–based false alarm probability. Multitapering improves the dynamic range of the power spectrum estimate and suppresses spectral window artifacts. We show that the multitaper–F-test combination applied to Kepler observations of KIC 6102338 detects differential rotation without requiring iterative sinusoid fitting and subtraction. Significant signals reside at harmonics of both fundamental rotation frequencies and suggest an antisolar rotation profile. Next we use the missing-data multitaper power spectrum estimator to identify the oscillation modes responsible for the complex "scallop-shell" shape of the K2 light curve of EPIC 203354381. We argue that multitaper power spectrum estimators should be used for all time series with regular observing cadence.

79 ASTRONOMY AND ASTROPHYSICS↗

Feasibility of Multi-Year Forecast for the Colorado River Water Supply: Time Series Modeling

The future of the Colorado River water supply (WS) affects millions of people and the US economy. A recent study suggested a cross-basin correlation between the Colorado River and its neighboring Great Salt Lake (GSL). Following that study, the feasibility of using the previously developed multi-year prediction of the GSL water level to forecast the Colorado River WS was tested. Time-series models were developed to predict the changes in WS out to 10 years. Regressive methods and the GSL water level data were used for the depiction of decadal variability of the Colorado River WS. Various time-series models suggest a decline in the 10-year averaged WS since 2013 before starting to increase around 2020. Comparison between this WS prediction and the WS projection published in a 2012 government report (derived from climate models) reveals a widened imbalance between supply and demand by 2020, a tendency that is confirmed by updated WS observation. Such information could aid in management decision-making in the face of near-future water shortages.

54 ENVIRONMENTAL SCIENCES↗

Uncovering heterogeneous intercommunity disease transmission from neutral allele frequency time series

The COVID-19 pandemic has underscored the need for accurate epidemic forecasting to predict pathogen spread, evolution, and evaluate intervention strategies. Forecast reliability hinges on detailed knowledge of disease transmission across population segments, which may be inferred from contact surveys or mobility data. However, these indirect approaches make it difficult to estimate rare transmissions between socially or geographically distant communities. We show that the steep ramp-up of genome sequencing surveillance during the pandemic can be leveraged to directly identify transmission patterns between geographically defined communities. Our approach uses a hidden Markov model to infer the fraction of infections a community imports from others based on how rapidly allele frequencies in the focal community converge to those in the donor communities. Applying this method to SARS-CoV-2 sequencing data from England and the United States, we uncover networks of intercommunity transmission that reflect geographical relationships while exposing significant long-range interactions. The scaling of importation rate with distance is consistent across both countries, yet weaker than expected based on mobility data, highlighting limitations of indirect inference. We show that transmission patterns can change between waves of variants of concern and analyze how the inferred heterogeneity in intercommunity transmission impacts evolutionary forecasts. While applied here to geographically defined communities, our approach could be applied to those defined by other traits (e.g., age, socioeconomic status), provided time-series data can be stratified accordingly. Overall, our study highlights population genomic time series data as a crucial record of epidemiological interactions, which can be deciphered using tree-free inference methods.

Okada, Takashi [Department of Physics; University ↗

Estimating the Performance Loss Rate of Photovoltaic Systems Using Time Series Change Point Analysis

The accurate quantification of the performance loss rate of photovoltaic systems is critical for project economics. Following the current research activities in the photovoltaic performance and reliability field, this work presents a comparative assessment between common change point methods for performance loss rate estimation of fielded photovoltaic installations. An extensive testing campaign was thus performed to evaluate time series analysis approaches for performance loss rate evaluation of photovoltaic systems. Historical electrical data from eleven photovoltaic systems installed in Nicosia, Cyprus, and the locations’ meteorological measurements over a period of 8 years were used for this investigation. The application of change point detection algorithms on the constructed monthly photovoltaic performance ratio series revealed that the obtained trend might not always be linear. Specifically, thin film photovoltaic systems showed nonlinear behavior, while nonlinearities were also detected for some crystalline silicon photovoltaic systems. When applying several change point techniques, different numbers and locations of changes were detected, resulting in different performance loss rate values (varying by up to 0.85%/year even for the same number of change points). The results highlighted the importance of the application of nonlinear techniques and the need to extract a robust nonlinear model for detecting significant changes in time series data and estimating accurately the performance loss rate of photovoltaic installations.

photovoltaics↗

Improving the Performance of Integrated Power-Hardware-in-the-Loop and Quasi-Static Time-Series Simulations

This paper introduces a novel multirate cosimulation architecture that overcomes previous challenges integrating faster real-time, microseconds-scale, power-hardware-in-the-loop (PHIL) with larger scale but slower, real-time, seconds-scale, quasi-static time-series (QSTS) simulation. Specifically, an intermediate reduced-equivalent electromagnetic transient (EMT) model duplicates the key power system topology to capture high-speed dynamics and converge hardware-power system interactions between QSTS updates. Exchanging multidimensional parameter vectors (loads, control status, etc.) between the QSTS and EMT models enables capturing the interactions of the rich, high-node-count (thousands of electrical nodes) QSTS model with the hardware. This architecture offers full spatial resolution from QSTS, including individual load dynamics, actual distribution management system controls, and nodal voltages. Simultaneously, the intermediate EMT model provides more detailed high-speed transients of key distributed energy resource hardware interactions. In addition, we use careful PHIL interface design and the exchange of complex power data, rather than current, to further improve performance. This cosimulation architecture is demonstrated by testing a simulated distribution system with an interconnected 500-kVA advanced photovoltaic (PV) inverter in PHIL. In conclusion, the architecture successfully captured PV local volt-volt ampere reactive (volt-VAR) control interactions with the larger network under time-varying electrical and weather conditions.

42 ENGINEERING↗