Search NASA⌕ Search

SEARCH · Search NASA

Results for “Time Series Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

MODIS NDVI Change Detection Techniques and Products Used in the Near Real Time ForWarn System for Detecting, Monitoring, and Analyzing Regional Forest Disturbances

This presentation discusses MODIS NDVI change detection methods and products used in the ForWarn Early Warning System (EWS) for near real time (NRT) recognition and tracking of regionally evident forest disturbances throughout the conterminous US (CONUS). The latter has provided NRT forest change products to the forest health protection community since 2010, using temporally processed MODIS Aqua and Terra NDVI time series data to currently compute and post 6 different forest change products for CONUS every 8 days. Multiple change products are required to improve detectability and to more fully assess the nature of apparent disturbances. Each type of forest change product reports per pixel percent change in NDVI for a given 24 day interval, comparing current versus a given historical baseline NDVI. EMODIS 7 day expedited MODIS MOD13 data are used to obtain current and historical NDVIs, respectively. Historical NDVI data is processed with Time Series Product Tool (TSPT); and 2) the Phenological Parameters Estimation Tool (PPET) software. While each change products employ maximum value compositing (MVC) of NDVI, the design of specific products primarily differs in terms of the historical baseline. The three main change products use either 1, 3, or all previous years of MVC NDVI as a baseline. Another product uses an Adaptive Length Compositing (ALC) version of MVC to derive an alternative current NDVI that is the freshest quality NDVI as opposed to merely the MVC NDVI across a 24 day time frame. The ALC approach can improve detection speed by 8 to 16 days. ForWarn also includes 2 change products that improve detectability of forest disturbances in lieu of climatic fluctuations, especially in the spring and fall. One compares current MVC NDVI to the zonal maximum under the curve NDVI per pheno-region cluster class, considering all previous years in the MODIS record. The other compares current maximum NDVI to the mean of maximum NDVI for all previous MODIS years.

Spruce, Joseph P.↗
NASA NTRS2013

Transfer Function Identification Using Orthogonal Fourier Transform Modeling Functions

A method for transfer function identification, including both model structure determination and parameter estimation, was developed and demonstrated. The approach uses orthogonal modeling functions generated from frequency domain data obtained by Fourier transformation of time series data. The method was applied to simulation data to identify continuous-time transfer function models and unsteady aerodynamic models. Model fit error, estimated model parameters, and the associated uncertainties were used to show the effectiveness of the method for identifying accurate transfer function models from noisy data.

Morelli, Eugene A.↗
NASA NTRS2013

The Version 8.6 SBUV Ozone Data Record: An Overview

Under a NASA program to produce long-term data records from instruments on multiple satellites, data from a series of nine Solar Backscatter Ultraviolet (SBUV and SBUV2) instruments have been re-processed to create a coherent ozone time series. Data from the BUV instrument on Nimbus 4, SBUV on Nimbus 7, and SBUV2 instruments on NOAA 9, 11, 14, 16, 17, 18, and 19 covering the period 1970-1972 and 1979-2011 were used to create a long-term data set. The goal is an ozone Earth Science Data Record - a consistent, calibrated ozone time series that can be used for trend analyses and other studies. In order to create this ozone data set, the radiances were adjusted and used to re-process the entire data records for each of the nine instruments. Inter-instrument comparisons during periods of overlap as well as comparisons with data from other satellite and ground-based instruments were used to evaluate the consistency of the record and make calibration adjustments as needed. Additional improvements in this version 8.6 processing included the use of the Brion, Daumont, and Malicet ozone cross sections, and a cloud-height climatology derived from Aura OMI measurements. Validation of the re-processed ozone shows that total column ozone is consistent with the Brewer Dobson network to within about 1 for the new time series. Comparisons with MLS, SAGE, sondes, and lidar show that ozone at individual levels in the stratosphere is generally consistent to within 5 percent.

ozone↗
NASA NTRSDate not supplied

Hydrological Data at the NASA GES DISC: Current Capabilities and New Opportunities

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is one of twelve NASA Earth science data centers that document, process, archive and distribute data from Earth observation missions and projects. GES DISC maintains an archive of several hydrology datasets, including the Land Data Assimilation Systems (LDAS) and the Gravity Recovery and Climate Experiment (GRACE) Data Assimilation for Drought Monitoring (GRACE-DA-DM) data products. These datasets include model output of heat fluxes, rain, snow, soil temperature, soil moisture, and runoff; and observational forcing data, including surface pressure, temperature, precipitation, downward shortwave and longwave radiation, humidity, and wind. The temporal resolution of the hydrology data at GES DISC ranges from hourly to monthly, and spatial resolutions range from 0.1° to 1.0°. The GES DISC provides services which enable users to aggregate, temporally and spatially subset, regrid, and visualize archived data including the GES DISC Subsetter, Hydrology Data Rods, and the Geospatial Interactive Online Visualization and Analysis Infrastructure (GIOVANNI). The Hydrology Data Rods service optimally reorganizes large hydrological data sets as extended time series, providing more efficient access for the hydrological community. The time series data (aka “data rods”) were integrated into hydrology community tools, such as the Data Rods Explorer on HydroShare. Furthermore, the GES DISC is in the process of migrating its data and services to the cloud. Hydrological data available at the GES DISC are now available in the Amazon Web Services (AWS) cloud (us-west-2 region) providing users Direct S3 data access and the capability for cloud computing operations. In this presentation, the hydrology data products and services currently available at the GES DISC will be summarized. Also discussed are the migration to the cloud, user support through this transition, and the status of migrating the data rods service to the cloud.

Ashley Heath↗
NASA NTRS1980

Calculation of power spectrums from digital time series with missing data points

Two algorithms are developed for calculating power spectrums from the autocorrelation function when there are missing data points in the time series. Both methods use an average sampling interval to compute lagged products. One method, the correlation function power spectrum, takes the discrete Fourier transform of the lagged products directly to obtain the spectrum, while the other, the modified Blackman-Tukey power spectrum, takes the Fourier transform of the mean lagged products. Both techniques require fewer calculations than other procedures since only 50% to 80% of the maximum lags need be calculated. The algorithms are compared with the Fourier transform power spectrum and two least squares procedures (all for an arbitrary data spacing). Examples are given showing recovery of frequency components from simulated periodic data where portions of the time series are missing and random noise has been added to both the time points and to values of the function. In addition the methods are compared using real data. All procedures performed equally well in detecting periodicities in the data.

Murray, C. W., Jr.↗
NASA NTRS2019

MERRA-2 Data and Analytic Services at NASA GES DISC for Climate Extremes Study

NASA's climate reanalysis datasets from the Modern Era Retrospective-analysis for Research and Applications, Version 2 (MERRA-2) contains numerous long-term atmosphere, land, and ocean data products from 1980-present. MERRA-2 datasets, such as precipitation, soil moisture, and temperature, have been used widely to study extreme events. The native archived MERRA-2 data files are day-file (hourly time interval) and month-file, containing up to 125 parameters in one file. Due to the large number of data files and volumes, it is challenging for users, especially the applications research community, to handle the original hourly data files for long time periods to analyze extreme events. In this presentation, we review MERRA-2 data for studies of extreme conditions, and demonstrate analytic services at the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). One of the current operational services, 'subsetter', allows users to download only specific data of interest, i.e. data selected by parameter, region, and time period. New services are under development that will provide more 'on-the-fly' statistical calculations when downloading data; improve efficiency when accessing long time-series data. We will provide additional "How-to" resources that include step-by-step instructions on data access and usage. We have tested restructuring of day-files in an optimized data cube, which has significantly improved system performance for accessing long time-series. Overall performance is associated with cube size and structure, data compression method, and how the data are accessed. The optimized data cube structure will enable better online analytic services for statistical analysis and extreme events mining. To demonstrate the service, we use an extreme drought associated with the anomalous 2016 monsoon over southern Asia. This prototype time-series service may be augmented in the cloud infrastructure in the future.

data access↗
NASA NTRS2003

High-Speed Recording of Test Data on Hard Disks

Disk Recording System (DRS) is a systems-integration computer program for a direct-to-disk (DTD) high-speed data acquisition system (HDAS) that records rocket-engine test data. The HDAS consists partly of equipment originally designed for recording the data on tapes. The tape recorders were replaced with hard-disk drives, necessitating the development of DRS to provide an operating environment that ties two computers, a set of five DTD recorders, and signal-processing circuits from the original tape-recording version of the HDAS into one working system. DRS includes three subsystems: (1) one that generates a graphical user interface (GUI), on one of the computers, that serves as a main control panel; (2) one that generates a GUI, on the other computer, that serves as a remote control panel; and (3) a data-processing subsystem that performs tasks on the DTD recorders according to instructions sent from the main control panel. The software affords capabilities for dynamic configuration to record single or multiple channels from a remote source, remote starting and stopping of the recorders, indexing to prevent overwriting of data, and production of filtered frequency data from an original time-series data file.

Lagarde, Paul M., Jr.↗
NASA NTRS2018

TPSAS-NF1676L-31995-DND

The Osa Peninsula, located in the southern region of Costa Rica’s Pacific Coast, is one of the most biologically-diverse places on Earth and is a popular ecotourism destination. However, the area faces watershed degradation and loss of biodiversity due to deforestation, pollution from agriculture, and human settlement. The NASA DEVELOP National Program worked with Osa Conservation to analyze land use and land cover change in the Osa Peninsula to better understand threats to river water quality and mangrove health. This project used Landsat 5 Thematic Mapper (TM), Landsat 8 Operational Land Imager (OLI), and Terra Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) to create a land cover time series map from 1987 to 2017. These time series data were used to compare land use over time, as well as patterns in water quality, mangrove health, erosion, and deforestation. The time series also helped to identify the impact of the creation of protected areas and the 1996 Forest Law 7575, which aimed to support reforestation and riparian health. Osa Conservation will use and distribute results to the National System of Conservation Areas (SINAC), Ministry of Environment and Energy (MINAE), and local communities to inform land management decisions, policy enforcement, education and outreach initiatives, and watershed restoration and monitoring.

Suravi Shrestha↗
NASA NTRS2020

Studies in Astronomical Time Series Analysis: VII. An Enquiry Concerning Non-Linearity, the RMS-Mean Flux Relation, and log-Normal Flux Distributions

A broad and widely used class of stationary, linear, additive time series models can have statistical properties which many authors have asserted imply that the underlying process must be non-linear, non-stationary, multiplicative, or inconsistent with shot noise. This result is demonstrated with exact and numerical evaluation of the model flux distribution function and dependence of flux standard deviation on mean flux (here and in the literature called the rms-flux relation). These models can: (1) exhibit normal, log-normal or other flux distributions; (2) show linear or slightly non-linear rms-mean flux dependencies; as well as (3) match arbitrary second order statistics of the time series data. Accordingly the above assertions cannot be made on the basis of statistical time series analysis alone. Also idscussed are ambiguities in the meaning of terms relevant to this study – linear, stationary and multiplicative – and functions that can transform observed fluxes to a normal distribution as well or better than the logarithm.

Jeffrey D Scargle↗
NASA NTRS2012

Particle Filtering for Model-Based Anomaly Detection in Sensor Networks

A novel technique has been developed for anomaly detection of rocket engine test stand (RETS) data. The objective was to develop a system that postprocesses a csv file containing the sensor readings and activities (time-series) from a rocket engine test, and detects any anomalies that might have occurred during the test. The output consists of the names of the sensors that show anomalous behavior, and the start and end time of each anomaly. In order to reduce the involvement of domain experts significantly, several data-driven approaches have been proposed where models are automatically acquired from the data, thus bypassing the cost and effort of building system models. Many supervised learning methods can efficiently learn operational and fault models, given large amounts of both nominal and fault data. However, for domains such as RETS data, the amount of anomalous data that is actually available is relatively small, making most supervised learning methods rather ineffective, and in general met with limited success in anomaly detection. The fundamental problem with existing approaches is that they assume that the data are iid, i.e., independent and identically distributed, which is violated in typical RETS data. None of these techniques naturally exploit the temporal information inherent in time series data from the sensor networks. There are correlations among the sensor readings, not only at the same time, but also across time. However, these approaches have not explicitly identified and exploited such correlations. Given these limitations of model-free methods, there has been renewed interest in model-based methods, specifically graphical methods that explicitly reason temporally. The Gaussian Mixture Model (GMM) in a Linear Dynamic System approach assumes that the multi-dimensional test data is a mixture of multi-variate Gaussians, and fits a given number of Gaussian clusters with the help of the wellknown Expectation Maximization (EM) algorithm. The parameters thus learned are used for calculating the joint distribution of the observations. However, this GMM assumption is essentially an approximation and signals the potential viability of non-parametric density estimators. This is the key idea underlying the new approach.

Solano, Wanda↗
NASA NTRS1990

NASA standard: Trend analysis techniques

Descriptive and analytical techniques for NASA trend analysis applications are presented in this standard. Trend analysis is applicable in all organizational elements of NASA connected with, or supporting, developmental/operational programs. This document should be consulted for any data analysis activity requiring the identification or interpretation of trends. Trend analysis is neither a precise term nor a circumscribed methodology: it generally connotes quantitative analysis of time-series data. For NASA activities, the appropriate and applicable techniques include descriptive and graphical statistics, and the fitting or modeling of data by linear, quadratic, and exponential models. Usually, but not always, the data is time-series in nature. Concepts such as autocorrelation and techniques such as Box-Jenkins time-series analysis would only rarely apply and are not included in this document. The basic ideas needed for qualitative and quantitative assessment of trends along with relevant examples are presented.

Source record↗
NASA NTRSDate not supplied

GeoNEX-SUBSETS: Geostationary Satellite Observations Over International Observing Network Sites

Satellite remote sensing is crucial for monitoring the Earth’s surface and for simulating global carbon and water cycles. Subsets of satellite data from sensors such as MODIS over established observing networks have been valuable for researchers for comparing the ground observed phenomena with satellite observations. Here, we introduce new subsets of the GeoNEX geostationary satellite datasets over locations of several ground observation networks. The NASA Earth Exchange group has been generating geostationary satellite products with our international partners and universities to cover the entire globe. In comparison to polar-orbiting satellite sensors such as MODIS, the new generation geostationary satellites observe target areas at a higher frequency (5-10 minutes), which also significantly increased the data volume. To reduce the burden of downloading and extracting geostationary time series data and provide easy access to the community, we provide subsets of GeoNEX products through our data portal [www.data.nas.nasa.gov]. The ready-to-use subset follows the same format as the MODIS fixed sites subset tools for users who are familiar with MODIS subset data and software. The selected networks include Fluxnet, AERONET, and Phenocam over the conterminous US. We demonstrate the usage of the GeoNEX fixed-site subset data and showcase thir advantages with three example studies. The first example is simulating the diurnal cycle of plant ecophysiology at Fluxnet sites. The high frequency of the GeoNEX time series allows us to run ecological models at sub-hour time steps and directly compare the simulated carbon and water fluxes with half-hourly Fluxnet data. The second example uses the geostationary data to track phenological changes. It highlights the high-frequent observations of geostationary satellites in helping mask cloud covers and capture the quick responses of vegetation to environmental changes. As such, these examples demonstrate the value of ready-to-use GeoNEX subsets data in terrestrial ecophysiology research.

GeoNEX↗
NASA NTRS1988

NASA standard: Trend analysis techniques

This Standard presents descriptive and analytical techniques for NASA trend analysis applications. Trend analysis is applicable in all organizational elements of NASA connected with, or supporting, developmental/operational programs. Use of this Standard is not mandatory; however, it should be consulted for any data analysis activity requiring the identification or interpretation of trends. Trend Analysis is neither a precise term nor a circumscribed methodology, but rather connotes, generally, quantitative analysis of time-series data. For NASA activities, the appropriate and applicable techniques include descriptive and graphical statistics, and the fitting or modeling of data by linear, quadratic, and exponential models. Usually, but not always, the data is time-series in nature. Concepts such as autocorrelation and techniques such as Box-Jenkins time-series analysis would only rarely apply and are not included in this Standard. The document presents the basic ideas needed for qualitative and quantitative assessment of trends, together with relevant examples. A list of references provides additional sources of information.

Source record↗
NASA NTRS1977

Sea truth and environmental characterization studies of Mobile Bay, Alabama, utilizing ERTS-1, data collection platforms

The paper reports on the scientific results obtained during a feasibility study that evaluated the potential of using ERTS data collection platforms (DCPs) in the coastal environment of Mobile Bay, Alabama. The utility of instrumented buoys operated in a coastal marine environment as ERTS DCPs is demonstrated. It is shown that these platforms are capable of providing both sea-truth data for ERTS imagery studies and time-series data for event monitoring and/or environmental characterization studies.

Schroeder, W. W.↗
NASA NTRS2023

The SunPy Project: An Interoperable Ecosystem for Solar Data Analysis

The SunPy Project is a community of scientists and software developers creating an ecosystem of Python packages for solar physics. The project includes the sunpy core package as well as a set of affiliated packages. The sunpy core package provides general purpose tools to access data from different providers, read image and time series data, and transform between commonly used coordinate systems. Affiliated packages perform more specialized tasks that do not fall within the more general scope of the sunpy core package. In this article, we give a high-level overview of the SunPy Project, how it is broader than the sunpy core package, and how the project curates and fosters the affiliated package system. We demonstrate how components of the SunPy ecosystem, including sunpy and several affiliated packages, work together to enable multi-instrument data analysis workflows. We also describe members of the SunPy Project and how the project interacts with the wider solar physics and scientific Python communities. Finally, we discuss the future direction and priorities of the SunPy Project.

Solar physics↗
NASA NTRSDate not supplied

Unsupervised Anomaly Detection in High-Dimensional Flight Data Using Convolutional Variational Auto-Encoder

The modern National Airspace System (NAS) is an extremely safe system. The industry has experienced a steady decrease in fatalities over the years. This can be contributed to both improved flight critical systems with redundant hardware and software protections as well as an increased focus on active monitoring and response to real time and historically identified vulnerabilities by implementing more resilient procedures and protocols. The main practice for identifying vulnerabilities in operations leverages domain expertise using knowledge about how the system should behave with the expected tolerances to known safety margins. This approach works well when the system has a well-defined operating condition. However, the operations in the NAS can be highly complex with various nuances that render it difficult to clearly pre-define all known safety vulnerabilities. With the advancement of data science and machine learning techniques, the potential to automatically identify emerging vulnerabilities in the observed operations has become more practical in recent years. The state-of-the-art anomaly detection approaches in aerospace data usually rely on supervised or semi-supervised learning. However, in many real-world problems such as flight safety creating labels for the data requires huge amount of efforts and is largely expensive. As a result, in this article, we develop a Convolutional Variational Auto-Encoder (CVAE), an unsupervised learning approach for anomaly detection in high-dimensional heterogeneous time-series data. We validate performance of CVAE compared to the state-of-the-art supervised learning approach (as an upper bound) as well as an supervised clustering based on K-Means (as a lower bound) on Yahoo!'s benchmark time series anomaly detection data. Finally, we showcase performance of CVAE on a case study of identifying anomalies in the first 60 seconds of commercial flights' take-offs using Flight Operational Quality Assurance (FOQA) data.

Milad Memarzadeh↗