Search NASA⌕ Search

SEARCH · Search NASA

Results for “Series Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Some analysis on the diurnal variation of rainfall over the Atlantic Ocean

Data collected from the GARP Atlantic Tropical Experiment (GATE) was examined. The data were collected from 10,000 grid points arranged as a 100 x 100 array; each grid covered a 4 square km area. The amount of rainfall was measured every 15 minutes during the experiment periods using c-band radars. Two types of analyses were performed on the data: analysis of diurnal variation was done on each of grid points based on the rainfall averages at noon and at midnight, and time series analysis on selected grid points based on the hourly averages of rainfall. Since there are no known distribution model which best describes the rainfall amount, nonparametric methods were used to examine the diurnal variation. Kolmogorov-Smirnov test was used to test if the rainfalls at noon and at midnight have the same statistical distribution. Wilcoxon signed-rank test was used to test if the noon rainfall is heavier than, equal to, or lighter than the midnight rainfall. These tests were done on each of the 10,000 grid points at which the data are available.

Gill, T.↗

Machine Learning Framework for Hazard Extraction and Analysis of Trends (HEAT) in Wildfire Response

This research proposes a natural language processing enabled risk analysis framework, named Hazard Extraction andAnalysis of Trends (HEAT), and applies the framework to the ICS-209-PLUS data set of wildfire incident responseforms. The HEAT framework produces safety- and risk- relevant analyses, consisting of: (1) a set of hazards extractedfrom text data, (2) a primary analysis using hazard-relevant metrics, such as rate and severity, to form an FMEA-styletable and risk matrix, (3) a time series analysis of metric trends, and (4) a secondary analysis examining potentialpredictors for hazards. Results from HEAT provide quantitative risk-relevant information for high-level hazards doc-umented in existing-state operations. Because of the generalizability of the steps and limited data requirements, HEATcan be applied to any dataset containing narrative text, thus providing a framework for data-driven machine learning-enabled quantitative risk analysis across a variety of domains. To demonstrate HEAT in a case study, we apply theframework to the ICS-209-PLUS dataset of wildland fire incident response forms. Hazards identified in wildfire re-sponse arise from environmental conditions, the mission, and the wildland urban interface. The resulting risk matrixidentifies evacuations as high-risk hazards, while all other identified hazards are medium or serious risk.

natural language processing↗

Geological rhythms and cometary impacts

Time-series analysis reveals two dominant, stable long-term periodicities approximately equal to 33 + or - 3 and 260 + or - 25 million years in the known series of geological and biological upheavals during the Phanerozoic Eon. Because the cycles of these episodes agree in period and phase with the cycles of impact cratering on earth, these results suggest that periodic comet impacts strongly influence global tectonism and biological evolution. These two periodicities could arise from interactions of the solar system with interstellar clouds as the solar system moves cyclically through the Galaxy.

Rampino, M. R.↗

Rotational modulation in IUE spectra of cool dwarf chromospheres. I - Data analysis and period search techniques

Time-sequenced IUE spectra of a number of a bright F-K dwarfs have been used to investigate rotational modulation in several important chromospheric and transition emission lines. Stellingwerf's phase dispersion minimization (PDM) technique forms the basis of this time-series analysis of these sparsely sampled, irregularly spaced observational sequences, which consist of no more than 13 spectra in any one season. In such highly sample-limited time series, the resultant PDM spectrum is greatly complicated by overlapping alias orders which invariably produce strong interference effects, but the deliberately irregular sampling has proven of value in the development of techniques to identify the intrinsic stellar flux modulation period. Two stars are selected to illustrate these new techniques in detail.

Hallam, K. L.↗

Remote Sensing Time Series Product Tool

The TSPT (Time Series Product Tool) software was custom-designed for NASA to rapidly create and display single-band and band-combination time series, such as NDVI (Normalized Difference Vegetation Index) images, for wide-area crop surveillance and for other time-critical applications. The TSPT, developed in MATLAB, allows users to create and display various MODIS (Moderate Resolution Imaging Spectroradiometer) or simulated VIIRS (Visible/Infrared Imager Radiometer Suite) products as single images, as time series plots at a selected location, or as temporally processed image videos. Manually creating these types of products is extremely labor intensive; however, the TSPT development tool makes the process simplified and efficient. MODIS is ideal for monitoring large crop areas because of its wide swath (2330 km), its relatively small ground sample distance (250 m), and its high temporal revisit time (twice daily). Furthermore, because MODIS imagery is acquired daily, rapid changes in vegetative health can potentially be detected. The new TSPT technology provides users with the ability to temporally process high-revisit-rate satellite imagery, such as that acquired from MODIS and from its successor, the VIIRS. The TSPT features the important capability of fusing data from both MODIS instruments onboard the Terra and Aqua satellites, which drastically improves cloud statistics. With the TSPT, MODIS metadata is used to find and optionally remove bad and suspect data. Noise removal and temporal processing techniques allow users to create low-noise time series plots and image videos and to select settings and thresholds that tailor particular output products. The TSPT GUI (graphical user interface) provides an interactive environment for crafting what-if scenarios by enabling a user to repeat product generation using different settings and thresholds. The TSPT Application Programming Interface provides more fine-tuned control of product generation, allowing experienced programmers to bypass the GUI and to create more user-specific output products, such as comparison time plots or images. This type of time series analysis tool for remotely sensed imagery could be the basis of a large-area vegetation surveillance system. The TSPT has been used to generate NDVI time series over growing seasons in California and Argentina and for hurricane events, such as Hurricane Katrina.

Predos, Don↗

QuakeSim 2.0

QuakeSim 2.0 improves understanding of earthquake processes by providing modeling tools and integrating model applications and various heterogeneous data sources within a Web services environment. QuakeSim is a multisource, synergistic, data-intensive environment for modeling the behavior of earthquake faults individually, and as part of complex interacting systems. Remotely sensed geodetic data products may be explored, compared with faults and landscape features, mined by pattern analysis applications, and integrated with models and pattern analysis applications in a rich Web-based and visualization environment. Integration of heterogeneous data products with pattern informatics tools enables efficient development of models. Federated database components and visualization tools allow rapid exploration of large datasets, while pattern informatics enables identification of subtle, but important, features in large data sets. QuakeSim is valuable for earthquake investigations and modeling in its current state, and also serves as a prototype and nucleus for broader systems under development. The framework provides access to physics-based simulation tools that model the earthquake cycle and related crustal deformation. Spaceborne GPS and Inter ferometric Synthetic Aperture (InSAR) data provide information on near-term crustal deformation, while paleoseismic geologic data provide longerterm information on earthquake fault processes. These data sources are integrated into QuakeSim's QuakeTables database system, and are accessible by users or various model applications. UAVSAR repeat pass interferometry data products are added to the QuakeTables database, and are available through a browseable map interface or Representational State Transfer (REST) interfaces. Model applications can retrieve data from Quake Tables, or from third-party GPS velocity data services; alternatively, users can manually input parameters into the models. Pattern analysis of GPS and seismicity data has proved useful for mid-term forecasting of earthquakes, and for detecting subtle changes in crustal deformation. The GPS time series analysis has also proved useful as a data-quality tool, enabling the discovery of station anomalies and data processing and distribution errors. Improved visualization tools enable more efficient data exploration and understanding. Tools provide flexibility to science users for exploring data in new ways through download links, but also facilitate standard, intuitive, and routine uses for science users and end users such as emergency responders.

Donnellan, Andrea↗

Periodic extinction of families and genera

Eight major episodes of biological extinction of marine families over the past 250 million years stand significantly above local background (P less than 0.05). These events are more pronounced when analyzed at the level of genus, and generic data exhibit additional apparent extinction events in the Aptian (Cretaceous) and Pliocene (Tertiary) Stages. Time-series analysis of these records strongly suggests a 26-million-year periodicity. This conclusion is robust even when adjusted for simultaneous testing of many trial periods. When the time series is limited to the four best-dated events (Cenomanian, Maestrichtian, upper Eocene, and middle Miocene), the hypothesis of randomness is also rejected for the 26-million-year period (P less than 0.0002).

Raup, David M.↗

Periodic extinction of families and genera

Eight major episodes of biological extinction of marine families over the past 250 million years stand significantly above local background (P < 0.05). These events are more pronounced when analyzed at the level of genus, and generic data exhibit additional apparent extinction events in the Aptian (Cretaceous) and Pliocene (Tertiary) Stages. Time-series analysis of these records strongly suggests a 26-million-year periodicity. This conclusion is robust even when adjusted for simultaneous testing of many trial periods. When the time series is limited to the four best-dated events (Cenomanian, Maestrichtian, upper Eocene, and middle Miocene), the hypothesis of randomness is also rejected for the 26-million-year period (P < 0.0002).

Non-NASA Center↗

Re-Organizing Earth Observation Data Storage to Support Temporal Analysis of Big Data

The Earth Observing System Data and Information System archives many datasets that are critical to understanding long-term variations in Earth science properties. Thus, some of these are large, multi-decadal datasets. Yet the challenge in long time series analysis comes less from the sheer volume than the data organization, which is typically one (or a small number of) time steps per file. The overhead of opening and inventorying complex, API-driven data formats such as Hierarchical Data Format introduces a small latency at each time step, which nonetheless adds up for datasets with O(10^6) single-timestep files. Several approaches to reorganizing the data can mitigate this overhead by an order of magnitude: pre-aggregating data along the time axis (time-chunking); storing the data in a highly distributed file system; or storing data in distributed columnar databases. Storing a second copy of the data incurs extra costs, so some selection criteria must be employed, which would be driven by expected or actual usage by the end user community, balanced against the extra cost.

data storage↗

MARGInS Model-Based Analysis of Realizable Goals in Systems

The high complexity of modern aircraft and spacecraft requires elaborate Verification and Validation (V&V) approaches to make sure that such complex systems work properly and reliably. MARGInS is a framework for the analysis, understanding, and prediction of the behavior of a complex, hybrid system. MARGInS contains a set of machine learning and statistical algorithms for multivariate clustering, treatment learning, critical factor determination, time-series analysis, event prediction, and safety-boundary detection and characterization. The framework supports system testing and can be configured to find novel features in test suites, determine classes of behavior, propose new experiments that can efficiently explore and characterize the boundaries between classes of system behavior, and to create visualizations and reports.

He, Yuning↗

Nonlinear Dynamic Control Derivative Analysis for Aircraft with Application to Transonic Truss-Braced Wing

This paper presents the development of a nonlinear dynamic control derivative estimation method. A nonlinear aerodynamic model is developed to account for the effects of large control surface deflections on aircraft aerodynamic forces and moments. A series of unsteady RANS CFD simulations is performed to simulate the control surface oscillations at various reduced frequencies. The time-domain data are transformed into the frequency-domain data by a Fourier series analysis. Transfer functions of the dynamic control derivatives are then estimated by a frequency-domain regression. The method is applied to the Transonic Truss-Braced Wing (TTBW) to estimate the dynamic control derivatives for the elevator, aileron, and rudder.

Aircraft Control Derivatives↗

Plio-Pleistocene time evolution of the 100-kyr cycle in marine paleoclimate records

A new time-series analysis technique (called envelope inversion), which is based on multiple taper spectral analysis, is used to address the question of an abrupt versus a gradual onset of the 100-kyr ice-age periodicity in the middle Pleistocene. Three long (greater than 2.6 m.y.) time series from Deep Sea Drilling Project site 607 (midlatitude Atlantic) and Ocean Drilling Program site 677 (equatorial Pacific) were analyzed using delta(O-18) records. Results do not yield compelling evidence for an abrupt change in the 100-kyr delta(O-18) signal. Rather, the results suggest that the 100-kyr delta(O-18) cycle is phase-locked with the 124-kyr eccentricity cycle some 300-400 kyr prior to its late Pleistocene growth in amplitude and phase lock with the 95-kyr eccentricity cycle.

Park, Jeffrey↗

The Latitude Dependence of the Effect of Pinatubo on Stratospheric Ozone

Statistical analysis of TOMS and SBLT total ozone data indicate that the eruption of Pinatubo in 1991 led to a significant decrease in ozone at northern midlatitudes with little or no effect at southern midlatitudes. We argue that this puzzling absence of a southern hemisphere effect may be an artifact of the statistical analysis. We have run a 3D CTM simulation of the past 30 years of stratospheric photochemistry with variable forcing due to chlorine/bromine compounds, solar ultraviolet radiation, and volcanic aerosols. This integration used winds from the FVGCM, which has similar interannual variability to the atmosphere. When this CTM output was examined with a standard time-series analysis, we found an effect of Pinatubo in the southern hemisphere, but not in the northern hemisphere. We then reran the CTM without volcanic aerosols. The subtraction of the two simulations indicated that, as expected, that Pinatubo affected both hemispheres in the model. This means that the northern hemisphere effect was in the model but did not show up in the statistical analysis. We also had an on-line parameterized chemical ozone tracer with seasonally repeating production and loss over the simulation. We used this as a dynamical surrogate to remove interannual variability from the original model output. The residual time series was then analyzed for the Pinatubo effect and we were able to find it in both hemispheres. We suggest that the combination of the two volcanoes, El Chichon and Pinatubo, with the solar cycle and interannual variability led to this problem of analysis in the northern hemisphere of our model. We furthermore suggest that a similar think may be occurring in the southern hemisphere of the data. An analysis of the atmosphere's southern hemisphere with a good dynamical surrogate may solve the mystery of the missing southern hemisphere effect of Pinatubo on ozone.

Stolarski, Richard S.↗

Con Connections: Detecting Fraud from Abstracts using Topological Data Analysis

In this paper we present a novel approach for identifying fraudulent papers from their titles and abstracts. The premise of the approach is that there are holes in the presentation of the approach and findings of fraudulent research papers. As an abstract is intended to highlight key features of the approach as well as important conclusions the authors seek to determine if the assumed existence of holes can be identified from analysis of abstracts alone. The data set considered is derived from papers sharing a single author with labels determined based on a formal linguistic analysis of the complete documents. To detect these logical and literary holes we utilize techniques from topological data analysis which summarizes data based on the presence of multi-dimensional, topological holes. We find that, in fact, topological features derived through a combination of techniques in natural language processing and time-series analysis allow for superior detection of the fraudulent papers than the natural language processing tools alone. Thus we conclude that the connections and holes present in the abstracts of research cons contributes to an ability to infer the scientific validity of the corresponding work.

Tymochko, Sarah J.↗

Linear and nonlinear trending and prediction for AVHRR time series data

The variability of AVHRR calibration coefficient in time was analyzed using algorithms of linear and non-linear time series analysis. Specifically we have used the spline trend modeling, autoregressive process analysis, incremental neural network learning algorithm and redundancy functional testing. The analysis performed on available AVHRR data sets revealed that (1) the calibration data have nonlinear dependencies, (2) the calibration data depend strongly on the target temperature, (3) both calibration coefficients and the temperature time series can be modeled, in the first approximation, as autonomous dynamical systems, (4) the high frequency residuals of the analyzed data sets can be best modeled as an autoregressive process of the 10th degree. We have dealt with a nonlinear identification problem and the problem of noise filtering (data smoothing). The system identification and filtering are significant problems for AVHRR data sets. The algorithms outlined in this study can be used for the future EOS missions. Prediction and smoothing algorithms for time series of calibration data provide a functional characterization of the data. Those algorithms can be particularly useful when calibration data are incomplete or sparse.

Smid, J.↗

Process air quality data

Air quality sampling was conducted. Data for air quality parameters, recorded on written forms, punched cards or magnetic tape, are available for 1972 through 1975. Computer software was developed to (1) calculate several daily statistical measures of location, (2) plot time histories of data or the calculated daily statistics, (3) calculate simple correlation coefficients, and (4) plot scatter diagrams. Computer software was developed for processing air quality data to include time series analysis and goodness of fit tests. Computer software was developed to (1) calculate a larger number of daily statistical measures of location, and a number of daily monthly and yearly measures of location, dispersion, skewness and kurtosis, (2) decompose the extended time series model and (3) perform some goodness of fit tests. The computer program is described, documented and illustrated by examples. Recommendations are made for continuation of the development of research on processing air quality data.

Butler, C. M.↗

PYSAT: Python Satellite Data Analysis Toolkit

A common problem in space science data analysis is combining complementary data sources that are provided and analyzed in different formats and programming languages. The Python Satellite Data Analysis Toolkit (pysat) addresses this issue by providing an open source toolkit that implements the general process of space science data analysis, from beginning to end, in an instrumentindependent manner. This toolkit uses an Instrument object that enables systematic analysis of science data from a variety of platforms within a single interface. Basic functions such as downloading, loading, and cleaning are included for all supported instruments. Common analysis routines are also included, which are instrument and data source independent. A nanokernel is used to provide instrument independence, it is attached to the Instrument object and mediates the systematic and arbitrary modification of loaded data. Pysat uses the nanokernel to improve the rigor of time series analysis, support onthefly orbit determination, and cleanly span file breaks. Pysat's functions and higherlevel scientific analysis features are validated through the use of unit testing. Further adoption by the community provides a set of scientific results produced by a common core, constituting a distributed heritage that supports the validity of the underlying processing and scientific output. These features are used to demonstrate consistency between derived electron density profiles and measured ion drifts, particularly downward ion drifts in the afternoon hours during extreme solar minimum. Pysat builds upon open source Python software that is freely available and encourages communitydriven development.

Stoneback, R.A.↗

Streamflow in the United States: Characteristics, trends, regime shifts, and extremes

Long-term streamflow observations contain essential information for understanding hydrological changes and managing water resources. A continental-scale dataset or analysis of temporal streamflow change is still lacking across hydrologic gauges in the Conterminous United States (CONUS). Here, we compiled 70 years of streamflow records from 1951 to 2021 at ~ 8000 hydrologic stations across the CONUS and characterized temporal trends, regime shifts, and extreme events using a Bayesian time series analysis algorithm. We found that the occurrences of sudden streamflow changes (e.g., regime shifts and extreme events) have been increasing with time across the CONUS. In addition, we derived 181 streamflow indicators that are valuable for hydrological and biological applications, such as the duration and frequency of high or low streamflow events. The Mississippi River Basin, especially the middle and lower parts, was a hot spot of high-frequency high-flow events. Overall, we anticipate the dataset generated here offers valuable information for understanding and quantifying changes in water resources across the CONUS.

54 ENVIRONMENTAL SCIENCES↗