Search NASA⌕ Search

SEARCH · Search NASA

Results for “variance component analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

IMERG and GPCP Seasonality and Response to Climate and Weather Variability

The Integrated Multi-satellitE Retrievals for GPM (IMERG) and the The Global Precipitation Climatology Project (GPCP) are two of the most popular precipitation products. IMERG is a relatively new dataset that targets the needs primarily of the hydrological community by resolving the hydrological cycle of precipitation at fine temporal (30-minutes) and spatial (10-km) scales. IMERG only recently exceeded the user base of the highly successful, but discontinued in 2019, TRMM Multi-satellite Precipitation Analysis (TMPA). GPCP, on the other hand, has traditionally been strong in the climate research community, and recently has been revised under the framework of NASA's Making Earth System Data records for Use in Research Environments (MEaSUREs) program. Both IMERG and GPCP are similar in the underlying approaches to achieve global coverage, in particular using satellite microwave and infrared observations, and adjusting the precipitation retrieval with rain gauge information. While there is a tendency to use both datasets interchangeably, differences remain and some of them limit the usage of IMERG as a climate data record at this point. By applying Principal Component Analysis, we identify the differences and similarities mode-by-mode, and further the guidance on suggested usage of IMERG as a climate data record. As an example in the attached figure, IMERG vs GPSP differences in the explained variance by the two leading seasonal modes can be identified, mainly in the extreme southern latitudes, and over western boundary currents (Gulfstream and Kuroshio). At the preparation time for this presentation, the new version "07"of IMERG was in the works that may resolve the issues presented here. Nevertheless, our analysis can help to gauge the uncertainties of the studies already done using the currently existing IMERG version "06", and evaluate the improvements in the upcoming version "07".

Andrey Savtchenko↗

MSL Telecom Automated Anomaly Detection

The Mars Science Laboratory (MSL) Telecom Operations Team at the Jet Propulsion Laboratory (JPL) has implemented a machine learning system in order to automate the anomaly detection process as a part of daily operations. Machine learning enables reliable detection of anomalies in Telecom-related telemetry and automated reporting of Telecom subsystem status, resulting in an 90% reduction in team workload and improved anomaly detection reliability. At present, machine learning methods are used to detect: 1. Anomalous long-term trends in telemetry data 2. Anomalous time-domain evolution of telemetry values Both types of anomalies pose their own unique challenges that are addressed in different ways. In the first case, long term trending of daily minima, maximum, and mean telemetry values in temperatures, currents, voltages, and radio frequency (RF) power levels is used in addition to hard threshold safety checks to look for changes in long-term equipment health and performance. Long-term trending methods allow for ordinary seasonal variations in these quantities caused by temperature changes over the course of the Martian year while allowing operators to determine whether current performance remains in line with historical values from previous years. Changes in long-term trends can provide important insights into the health and status of the rover's on-board systems as well as valuable early warning if subtle degradation begins to take hold. But while trending of daily statistics is valuable, it does not detect anomalies in the short-term time evolution of data over the course of minutes or hours during a day, and this task is handled with short-term shape analysis. Principal components analysis (PCA) has been found to provide robust detection of short-term anomalies, and several examples of the use of PCA to detect actual anomalous events will be provided here. In using PCA, we use both the percentage of explained variance and also a log likelihood test on the PCA expansion coefficients to flag telemetry data for human review. Previous work in the field of spacecraft anomaly detection includes [1] for MSL and [2] for some other JPL missions.

Mukai, Ryan↗

Power spectral estimation algorithms

Algorithms to estimate the power spectrum using Maximum Entropy Methods were developed. These algorithms were coded in FORTRAN 77 and were implemented on the VAX 780. The important considerations in this analysis are: (1) resolution, i.e., how close in frequency two spectral components can be spaced and still be identified; (2) dynamic range, i.e., how small a spectral peak can be, relative to the largest, and still be observed in the spectra; and (3) variance, i.e., how accurate the estimate of the spectra is to the actual spectra. The application of the algorithms based on Maximum Entropy Methods to a variety of data shows that these criteria are met quite well. Additional work in this direction would help confirm the findings. All of the software developed was turned over to the technical monitor. A copy of a typical program is included. Some of the actual data and graphs used on this data are also included.

Bhatia, Manjit S.↗

The El Nino/Southern Oscillation and Future Soybean Prices

Recently, it was shown that the application of a method combining singular spectrum analysis (SSA) and the maximum entropy method to univariate indicators of the coupled ocean-atmosphere El Nino/Southern Oscillation (ENSO) phenomenon can be helpful in determining whether an El Nino (EN) or La Nina (LN) event will occur. SSA - a variant of principal component analysis applied in the time domain - filters out variability unrelated to ENSO and separates the quasi-biennial (QB), two-to-three year variability, from a lower-frequency (LF) four-to-six year EN-LN cycle; the total variance associated with ENSO combines the QB and LF modes. ENSO has been known to affect weather conditions over much of the globe. For example, EN events have been connected with unusually rainy weather over the Central and Western US, while the opposite phases of the oscillation (LN) have been plausibly associated with extreme dry conditions over much of the same geographical area...

Keppenne, C.↗

Large-Scale Circulation and Climate Variability

The causes of regional climate trends cannot be understood without considering the impact of variations in large-scale atmospheric circulation and an assessment of the role of internally generated climate variability. There are contributions to regional climate trends from changes in large-scale latitudinal circulation, which is generally organized into three cells in each hemisphere-Hadley cell, Ferrell cell and Polar cell-and which determines the location of subtropical dry zones and midlatitude jet streams. These circulation cells are expected to shift poleward during warmer periods, which could result in poleward shifts in precipitation patterns, affecting natural ecosystems, agriculture, and water resources. In addition, regional climate can be strongly affected by non-local responses to recurring patterns (or modes) of variability of the atmospheric circulation or the coupled atmosphere-ocean system. These modes of variability represent preferred spatial patterns and their temporal variation. They account for gross features in variance and for teleconnections which describe climate links between geographically separated regions. Modes of variability are often described as a product of a spatial climate pattern and an associated climate index time series that are identified based on statistical methods like Principal Component Analysis (PC analysis), which is also called Empirical Orthogonal Function Analysis (EOF analysis), and cluster analysis.

Perlwitz, J.↗

Ground-Based High Spectral Resolution Lidar Observation of Aerosol Vertical Distribution in the Summertime Southeast United States

As part of the Southeast United States-based Studies of Emissions and Atmospheric Composition, Clouds and Climate Coupling by Regional Surveys (SEAC4RS), and collinear with part of the Southeast Atmosphere Study, the University of Wisconsin High Spectral Resolution Lidar system was deployed to the University of Alabama from 19 June to 4 November 2013. With a collocated Aerosol Robotic Network (AERONET) sun photometer, a nearby Chemical Speciation Network (PM2.5) measurement station, and near daily ozonesonde releases for the August-September SEAC4RS campaign, the site allowed the regions first comprehensive diurnal monitoring of aerosol particle vertical structure. A 532nm lidar ratio of 55 sr provided good closure between aerosol backscatter and AERONET (aerosol optical thickness, AOT). A principle component analysis was performed to identify key modes of variability in aerosol backscatter. ''Fair weather'' days exhibited classic planetary boundary layer structure of a mixed layer accounting for approx. 50% of AOT and an entrainment zone providing another 25%. An additional 5-15% of variance is gained from the lower free troposphere from either convective detrainment or frequent intrusions of western United States biomass burning smoke. Generally, aerosol particles were contained below the 0 C level, a common level of stability in convective regimes. However, occasional strong injections of smoke to the upper troposphere were also observed, accounting for the remaining 10-15% variability in AOT. Examples of these common modes of variability in frontal and convective regimes are presented, demonstrating why AOT often has only a weak relationship to surface PM2.5 concentration.

HSRL↗

Eigenvector analysis of some observed and model-generated Climatological fields

An empirical orthogonal function analysis of monthly mean synoptic fields computed with a general circulation model and the corresponding observed climatological patterns is presented. A computer program was used to compute the principal components of the data matrices representing global maps of various observed and model-generated climatological fields. The variables analyzed were: 500mb geopotential height, 850 mb temperature, and sea level pressure. It is concluded that eigenvector analysis of observed and model-generated synoptic climatological fields is a useful diagnostic aid in the evaluation of global model simulation. The maps of any climatological variables are readily decomposed into a few orthogonal components which account for a large fraction of the total spatial variance, and the observed and model-generated patterns may then be compared in terms of these principal components of the original data matrices.

Dennis, M.↗

Magnetic field directional discontinuities. I - Minimum variance errors

The paper deals with a statistical analysis of the errors associated with a minimum variance analysis of directional discontinuities by use of an idealized model of these discontinuities and various simulations, and also by an examination of actual Mariner 10 interplanetary magnetic field data. An empirical expression is derived for the magnitude of the error in an estimated discontinuity normal component, relative to the total field across the directional discontinuity. The analysis was performed primarily to aid in differentiating between interplanetary tangential and rotational discontinuities observed by Mariner 10.

Lepping, R. P.↗

Two biased estimation techniques in linear regression: Application to aircraft

Several ways for detection and assessment of collinearity in measured data are discussed. Because data collinearity usually results in poor least squares estimates, two estimation techniques which can limit a damaging effect of collinearity are presented. These two techniques, the principal components regression and mixed estimation, belong to a class of biased estimation techniques. Detection and assessment of data collinearity and the two biased estimation techniques are demonstrated in two examples using flight test data from longitudinal maneuvers of an experimental aircraft. The eigensystem analysis and parameter variance decomposition appeared to be a promising tool for collinearity evaluation. The biased estimators had far better accuracy than the results from the ordinary least squares technique.

Klein, Vladislav↗

Application of Spectral Analysis Techniques in the Intercomparison of Aerosol Data: 1. an EOF Approach to the Spatial-Temporal Variability of Aerosol Optical Depth Using Multiple Remote Sensing Data Sets

Many remote sensing techniques and passive sensors have been developed to measure global aerosol properties. While instantaneous comparisons between pixel-level data often reveal quantitative differences, here we use Empirical Orthogonal Function (EOF) analysis, also known as Principal Component Analysis, to demonstrate that satellite-derived aerosol optical depth (AOD) data sets exhibit essentially the same spatial and temporal variability and are thus suitable for large-scale studies. Analysis results show that the first four EOF modes of AOD account for the bulk of the variance and agree well across the four data sets used in this study (i.e., Aqua MODIS, Terra MODIS, MISR, and SeaWiFS). Only SeaWiFS data over land have slightly different EOF patterns. Globally, the first two EOF modes show annual cycles and are mainly related to Sahara dust in the northern hemisphere and biomass burning in the southern hemisphere, respectively. After removing the mean seasonal cycle from the data, major aerosol sources, including biomass burning in South America and dust in West Africa, are revealed in the dominant modes due to the different interannual variability of aerosol emissions. The enhancement of biomass burning associated with El Niño over Indonesia and central South America is also captured with the EOF technique.

variability↗

Spherical harmonic analysis of a model-generated climatology

Monthly mean fields of 850 mb temperature (T850), 500 mb geopotential height (G500) and sea level pressure (SLP) were generated in the course of a five-year climate simulation run with a global general circulation model. Both the model-generated climatology and an observed climatology were subjected to spherical harmonic analysis, with separate analyses of the globe and the Northern Hemisphere. Comparison of the dominant harmonics of the two climatologies indicates that more than 95% of the area-weighted spatial variance of G500 and more than 90% of that of T850 are explained by fewer than three components, and that the model adequately simulates these large-scale characteristics. On the other hand, as many as 25 harmonics are needed to explain 95% of the observed variance of SLP, and the model simulation of this field is much less satisfactory. The model climatology is also evaluated in terms of the annual cycles of the dominant harmonics.

Christidis, Z. D.↗

Modes of interannual variability in the stratosphere

During 1964-91, stratospheric temperature and circulation in Northern Hemisphere winter varied interannually on time scales from 2 to about 12 years. A substantial percentage of December-February interannual variance was correlated with the quasi-biennial oscillation (QBO). Additional monthly variance could be accounted for by quasi-decadal oscillation and QBO/low-frequency modulation. The QBO was the largest and most consistent of these signals, and its decadal modulation explains an apparent correlation with the solar cycle depending on the sign of the QBO - an interpretation supported by principal component analysis.

Dunkerton, Timothy J.↗

Passive microwave observations of the Wedell Sea during austral winter and early spring

The results of multispectral passive microwave observations (6.7 to 90-GHz) are presented from the cruises of the FS Polarstern in the Weddell Sea from July to December 1986. This paper includes primarily the analysis of radiometric observations taken at ice station sites. Averaged emissivity spectra for first-year (FY) ice were relatively constant throughout the experiment and were not statistically different from FY ice signatures in the Arctic. Detailed ice characterization was carried out at each site to compare the microwave signatures of the ice with the physical properties. Absorption optical depths of FY ice were found to be sufficiently high that only the structure in the upper portions of the ice contributed significantly to interstation emissivity variations. The emissivities at 90-GHz, e(90), had the greatest variance. Both e(90) at vertical polarization and GR(sub e)(90, 18.7)(defined as (e(sub V)(90)-e(sub V)(18.7))/e(sub V)(90 + e(sub V)(18.7)) depended on the scattering optical depth which is a function of the snow grain diameter and layer thickness. The variance showed a latitude dependence and is probably due to an increase in the strength of snow metamorphism nearer the northern edge of the ice pack. The contribution of variations of near-surface brine volume to the emissivity was not significant over the range of values encountered at the station sites. Emissivity spectra are presented for a range of thin ice types. Unsupervised principal component analysis produced three significant eigenvectors and showed a separation among four different surface types: open water, thin ice, FY ice, and FY ice with a thick snow cover. A comparison with SMMR satellite data showed that average ice concentrations derived from the ship's ice watch log were consistent with the satellite concentrations. The surface based emissivities for FY ice were also compared with emissivities calculated from scanning multichannel microwave radiometer (SMMR) satellite radiances. Best agreement was found at 6.7 and 10-GHz, while at 18 and 37-GHz, SMMR emissivities were slightly lower than surface based results. For the three lower frequencies agreement was found within a confidence limit of 95% and for 37-GHz within about 90%.

Grenfell, T. C.↗

Digital Filter Separates Signal From Noise

Variance of signal-estimation error minimized. Mathematical technique extracts best estimates of signal component from periodic digital samples of signal plus noise. Technique combines Kalman- and smoothingfilter algorithms to minimize mean-square estimation error based on past, present, and predicted samples of signal plus noise. Technique useful in image analysis and other applications involving processing of noisy signals.

Lear, W. M.↗

Jovian Chromophore Characteristics from Multispectral HST Images

The chromophores responsible for coloring the jovian atmosphere are embedded within Jupiter's vertical aerosol structure. Sunlight propagates through this vertical distribution of aerosol particles, whose colors are defined by omega-bar (sub 0)(lambda), and we remotely observe the culmination of the radiative transfer as I/F(lambda). In this study, we employed a radiative transfer code to retrieve omega-bar (sub 0)(lambda) for particles in Jupiter's tropospheric haze at seven wavelengths in the near-UV and visible regimes. The data consisted of images of the 2008 passage of Oval BA to the south of the Great Red Spot obtained by the Wide Field Planetary Camera 2 on-board the Hubble Space Telescope. We present derived particle colors for locations that were selected from 14 weather regions, which spanned a large range of observed colors. All omega-bar (sub 0)(lambda) curves were absorbing in the blue, and omega-bar (sub 0)(lambda) increased monotonically to approximately unity as wavelength increased. We found accurate fits to all omega-bar (sub 0)(lambda) curves using an empirically derived functional form: omega-bar (sub 0)(lambda) = 1 A exp(-B lambda). The best-fit parameters for the mean omega-bar (sub 0)(lambda) curve were A = 25.4 and B = 0.0149 for lambda in units of nm. We performed a principal component analysis (PCA) on our omega-bar (sub 0)(lambda) results and found that one or two independent chromophores were sufficient to produce the variations in omega-bar (sub 0)(lambda). A PCA of I/F(lambda) for the same jovian locations resulted in principal components (PCs) with roughly the same variances as the omega-bar (sub 0)(lambda) PCA, but they did not result in a one-to-one mapping of PC amplitudes between the omega-bar (sub 0)(lambda) PCA and I/F(lambda) PCA. We suggest that statistical analyses performed on I/ F(lambda) image cubes have limited applicability to the characterization of chromophores in the jovian atmosphere due to the sensitivity of 1/ F(lambda) to horizontal variations in the vertical aerosol distribution.

Strycker, Paul D.↗

Regional climates in the GISS global circulation model - Synoptic-scale circulation

A major weakness of current general circulation models (GCMs) is their perceived inability to predict reliably the regional consequences of a global-scale change, and it is these regional-scale predictions that are necessary for studies of human-environmental response. For large areas of the extratropics, the local climate is controlled by the synoptic-scale atmospheric circulation, and it is the purpose of this paper to evaluate the synoptic-scale circulation of the Goddard Institute for Space Studies (GISS) GCM. A methodology for validating the daily synoptic circulation using Principal Component Analysis is described, and the methodology is then applied to the GCM simulation of sea level pressure over the continental United States (excluding Alaska). The analysis demonstrates that the GISS 4 x 5 deg GCM Model II effectively simulates the synoptic-scale atmospheric circulation over the United States. The modes of variance describing the atmospheric circulation of the model are comparable to those found in the observed data, and these modes explain similar amounts of variance in their respective datasets. The temporal behavior of these circulation modes in the synoptic time frame are also comparable.

Hewitson, B.↗

Predictability of Zonal Means During Boreal Summer

This study examines the predictability of seasonal means during boreal summer. The results are based on ensembles of June-July-August (JJA) simulations (started in mid May) carried out with the NASA Seasonal-to-Interannual Prediction Project (NSIPP-1) atmospheric general circulation model (AGCM) forced with observed sea surface temperatures (SSTS) and sea ice for the years 1980-1999. We find that the predictability of the JJA extra-tropical height field is primarily in the zonal mean component of the response to the SST anomalies. This contrasts with the cold season (January-February-March) when the predictability of seasonal means in the boreal extratropics is primarily in the wave component of the El Nino/Southern Oscillation (ENSO) response. Two patterns dominate the interannual variability of the ensemble mean JJA zonal mean height field. One has maximum variance in the tropical/subtropical upper troposphere, while the other has substantial variance in middle latitudes of both hemispheres. Both are symmetric with respect to the equator. A regression analysis suggests that the tropical/subtropical pattern is associated with SST anomalies in the far eastern tropical Pacific and the Indian Ocean, while the middle latitude pattern is forced by SST anomalies in the tropical Pacific just east of the dateline. The two leading zonal height patterns are reproduced in model runs forced with the two leading JJA SST patterns of variability. A comparison with observations shows a signature of the middle latitude pattern that is consistent with the occurrence of dry and wet summers over the United States. We hypothesize that both patterns, while imposing only weak constraints on extratropical warm season continental-scale climates, may play a role in the predilection for drought or pluvial conditions.

Schubert, Siegfried↗

Interannual Variability and Trends of Extratropical Ozone, Part II: Southern Hemisphere: Southern Hemisphere - Part 2

A principal component analysis (PCA) is applied to the Southern Hemisphere (SH) total column ozone following the method established for analyzing the data in the Northern Hemisphere (NH) in a companion paper. The interannual variability (IAV) of extratropical O-3 in the SH is characterized by four main modes, which account for 75% of the total variance. The first two leading modes are approximately zonally symmetric and relate to the Southern Hemisphere annular mode and the quasi-biennial oscillation. The third and fourth modes exhibit wavenumber-1 structures. Contrary to the Northern Hemisphere, the third and fourth are nor related to stationary waves. Similar results obtained for the 30 100-hPa geopotential thickness.The decreasing O3 trend in the SH is captured in the first mode. The largest trend is at the South Pole, with value similar to-2 Dobson Units (DU)/yr. Both the spatial pattern and trends in the column ozone are captured by the Goddard Earth Observation System chemistry-climate model (GEOS-CCM) in the SH.

Yung, Y. L.↗