Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical Algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
NASA NTRS2000

Early Results from the MODIS Atmosphere Cloud Algorithms

The Moderate Resolution Imaging Spectroradiometer (MODIS) is one of five instruments aboard the Terra Earth Observing System platform launched in December 1999. With 36 spectral bands from the visible through the infrared, and spatial resolution from 250m to 1km, the instrument provides an unprecedented opportunity for global cloud studies. A comprehensive set of remote sensing algorithms for cloud masking and retrieval of cloud physical and optical properties have been developed by members of the MODIS atmosphere team. The archived products from these algorithms have applications in climate change studies, climate modeling, numerical weather prediction, as well as fundamental atmospheric research. In addition to an extensive cloud mask, products include cloud top physical parameters (temperature, pressure, emissivity), cloud phase, cloud optical parameters (optical depth, effective particle radius, water path), visible cirrus reflectance, a contrail flag, and other derived parameters. All products are archived into two categories: pixel-level retrievals at a 1 km or 5 km spatial resolution at nadir (referred to as Level-2 products) and 1 degree global gridded statistics (Level-3 products). An overview of the MODIS atmosphere algorithms and products, their status, validation activities, and early level-2 and -3 results will be presented.

Platnick, S.↗
NASA NTRS1979

Autocorrelation in Landsat data

Many computer algorithms for the analysis of Landsat data have a statistical basis which requires that the observations comprise independent samples. Four distinct methods are employed to show that this assumption commonly is not fulfilled for these data. Each leads to a similar conclusion; the data must be sampled no closer than every 10th pixel in order to yield independent estimators. The implications of this are illustrated with a simple example.

Craig, R. G.↗
NASA NTRS1986

Imaging radar contributions to a major air-sea-ice interaction study in the Greenland Sea

By virtue of the Synthetic Aperture Radar (SAR's) imaging capabilities, such as all-weather imaging, relatively high resolution, and large dynamic range of backscatter from SAR ice and open ocean, information on the important marginal ice zone (MIZ) parameters can be derived from the SAR data. Information on ice edge location and location of ice-edge eddies, for example, can be obtained directly from examination of the imagery as can detection of ocean fronts and internal waves. With machine-assisted manual image analysis, estimates of ice concentration, floe size distributions, and ice field motion can also be derived. Full digital analysis, however, is required to obtain gravity wave spectral information and backscatter statistics for ice type discrimination and automated ice concentration algorithms.

Shuchman, Robert A.↗
NASA NTRS1991

The detection of X-rays from the hot interstellar medium of the Large Magellanic Cloud

A comprehensive reanalysis is presented of the Einstein IPC data base on the LMC, and a number of new algorithms are used to improve the reliability of the point source detection in this crowded region and to produce the first large-scale map of diffuse emission free from the effects of solar scattered X-rays and cosmic-ray particles. Algorithms described in detail include a technique to decontaminate fields containing solar scattered flux, a mechanism for obtaining a spectrum-weighted vignetting function, and a source excision and smoothing algorithm which results in a diffuse map of uniform statistical quality. A catalog of discrete X-rays sources in the direction of the LMC is presented which contains 33 new sources and eliminates a number of spurious and/or marginal directions from previous lists. A possible detection of the long-sought shadowing effect on the cosmic X-ray background produced by cold LMC gas is reported.

Wang, Q.↗
NASA NTRS1991

Autoclass: An automatic classification system

The task of inferring a set of classes and class descriptions most likely to explain a given data set can be placed on a firm theoretical foundation using Bayesian statistics. Within this framework, and using various mathematical and algorithmic approximations, the AutoClass System searches for the most probable classifications, automatically choosing the number of classes and complexity of class descriptions. A simpler version of AutoClass has been applied to many large real data sets, has discovered new independently-verified phenomena, and has been released as a robust software package. Recent extensions allow attributes to be selectively correlated within particular classes, and allow classes to inherit, or share, model parameters through a class hierarchy. The mathematical foundations of AutoClass are summarized.

Stutz, John↗
NASA NTRS1991

Galileo Attitude Determination: Experiences with a Rotating Star Scanner

The Galileo experience with a rotating star scanner is discussed in terms of problems encountered in flight, solutions implemented, and lessons learned. An overview of the Galileo project and the attitude and articulation control subsystem is given and the star scanner hardware and relevant software algorithms are detailed. The star scanner is the sole source of inertial attitude reference for this spacecraft. Problem symptoms observed in flight are discussed in terms of effects on spacecraft performance and safety. Sources of thse problems include contributions from flight software idiosyncrasies and inadequate validation of the ground procedures used to identify target stars for use by the autonomous on-board star identification algorithm. Problem fixes (some already implemented and some only proposed) are discussed. A general conclusion is drawn regarding the inherent difficulty of performing simulation tests to validate algorithms which are highly sensitive to external inputs of statistically 'rare' events.

Merken, L.↗
NASA NTRS1991

Bayesian classification theory

The task of inferring a set of classes and class descriptions most likely to explain a given data set can be placed on a firm theoretical foundation using Bayesian statistics. Within this framework and using various mathematical and algorithmic approximations, the AutoClass system searches for the most probable classifications, automatically choosing the number of classes and complexity of class descriptions. A simpler version of AutoClass has been applied to many large real data sets, has discovered new independently-verified phenomena, and has been released as a robust software package. Recent extensions allow attributes to be selectively correlated within particular classes, and allow classes to inherit or share model parameters though a class hierarchy. We summarize the mathematical foundations of AutoClass.

Hanson, Robin↗
NASA NTRS1993

Cloud detection using satellite measurements of infrared and visible radiances for ISCCP

This paper, the first of three, describes the cloud detection part of the International Satellite Cloud Climatology Project (ISCCP) analysis. Key features of the cloud detection alogrithm are (1) use of space and time radiance variation tests over several different space and time domains to account for the global variety of cloudy and clear characteristics, (2) estimation of clear radiance values for every time and place, and, (3) use of radiance thresholds that vary with the type of surface and climate regime. Design of the detection algorithm was supported by global, multiyear surveys of the statistical behavior of satellite-measured infrared and visible radiances to determine those characteristics that differentiate cloudy and clear scenes and how these characteristics vary among climate regimes. A summary of these statistical results is presented to illustrate how the cloud detection method works in a variety of circumstances. The sensitivity of the results to changing test parameter values is determined to provide a first estimate of the uncertainty of ISCCP cloud amounts. These test results (which exclude polar regions) suggest detection uncertainties of about 10% with possible negative biases of 5% (especially at night).

Rossow, Illiam B.↗
NASA NTRS2002

Using Clustering to Establish Climate Regimes from PCM Output

A multivariate statistical clustering technique--based on the k-means algorithm of Hartigan has been used to extract patterns of climatological significance from 200 years of general circulation model (GCM) output. Originally developed and implemented on a Beowulf-style parallel computer constructed by Hoffman and Hargrove from surplus commodity desktop PCs, the high performance parallel clustering algorithm was previously applied to the derivation of ecoregions from map stacks of 9 and 25 geophysical conditions or variables for the conterminous U.S. at a resolution of 1 sq km. Now applied both across space and through time, the clustering technique yields temporally-varying climate regimes predicted by transient runs of the Parallel Climate Model (PCM). Using a business-as-usual (BAU) scenario and clustering four fields of significance to the global water cycle (surface temperature, precipitation, soil moisture, and snow depth) from 1871 through 2098, the authors' analysis shows an increase in spatial area occupied by the cluster or climate regime which typifies desert regions (i.e., an increase in desertification) and a decrease in the spatial area occupied by the climate regime typifying winter-time high latitude perma-frost regions. The patterns of cluster changes have been analyzed to understand the predicted variability in the water cycle on global and continental scales. In addition, representative climate regimes were determined by taking three 10-year averages of the fields 100 years apart for northern hemisphere winter (December, January, and February) and summer (June, July, and August). The result is global maps of typical seasonal climate regimes for 100 years in the past, for the present, and for 100 years into the future. Using three-dimensional data or phase space representations of these climate regimes (i.e., the cluster centroids), the authors demonstrate the portion of this phase space occupied by the land surface at all points in space and time. Any single spot on the globe will exist in one of these climate regimes at any single point in time. By incrementing time, that same spot will trace out a trajectory or orbit between and among these climate regimes (or atmospheric states) in phase (or state) space. When a geographic region enters a state it never previously visited, a climatic change is said to have occurred. Tracing out the entire trajectory of a single spot on the globe yields a 'manifold' in state space representing the shape of its predicted climate occupancy. This sort of analysis enables a researcher to more easily grasp the multivariate behavior of the climate system.

Oglesby, Robert↗
NASA NTRS2013

Estimating Ground-Level PM(sub 2.5) Concentrations in the Southeastern United States Using MAIAC AOD Retrievals and a Two-Stage Model

Previous studies showed that fine particulate matter (PM(sub 2.5), particles smaller than 2.5 micrometers in aerodynamic diameter) is associated with various health outcomes. Ground in situ measurements of PM(sub 2.5) concentrations are considered to be the gold standard, but are time-consuming and costly. Satellite-retrieved aerosol optical depth (AOD) products have the potential to supplement the ground monitoring networks to provide spatiotemporally-resolved PM(sub 2.5) exposure estimates. However, the coarse resolutions (e.g., 10 km) of the satellite AOD products used in previous studies make it very difficult to estimate urban-scale PM(sub 2.5) characteristics that are crucial to population-based PM(sub 2.5) health effects research. In this paper, a new aerosol product with 1 km spatial resolution derived by the Multi-Angle Implementation of Atmospheric Correction (MAIAC) algorithm was examined using a two-stage spatial statistical model with meteorological fields (e.g., wind speed) and land use parameters (e.g., forest cover, road length, elevation, and point emissions) as ancillary variables to estimate daily mean PM(sub 2.5) concentrations. The study area is the southeastern U.S., and data for 2003 were collected from various sources. A cross validation approach was implemented for model validation. We obtained R(sup 2) of 0.83, mean prediction error (MPE) of 1.89 micrograms/cu m, and square root of the mean squared prediction errors (RMSPE) of 2.73 micrograms/cu m in model fitting, and R(sup 2) of 0.67, MPE of 2.54 micrograms/cu m, and RMSPE of 3.88 micrograms/cu m in cross validation. Both model fitting and cross validation indicate a good fit between the dependent variable and predictor variables. The results showed that 1 km spatial resolution MAIAC AOD can be used to estimate PM(sub 2.5) concentrations.

aerosol optical depth↗
NASA NTRS2016

Analyzing and Predicting Effort Associated with Finding and Fixing Software Faults

Context: Software developers spend a significant amount of time fixing faults. However, not many papers have addressed the actual effort needed to fix software faults. Objective: The objective of this paper is twofold: (1) analysis of the effort needed to fix software faults and how it was affected by several factors and (2) prediction of the level of fix implementation effort based on the information provided in software change requests. Method: The work is based on data related to 1200 failures, extracted from the change tracking system of a large NASA mission. The analysis includes descriptive and inferential statistics. Predictions are made using three supervised machine learning algorithms and three sampling techniques aimed at addressing the imbalanced data problem. Results: Our results show that (1) 83% of the total fix implementation effort was associated with only 20% of failures. (2) Both safety critical failures and post-release failures required three times more effort to fix compared to non-critical and pre-release counterparts, respectively. (3) Failures with fixes spread across multiple components or across multiple types of software artifacts required more effort. The spread across artifacts was more costly than spread across components. (4) Surprisingly, some types of faults associated with later life-cycle activities did not require significant effort. (5) The level of fix implementation effort was predicted with 73% overall accuracy using the original, imbalanced data. Using oversampling techniques improved the overall accuracy up to 77%. More importantly, oversampling significantly improved the prediction of the high level effort, from 31% to around 85%. Conclusions: This paper shows the importance of tying software failures to changes made to fix all associated faults, in one or more software components and/or in one or more software artifacts, and the benefit of studying how the spread of faults and other factors affect the fix implementation effort.

software fix implementation effort↗
NASA NTRS2016

The GPM Combined Algorithm

In this paper, the operational Global Precipitation Measurement (GPM) mission combined radar-radiometer algorithm is thoroughly described. The operational combined algorithm is designed to reduce uncertainties in GPM Core Observatory precipitation estimates by effectively integrating complementary information from the GPM Dual-Frequency Precipitation Radar (DPR) and the GPM Microwave Imager (GMI) into an optimal, physically consistent precipitation product. Although similar in many respects to previously developed combined algorithms, the GPM combined algorithm has several unique features that are specifically designed to meet the GPM objectives of deriving, based on GPM Core Observatory information, accurate and physically consistent precipitation estimates from multiple spaceborne instruments, and ancillary environmental data from reanalyses. The algorithm features an optimal estimation framework based on a statistical formulation of the Gauss-Newton method, a parameterization for the nonuniform distribution of precipitation within the radar fields of view, a methodology to detect and account for multiple scattering in Ka-band DPR observations, and a statistical deconvolution technique that allows for an efficient sequential incorporation of radiometer information into DPR precipitation retrievals.

Grecu, Mircea↗
NASA NTRS2019

Star Tracker Accuracy Improvement and Optimization for Attitude Measurement in Three-Axis

High precision attitude measurement systems obviate the need for the beacon from the receiver making it possible for the spacecraft to beam a laser communications signal to a ground station without the ground station advertising its location. The research presented targets new detection and estimation methods to improve the accuracy in locating stars on a focal plane detector, and an understanding of the effects of changes in the optics design parameters and aberration, including defocus, on the navigation solution itself. This understanding can lead to an optimization of the attitude solution with respect to those optics realm parameter changes. The methodology discussed includes the development of a model of a current star tracker system. Using this model, multiple algorithms are implemented, including a multi-hypothesis method (MHT), to detect and estimate the position of the stars on the focal plane detector. It will be shown that using the MHT for detection and estimation, a greater accuracy can be found for each star estimation from more traditional detection and estimation algorithms. The approach then uses the model to develop statistics of the star tracker and the attitude estimation outputs to understand the accuracy, or variance, of the system's attitude solution. This solution is repeated for a range of defocus aberration, and a lower limit to the variance of the attitude solution is shown. A Cramer Rao lower bound solution is derived for the star tracker system and the results are compared to the Monte Carlo analysis from the model and shown to correlate very well. The approach uses a star image not as a Gaussian spot on the focal plane as done in previous work, and use of an image that includes the effects of aberrations of the optic system, and the effects of under-sampling and noise from the focal plane detector as well. Analysis includes exploring a star tracker's accuracy improvement through the combination of focus error and under-sampling effects alone, possibly contradicting conventional wisdom and approaches.

Lichter, Michael J.↗
NASA NTRS2000

MODIS Retrievals of Cloud Optical Thickness and Particle Radius

The Moderate Resolution Imaging Spectroradiometer (MODIS) provides an unprecedented opportunity for global cloud studies with 36 spectral bands from the visible through the infrared, and spatial resolution from 250 m to 1 km at nadir. In particular, all solar window bands useful for simultaneous retrievals of cloud optical thickness and particle size (0.67, 0.86, 1.2, 1.6, 2.1, and 3.7 micron bands) are now available on a single satellite instrument/platform for the first time. An operational algorithm for the retrieval of these optical and cloud physical properties (including water path) have been developed for both liquid and ice phase clouds. The product is archived into two categories: pixel-level retrievals at 1 km spatial resolution (referred to as a Level-2 product) and global gridded statistics (Level-3 product). An overview of the MODIS cloud retrieval algorithm and early level-2 and -3 results will be presented. A number of MODIS cloud validation activities are being planned, including the recent Southern Africa Regional Science Initiative 2000 (SAFARI-2000) dry season campaign conducted in August/September 2000. The later part of the experiment concentrated on MODIS validation in the Namibian stratocumulus regime off the southwest coast of Africa. Early retrieval results from this regime will be discussed.

Platnick, S.↗
NASA NTRS1999

Abel Inversion of Deflectometric Measurements in Dynamic Flows

We present an Abel-inversion algorithm to reconstruct mean and rms refractive-index profiles from spatially resolved statistical measurements of the beam-deflection angle in time-dependent, axisymmetric flows. An oscillating gas-jet diffusion flame was investigated as a test case for applying the algorithm. Experimental data were obtained across the whole field by a rainbow schlieren apparatus. Results show that simultaneous multipoint measurements are necessary to reconstruct the rms refractive index accurately.

Agrawal, Ajay K.↗
NASA NTRS2010

Using MERRA Gridded Innovations for Quantifying Uncertainties in Analysis Fields and Diagnosing Observing System Inhomogeneities

MERRA is a NASA reanalysis for the satellite era using a major new version of the Goddard Earth Observing System Data Assimilation System Version 5 (GEOS-5). The project focuses on historical analyses of the hydrological cycle on a broad range of weather and climate time scales and places the NASA EOS suite of observations in a climate context. The characterization of uncertainty in reanalysis fields is a commonly requested feature by users of such data. While intercomparison with reference data sets is common practice for ascertaining the realism of the datasets, such studies typically are restricted to long term climatological statistics and seldom provide state dependent measures of the uncertainties involved. In principle, variational data assimilation algorithms have the ability of producing error estimates for the analysis variables (typically surface pressure, winds, temperature, moisture and ozone) consistent with the assumed background and observation error statistics. However, these "perceived error estimates" are expensive to obtain and are limited by the somewhat simplistic errors assumed in the algorithm. The observation minus forecast residuals (innovations) by-product of any assimilation system constitutes a powerful tool for estimating the systematic and random errors in the analysis fields. Unfortunately, such data is usually not readily available with reanalysis products, often requiring the tedious decoding of large datasets and not so-user friendly file formats. With MERRA we have introduced a gridded version of the observations/innovations used in the assimilation process, using the same grid and data formats as the regular datasets. Such dataset empowers the user with the ability of conveniently performing observing system related analysis and error estimates. The scope of this dataset will be briefly described. We will present a systematic analysis of MERRA innovation time series for the conventional observing system, including maximum-likelihood estimates of background and observation errors, as well as global bias estimates. Starting with the joint PDF of innovations and analysis increments at observation locations we propose a technique for diagnosing bias among the observing systems, and document how these contextual biases have evolved during the satellite era covered by MERRA.

da Silva, Arlindo↗
NASA NTRS1989

Modeling, simulation, and analysis of optical remote sensing systems

Remote Sensing of the Earth's resources from space-based sensors has evolved in the past 20 years from a scientific experiment to a commonly used technological tool. The scientific applications and engineering aspects of remote sensing systems have been studied extensively. However, most of these studies have been aimed at understanding individual aspects of the remote sensing process while relatively few have studied their interrelations. A motivation for studying these interrelationships has arisen with the advent of highly sophisticated configurable sensors as part of the Earth Observing System (EOS) proposed by NASA for the 1990's. Two approaches to investigating remote sensing systems are developed. In one approach, detailed models of the scene, the sensor, and the processing aspects of the system are implemented in a discrete simulation. This approach is useful in creating simulated images with desired characteristics for use in sensor or processing algorithm development. A less complete, but computationally simpler method based on a parametric model of the system is also developed. In this analytical model the various informational classes are parameterized by their spectral mean vector and covariance matrix. These class statistics are modified by models for the atmosphere, the sensor, and processing algorithms and an estimate made of the resulting classification accuracy among the informational classes. Application of these models is made to the study of the proposed High Resolution Imaging Spectrometer (HRIS). The interrelationships among observational conditions, sensor effects, and processing choices are investigated with several interesting results.

Kerekes, John Paul↗