SEARCH · Search NASA

Results for “Statistical Algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

All sources NASA NTRS DOE OSTI

NASA NTRS2021

Operational Detection of Sun Glints in DSCOVR EPIC Images

Satellite images often feature sun glints caused by the specular reflection of sunlight from water surfaces or from horizontally oriented ice crystals occurring in clouds. Such glints can prevent accurate retrievals of atmospheric and surface properties using existing algorithms, but the glints can also be used to infer more about the glint-causing objects—for example about the microphysical properties and radiative effects of ice clouds. This paper introduces the recently released operational glint product of the Earth Polychromatic Camera (EPIC) onboard the Deep Space Climate Observatory (DSCOVR) spacecraft. Most importantly, the paper describes the algorithm used for generating the key component of the new product: a glint mask indicating the presence of sun glint caused by the specular reflection of sunlight from ice clouds and smooth water surfaces. After describing the glint detection algorithm and glint product, the paper shows some examples of the detected glints and discusses some basic statistics of the glint population in a yearlong dataset of EPIC images. These statistics provide insights into the performance of glint detection and point toward possibilities for using the glint product to gain scientific insights about ice clouds and water surfaces.

DSCOVR↗

NASA NTRS1985

Formulation and implementation of nonstationary adaptive estimation algorithm with applications to air-data reconstruction

The dynamics model and data sources used to perform air-data reconstruction are discussed, as well as the Kalman filter. The need for adaptive determination of the noise statistics of the process is indicated. The filter innovations are presented as a means of developing the adaptive criterion, which is based on the true mean and covariance of the filter innovations. A method for the numerical approximation of the mean and covariance of the filter innovations is presented. The algorithm as developed is applied to air-data reconstruction for the space shuttle, and data obtained from the third landing are presented. To verify the performance of the adaptive algorithm, the reconstruction is also performed using a constant covariance Kalman filter. The results of the reconstructions are compared, and the adaptive algorithm exhibits better performance.

Whitmore, S. A.↗

NASA NTRS1985

Formulation and implementation of nonstationary adaptive estimation algorithm with applications to air-data reconstruction

The dynamics model and data sources used to perform air-data reconstruction are discussed, as well as the Kalman filter. The need for adaptive determination of the noise statistics of the process is indicated. The filter innovations are presented as a means of developing the adaptive criterion, which is based on the true mean and covariance of the filter innovations. A method for the numerical approximation of the mean and covariance of the filter innovations is presented. The algorithm as developed is applied to air-data reconstruction for the Space Shuttle, and data obtained from the third landing are presented. To verify the performance of the adaptive algorithm, the reconstruction is also performed using a constant covariance Kalman filter. The results of the reconstructions are compared, and the adaptive algorithm exhibits better performance.

Whitmore, S. A.↗

NASA NTRS2000

Satellite Data Sets in the Polar Regions

We have generated about two decades of consistently derived geophysical parameters in the polar regions. The key parameters are sea ice concentration, surface temperature, albedo, and cloud cover statistics. Sea ice concentrations were derived from the Scanning Multichannel Microwave Radiometer (SMMR) data and the Special Scanning Cl Microwave Imager (SSM/I) data from several platforms using the enhanced Bootstrap Algorithm for the period 1978 through 1999. The new algorithm reduces the errors associated with spatial and temporal variations in the emissivity and surface temperatures of sea ice. Also, bad data at ocean/land interfaces are identified and deleted in an unsupervised manner. Surface ice temperature, albedo and cloud cover statistics are derived simultaneously from the Advanced Very High Resolution Radiometer (AVHRR) data from 1981 through 1999 and mapped at a higher resolution but the same format as the ice concentration data. The technique makes use these co-registered ice concentration maps to enable cloud masking to be done separately for open ocean, sea ice and land areas. The effect of inversion is minimized by taking into consideration the expected changes in the effect of inversion with altitude, especially in the Antarctic. A technique for ice type regional classification has also been developed using multichannel cluster analysis and a neural network. This provide a means to identify large areas of thin ice, first year ice, and older ice types. The data sets have been shown to be coherent with each other and provide a powerful tool for in depth studies of the currently changing Arctic and Antarctic environment.

Comiso, Josefino C.↗

NASA NTRS2008

Algorithms for Spectral Decomposition with Applications to Optical Plume Anomaly Detection

The analysis of spectral signals for features that represent physical phenomenon is ubiquitous in the science and engineering communities. There are two main approaches that can be taken to extract relevant features from these high-dimensional data streams. The first set of approaches relies on extracting features using a physics-based paradigm where the underlying physical mechanism that generates the spectra is used to infer the most important features in the data stream. We focus on a complementary methodology that uses a data-driven technique that is informed by the underlying physics but also has the ability to adapt to unmodeled system attributes and dynamics. We discuss the following four algorithms: Spectral Decomposition Algorithm (SDA), Non-Negative Matrix Factorization (NMF), Independent Component Analysis (ICA) and Principal Components Analysis (PCA) and compare their performance on a spectral emulator which we use to generate artificial data with known statistical properties. This spectral emulator mimics the real-world phenomena arising from the plume of the space shuttle main engine and can be used to validate the results that arise from various spectral decomposition algorithms and is very useful for situations where real-world systems have very low probabilities of fault or failure. Our results indicate that methods like SDA and NMF provide a straightforward way of incorporating prior physical knowledge while NMF with a tuning mechanism can give superior performance on some tests. We demonstrate these algorithms to detect potential system-health issues on data from a spectral emulator with tunable health parameters.

Srivastava, Askok N.↗

NASA NTRSDate not supplied

Statistical Descriptors of Composite Fiber Aggregation

This study introduces a method of characterizing fiber aggregation and resin rich regions in composite microstructures. Microscale models of representative elements (RVE) need to be indicative of the extend of clustering (i.e. close fiber-to-fiber interaction) and resin rich “pools” which may impact the overall strength and performance of a composite structure. This algorithm was used to evaluate different unidirectional 2-D microstructure scans, which will be compared to their manufacturing method or any special treatment processes. These cluster and pool scan statistics can be used as criteria to judge statistical equivalency of artificially constructed microstructures.

Statistics↗

NASA NTRS1986

The Tukey algorithm for enhancing MST radar data

One of the most troublesome features in MSR (mesosphere stratosphere troposphere) velocity measurements is the determination of unwanted scatterer whose velocity is different from that of the surrounding atmosphere. Aircraft seen in the sidelobes of the antenna are the principal problem. Because coherent integration essentially eliminates echoes with line of sight velocities greater than 10 or 20 m/s, aircraft are seen only when their flight path is almost perpendicular to the line of sight. Then, they give large returns whose velocities may be positive or negative, and certainly different from that of the surrounding air. The glitches in the minute by minute velocity records are quite troublesome in that they may distort the statistics of the velocity. An objective way is therefore needed to remove sporadic points of this kind. For this purpose, the Tukey algorithm is appropriate and has some advantages over averaging. The Tukey algorithm, applied to a data array, uses for each data point the median of it and the two points surrounding it. If the three points form a monotonically increasing or decreasing sequence, the original point is copied with change. However, if the central point is remote from the other two, it is replaced by whichever of the two surrounding points is closest in value. The greatest effect of the Tukey algorithm is on data where the successive points are uncorrelated. Examples are given.

Bowhill, S. A.↗

NASA NTRS2008

Integrated Software Systems for Crew Management During Extravehicular Activity in Planetary Terrain Exploration

Initial planetary explorations with the Apollo program had a veritable ground support army monitoring the safety and health of the 12 astronauts who performed lunar surface extravehicular activities (EVAs). Given the distances involved, this will not be possible on Mars. A spacesuit for Mars must be smart enough to replace that army. The next generation suits can do so using 2 software systems serving as virtual companions, LEGACI (Life support, Exploration Guidance Algorithm and Consumable Interrogator) and VIOLET (Voice Initiated Operator for Life support and Exploration Tracking). The system presented in this study integrates data inputs from a suite of sensors into the MIII suit s communications, avionics and informatics hardware for distribution to remote managers and data analysis. If successful, the system has application not only for Mars but for nearer term missions to the Moon, and the next generation suits used on ISS as well. Field tests are conducted to assess capabilities for next generation spacesuits at Johnson Space Center (JSC) as well as the Mars and Lunar analog (Devon Island, Canada). LEGACI integrates data inputs from a suite of noninvasive biosensors in the suit and the astronaut (heart rate, suit inlet/outlet lcg temperature and flowrate, suit outlet gas and dewpoint temperature, pCO2, suit O2 pressure, state vector (accelerometry) and others). In the Integrated Walkback Suit Tests held at NASA-JSC and the HMP tests at Devon Island, communication and informatics capabilities were tested (including routing by satellite from the suit at Devon Island to JSC in Houston via secure servers at VCU in Richmond, VA). Results. The input from all the sensors enable LEGACI to compute multiple independent assessments of metabolic rate, from which a "best" met rate is chosen based on statistical methods. This rate can compute detailed information about the suit, crew and EVA performance using test-derived algorithms. VIOLET gives LEGACI voice activation capability, allowing the crew to query the suit, and receive feedback and alerts that will lead to corrective action. LEGACI and VIOLET can also automatically control the astronaut's cooling and consumable use rate without crew input if desired. These findings suggest that non-invasive physiological and environmental sensors supported with data analysis can allow for more effective management of mission task performance during EVA. Integrated remote and local view of data metrics allow crewmember to receive real time feedback in synch with mission control in preventing performance shortcomings for EVA in exploration missions.

Kuznetz, Lawrence↗

NASA NTRS1998

Design and Calibration of the X-33 Flush Airdata Sensing (FADS) System

This paper presents the design of the X-33 Flush Airdata Sensing (FADS) system. The X-33 FADS uses a matrix of pressure orifices on the vehicle nose to estimate airdata parameters. The system is designed with dual-redundant measurement hardware, which produces two independent measurement paths. Airdata parameters that correspond to the measurement path with the minimum fit error are selected as the output values. This method enables a single sensor failure to occur with minimal degrading of the system performance. The paper shows the X-33 FADS architecture, derives the estimating algorithms, and demonstrates a mathematical analysis of the FADS system stability. Preliminary aerodynamic calibrations are also presented here. The calibration parameters, the position error coefficient (epsilon), and flow correction terms for the angle of attack (delta alpha), and angle of sideslip (delta beta) are derived from wind tunnel data. Statistical accuracy of' the calibration is evaluated by comparing the wind tunnel reference conditions to the airdata parameters estimated. This comparison is accomplished by applying the calibrated FADS algorithm to the sensed wind tunnel pressures. When the resulting accuracy estimates are compared to accuracy requirements for the X-33 airdata, the FADS system meets these requirements.

Whitmore, Stephen A.↗

NASA NTRS2011

Distributed Monitoring of the R(sup 2) Statistic for Linear Regression

The problem of monitoring a multivariate linear regression model is relevant in studying the evolving relationship between a set of input variables (features) and one or more dependent target variables. This problem becomes challenging for large scale data in a distributed computing environment when only a subset of instances is available at individual nodes and the local data changes frequently. Data centralization and periodic model recomputation can add high overhead to tasks like anomaly detection in such dynamic settings. Therefore, the goal is to develop techniques for monitoring and updating the model over the union of all nodes data in a communication-efficient fashion. Correctness guarantees on such techniques are also often highly desirable, especially in safety-critical application scenarios. In this paper we develop DReMo a distributed algorithm with very low resource overhead, for monitoring the quality of a regression model in terms of its coefficient of determination (R2 statistic). When the nodes collectively determine that R2 has dropped below a fixed threshold, the linear regression model is recomputed via a network-wide convergecast and the updated model is broadcast back to all nodes. We show empirically, using both synthetic and real data, that our proposed method is highly communication-efficient and scalable, and also provide theoretical guarantees on correctness.

Bhaduri, Kanishka↗

NASA NTRS2001

Satellite Remote Sensing of Tropical Precipitation and Ice Clouds for GCM Verification

This project, supported by the NASA New Investigator Program, has primarily been funding a graduate student, Darren McKague. Since August 1999 Darren has been working part time at Raytheon, while continuing his PhD research. Darren is planning to finish his thesis work in May 2001, thus some of the work described here is ongoing. The proposed research was to use GOES visible and infrared imager data and SSM/I microwave data to obtain joint distributions of cirrus cloud ice mass and precipitation for a study region in the Eastern Tropical Pacific. These joint distributions of cirrus cloud and rainfall were to be compared to those from the CSU general circulation model to evaluate the cloud microphysical amd cumulus parameterizations in the GCM. Existing algorithms were to be used for the retrieval of cloud ice water path from GOES (Minnis) and rainfall from SSM/I (Wilheit). A theoretical study using radiative transfer models and realistic variations in cloud and precipitation profiles was to be used to estimate the retrieval errors. Due to the unavailability of the GOES satellite cloud retrieval algorithm from Dr. Minnis (a co-PI), there was a change in the approach and emphasis of the project. The new approach was to develop a completely new type of remote sensing algorithm - one to directly retrieve joint probability density functions (pdf's) of cloud properties from multi-dimensional histograms of satellite radiances. The usual approach is to retrieve individual pixels of variables (i.e. cloud optical depth), and then aggregate the information. Only statistical information is actually needed, however, and so a more direct method is desirable. We developed forward radiative transfer models for the SSM/I and GOES channels, originally for testing the retrieval algorithms. The visible and near infrared ice scattering information is obtained from geometric ray tracing of fractal ice crystals (Andreas Macke), while the mid-infrared and microwave scattering is computed with Mie scattering. The radiative transfer is performed with the Spherical Harmonic Discrete Ordinate Method (developed by the PI), and infrared molecular absorption is included with the correlated k-distribution method. The SHDOM radiances have been validated by comparison to version 2 of DISORT (the community "standard" discrete-ordinates radiative transfer model), however we use SHDOM since it is computationally more efficient.

Evans, K. Franklin↗

NASA NTRS1974

Refinement of the Goloseyev catalog point coordinates in the limb zone and determination of point coordinates on the back side of the moon

Lunar photography from Zond 6 showed half the side of the moon which is not visible from the earth, and this made it possible to construct a photogrammetric grid encompassing the entire Western Hemisphere and referenced to points of the visible side, whose coordinates were taken from the Goloseyev catalog. The problem was solved using two pictures taken from approximately 9000 km above the lunar surface. The photogrammetric grid was constructed by joint statistical analysis of the measurements of both pictures and the selenographic coordinates of the catalog points. A special algorithm was developed and a program compiled realizing the maximum likelihood method which permitted working with up to 120 catalog points simultaneously.

Krasikov, V. A.↗

NASA NTRS1991

The analysis of a rocket tomography measurement of the N2+3914A emission and N2 ionization rates in an auroral arc

Techniques were developed for recovering two-dimensional distributions of auroral volume emission rates from rocket photometer measurements made in a tomographic spin scan mode. These tomographic inversion procedures are based upon an algebraic reconstruction technique (ART) and utilize two different iterative relaxation techniques for solving the problems associated with noise in the observational data. One of the inversion algorithms is based upon a least squares method and the other on a maximum probability approach. The performance of the inversion algorithms, and the limitations of the rocket tomography technique, were critically assessed using various factors such as (1) statistical and non-statistical noise in the observational data, (2) rocket penetration of the auroral form, (3) background sources of emission, (4) smearing due to the photometer field of view, and (5) temporal variations in the auroral form. These tests show that the inversion procedures may be successfully applied to rocket observations made in medium intensity aurora with standard rocket photometer instruments. The inversion procedures have been used to recover two-dimensional distributions of auroral emission rates and ionization rates from an existing set of N2+3914A rocket photometer measurements which were made in a tomographic spin scan mode during the ARIES auroral campaign. The two-dimensional distributions of the 3914A volume emission rates recoverd from the inversion of the rocket data compare very well with the distributions that were inferred from ground-based measurements using triangulation-tomography techniques and the N2 ionization rates derived from the rocket tomography results are in very good agreement with the in situ particle measurements that were made during the flight. Three pre-prints describing the tomographic inversion techniques and the tomographic analysis of the ARIES rocket data are included as appendices.

Mcdade, Ian C.↗

NASA NTRS1990

Direct simulations of wall-bounded compressible turbulence

A study has been initiated on the effects of compressibility (Mach number) on turbulent boundary layers. An understanding of both qualitative (turbulence structures, physical processes) and quantitative (turbulence statistics) effects are desired. This understanding should lead to better turbulence models for applications involving supersonic wall-bounded flows. Direct numerical simulations of an idealized problem will be used to accomplish these objectives. Among several possibilities we chose plane Couette flow with constant-temperature walls as the first problem to be studied. The lack of mean streamwise pressure gradient plus isothermal walls implies that both horizontal directions can be assumed to be homogeneous and that the flow can reach a statistically steady state. Together, these features greatly simplify the calculations and analyses of the results. To date, an algorithm has been developed and implemented (but not yet fully tested) for the accurate solution of the Navier-Stokes equations with the assumptions noted above.

Buell, J. C.↗

NASA NTRS1994

Canopy reflectance modelling of semiarid vegetation

Three different types of remote sensing algorithms for estimating vegetation amount and other land surface biophysical parameters were tested for semiarid environments. These included statistical linear models, the Li-Strahler geometric-optical canopy model, and linear spectral mixture analysis. The two study areas were the National Science Foundation's Jornada Long Term Ecological Research site near Las Cruces, NM, in the northern Chihuahuan desert, and the HAPEX-Sahel site near Niamey, Niger, in West Africa, comprising semiarid rangeland and subtropical crop land. The statistical approach (simple and multiple regression) resulted in high correlations between SPOT satellite spectral reflectance and shrub and grass cover, although these correlations varied with the spatial scale of aggregation of the measurements. The Li-Strahler model produced estimated of shrub size and density for both study sites with large standard errors. In the Jornada, the estimates were accurate enough to be useful for characterizing structural differences among three shrub strata. In Niger, the range of shrub cover and size in short-fallow shrublands is so low that the necessity of spatially distributed estimation of shrub size and density is questionable. Spectral mixture analysis of multiscale, multitemporal, multispectral radiometer data and imagery for Niger showed a positive relationship between fractions of spectral endmembers and surface parameters of interest including soil cover, vegetation cover, and leaf area index.

Franklin, Janet↗

NASA NTRS1998

Distortion Representation of Forecast Errors for Model Skill Assessment and Objective Analysis

We proposed a novel characterization of errors for numerical weather predictions. A general distortion representation allows for the displacement and amplification or bias correction of forecast anomalies. Characterizing and decomposing forecast error in this way has several important applications, including the model assessment application and the objective analysis application. In this project, we have focused on the assessment application, restricted to a realistic but univariate 2-dimensional situation. Specifically, we study the forecast errors of the sea level pressure (SLP), the 500 hPa geopotential height, and the 315 K potential vorticity fields for forecasts of the short and medium range. The forecasts are generated by the Goddard Earth Observing System (GEOS) data assimilation system with and without ERS-1 scatterometer data. A great deal of novel work has been accomplished under the current contract. In broad terms, we have developed and tested an efficient algorithm for determining distortions. The algorithm and constraints are now ready for application to larger data sets to be used to determine the statistics of the distortion as outlined above, and to be applied in data analysis by using GEOS water vapor imagery to correct short-term forecast errors.

Hoffman, Ross N.↗

NASA NTRS2003

TOMS and SBUV Data: Comparison to 3D Chemical-Transport Model Results

We have updated our merged ozone data (MOD) set using the TOMS data from the new version 8 algorithm. We then analyzed these data for contributions from solar cycle, volcanoes, QBO, and halogens using a standard statistical time series model. We have recently completed a hindcast run of our 3D chemical-transport model for the same years. This model uses off-line winds from the finite-volume GCM, a full stratospheric photochemistry package, and time-varying forcing due to halogens, solar uv, and volcanic aerosols. We will report on a parallel analysis of these model results using the same statistical time series technique as used for the MOD data.

Stolarski, Richard S.↗

NASA NTRS2005

Comparison of TRMM Ground Validation and Satellite Rain Intensity Estimates

The Tropical Rainfall Measuring Mission (TRMM) Ground Validation (GV) Program began in the late 1980's and has provided a wealth of data and resources for validating TRMM satellite estimates. The TRMM GV program's main operational task is to provide rainfall products for four sites: Darwin, Australia (DARW); Houston, Texas (HSTN); Kwajalein, Republic of the Marshall Islands (KWAJ); and, Melbourne, Florida (MELB). A comparison between TRMM Ground Validation (Version 5) and Satellite (Version 6) rain intensity estimates is presented. The full suite of Version 6 satellite data is currently being generated by the TRMM Science Data and Information System (TSDIS) and should be completed some time near the end of 2005. The gridded satellite product (3G68) will be compared to GV Level II rain-intensity and -type maps (2A53 and 2A54, respectively). The 3G68 product represents a 0.5 deg x 0.5 deg data grid providing estimates of rain intensities from the TRMM Precipitation Radar (PR), Microwave Imager (TMI) and Combined (COM) algorithms. The comparisons will be sub-setted according to geographical type (land, coast and ocean). A bias statistic will be presented that provides quantification of the relative differences between the various estimators. Previous comparisons of an interim satellite product (Version 6a) showed that all of the estimates (GV and satellite) are converging, with some expected discrepancies. The convergence of the GV and satellite estimates bodes well for expectations for the proposed Global Precipitation Measurement (GPM) program and this study and others are being leveraged towards planning GV goals for GPM.

Wolff, David B.↗