Search NASA⌕ Search

SEARCH · Search NASA

Results for “Maximum likelihood estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

An Interactive MATLAB Program for Fitting Transfer Functions to Frequency Responses

A computer program called FRFit (Frequency Response Fitting) for matching single-input single-output (SISO) transfer function models to empirical frequency response data is described. The program was written in MATLAB and has a graphical user interface (GUI). It is interactive in that the user manually builds the transfer function model using ``elementary factors'' (gain, delay, differentiators and integrators, and first- and second-order poles and zeros) and adjusts their values with sliders or entry fields. A nonlinear optimization can also be used to determine maximum-likelihood estimates of the transfer function parameters and their associated uncertainties. The program has some usefulness as a teaching aid, and can be applied to model structure determination, reduced-order modeling, preliminary analysis, and other system identification problems. FRFit is demonstrated using example problems, including the identification of aircraft transfer functions and rational function approximations of Theodorsen's function.

Frequency response↗

Synergistic Use of Hyperspectral UV-Visible OMI and Broadband Meteorological Imager MODIS Data for a Merged Aerosol Product

The retrieval of optimal aerosol datasets by the synergistic use of hyperspectral ultraviolet(UV)–visible and broadband meteorological imager (MI) techniques was investigated. The Aura Ozone Monitoring Instrument (OMI) Level 1B (L1B) was used as a proxy for hyperspectral UV–visible instrument data to which the Geostationary Environment Monitoring Spectrometer (GEMS) aerosol algorithm was applied. Moderate-Resolution Imaging Spectroradiometer (MODIS) L1B and dark target aerosol Level 2 (L2) data were used with a broadband MI to take advantage of the consistent time gap between the MODIS and the OMI. First, the use of cloud mask information from the MI infrared (IR) channel was tested for synergy. High-spatial-resolution and IR channels of the MI helped mask cirrus and sub-pixel cloud contamination of GEMS aerosol, as clearly seen in aerosol optical depth (AOD) validation with Aerosol Robotic Network (AERONET) data. Second, dust aerosols were distinguished in the GEMS aerosol-type classification algorithm by calculating the total dust confidence index (TDCI) from MODIS L1B IR channels. Statistical analysis indicates that the Probability of Correct Detection (POCD) between the forward and inversion aerosol dust models (DS) was increased from 72% to 94% by use of the TDCI for GEMS aerosol-type classification, and updated aerosol types were then applied to the GEMS algorithm. Use of the TDCI for DS type classification in the GEMS retrieval procedure gave improved single-scattering albedo (SSA) values for absorbing fine pollution particles (BC) and DS aerosols. Aerosol layer height (ALH) retrieved from GEMS was compared with Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) data, which provides high-resolution vertical aerosol profile information. The CALIOP ALH was calculated from total attenuated backscatter data at 1064 nm, which is identical to the definition of GEMS ALH. Application of the TDCI value reduced the median bias of GEMS ALH data slightly. The GEMS ALH bias approximates zero, especially for GEMS AOD values of>~0.4 and GEMS SSA values of<~0.95.Finally, the AOD products from the GEMS algorithm and MI were used in aerosol merging with the maximum-likelihood estimation method, based on a weighting factor derived from the standard deviation of the original AOD products. With the advantage of the UV–visible channel in retrieving aerosol properties over bright surfaces, the combined AOD products demonstrated better spatial data availability than the original AOD products, with comparable accuracy. Furthermore, pixel-level error analysis of GEMS AOD data indicates improvement through MI synergy.

aerosol↗

Earth beacon acquisition and tracking under various illumination conditions

This paper develops an algorithm for determining the geocenter of the Earth regardless of the illumination by the sun using sub-pixel scanning and a simple thresholding technique. To complete this approach the acquisition algorithm is paired with a tracking technique based on maximum likelihood estimation.

beacon↗

Velocity and Temperature Measurements in High-speed Flows with Naturally Present Dust Particles Using Rayleigh and Mie Scattering

Dust particles and occasional moisture condensations are unavoidable reality of all wind tunnels. On the path to pursue a goal of velocity and temperature measurements in large transonic and supersonic wind tunnels we have created a tabletop, spectrally resolved, Rayleigh-Mie scattering setup around a small jet fed by ambient and lightly seeded air to determine the viability and accuracy of the technique. The other reality of a wind tunnel setup is the background scattering or the glare at laser frequency, which contaminates the Rayleigh-Mie scattered light. This is simulated by backgrounds with different reflectivity towards the collection optics. Light from a CW laser is delivered via an optical fiber and the scattered light is spectrally resolved using a stabilized Fabry-Perot interferometer, followed by imaging on an EMCCD camera. A model of the of the combined background glare, Mie scattering, and the Rayleigh spectrum was fitted to the camera image using maximum likelihood estimation. Since the background glare occurs at the known frequency of the incident light and the Mie scattering peak corresponds to the Doppler shift from the bulk velocity, both were easily identified, and provided a measure of flow velocity. Preliminary results show that the Rayleigh spectrum can also be resolved, which provides a measure of temperature. It is observed that a slight drift of the laser frequency during data collection affected fitting of the model function leading to larger error. A feedback loop-based stabilization system is on development to take advantage of slight tunability of the laser via a piezo-control. Preliminary results are presented in the abstract. More extensive data from a systematic survey will be presented in the final paper.

Rayleigh scattering↗

Velocity and Temperature Measurements in High-speed Flows with Naturally Present Dust Particles Using Rayleigh and Mie Scattering

Dust particles and occasional moisture condensations are unavoidable reality of all wind tunnels. On the path to pursue a goal of velocity and temperature measurements in high-speed wind tunnels we have created a tabletop, spectrally resolved, Rayleigh-Mie scattering setup around a small jet fed by ambient and air with different particle concentration to determine the accuracy of the technique. The other reality of a wind tunnel setup is the spurious reflection and scattering of the incident laser beam by solid surfaces (flare light), which contaminates the Rayleigh-Mie scattered light. This is simulated by backgrounds with different reflectivity towards the collection optics. Light from a CW laser is delivered via an optical fiber and the scattered light from a point on the laser path is spectrally resolved using a stabilized Fabry-Perot interferometer, followed by imaging on an EMCCD camera. A model of the combined background glare, Mie scattering, and the Rayleigh spectrum was fitted to the camera image using maximum likelihood estimation. It was observed that the present modeling approach can extract velocity and temperature with reasonable accuracy when the intensity of the Mie scattered light is less than or comparable to that of the Rayleigh scattered light; beyond that error in velocity measurement remains reasonable ±12m/s but the temperature measurement becomes progressively more inaccurate. Increasingly the flare light is found to cause a bias error in velocity. Similar trend is observed in the presence of both the flare light and the Mie scattered light. The setup has provided a set of data for the future improvement of the modeling procedure, and demonstrated that even in the case of large amount of dust particles and large flare light the present technique can provide measurement of velocity with reasonable accuracy.

Rayleigh scattering↗

A comparison of minimum distance and maximum likelihood techniques for proportion estimation

The estimation of mixing proportions P sub 1, P sub 2,...P sub m in the mixture density f(x) = the sum of the series P sub i F sub i(X) with i = 1 to M is often encountered in agricultural remote sensing problems in which case the p sub i's usually represent crop proportions. In these remote sensing applications, component densities f sub i(x) have typically been assumed to be normally distributed, and parameter estimation has been accomplished using maximum likelihood (ML) techniques. Minimum distance (MD) estimation is examined as an alternative to ML where, in this investigation, both procedures are based upon normal components. Results indicate that ML techniques are superior to MD when component distributions actually are normal, while MD estimation provides better estimates than ML under symmetric departures from normality. When component distributions are not symmetric, however, it is seen that neither of these normal based techniques provides satisfactory results.

Woodward, W. A.↗

Use of robust estimators in parametric classifiers

The parametric approach to density estimation and classifier design is a well studied subject. The parametric approach is desirable because basically it reduces the problem of classifier design to that of estimating a few parameters for each of the pattern classes. The class parameters are usually estimated using maximum-likelihood (ML) estimators. ML estimators are, however, very sensitive to the presence of outliers. Several robust estimators of mean and covariance matrix and their effect on the probability of error in classification are examined. Comments are made about alpha-ranked (alpha-trimmed) estimators.

Safavian, S. Rasoul↗

Mixture densities, maximum likelihood, and the EM algorithm

The problem of estimating the parameters which determine a mixture density is reviewed as well as maximum likelihood estimation for it. A particular iterative procedure for numerically approximating maximum likelihood estimates for mixture density problems is considered. This EM algorithm, is a specialization to the mixture density context of a general algorithm of the same name used to approximate maximum likelihood estimates for incomplete data problems. The formulation and theoretical and practical properties of the EM algorithm for mixture densities are discussed focussing in particular on mixtures of densities from exponential families.

Redner, R. A.↗

A methodology for airplane parameter estimation and confidence interval determination in nonlinear estimation problems

An algorithm for maximum likelihood (ML) estimation is developed with an efficient method for approximating the sensitivities. The ML algorithm relies on a new optimization method referred to as a modified Newton-Raphson with estimated sensitivities (MNRES). MNRES determines sensitivities by using slope information from local surface approximations of each output variable in parameter space. With the fitted surface, sensitivity information can be updated at each iteration with less computational effort than that required by either a finite-difference method or integration of the analytically determined sensitivity equations. MNRES eliminates the need to derive sensitivity equations for each new model, and thus provides flexibility to use model equations in any convenient format. A random search technique for determining the confidence limits of ML parameter estimates is applied to nonlinear estimation problems for airplanes. The confidence intervals obtained by the search are compared with Cramer-Rao (CR) bounds at the same confidence level. The degree of nonlinearity in the estimation problem is an important factor in the relationship between CR bounds and the error bounds determined by the search technique. Beale's measure of nonlinearity is developed in this study for airplane identification problems; it is used to empirically correct confidence levels and to predict the degree of agreement between CR bounds and search estimates.

Murphy, P. C.↗

Estimation of bias errors in measured airplane responses using maximum likelihood method

A maximum likelihood method is used for estimation of unknown bias errors in measured airplane responses. The mathematical model of an airplane is represented by six-degrees-of-freedom kinematic equations. In these equations the input variables are replaced by their measured values which are assumed to be without random errors. The resulting algorithm is verified with a simulation and flight test data. The maximum likelihood estimates from in-flight measured data are compared with those obtained by using a nonlinear-fixed-interval-smoother and an extended Kalmar filter.

Klein, Vladiaslav↗

A real-time digital program for estimating aircraft stability and control parameters from flight test data by using the maximum likelihood method

A computer program (Langley program C1123) has been developed for estimating aircraft stability and control parameters from flight test data. These parameters are estimated by the maximum likelihood estimation procedure implemented on a real-time digital simulation system, which uses the Control Data 6600 computer. This system allows the investigator to interact with the program in order to obtain satisfactory results. Part of this system, the control and display capabilities, is described for this program. This report also describes the computer program by presenting the program variables, subroutines, flow charts, listings, and operational features. Program usage is demonstrated with a test case using pseudo or simulated flight data.

Grove, R. D.↗

Estimation of elastic aircraft parameters using the maximum likelihood method

The application of the maximum likelihood method to estimate the aerodynamic parameters of elastic flight vehicles in a symmetric flight condition is discussed. In this application, particular attention is directed toward the center of mass, elastic deformation, and sensor equations of motion. It is shown that the two major computational problems to be overcome are the inversion of large-sized matrices and the time-wise integration of a large number of linear, ordinary, differential equations.

Schwanz, R. C.↗

Maximum Likelihood Time-of-Arrival Estimation of Optical Pulses via Photon-Counting Photodetectors

Many optical imaging, ranging, and communications systems rely on the estimation of the arrival time of an optical pulse. Recently, such systems have been increasingly employing photon-counting photodetector technology, which changes the statistics of the observed photocurrent. This requires time-of-arrival estimators to be developed and their performances characterized. The statistics of the output of an ideal photodetector, which are well modeled as a Poisson point process, were considered. An analytical model was developed for the mean-square error of the maximum likelihood (ML) estimator, demonstrating two phenomena that cause deviations from the minimum achievable error at low signal power. An approximation was derived to the threshold at which the ML estimator essentially fails to provide better than a random guess of the pulse arrival time. Comparing the analytic model performance predictions to those obtained via simulations, it was verified that the model accurately predicts the ML performance over all regimes considered. There is little prior art that attempts to understand the fundamental limitations to time-of-arrival estimation from Poisson statistics. This work establishes both a simple mathematical description of the error behavior, and the associated physical processes that yield this behavior. Previous work on mean-square error characterization for ML estimators has predominantly focused on additive Gaussian noise. This work demonstrates that the discrete nature of the Poisson noise process leads to a distinctly different error behavior.

Erkmen, Baris I.↗

Nonparametric probability density estimation by optimization theoretic techniques

Two nonparametric probability density estimators are considered. The first is the kernel estimator. The problem of choosing the kernel scaling factor based solely on a random sample is addressed. An interactive mode is discussed and an algorithm proposed to choose the scaling factor automatically. The second nonparametric probability estimate uses penalty function techniques with the maximum likelihood criterion. A discrete maximum penalized likelihood estimator is proposed and is shown to be consistent in the mean square error. A numerical implementation technique for the discrete solution is discussed and examples displayed. An extensive simulation study compares the integrated mean square error of the discrete and kernel estimators. The robustness of the discrete estimator is demonstrated graphically.

Scott, D. W.↗

Time-resolved speckle effects on the estimation of laser-pulse arrival times

A maximum-likelihood (ML) estimator of the pulse arrival in laser ranging and altimetry is derived for the case of a pulse distorted by shot noise and time-resolved speckle. The performance of the estimator is evaluated for pulse reflections from flat diffuse targets and compared with the performance of a suboptimal centroid estimator and a suboptimal Bar-David ML estimator derived under the assumption of no speckle. In the large-signal limit the accuracy of the estimator was found to improve as the width of the receiver observational interval increases. The timing performance of the estimator is expected to be highly sensitive to background noise when the received pulse energy is high and the receiver observational interval is large. Finally, in the speckle-limited regime the ML estimator performs considerably better than the suboptimal estimators.

Tsai, B.-M.↗

Maximum likelihood techniques in QELS

A framework for the analysis of Quasi Elastic Light Scattering (QELS) experiments designed to be used in microgravity environment is derived. Example calculations of the type to be used to design the QELS system are given. The framework for the analysis is based on the concepts of parameter estimation typified by Maximum Likelihood Estimation methods. These methods not only serve as the template for parameter estimation algorithms, but can also be used for optimal design of the experiments. Optimal design of experiments is facilitated by the fact that these methods not only give procedures for parameter estimation, but also estimates of the errors associated with the parameter estimation.

Edwards, Robert V.↗