Search NASA⌕ Search

SEARCH · Search NASA

Results for “maximum likelihood estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

Filtering flight data prior to aerodynamic system identification

An algorithm for processing flight-test data to provide state estimates and instrument calibrations for aerodynamic or hydrodynamic system identification by the equation error estimation method is developed and demonstrated on synthesized data. The extended-Kalman-filter algorithm employs a locally level, north-pointing frame of reference, accounts for rotating ellipsoidal earth effects, and estimates sensor bias, scale factors, wind components, and process noise levels by maximum-likelihood parameters. The method is found to be most effective with navigation quality inertial input data. The algorithm is applied to data from a six-degree-of-freedom F-4 aircraft simulation and shown to produce state estimates in good agreement with the simulation values.

Trankle, T. L.↗

Gaussian processes with built-in dimensionality reduction: Applications to high-dimensional uncertainty propagation

Uncertainty quantification (UQ) tasks, such as model calibration, uncertainty propagation, and optimization under uncertainty, typically require several thousand evaluations of the underlying computer codes. To cope with the cost of simulations, one replaces the real response surface with a cheap surrogate based, e.g., on polynomial chaos expansions, neural networks, support vector machines, or Gaussian processes (GP). However, the number of simulations required to learn a generic multivariate response grows exponentially as the input dimension increases. This curse of dimensionality can only be addressed, if the response exhibits some special structure that can be discovered and exploited. A wide range of physical responses exhibit a special structure known as an active subspace (AS). An AS is a linear manifold of the stochastic space characterized by maximal response variation. The idea is that one should first identify this low dimensional manifold, project the high-dimensional input onto it, and then link the projection to the output. If the dimensionality of the AS is low enough, then learning the link function is a much easier problem than the original problem of learning a high-dimensional function. The classic approach to discovering the AS requires gradient information, a fact that severely limits its applicability. Furthermore, and partly because of its reliance to gradients, it is not able to handle noisy observations. The latter is an essential trait if one wants to be able to propagate uncertainty through stochastic simulators, e.g., through molecular dynamics codes. In this work, we develop a probabilistic version of AS which is gradient-free and robust to observational noise. Our approach relies on a novel Gaussian process regression with built-in dimensionality reduction. In particular, the AS is represented as an orthogonal projection matrix that serves as yet another covariance function hyper-parameter to be estimated from the data. To train the model, we design a two-step maximum likelihood optimization procedure that ensures the orthogonality of the projection matrix by exploiting recent results on the Stiefel manifold, i.e., the manifold of matrices with orthogonal columns. The additional benefit of our probabilistic formulation, is that it allows us to select the dimensionality of the AS via the Bayesian information criterion. We validate our approach by showing that it can discover the right AS in synthetic examples without gradient information using both noiseless and noisy observations. We demonstrate that our method is able to discover the same AS as the classical approach in a challenging one-hundred-dimensional problem involving an elliptic stochastic partial differential equation with random conductivity. Finally, we use our approach to study the effect of geometric and material uncertainties in the propagation of solitary waves in a one dimensional granular system.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

BLACK HOLE MASS AND EDDINGTON RATIO DISTRIBUTION FUNCTIONS OF X-RAY-SELECTED BROAD-LINE AGNs AT z {approx} 1.4 IN THE SUBARU XMM-NEWTON DEEP FIELD

In order to investigate the growth of supermassive black holes (SMBHs), we construct the black hole mass function (BHMF) and Eddington ratio distribution function (ERDF) of X-ray-selected broad-line active galactic nuclei (AGNs) at z {approx} 1.4 in the Subaru XMM-Newton Deep Survey (SXDS) field. A significant part of the accretion growth of SMBHs is thought to take place in this redshift range. Black hole masses of X-ray-selected broad-line AGNs are estimated using the width of the broad Mg II line and 3000 A monochromatic luminosity. We supplement the Mg II FWHM values with the H{alpha} FWHM obtained from our NIR spectroscopic survey. Using the black hole masses of broad-line AGNs at redshifts between 1.18 and 1.68, the binned broad-line AGN BHMFs and ERDFs are calculated using the V{sub max} method. To properly account for selection effects that impact the binned estimates, we derive the corrected broad-line AGN BHMFs and ERDFs by applying the maximum likelihood method, assuming that the ERDF is constant regardless of the black hole mass. We do not correct for the non-negligible uncertainties in virial BH mass estimates. If we compare the corrected broad-line AGN BHMF with that in the local universe, then the corrected BHMF at z = 1.4 has a higher number density above 10{sup 8} M{sub Sun} but a lower number density below that mass range. The evolution may be indicative of a downsizing trend of accretion activity among the SMBH population. The evolution of broad-line AGN ERDFs from z = 1.4 to 0 indicates that the fraction of broad-line AGNs with accretion rates close to the Eddington limit is higher at higher redshifts.

79 ASTRONOMY AND ASTROPHYSICS↗

Multi crop area estimation in Idaho using EDITOR

The use of LANDSAT multispectral scanner digital data for multi-crop acreage estimation in the central Snake River Plain of Idaho was examined. Two acquisitions of LANDSAT data covering ground sample units selected from a U.S. Department of Agriculture sampling frame in a four country study site were used to train a maximum likelihood classifier which, subsequently, classified all picture elements in the study site. Acreage estimates for six major crops, by county and for the four counties combined, were generated from the classification using the Battesse-Fuller model for estimation by regression in small areas. Results from the regression analysis were compared to those obtained by direct expansion of the ground data. Using the LANDSAT data significantly decreased the errors associated with the estimates for the three largest acreage crops. The late date of the second LANDSAT acquisition may have contributed to the poor results for three summer crops.

Sheffner, E. J.↗

On the regularity of the covariance matrix of a discretized scalar field on the sphere

We present a comprehensive study of the regularity of the covariance matrix of a discretized field on the sphere. In a particular situation, the rank of the matrix depends on the number of pixels, the number of spherical harmonics, the symmetries of the pixelization scheme and the presence of a mask. Taking into account the above mentioned components, we provide analytical expressions that constrain the rank of the matrix. They are obtained by expanding the determinant of the covariance matrix as a sum of determinants of matrices made up of spherical harmonics. We investigate these constraints for five different pixelizations that have been used in the context of Cosmic Microwave Background (CMB) data analysis: Cube, Icosahedron, Igloo, GLESP and HEALPix, finding that, at least in the considered cases, the HEALPix pixelization tends to provide a covariance matrix with a rank closer to the maximum expected theoretical value than the other pixelizations. The effect of the propagation of numerical errors in the regularity of the covariance matrix is also studied for different computational precisions, as well as the effect of adding a certain level of noise in order to regularize the matrix. In addition, we investigate the application of the previous results to a particular example that requires the inversion of the covariance matrix: the estimation of the CMB temperature power spectrum through the Quadratic Maximum Likelihood algorithm. Finally, some general considerations in order to achieve a regular covariance matrix are also presented.

79 ASTRONOMY AND ASTROPHYSICS↗

Enhancing Gaussian Process Surrogates for Optimization and Posterior Approximation via Random Exploration

This paper proposes novel noise-free Bayesian optimization strategies that rely on a random exploration step to enhance the accuracy of Gaussian process surrogate models. The new algorithms retain the ease of implementation of the classical GP-UCB algorithm, but the additional random exploration step accelerates their convergence, nearly achieving the optimal convergence rate. Furthermore, to facilitate Bayesian inference with intractable likelihoods, we propose to utilize optimization iterates for maximum a posteriori estimation to build a Gaussian process surrogate model for the unnormalized log-posterior density. We provide bounds for the Hellinger distance between the true and the approximate posterior distributions in terms of the number of design points. We demonstrate the effectiveness of our Bayesian optimization algorithms in nonconvex benchmark objective functions, in a machine learning hyperparameter tuning problem, and in a black-box engineering design problem. The effectiveness of our posterior approximation approach is demonstrated in two Bayesian inference problems for parameters of dynamical systems.

Bayesian inference↗

Analytical evaluation of tilting proprotor wind tunnel test requirements

Specific test requirements related to the wind tunnel testing of the XV-15 advanced tilt rotor research aircraft were determined. The following analytical tools were developed: (1) digital simulation of the XV-15, incorporating a simplified tunnel support model, control system loop, measurement lags, gust disturbances, and sensor noise, (2) specialization of existing data analysis programs to the high order XV-15 dynamical model (transfer function program, a time series analysis program, an advanced maximum likelihood parameter identification program), (3) several auxiliary programs to provide estimates of damping from transfer functions as well as calculations of model decomposition of system response. The following results were discussed: (1) modelling of the aircraft, instrumentation, and controls, (2) results of the rotor/cantilever wing model and coupled wing, (3) examples of data prediction with system identification techniques, and (4) detailed conclusions and recommendations.

Hall, W. E., Jr.↗

The use of Landsat data to inventory cotton and soybean acreage in North Alabama

This study was performed to determine if Landsat data could be used to improve the accuracy of the estimation of cotton acreage. A linear classification algorithm and a maximum likelihood algorithm were used for computer classification of the area, and the classification was compared with ground truth. The classification accuracy for some fields was greater than 90 percent; however, the overall accuracy was 71 percent for cotton and 56 percent for soybeans. The results of this research indicate that computer analysis of Landsat data has potential for improving upon the methods presently being used to determine cotton acreage; however, additional experiments and refinements are needed before the method can be used operationally.

Downs, S. W., Jr.↗

The IceCube Neutrino Observatory, the Pierre Auger Observatory and the Telescope Array: Joint Contribution to the 34th International Cosmic Ray Conference (ICRC 2015)

We have conducted three searches for correlations between ultra-high energy cosmic rays detected by the Telescope Array and the Pierre Auger Observatory, and high-energy neutrino candidate events from IceCube. Two cross-correlation analyses with UHECRs are done: one with 39 cascades from the IceCube `high-energy starting events' sample and the other with 16 high-energy `track events'. The angular separation between the arrival directions of neutrinos and UHECRs is scanned over. The same events are also used in a separate search using a maximum likelihood approach, after the neutrino arrival directions are stacked. To estimate the significance we assume UHECR magnetic deflections to be inversely proportional to their energy, with values $3^\circ$, $6^\circ$ and $9^\circ$ at 100 EeV to allow for the uncertainties on the magnetic field strength and UHECR charge. A similar analysis is performed on stacked UHECR arrival directions and the IceCube sample of through-going muon track events which were optimized for neutrino point-source searches.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Denoising of polychromatic CT images based on their own noise properties

Purpose: Because of high diagnostic accuracy and fast scan time, computed tomography (CT) has been widely used in various clinical applications. Since the CT scan introduces radiation exposure to patients, however, dose reduction has recently been recognized as an important issue in CT imaging. However, low-dose CT causes an increase of noise in the image and thereby deteriorates the accuracy of diagnosis. In this paper, the authors develop an efficient denoising algorithm for low-dose CT images obtained using a polychromatic x-ray source. The algorithm is based on two steps: (i) estimation of space variant noise statistics, which are uniquely determined according to the system geometry and scanned object, and (ii) subsequent novel conversion of the estimated noise to Gaussian noise so that an existing high performance Gaussian noise filtering algorithm can be directly applied to CT images with non-Gaussian noise. Methods: For efficient polychromatic CT image denoising, the authors first reconstruct an image with the iterative maximum-likelihood polychromatic algorithm for CT to alleviate the beam-hardening problem. We then estimate the space-variant noise variance distribution on the image domain. Since there are many high performance denoising algorithms available for the Gaussian noise, image denoising can become much more efficient if they can be used. Hence, the authors propose a novel conversion scheme to transform the estimated space-variant noise to near Gaussian noise. In the suggested scheme, the authors first convert the image so that its mean and variance can have a linear relationship, and then produce a Gaussian image via variance stabilizing transform. The authors then apply a block matching 4D algorithm that is optimized for noise reduction of the Gaussian image, and reconvert the result to obtain a final denoised image. To examine the performance of the proposed method, an XCAT phantom simulation and a physical phantom experiment were conducted. Results: Both simulation and experimental results show that, unlike the existing denoising algorithms, the proposed algorithm can effectively reduce the noise over the whole region of CT images while preventing degradation of image resolution. Conclusions: To effectively denoise polychromatic low-dose CT images, a novel denoising algorithm is proposed. Because this algorithm is based on the noise statistics of a reconstructed polychromatic CT image, the spatially varying noise on the image is effectively reduced so that the denoised image will have homogeneous quality over the image domain. Through a simulation and a real experiment, it is verified that the proposed algorithm can deliver considerably better performance compared to the existing denoising algorithms.

60 APPLIED LIFE SCIENCES↗

DETECTION OF THE COSMIC {gamma}-RAY HORIZON FROM MULTIWAVELENGTH OBSERVATIONS OF BLAZARS

The first statistically significant detection of the cosmic {gamma}-ray horizon (CGRH) that is independent of any extragalactic background light (EBL) model is presented. The CGRH is a fundamental quantity in cosmology. It gives an estimate of the opacity of the universe to very high energy (VHE) {gamma}-ray photons due to photon-photon pair production with the EBL. The only estimations of the CGRH to date are predictions from EBL models and lower limits from {gamma}-ray observations of cosmological blazars and {gamma}-ray bursts. Here, we present homogeneous synchrotron/synchrotron self-Compton (SSC) models of the spectral energy distributions of 15 blazars based on (almost) simultaneous observations from radio up to the highest energy {gamma}-rays taken with the Fermi satellite. These synchrotron/SSC models predict the unattenuated VHE fluxes, which are compared with the observations by imaging atmospheric Cherenkov telescopes. This comparison provides an estimate of the optical depth of the EBL, which allows us a derivation of the CGRH through a maximum likelihood analysis that is EBL-model independent. We find that the observed CGRH is compatible with the current knowledge of the EBL.

79 ASTRONOMY AND ASTROPHYSICS↗

Linear functional minimization for inverse modeling

In this paper, we present a novel inverse modeling strategy to estimate spatially distributed parameters of nonlinear models. The maximum a posteriori (MAP) estimators of these parameters are based on a likelihood functional, which contains spatially discrete measurements of the system parameters and spatiotemporally discrete measurements of the transient system states. The piecewise continuity prior for the parameters is expressed via Total Variation (TV) regularization. The MAP estimator is computed by minimizing a nonquadratic objective equipped with the TV operator. We apply this inversion algorithm to estimate hydraulic conductivity of a synthetic confined aquifer from measurements of conductivity and hydraulic head. The synthetic conductivity field is composed of a low-conductivity heterogeneous intrusion into a high-conductivity heterogeneous medium. Our algorithm accurately reconstructs the location, orientation, and extent of the intrusion from the steady-state data only. Finally, addition of transient measurements of hydraulic head improves the parameter estimation, accurately reconstructing the conductivity field in the vicinity of observation locations.

47 OTHER INSTRUMENTATION↗

Accidental Father-to-Son HIV-1 Transmission During the Seroconversion Period

A 4-year-old child born to an HIV-1 seronegative mother was diagnosed with HIV-1, the main risk factor being transmission from the child's father who was seroconverting at the time of the child's birth. In the context of a forensic investigation, here we aimed to identify the source of infection of the child and date of the transmission event. Samples were collected from the father and child at two time points about 4 years after the child's birth. Partial segments of three HIV-1 genes (gag, pol, and env) were sequenced and maximum likelihood (ML) and Bayesian methods were used to determine direction and estimate date of transmission. Neutralizing antibodies were determined using a single cycle assay. Bayesian trees displayed a paraphyletic–monophyletic topology in all three genomic regions, with the father's host label at the root, which is consistent with father-to-son transmission. ML trees found similar topologies in gag and pol and a monophyletic–monophyletic topology in env. Analysis of the time of the most recent common ancestor of each HIV-1 gene population indicated that the child was infected shortly after the father. Consistent with the infection history, both father and son developed broad and potent HIV-specific neutralizing antibody responses. In conclusion, the direction of transmission implicated the father as the source of transmission. Transmission occurred during the seroconversion period when the father was unaware of the infection and was likely accidental. This case shows how genetic, phylogenetic, and serological data can contribute for the forensic investigation of HIV transmission.

60 APPLIED LIFE SCIENCES↗

A square root formulation for the combined state-parameter estimator with application to the identification of sailplane performance

A square root formulation is presented for the discrete combined state parameter estimation problem with linear plant dynamics, Gaussian random disturbances, and constant but uncertain parameters. The estimator is a combination of the classical Kalman filter and a maximum likelihood algorithm which maximizes the parameter log-likelihood function using a first order search routine.

Froidevaux, M. R.↗

Regions of constrained maximum likelihood parameter identifiability

This paper considers the parameter identification problem of general discrete-time, nonlinear, multiple-input/multiple-output dynamic systems with Gaussian-white distributed measurement errors. Knowledge of the system parameterization is assumed to be known. Regions of constrained maximum likelihood (CML) parameter identifiability are established. A computation procedure employing interval arithmetic is proposed for finding explicit regions of parameter identifiability for the case of linear systems. It is shown that if the vector of true parameters is locally CML identifiable, then with probability one, the vector of true parameters is a unique maximal point of the maximum likelihood function in the region of parameter identifiability and the CML estimation sequence will converge to the true parameters.

Lee, C.-H.↗

Determination of the stability and control derivatives of the F/A-18 HARV from flight data using the maximum likelihood method

The research being conducted pertains to the determination of the stability and control derivatives of the F/A-18 High Alpha Research Vehicle (HARV) from flight data using the Maximum Likelihood Method. The document outlines the approach used in the parameter estimation (PID) process and briefly describes the mathematical modeling of the F/A-18 HARV and the maneuvers designed to generate a sufficient data base for the PID research.

Napolitano, Marcello R.↗

Very High-Resolution Satellite-Derived Bathymetry and Habitat Mapping Using Pleiades-1 and ICESat-2

Accurate and reliable bathymetric data are needed for a wide diversity of marine research and management applications. Satellite-derived bathymetry represents a time saving method to map large shallow waters of remote regions compared to the current costly in situ measurement techniques. This study aims to create very high-resolution (VHR) bathymetry and habitat mapping in Mayotte island waters (Indian Ocean) by fusing 0.5 m Pleiades-1 passive multispectral imagery and active ICESat-2 LiDAR bathymetry. ICESat-2 georeferenced photons were filtered to remove noise and corrected for water column refraction. The bathymetric point clouds were validated using the French naval hydrographic and oceanographic service Litto3D® dataset and then used to calibrate the multispectral image to produce a digital depth model (DDM). The latter enabled the creation of a digital albedo model used to classify benthic habitats. ICESat-2 provided bathymetry down to 15 m depth with a vertical accuracy of bathymetry estimates reaching 0.89 m. The benthic habitats map produced using the maximum likelihood supervised classification provided an overall accuracy of 96.62%. This study successfully produced a VHR DDM solely from satellite data. Digital models of higher accuracy were further discussed in the light of the recent and near-future launch of higher spectral and spatial resolution satellites.

Bathymetry↗