Search NASA⌕ Search

SEARCH · Search NASA

Results for “expectation-maximization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

32 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Autodifferentiable Ensemble Kalman Filters

Data assimilation is concerned with sequentially estimating a temporally evolving state. This task, which arises in a wide range of scientific and engineering applications, is particularly challenging when the state is high-dimensional and the state-space dynamics are unknown. This paper introduces a machine learning framework for learning dynamical systems in data assimilation. Here, our auto-differentiable ensemble Kalman filters (AD-EnKFs) blend ensemble Kalman filters for state recovery with machine learning tools for learning the dynamics. In doing so, AD-EnKFs leverage the ability of ensemble Kalman filters to scale to high-dimensional states and the power of automatic differentiation to train high-dimensional surrogate models for the dynamics. Numerical results using the Lorenz-96 model show that AD-EnKFs outperform existing methods that use expectation-maximization or particle filters to merge data assimilation and machine learning. In addition, AD-EnKFs are easy to implement and require minimal tuning.

autodifferentiation↗
DOE OSTI2018

Implementing and evaluating a Gaussian mixture framework for identifying gene function from TnSeq data

The rapid acceleration of microbial genome sequencing increases opportunities to understand bacterial gene function. Unfortunately, only a small proportion of genes have been studied. Recently, TnSeq has been proposed as a cost-effective, highly reliable approach to predict gene functions as a response to changes in a cell’s fitness before-after genomic changes. However, major questions remain about how to best determine whether an observed quantitative change in fitness represents a meaningful change. To address the limitation, we develop a Gaussian mixture model framework for classifying gene function from TnSeq experiments. In order to implement the mixture model, we present the Expectation-Maximization algorithm and a hierarchical Bayesian model sampled using Stan’s Hamiltonian Monte-Carlo sampler. We compare these implementations against the frequentist method used in current TnSeq literature. From simulations and real data produced by E.coli TnSeq experiments, we show that the Bayesian implementation of the Gaussian mixture framework provides the most consistent classification results.

Li, Kevin↗
DOE OSTI2025

A Latent-Variable Formulation of the Poisson Canonical Polyadic Tensor Model: Maximum Likelihood Estimation and Fisher Information

We establish parameter inference for the Poisson canonical polyadic (PCP) tensor model through a latent-variable formulation. Our approach exploits the observation that any random PCP tensor can be derived by marginalizing an unobservable random tensor of one dimension larger. The loglikelihood of this larger dimensional tensor, referred to as the “complete” loglikelihood, is comprised of multiple rank one PCP loglikelihoods. Using this methodology, we first derive maximum likelihood estimators for the PCP model and demonstrate that several existing algorithms for fitting non-negative matrix and tensor factorizations are Expectation-Maximization algorithms. Next, we derive the observed and expected Fisher information matrices for the PCP model. The Fisher information provides us crucial insights into the well-posedness of the tensor model, such as the role that tensor rank plays in identifiability and indeterminacy. For the special case of rank one PCP models, we demonstrate that these results are greatly simplified.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Monte Carlo Simulation and Reconstruction: Assessment of Myocardial Perfusion Imaging of Tracer Dynamics With Cardiac Motion Due to Deformation and Respiration Using Gamma Camera With Continuous Acquisition

Purpose: Myocardial perfusion imaging (MPI) with single photon emission computed tomography (SPECT) is routinely used for stress testing in nuclear medicine. Recently, our group extended its potential going from 3D visual qualitative image analysis to 4D spatiotemporal reconstruction of dynamically acquired data to capture the time variation of the radiotracer concentration and the estimated myocardial blood flow (MBF) and coronary flow reserve (CFR). However, the quality of reconstructed image is compromised due to cardiac deformation and respiration. The work presented here develops an algorithm that reconstructs the dynamic sequence of separate respiratory and cardiac phases and evaluates the algorithm with data simulated with a Monte Carlo simulation for the continuous image acquisition and processing with a slowly rotating SPECT camera. Methods: A clinically realistic Monte Carlo (MC) simulation is developed using the 4D Extended Cardiac Torso (XCAT) digital phantom with respiratory and cardiac motion to model continuous data acquisition of dynamic cardiac SPECT with slowly rotating gamma cameras by incorporating deformation and displacement of the myocardium due to cardiac and respiratory motion. We extended our previously developed 4D maximum-likelihood expectation-maximization (MLEM) reconstruction algorithm for a data set binned from a continuous list mode (LM) simulation with cardiac and respiratory information. Our spatiotemporal image reconstruction uses splines to explicitly model the temporal change of the tracer for each cardiac and respiratory gate that delineates the myocardial spatial position as the tracer washes in and out. Unlike in a fully list-mode data acquisition and reconstruction the accumulated photons are binned over a specific but very short time interval corresponding to each cardiac and respiratory gate. Reconstruction results are presented showing the dynamics of the tracer in the myocardium as it continuously deforms. These results are then compared with the conventional 4D spatiotemporal reconstruction method that models only the temporal changes of the tracer activity. Mean Stabilized Activity (MSA), signal to noise ratio (SNR) and Bias for the myocardium activities for three different target-to-background ratios (TBRs) are evaluated. Dynamic quantitative indices such as wash-in (K1) and wash-out (k2) rates at each gate were also estimated. Results: The MSA and SNR are higher with higher TBRs while biases were improved with higher TBRs to less than 10%. The correlation between exhalation-inhalation sequence with the ground truth during respiratory cycle was excellent. Our reconstruction method showed better resolved myocardial walls during diastole to systole as compared to the ungated 4D image. Estimated values of K1 and k2 were also consistent with the ground truth. Conclusion: The continuous image acquisition for dynamic scan using conventional two-head gamma cameras can provide valuable information for MPI. Our study demonstrated the viability of using a continuous image acquisition method on a widely used clinical two-head SPECT system. Our reconstruction method showed better resolved myocardial walls during diastole to systole as compared to the ungated 4D image. Precise implementation of reconstruction algorithms, better segmentation techniques by generating images of different tissue types and background activity would improve the feasibility of the method in real clinical environment.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2004

Statistical analysis of geodetic networks for detecting regional events

We present an application of hidden Markov models (HMMs) to analysis of geodetic time series in Southern California. Our model fitting method uses a regularized version of the deterministic annealing expectation-maximization algorithm to ensure that model solutions are both robust and of high quality.

geodetic networks↗
NASA NTRS2004

Symmetric normal mixtures

We consider mixture density estimation under the symmetry constraint x = Az for an orthogonal matrix A. This distributional constraint implies a corresponding constraint on the mixture parameters. Focusing on the gaussian case, we derive an expectation-maximization (EM) algorithm to enforce the constraint and show results for modeling of image feature vectors.

symmetry constraint↗
NASA NTRSDate not supplied

Unsupervised Change Detection for Space Habitats Using 3D Point Clouds

This work presents an algorithm for scene change detection from point clouds to enable autonomous robotic caretaking in future space habitats. Autonomous robotic systems will help maintain future deep-space habitats, such as the Gateway space station, which will be uncrewed for extended periods. Existing scene analysis software used on the International Space Station (ISS) relies on manually-labeled images for detecting changes. In contrast, the algorithm presented in this work uses raw, unlabeled point clouds as inputs. The algorithm first applies modified Expectation-Maximization Gaussian Mixture Model (GMM) clustering to two input point clouds. It then performs change detection by comparing the GMMs using the Earth Mover’s Distance. The algorithm is validated quantitatively and qualitatively using a test dataset collected by an Astrobee robot in the NASA Ames Granite Lab comprising single frame depth images taken directly by Astrobee and full-scene reconstructed maps built with RGB-D and pose data from Astrobee. The runtimes of the approach are also analyzed in depth. The source code is publicly released to promote further development.

robotics↗
NASA NTRS2020

Shape Estimation for Elongated Deformable Object using B-spline Chained Multiple Random Matrices Model

In this paper, a B-spline chained multiple random matrix models (RMMs) representation is proposed to model geometric characteristics of an elongated deformable object. The hyper degrees of freedom structure of the elongated deformable object make its shape estimation challenging. Based on the likelihood function of the proposed B-spline chained multiple RMMs, an expectation-maximization (EM) method is derived to estimate the shape of the elongated deformable object. A split and merge method based on the Euclidean minimum spanning tree (EMST) is proposed to provide initialization for the EM algorithm. The proposed algorithm is evaluated for the shape estimation of the elongated deformable objects in scenarios, such as the static rope with various configurations (including configurations with intersection), the continuous manipulation of a rope and a plastic tube, and the assembly of two plastic tubes. The execution time is computed and the accuracy of the shape estimation results is evaluated based on the comparisons between the estimated width values and its ground-truth, and the intersection over union (IoU) metric.

Gang Yao↗
DOE OSTI2016

A Deep Generative Deconvolutional Image Model

A deep generative model is developed for representation and analysis of images, based on a hierarchical convolutional dictionary-learning framework. Stochastic unpooling is employed to link consecutive layers in the model, yielding top-down image generation. A Bayesian support vector machine is linked to the top-layer features, yielding max-margin discrimination. Deep deconvolutional inference is employed when testing, to infer the latent features, and the top-layer features are connected with the max-margin classifier for discrimination tasks. The model is efficiently trained using a Monte Carlo expectation-maximization (MCEM) algorithm; the algorithm is implemented on graphical processor units (GPU) to enable large-scale learning, and fast testing. Excellent results are obtained on several benchmark datasets, including ImageNet, demonstrating that the proposed model achieves results that are highly competitive with similarly sized convolutional neural networks.

convolutional neural network↗
DOE OSTI2017

Stochastic Short-term High-resolution Prediction of Solar Irradiance and Photovoltaic Power Output

The increased penetration of solar photovoltaic (PV) energy sources into electric grids has increased the need for accurate modeling and prediction of solar irradiance and power production. Existing modeling and prediction techniques focus on long-term low-resolution prediction over minutes to years. This paper examines the stochastic modeling and short-term high-resolution prediction of solar irradiance and PV power output. We propose a stochastic state-space model to characterize the behaviors of solar irradiance and PV power output. This prediction model is suitable for the development of optimal power controllers for PV sources. A filter-based expectation-maximization and Kalman filtering mechanism is employed to estimate the parameters and states in the state-space model. The mechanism results in a finite dimensional filter which only uses the first and second order statistics. The structure of the scheme contributes to a direct prediction of the solar irradiance and PV power output without any linearization process or simplifying assumptions of the signal’s model. This enables the system to accurately predict small as well as large fluctuations of the solar signals. The mechanism is recursive allowing the solar irradiance and PV power to be predicted online from measurements. The mechanism is tested using solar irradiance and PV power measurement data collected locally in our lab.

Melin, Alexander M.↗
DOE OSTI2018

Compositing "Stand Off" Ground Penetrating Radar Scans of Differing Frequencies.

Methods have been developed to combine signals of various frequencies in a manner to produce clearer images in the presence of noise. Ground Penetrating Radar (GPR) scans at various frequencies are no exception. Methods using an optimization problem solver, the Expectation-Maximization (EM) Algorithm, define weights used to perform the task of combining GPR scans. In this paper, we explore using the Gaussian Mixture Model (GMM) feature of the EM Algorithm on GPR scans taken at various heights above ground ("Stand Off' GPR). This method demonstrates the same measured improvement toward producing a cleaner image as GPR scans taken at ground level using the same EM Algorithm method.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A full-ring variable-aperture cadmium zinc telluride system for whole-body single photon emission computed tomography: realistic simulations with phantoms

Single photon emission computed tomography (SPECT) is an imaging modality that has demonstrated its utility in a number of clinical indications. Despite this progress, a high sensitivity, high spatial resolution, multi-tracer SPECT with a large field of view suitable for whole-body imaging of a broad range of radiotracers for theranostics is not available. Purpose We have designed a cadmium zinc telluride (CZT) variable-aperture full-ring SPECT scanner instrumented with a broad-energy tungsten collimator intended to fill this technological gap. The final purpose is to provide a multi-tracer solution for brain and whole-body imaging. Our static SPECT scanner breaks the paradigm of the standard dual- and triple-head rotational SPECT systems, utilizing a larger detector area in each scan increasing the sensitivity. We provide a demonstration of the performance of our design using a realistic model of our detector with simulated body-sized 99mTc phantoms. Methods We developed a realistic model of our detector by using a combination of a Geant4 Monte Carlo simulation and a CZT detector response model based on a finite element model. Our approach models the characteristic low-energy tail effect in CZT that noticeably affects the sensitivity and the quality of the scatter correction in CZT detectors. We implement a modified dual energy window scatter correction adapted to include the CZT low-energy tail effect. A dedicated correction is also developed to eliminate the undesirable truncation observed in images given the presence of detector edges and gaps between detectors, due to the non-rotational nature of our device. Corrections for the attenuation, detector response and the presence of collimators are also included. The images are reconstructed using the maximum-likelihood expectation-maximization algorithm implemented in the reconstruction open software STIR. Detector and reconstruction performance are characterized with a Derenzo phantom and a body-sized National Electrical Manufacturers Association (NEMA) Image Quality (IQ) phantom containing 99mTc. Results Our SPECT design can resolve 6.4mm rods in a Derenzo phantom and obtain a good image contrast with the IQ phantom. Explicit testing of the gap and edge correction is provided, showing an excellent performance in eliminating the image truncation artifacts. Our modified scatter correction shows no overestimation of the contrast-recovery ratio for our realistic CZT detector model, as opposed to the cases without correction and with a standard dual-energy window scatter correction. Conclusions In this paper, we further demonstrate the performance of our design for whole-body imaging purposes. This adds to our previous demonstration of improved qualitative and quantitative 99mTc imaging for brain perfusion and 123I imaging for dopamine transport with respect to state-of-the-art NaI dual-head cameras. We show that our design performs similarly to the VERITON SPECT from Spectrum Dynamics, a commercial full-ring CZT SPECT camera, with the potential advantage of the broader energy range of application given by our custom-design tungsten collimators. Here, our device combines high sensitivity and image resolution with a broad-energy imaging application for the purpose of clinical imaging and theranostics of emerging radionuclides.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2023

3D Source Reconstruction Using Coded Aperture Gamma-Ray Imaging

Recent measurements with coded-aperture imagers demonstrate material mass determination in a holdup setting to an accuracy within a few percent. This capability is of particular interest to the Surplus Plutonium Disposition (SPD) project, which aims to dilute and dispose of surplus plutonium oxide. Gamma-ray imagers can be used to determine holdup without interrupting normal operations. In this work, we examine techniques for 3D source localization and mass determination using gamma-ray imagers. Coded-aperture imagers provide excellent source localization within the 2D image plane; however, multiple imagers operating in tandem are necessary to identify source location in 3D space. A Maximum Likelihood Expectation-Maximization (MLEM) method for fitting detector mappings is a powerful tool for accomplishing this task. MLEM allows 3D source localization to be simultaneously constrained using multiple gamma-ray imagers by constructing the basis for the MLEM fit using detector mappings from different detector locations stitched together. Each of these basis points represents a singular response from a source in 3D space and is generated using Monte Carlo simulations of sources placed individually at different locations throughout the imager’s field of view. Additionally, implementing knowledge of the physical equipment in the simulations of the glovebox used for the SPD project incorporates attenuation effects that are needed to calculate material holdup.

Laminack, Alex↗
NASA NTRSDate not supplied

Maximum-Likelihood Parameter Estimation for High-Contrast Wavefront Sensing & Control

Stellar coronagraphs use closed-loop focal-plane wavefront sensing and control algorithms to create high-contrast dark zones suitable for imaging exoplanets and exozodiacal dust clouds around nearby stars. At present, the deepest contrast has been achieved using model-based algorithms, which use the predicted focal-plane influence of the coronagraph's deformable mirrors to drive diffracted starlight toward zero over time in an optimal control framework. However, model-based algorithms are susceptible to model mismatch, wherein a departure of the coronagraph's true optical characteristics from the model predictions causes reduced control loop performance. Here, we report on a technique for maximum-likelihood estimation of the wavefront control Jacobian matrix and noise statistics of the coronagraph focal-plane electric field from data acquired in situ during closed-loop wavefront control operations. By empirically tuning the Jacobian and noise properties in a statistically rigorous fashion, the maximum-likelihood approach mitigates model mismatch and recovers near-optimal control loop performance.

coronagraphy↗