SEARCH · Search NASA
Results for “Bayesian imaging”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Examination of nucleon distribution with Bayesian imaging for isobar collisions
Relativistic collision of isobaric systems is found to be valuable in differentiating the nucleon distributions for nuclei with the same mass number. In recent contrast experiment of $^{96}_{44}$Ru + $^{96}_{44}$Ru versus $^{96}_{40}$Zr + $^{96}_{40}$Zr collisions at $\sqrt{s_{NN}}$ = 200 GeV, the ratios of multiplicity distribution, elliptic flow, triangular flow, and radial flow are precisely measured and found to be significantly different from unity, indicating the difference in the shapes of the isobar pair. Here, in this work, we investigate the feasibility of nuclear structure reconstruction from heavy-ion collision observables. We perform Bayesian Inference with employing the Monte-Carlo Glauber model as an estimator of the mapping from nuclear structure to the final state observables and to provide the mock data for reconstruction. By varying combination of observables included in the mock data, we find it plausible to infer Woods–Saxon parameters from the observables. We also observe that single-system multiplicity distribution for the isobar system, rather than their ratio, is crucial to simultaneously determine the nuclear structure for the isobar system.
Radiation image reconstruction and uncertainty quantification using a Gaussian process prior
We propose a complete framework for Bayesian image reconstruction and uncertainty quantification based on a Gaussian process prior (GPP) to overcome limitations of maximum likelihood expectation maximization (ML-EM) image reconstruction algorithm. The prior distribution is constructed with a zero-mean Gaussian process (GP) with a choice of a covariance function, and a link function is used to map the Gaussian process to an image. Unlike many other maximum a posteriori approaches, our method offers highly interpretable hyperparamters that are selected automatically with the empirical Bayes method. Furthermore, the GP covariance function can be modified to incorporate a priori structural priors, enabling multi-modality imaging or contextual data fusion. Lastly, we illustrate that our approach lends itself to Bayesian uncertainty quantification techniques, such as the preconditioned Crank–Nicolson method and the Laplace approximation. The proposed framework is general and can be employed in most radiation image reconstruction problems, and we demonstrate it with simulated free-moving single detector radiation source imaging scenarios. We compare the reconstruction results from GPP and ML-EM, and show that the proposed method can significantly improve the image quality over ML-EM, all the while providing greater understanding of the source distribution via the uncertainty quantification capability. Furthermore, significant improvement of the image quality by incorporating a structural prior is illustrated.
Sequential Image Recovery Using Joint Hierarchical Bayesian Learning
Abstract Recovering temporal image sequences (videos) based on indirect, noisy, or incomplete data is an essential yet challenging task. We specifically consider the case where each data set is missing vital information, which prevents the accurate recovery of the individual images. Although some recent (variational) methods have demonstrated high-resolution image recovery based on jointly recovering sequential images, there remain robustness issues due to parameter tuning and restrictions on the type of sequential images. Here, we present a method based on hierarchical Bayesian learning for the joint recovery of sequential images that incorporates prior intra- and inter-image information. Our method restores the missing information in each image by “borrowing” it from the other images. More precisely, we couple sequential images by penalizing their pixel-wise difference. The corresponding penalty terms (one for each pixel and pair of subsequent images) are treated as weakly-informative random variables that favor small pixel-wise differences but allow occasional outliers. As a result, all of the individual reconstructions yield improved accuracy. Our method can be used for various data acquisitions and allows for uncertainty quantification. Some preliminary results indicate its potential use for sequential deblurring and magnetic resonance imaging.
Satellite Image Algorithms
Presented by Conner Hatton at SIAM UQ Conference in Trieste, Italy, on February 27th, 2024. Conference details available online at https://www.siam.org/conferences/cm/conference/uq24
Statistical modelling and Bayesian inversion for a Compton imaging system: application to radioactive source localization
Abstract This paper presents a statistical forward model for a Compton imaging system, called Compton imager. This system, under development at the University of Illinois Urbana Champaign, is a variant of Compton cameras with a single type of sensors which can simultaneously act as scatterers and absorbers. This imager is convenient for imaging situations requiring a wide field of view. The proposed statistical forward model is then used to solve the inverse problem of estimating the location and energy of point-like sources from observed data. This inverse problem is formulated and solved in a Bayesian framework by using a Metropolis within Gibbs algorithm for the estimation of the location, and an expectation-maximization algorithm for the estimation of the energy. This approach leads to more accurate estimation when compared with the deterministic standard back-projection approach, with the additional benefit of uncertainty quantification in the low photon imaging setting.
Lowering the computational barrier: Partially Bayesian neural networks for transparency in medical imaging AI
Deep Neural Networks (DNNs) can provide clinicians with fast and accurate predictions that are highly valuable for high-stakes medical decision-making, such as in brain tumor segmentation and treatment planning. However, these models largely lack transparency about the uncertainty in their predictions, potentially giving clinicians a false sense of reliability that may lead to grave consequences in patient care. Growing calls for Transparent and Responsible AI have promoted Uncertainty Quantification (UQ) to capture and communicate uncertainty in a systematic and principled manner. However, traditional Bayesian UQ methods remain prohibitively costly for large, million-dimensional tumor segmentation DNNs such as the U-Net. In this work, we discuss a computationally-efficient UQ approach via the partially Bayesian neural networks (pBNN). In pBNN, only a single layer, strategically selected based on gradient-based sensitivity analysis, is targeted for Bayesian inference. We illustrate the effectiveness of pBNN in capturing the full uncertainty for a 7.8-million parameter U-Net. We also demonstrate how practitioners and model developers can use the pBNN's predictions to better understand the model's capabilities and behavior.
Bayesian Target Detection Algorithms for Solid Subpixel Targets in Hyperspectral Images
Not Available
A deep learning approach to fast analysis of collective Thomson scattering spectra
Fast analysis of collective Thomson scattering ion acoustic wave features using a deep convolutional neural network model is presented. The network was trained from spectra to predict the plasma parameters, including ion velocities, population fractions, and ion and electron temperatures. A fully kinetic particle-in-cell simulation was used to model a laboratory astrophysics experiment and simulate a diagnostic image of the ion acoustic wave feature. Network predictions were compared with Bayesian inference of the plasma model parameters for both the simulated and experimentally measured images. Both approaches were fairly accurate predicting the simulated image and the network predictions matched a good portion of the Bayesian results for the experimentally measured image. The Bayesian approach is more robust to noise and motivates future work to train deep learning models with realistic noise. The advantage of the deep learning model is making thousands of predictions in a few hundred milliseconds, compared to a few seconds to minutes per prediction for the optimization and Bayesian approaches presented here. The results demonstrate promising capabilities of deep learning models to analyze Thomson data orders of magnitude faster than conventional methods when using the neural network for standalone analysis. If more rigorous analysis is needed, neural network predictions can be used to quickly initialize other optimization methods and increase chances of success. This is especially useful when the dataset becomes very large or highly dimensional and manually refining initial conditions for the entire dataset are no longer tractable.
Physics-based reward driven image analysis in microscopy
The rise of electron microscopy has expanded our ability to acquire nanometer and atomically resolved images of complex materials. The resulting vast datasets are typically analyzed by human operators, an intrinsically challenging process due to the multiple possible analysis steps and the corresponding need to build and optimize complex analysis workflows. We present a methodology based on the concept of a Reward Function coupled with Bayesian Optimization, to optimize image analysis workflows dynamically. The Reward Function is engineered to closely align with the experimental objectives and broader context and is quantifiable upon completion of the analysis. Here, cross-section, high-angle annular dark field (HAADF) images of ion-irradiated (Y, Dy)Ba 2 Cu 3 O 7–δ thin-films were used as a model system. The reward functions were formed based on the expected materials density and atomic spacings and used to drive multi-objective optimization of the classical Laplacian-of-Gaussian (LoG) method. These results can be benchmarked against the DCNN segmentation. This optimized LoG* compares favorably against DCNN in the presence of the additional noise. We further extend the reward function approach towards the identification of partially-disordered regions, creating a physics-driven reward function and action space of high-dimensional clustering. We pose that with correct definition, the reward function approach allows real-time optimization of complex analysis workflows at much higher speeds and lower computational costs than classical DCNN-based inference, ensuring the attainment of results that are both precise and aligned with the human-defined objectives.
Physics Discovery in Nanoplasmonic Systems via Autonomous Experiments in Scanning Transmission Electron Microscopy
Abstract Physics‐driven discovery in an autonomous experiment has emerged as a dream application of machine learning in physical sciences. Here, this work develops and experimentally implements a deep kernel learning (DKL) workflow combining the correlative prediction of the target functional response and its uncertainty from the structure, and physics‐based selection of acquisition function, which autonomously guides the navigation of the image space. Compared to classical Bayesian optimization (BO) methods, this approach allows to capture the complex spatial features present in the images of realistic materials, and dynamically learn structure–property relationships. In combination with the flexible scalarizer function that allows to ascribe the degree of physical interest to predicted spectra, this enables physical discovery in automated experiment. Here, this approach is illustrated for nanoplasmonic studies of nanoparticles and experimentally implemented in a truly autonomous fashion for bulk‐ and edge plasmon discovery in MnPS 3 , a lesser‐known beam‐sensitive layered 2D material. This approach is universal, can be directly used as‐is with any specimen, and is expected to be applicable to any probe‐based microscopic techniques including other STEM modalities, scanning probe microscopies, chemical, and optical imaging.
Autonomous convergence of STM control parameters using Bayesian optimization
Scanning tunneling microscopy (STM) is a widely used tool for atomic imaging of novel materials and their surface energetics. However, the optimization of the imaging conditions is a tedious process due to the extremely sensitive tip–surface interaction, thus limiting the throughput efficiency. In this paper, we deploy a machine learning (ML)-based framework to achieve optimal atomically resolved imaging conditions in real time. The experimental workflow leverages the Bayesian optimization (BO) method to rapidly improve the image quality, defined by the peak intensity in the Fourier space. The outcome of the BO prediction is incorporated into the microscope controls, i.e., the current setpoint and the tip bias, to dynamically improve the STM scan conditions. We present strategies to either selectively explore or exploit across the parameter space. As a result, suitable policies are developed for autonomous convergence of the control parameters. The ML-based framework serves as a general workflow methodology across a wide range of materials.
Uncertainty Quantification for the Image Segmentation Task [Slides]
This report provides information about image segmentation, including challenges, experiment results and future efforts.
BEACON—automated aberration correction for scanning transmission electron microscopy using Bayesian optimization
Aberration correction is an important aspect of modern high-resolution scanning transmission electron microscopy. Most methods of aligning aberration correctors require specialized sample regions and are unsuitable for fine-tuning aberrations without interrupting on-going experiments. Here, we present an automated method of correcting first- and second-order aberrations called BEACON, which uses Bayesian optimization of the normalized image variance to efficiently determine the optimal corrector settings. We demonstrate its use on gold nanoparticles and a hafnium dioxide thin film showing its versatility in nano- and atomic-scale experiments. BEACON can correct all first- and second-order aberrations simultaneously to achieve an initial alignment and first- and second-order aberrations independently for fine alignment. Ptychographic reconstructions are used to demonstrate an improvement in probe shape and a reduction in the target aberration.
Measurement of charge state distributions using a scintillation screen
Absolute cross sections measured using electromagnetic devices to separate and detect heavy recoiling ions need to be corrected for charge state fractions. Accurate prediction of charge state distributions using theoretical models is not always a possibility, especially in energy and mass regions where data is sparse. As such, it is often necessary to measure charge state fractions directly. In this paper we present a novel method of using a scintillation screen along with a CMOS camera to image the charge dispersed beam after a set of magnetic dipoles. A measurement of the charge state distribution for 88 Sr passing through a natural carbon foil is performed. Using a Bayesian model to extract statistically meaningful uncertainties from these images, we find agreement between the new method and a more traditional method using Faraday cups. Additional future work is need to better understand systematic uncertainties. Our technique offers a viable method to measure charge state distributions.
Bayesian merging of numerical modeling and remote sensing for saltwater intrusion quantification in the Vietnamese Mekong Delta
Saltwater intrusion has become one of the most concerning issues in the Vietnamese Mekong Delta (VMD) due to its increasing impacts on agriculture and food security of Vietnam. Reliable estimation of salinity plays a crucial role to mitigate the impacts of saltwater intrusion. Here, this study developed a hybrid technique that merges satellite imagery with numerical simulations to improve the estimation of salinity in the VMD. The salinity derived from Landsat images and by numerical simulations was fused using the Bayesian inference technique. The results indicate that our technique significantly reduces the uncertainties and improves the accuracy of salinity estimates. The Nash–Sutcliffe coefficient is 0.74, which is much higher than that of numerical simulation (0.63) and Landsat estimation (0.6). The correlation coefficient between the ensemble and measured salinity is relatively high (0.88). The variance of the ensemble salinity errors (5.0 ppt 2 ) is lower than that of Landsat estimation (10.4 ppt 2 ) and numerical simulations (9.6 ppt 2 ). The proposed approach shows a great potential to combine multiple data sources of a variable of interest to improve its accuracy and reliability wherever these data are available.
Evaluation of Plasma Phosphorylated Tau217 for Differentiation Between Alzheimer Disease and Frontotemporal Lobar Degeneration Subtypes Among Patients With Corticobasal Syndrome
Plasma phosphorylated tau217 (p-tau217), a biomarker of Alzheimer disease (AD), is of special interest in corticobasal syndrome (CBS) because autopsy studies have revealed AD is the driving neuropathology in up to 40% of cases. This differentiates CBS from other 4-repeat tauopathy (4RT)–associated syndromes, such as progressive supranuclear palsy Richardson syndrome (PSP-RS) and nonfluent primary progressive aphasia (nfvPPA), where underlying frontotemporal lobar degeneration (FTLD) is typically the primary neuropathology. To validate plasma p-tau217 against positron emission tomography (PET) in 4RT-associated syndromes, especially CBS. This multicohort study with 6, 12, and 24-month follow-up recruited adult participants between January 2011 and September 2020 from 8 tertiary care centers in the 4RT Neuroimaging Initiative (4RTNI). All participants with CBS (n = 113), PSP-RS (n = 121), and nfvPPA (n = 39) were included; other diagnoses were excluded due to rarity (n = 29). Individuals with PET-confirmed AD (n = 54) and PET-negative cognitively normal control individuals (n = 59) were evaluated at University of California San Francisco. Operators were blinded to the cohort. Plasma p-tau217, measured by Meso Scale Discovery electrochemiluminescence, was validated against amyloid-β (Aβ) and flortaucipir (FTP) PET. Imaging analyses used voxel-based morphometry and bayesian linear mixed-effects modeling. Clinical biomarker associations were evaluated using longitudinal mixed-effect modeling. Of 386 participants, 199 (52%) were female, and the mean (SD) age was 68 (8) years. Plasma p-tau217 was elevated in patients with CBS with positive Aβ PET results (mean [SD], 0.57 [0.43] pg/mL) or FTP PET (mean [SD], 0.75 [0.30] pg/mL) to concentrations comparable to control individuals with AD (mean [SD], 0.72 [0.37]), whereas PSP-RS and nfvPPA showed no increase relative to control. Within CBS, p-tau217 had excellent diagnostic performance with area under the receiver operating characteristic curve (AUC) for Aβ PET of 0.87 (95% CI, 0.76-0.98; P < .001) and FTP PET of 0.93 (95% CI, 0.83-1.00; P < .001). At baseline, individuals with CBS-AD (n = 12), defined by a PET-validated plasma p-tau217 cutoff 0.25 pg/mL or greater, had increased temporoparietal atrophy at baseline compared to individuals with CBS-FTLD (n = 39), whereas longitudinally, individuals with CBS-FTLD had faster brainstem atrophy rates. Individuals with CBS-FTLD also progressed more rapidly on a modified version of the PSP Rating Scale than those with CBS-AD (mean [SD], 3.5 [0.5] vs 0.8 [0.8] points/year; P = .005). In this cohort study, plasma p-tau217 had excellent diagnostic performance for identifying Aβ or FTP PET positivity within CBS with likely underlying AD pathology. Plasma P-tau217 may be a useful and inexpensive biomarker to select patients for CBS clinical trials.
Automating STEM Aberration Correction via Bayesian Optimization
Multipole aberration correctors have given scanning transmission electron microscopes (STEM) the ability to produce high-quality, atomic-resolution images, enabling STEM to be a key tool in material sciences for characterizing the structure and composition of materials. However, the process of correcting these aberrations typically requires human input and is accomplished using scanned STEM or Ronchigram images at different focii and beam tilts. In this work, we demonstrate an automated on-sample aberration correction system using Bayesian Optimization. We have developed a Python-based server able to communicate with the CEOS DCOR aberration corrector and the Thermo Fischer microscope scripting interface. This server allows us to change aberrations, acquire images and perform basic image analysis.