Search NASA⌕ Search

SEARCH · Search NASA

Results for “image quality assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Visualization Quality Assessment

Understanding how inaccuracies in visualizations affect users’ perception and understanding of scientific data is hard. Inaccuracies in visualizations are quite common and could arise from a range of sources such as errors in the original dataset arising from compression artifacts, errors in the capturing device, noise during transmission of the data, effects due to the algorithm being used to convert data to visualization images, images generated from neural networks, and sources we have yet to discover. Many image quality assessment metrics have been developed to quantify image errors. However, these are usually focused on “natural images” rather than visualizations of scientific data. Common image quality assessment metrics (IQAs) include MSE, PSNR, perceptual metrics such SSIM, FSIM as well as perceptual metrics using deep learning approaches. However, a critical part of understanding how errors are perceived by humans, and subsequently developing more accurate quality assessment metrics, is through user evaluation studies. The goal of this software is to develop a visualization quality assessment (VQA) process that will enable the generation of VQAs that can be used to quantify errors in scientific data visualizations. The VQA development process will include software to support user evaluation experimental design, analysis of visualization differences against standard quality metrics, and the ability to develop additional VQA metrics specific to scientific visualization images.

Grosset, Andre↗
DOE OSTI2022

Image Analysis for Rapid Assessment and Quality-Based Sorting of Corn Stover

Imaging in the visible spectrum is a low-cost tool that can be readily deployed for in-field or over-belt monitoring of biomass quality for bio-refining operations. Rapid image analysis coupled with innovative preprocessing may reduce the impacts of feedstock variability through identification of contaminants or other material attributes to guide selective sorting and quality management. Image analysis was employed to evaluate the quality of corn stover in red-green-blue (RGB) chromatic space. This study used controlled, bench-scale imaging as a proof-of-concept for rapid quality assessment of corn stover based on variations in material attributes, including chemical and physical attributes, that relate to biological degradation and soil contamination. Additionally, logistic regression-based classification algorithms were used to develop a method for biomass screening as a function of biological degradation or soil contamination. This study demonstrated the use of image analysis to extract features from RGB color space to investigate variations in critical material attributes from chemical composition of corn stover. Fourier transform infrared (FT-IR) suggested a correlation between red band intensity and biological degradation, while detailed surface texture analysis was found to distinguish among variations in ash. These insights offer promise for development of a rapid screening tool that could be deployed by farmers for in-field assessment of biomass quality or biorefinery operators for in-line sorting and process optimization.

09 BIOMASS FUELS↗
DOE OSTI2024

Uncertainty quantification and propagation in lithium-ion battery electrodes using bayesian convolutional neural networks

The complex nature of manufacturing processes stipulates electrodes to possess high variability with increased heterogeneity during production. X-ray computed tomography imaging has proved to be critical in visualizing the complicated stochastic particle distribution of as-manufactured electrodes in lithium-ion batteries. However, accurate prediction of their electrochemical performance necessitates precise evaluation of kinetic and transport properties from real electrodes. Image segmentation that characterizes voxels to particle/pore phase is often meticulous and fraught with subjectivity owing to a myriad of unconstrained choices and filter algorithms. Here we utilize a Bayesian convolutional neural network to tackle segmentation subjectivity and quantify its pertinent uncertainties. Otsu inter-variance and Blind/Referenceless Imaging Spatial Quality Evaluator are used to assess the relative image quality of grayscale tomograms, thus evaluating the uncertainty in the derived microstructural attributes. We analyze how image uncertainty is correlated with the uncertainties and magnitude of kinetic and transport properties of an electrode, further identifying pathways of uncertainty propagation within microstructural attributes. The coupled effect of spatial heterogeneity and microstructural anisotropy on the uncertainty quantification of transport parameters is also understood. This work demonstrates a novel methodology to extract microstructural descriptors from real electrode images through quantification of associated uncertainties and discerning the relative strength of their propagation, thus facilitating feedback to manufacturing processes from accurate image based electrochemical simulations.

25 ENERGY STORAGE↗
DOE OSTI2023

A combination interferometric and morphological image processing approach to rapid quality assessment of additively manufactured cellular truss core components

Advanced manufacturing (AM) processes such as laser powder bed fusion (LPBF) are increasingly capable of fabricating components with useful and unprecedented mechanical properties by incorporating complex internal bracing structures. From the standpoint of quality control and assessment, however, internally complex assemblies present significant build-verification challenges. Here we propose a hybrid approach to the inspection involving the application of computer-aided speckle interferometry (CASI) and morphological image processing as a rapid, inexpensive, and facile method for AM quality control. The described methodology has low capital equipment costs, is full-field and non-contact, can be used in an industrial setting, and has very low requirements in terms of operator training and expertise. Consisting primarily of the combination of image processing software with a simple optical system of variable sensitivity, the method is shown to be effective for inspection of a titanium honeycomb component subjected to differential pressure. Results are compared to those achieved with computed tomography (CT), immersion ultrasound testing (UT), and optical holographic interferometry. Here we propose several possible processing strategies for automated quality assessment based on this powerful hybrid approach.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Physics‐based iterative reconstruction for dual‐source and flying focal spot computed tomography

Purpose For single‐source helical Computed Tomography (CT), both Filtered‐Back Projection (FBP) and statistical iterative reconstruction have been investigated. However, for dual‐source CT with flying focal spot (DS‐FFS CT), a statistical iterative reconstruction that accurately models the scanner geometry and acquisition physics remains unknown to researchers. Therefore, our purpose is to present a novel physics‐based iterative reconstruction method for DS‐FFS CT and assess its image quality. Methods Our algorithm uses precise physics models to reconstruct from the native cone‐beam geometry and interleaved dual‐source helical trajectory of a DS‐FFS CT. To do so, we construct a noise physics model to represent data acquisition noise and a prior image model to represent image noise and texture. In addition, we design forward system models to compute the locations of deflected focal spots, the dimension, and sensitivity of voxels and detector units, as well as the length of intersection between x‐rays and voxels. The forward system models further represent the coordinated movement between the dual sources by computing their x‐ray coverage gaps and overlaps at an arbitrary helical pitch. With the above models, we reconstruct images by an advanced Consensus Equilibrium (CE) numerical method to compute the maximum a posteriori estimate to a joint optimization problem that simultaneously fits all models. Results We compared our reconstruction with Siemens ADMIRE, which is the clinical standard hybrid iterative reconstruction (IR) method for DS‐FFS CT, in terms of spatial resolution, noise profile, and image artifacts through both phantoms and clinical scan datasets. Experiments show that our reconstruction has a higher spatial resolution, with a Task‐Based Modulation Transfer Function (MTF task ) consistently higher than the clinical standard hybrid IR. In addition, our reconstruction shows a reduced magnitude of image undersampling artifacts than the clinical standard. Conclusions By modeling a precise geometry and avoiding data rebinning or interpolation, our physics‐based reconstruction achieves a higher spatial resolution and fewer image artifacts with smaller magnitude than the clinical standard hybrid IR.

Wang, Xiao↗
DOE OSTI2025

Image registration for accurate electrode deformation analysis in operando microscopy of battery materials

Operando imaging techniques have become increasingly valuable in both battery research and manufacturing. However, the reliability of these methods can be compromised by instabilities in the imaging setup and operando cells, particularly when utilizing high-resolution imaging systems. The acquired imaging data often include features arising from both undesirable system vibrations and drift, as well as the scientifically relevant deformations occurring in the battery sample during cell operation. For meaningful analysis, it is crucial to distinguish and separately evaluate these two factors. To address these challenges, we employ a suite of advanced image-processing techniques. These include fast Fourier transform analysis in the frequency domain, power spectrum-based assessments for image quality, as well as rigid and non-rigid image-registration methods. These techniques allow us to identify and exclude blurred images, correct for displacements caused by motor vibrations and sample holder drift and, thus, prevent unwanted image artifacts from affecting subsequent analyses and interpretations. Additionally, we apply optical flow analysis to track the dynamic deformation of battery electrode materials during electrochemical cycling. This enables us to observe and quantify the evolving mechanical responses of the electrodes, offering deeper insights into battery degradation. Together, these methods ensure more accurate image analysis and enhance our understanding of the chemomechanical interplay in battery performance and longevity.

Sun, Tianxiao↗
DOE OSTI2026

Quantum imaging with positronium-decay-emitted gamma rays

The use of entangled gamma rays from positronium decay for quantum-enhanced imaging of dense materials is demonstrated. Quantum ghost images, where only one of the entangled 511-keV photons interacts with the object, are obtained for tantalum samples of varying density using a 210-ps time-resolution dual detector system and a Na-22 positron source. An analysis comparing both classical and quantum imaging modalities is employed to isolate true 511-keV events from background noise. Image quality is quantitatively assessed using transmission ratios and the Michelson contrast. Quantum-correlated images are found to exhibit superior (up to approximately 1.7x, from 0.49 to 0.83 in the thickest sample measured) contrast compared to classical methods and align well with theoretical expectations. These results suggest that quantum ghost imaging with positronium-based entangled gamma rays could significantly enhance noninvasive imaging of high-density objects, with potential applications in areas such as cargo inspection and security screening.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Dynamic Differential Image Circle Diameter Measurement Precision Assessment: Application to Burning Droplets

Dynamic measurement precision assessment has been achieved for a differential circle measurement application. Differential circle diameter measurement, in image analysis, typically requires fitting a circle model that optimizes for image distortions, defects or occlusions. The differential task occurs when precise measurements of diameter change are required given object size variation with time. An automated system was designed to provide diameter measurements and associated measurement precision of images of a fuel droplet undergoing combustion in zero gravity for the FLEX-2 dataset. An image gradient-based, least-squares boundary point fitting method to a circle or ellipse model is used for diameter measurement. The presence of soot aggregates poses significant challenges for diameter measurements when it occludes part of the droplet boundary. The precision of the diameter measurements depends upon the image quality. Using synthetic image simulations that model the soot behavior, we developed a model based on image quality measures that assesses the measurement precision for each individual diameter measurement. Thus, diameter measurements with precision assessments were made available for follow-up scientific analysis. As a result, the algorithm's success rate for measurable runs was 98%. In cases of limited occlusion, a measurement precision of ±0.2 pixels for the FLEX-2 dataset was achieved.

42 ENGINEERING↗
DOE OSTI2024

Evaluating Machine Learning-Based MRI Reconstruction Using Digital Image Quality Phantoms

Quantitative and objective evaluation tools are essential for assessing the performance of machine learning (ML)-based magnetic resonance imaging (MRI) reconstruction methods. However, the commonly used fidelity metrics, such as mean squared error (MSE), structural similarity (SSIM), and peak signal-to-noise ratio (PSNR), often fail to capture fundamental and clinically relevant MR image quality aspects. To address this, we propose evaluation of ML-based MRI reconstruction using digital image quality phantoms and automated evaluation methods. Our phantoms are based upon the American College of Radiology (ACR) large physical phantom but created in k-space to simulate their MR images, and they can vary in object size, signal-to-noise ratio, resolution, and image contrast. Our evaluation pipeline incorporates evaluation metrics of geometric accuracy, intensity uniformity, percentage ghosting, sharpness, signal-to-noise ratio, resolution, and low-contrast detectability. We demonstrate the utility of our proposed pipeline by assessing an example ML-based reconstruction model across various training and testing scenarios. The performance results indicate that training data acquired with a lower undersampling factor and coils of larger anatomical coverage yield a better performing model. The comprehensive and standardized pipeline introduced in this study can help to facilitate a better understanding of the performance and guide future development and advancement of ML-based reconstruction algorithms.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Improving 3D reconstruction quality for root phenotyping: assessing the impact of camera calibration and imaging parameters

Arate 3D reconstruction is essential for high-throughput plant phenotyping, particularly for studying complex structures such as root systems. While photogrammetry and Structure from Motion (SfM) techniques have become widely used for 3D root imaging, the camera settings used are often underreported in studies, and the impact of camera calibration on model accuracyccu remains largely underexplored in plant science. In this study, we systematically evaluate the effects of focus, aperture, exposure time, and gain settings on the quality of 3D root models made with a multi-camera scanning system. We show through a series of experiments that calibration significantly improves model quality, with focus misalignment and shallow depth of field (DoF) being the most important factors affecting reconstruction accuracy. Our results further show that proper calibration has a greater effect on reducing noise than filtering it during post-processing, emphasizing the importance of optimizing image acquisition rather than relying solely on computational corrections. This work improves the repeatability and accuracy of 3D root imaging for phenotyping pipelines by giving useful calibration guidelines. This leads to better trait quantification for use in crop research and plant breeding in downstream analysis.

3D reconstruction↗
DOE OSTI2022

Vision-based inspection of prefabricated components using camera poses: Addressing inherent limitations of image-based 3D reconstruction

Modular construction can lead to additional cost overruns and delays when a defect is found on the construction site and is not easily repairable. Researchers have developed various methods that use image-based 3D reconstruction for quality assessment, but they have inherent limitations, such as inconsistency and dealing with surfaces with reflectivity and limited visual features. Therefore, this paper presents a vision-based quality assessment method using cameras for prefabricated components by addressing these limitations. Specifically, this paper proposes a novel quality inspection method with sub-millimeter accuracy using cameras focused on leveraging camera poses (as opposed to 3D point clouds that are often not consistent in quality) from the image-based 3D reconstruction. The 3D point estimation by computing triangulation was used for achieving accurate measurement. The proposed method is validated using six different variances and two case studies – an aluminum pipe with a reflective surface and a fabricated concrete column. Furthermore, the results demonstrate the accuracy and effectiveness of the proposed method.

42 ENGINEERING↗
DOE OSTI2024

Missing Wedge Completion via Unsupervised Learning with Coordinate Networks

Cryogenic electron tomography (cryoET) is a powerful tool in structural biology, enabling detailed 3D imaging of biological specimens at a resolution of nanometers. Despite its potential, cryoET faces challenges such as the missing wedge problem, which limits reconstruction quality due to incomplete data collection angles. Recently, supervised deep learning methods leveraging convolutional neural networks (CNNs) have considerably addressed this issue; however, their pretraining requirements render them susceptible to inaccuracies and artifacts, particularly when representative training data is scarce. To overcome these limitations, we introduce a proof-of-concept unsupervised learning approach using coordinate networks (CNs) that optimizes network weights directly against input projections. This eliminates the need for pretraining, reducing reconstruction runtime by 3–20× compared to supervised methods. Our in silico results show improved shape completion and reduction of missing wedge artifacts, assessed through several voxel-based image quality metrics in real space and a novel directional Fourier Shell Correlation (FSC) metric. Our study illuminates benefits and considerations of both supervised and unsupervised approaches, guiding the development of improved reconstruction strategies.

42 ENGINEERING↗
DOE OSTI2023

Improving and Assessing the Quality of Uncertainty Quantification in Deep Learning

Deep learning (DL) models have enjoyed increased attention in recent years because of their powerful predictive capabilities. While many successes have been achieved, standard deep learning methods suffer from a lack of uncertainty quantification (UQ). While the development of methods for producing UQ from DL models is an active area of current research, little attention has been given to the quality of the UQ produced by such methods. In order to deploy DL models to high-consequence applications, high-quality UQ is necessary. This report details the research and development conducted as part of a Laboratory Directed Research and Development (LDRD) project at Sandia National Laboratories. The focus of this project is to develop a framework of methods and metrics for the principled assessment of UQ quality in DL models. This report presents an overview of UQ quality assessment in traditional statistical modeling and describes why this approach is difficult to apply in DL contexts. An assessment on relatively simple simulated data is presented to demonstrate that UQ quality can differ greatly between DL models trained on the same data. A method for simulating image data that can then be used for UQ quality assessment is described. A general method for simulating realistic data for the purpose of assessing a model’s UQ quality is also presented. A Bayesian uncertainty framework for understanding uncertainty and existing metrics is described. Research that came out of collaborations with two university partners are discussed along with a software toolkit that is currently being developed to implement the UQ quality assessment framework as well as serve as a general guide to incorporating UQ into DL applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

A Versatile Fiber Coating Process for Efficient Fabrication of Multifunctional Composites

The objective of this research is to demonstrate the versatility of a dip coating process for the efficient integration of piezoelectric barium titanate (BaTiO3) microparticles on a wide variety of fibers to design passive self-sensing composites. The microparticles were deposited on glass, aramid, and basalt fiber weaves through the proposed dip coating technique. A computational framework is established to predict the deposition thickness on the fiber surfaces from the given microparticle concentration, size, coating velocity, and coating fluid viscosity. The deposition quality assessment was performed through scanning electron microscope imaging and subsequent image analysis. BaTiO3-coated fibers were directly used in composite preparation. After fabrication, the BaTiO3-enhanced composites were subjected to high-voltage poling. Finally, their passive self-sensing properties were characterized through experimental studies. The results show the adaptability of the proposed coating process to integrate BaTiO3 microparticles within different types of fiber-reinforced composites enabling passive self-sensing to attain subsurface damage characterization.

Gupta, Sumit↗
DOE OSTI2025

Location generalizability of image-based air quality models

This paper is to be submitted at the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) Computer Vision for Earth Observation workshop. The full paper abstract is below: The ability to rapidly quantify atmospheric pollutants is important both for global emissions monitoring and for mitigating the adverse effects that follow a hazardous chemical release. In the aftermath of a chemical release, imagery is often the only available resource to assess local conditions. Recent work has demonstrated initial success in predicting particulate matter pollution from imagery; however, these results are tied to a specific site and do not generalize to new geographic locations. In this work, we seek to understand how easily deep learning models generalize to new locations in the context of image-based air quality assessments, targeting two distinct tasks: (1) broad measures of particulate matter pollution, and (2) the mass of a given chemical released in hazardous plumes. For the latter, we focus on sulfur dioxide, a toxic aerosol and a major component of particulate matter pollution caused by industrial fossil fuel consumption. To develop a model that operates in the widest possible range of environments, we test different training strategies, including the use of new geolocation foundation models. The best performing models achieve >80% accuracy when evaluating unseen imagery at previously seen sites, but we find significant drops in performance when evaluating imagery from unseen sites, at best 65%. Additionally, we present the public release of the National Parks Air Quality Index Dataset, a new medium-sized dataset that pairs imagery with sensor-based air quality measurements at 15 different national parks.

Byler, Eleanor B. [BATTELLE (PACIFIC NW LAB)]↗
DOE OSTI2022

Rapid multiplex ultrafast nonlinear microscopy for material characterization

We demonstrate rapid imaging based on four-wave mixing (FWM) by assessing the quality of advanced materials through measurement of their nonlinear response, exciton dephasing, and exciton lifetimes. We use a WSe 2 monolayer grown by chemical vapor deposition as a canonical example to demonstrate these capabilities. By comparison, we show that extracting material parameters such as FWM intensity, dephasing times, excited state lifetimes, and distribution of dark/localized states allows for a more accurate assessment of the quality of a sample than current prevalent techniques, including white light microscopy and linear micro-reflectance spectroscopy. We further discuss future improvements of the ultrafast FWM techniques by modeling the robustness of exponential decay fits to different spacing of the sampling points. Employing ultrafast nonlinear imaging in real-time at room temperature bears the potential for rapid in-situ sample characterization of advanced materials and beyond.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Summary: SEE4GEO

The seismoelectric effects technique (SEE) is a new and innovative approach for geothermal subsurface imaging and monitoring at reservoir scale. The objective of this project is to assess SEE in terms of data acquisition, cost and quality, and to determine its capability in comparison with classical imaging and monitoring techniques, particularly decoupled seismic and electromagnetic methods. This will be achieved by (1) development of a fast, true 3D numerical package, handling SEE imaging and subsurface properties characterization, including resistivity and permeability, (2) laboratory experiments performed in a controlled environment to define optimal deployment design, data quality, and inform field deployment, and (3) field surveys to ultimately test and draw lessons for practical use of SEE technology. There is a relatively extensive body of work in the literature on SEE, and members of this consortium have been involved in theoretical and numerical development of SEE modeling as well as laboratory experiments. Nevertheless, to our knowledge few, if any, documented efforts have been specifically targeting the use of SEE for geothermal subsurface imaging and monitoring. The strength and originality of our proposal rely on an integrated approach leveraging numerical, laboratory and field experiments, to properly document the practical use of SEE. Through this process, SEE in-hand technology for the geothermal industry will be able to progress from a TRL 1 to TRL 3.

58 GEOSCIENCES↗