Search NASA⌕ Search

SEARCH · Search NASA

Results for “automated image analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Massive all-atom analysis of 2D materials with quantum properties (Final report)

Improvements in microscopy have enabled the acquisition of data at a scale that is difficult to process manually, making automated machine learning approaches to analyzing experimental images essential. In this project, we developed and applied machine learning (ML) workflows for atomic resolution scanning transmission electron microscopy (STEM) images. This development included improving both methodology as well as generating user-friendly codes. We developed machine learning architectures which, after training, automatically identify the location and types of defects throughout a material. We used these data to produce class-averaged images of 2D atomic coordinates with up to 0.3 pm precision, uncovering the structure and oscillations of long-range strain fields around point defects in WSe 2-2x Te 2x . We also resolved a long-standing problem in this field in the training of ML models, a lack of labeled experimental data, by developing a cycle-GAN that transformed simulated-generated labeled data into labeled data indistinguishable from experiment and therefore suitable for training. This removed the remaining parts of the ML data processing workflow where human intervention was still critical and therefore a bottleneck to working at scale. Codes have been developed and released for this full machine learning workflow. ML approaches to partially automate STEM acquisition were also developed. Finally we applied ML and other advanced data processing methods to several materials science problems in two-dimensional materials, including studying the evolution of hyperuniformity with defect concentration in WSe2, understanding phase transformations in transition metal dichalcogenides during in-situ heating in the STEM, and exploring how 2D interfaces transform from twisted into aligned structures.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Hyperspectral Detection of the Fluorescence Shift between Chirality-Sorted Empty and Water-Filled Single-Wall Carbon Nanotube Enantiomers

Single-wall carbon nanotubes (SWCNTs) have extraordinary electronic and optical properties that depend strongly on their exact chiral structure and their interaction with their inner and outer environment. The fluorescence (PL) of semiconducting SWCNTs, for instance, will shift depending on the molecules with which the SWCNT’s hollow core is filled. These interaction-induced shifts are challenging to resolve on the ensemble level in samples containing a mixture of different filling contents due to the relatively large inhomogeneous line width of the ensemble SWCNT PL compared to the size of these shifts. To circumvent this inhomogeneous broadening, single-tube spectroscopy and hyperspectral imaging are often applied, which until now required time-consuming statistical studies. Here, we present hyperspectral PL microscopy combined with automated SWCNT segmenting based on either principal component analysis or a convolutional neural network, capable of both spatially and spectrally resolving the PL along the length of many individual SWCNTs at the same time and automatically fitting peak positions and line widths of individual SWCNTs. The methodology is demonstrated by accurately determining the emission shifts and line widths of thousands of left- and right-handed empty and water-filled SWCNTs coated with a chiral surfactant, resulting in four statistical distributions which cannot be resolved in ensemble spectroscopy of unsorted samples. The results demonstrate a robust method to quickly probe ensemble properties with single-enantiomer spectral resolution. Moreover, it promises to be an absolute quantitative method to characterize the relative abundances of SWCNTs with different handedness or filling content in macroscopic samples, simply by counting individual species.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

BFSVBF (BatFinder Smart Video BioFilter) [SWR-22-87] and Multi-class BatFinder Smart Video BioFilter Keras

Bats are notoriously difficult to study, therefore, identifying specific behavioral trends and the precise environmental conditions at the time of collision requires a monitoring solution that can reliably collect relevant data. To date, thermal infrared video surveillance has been extensively applied to study bats and has proven to be a powerful yet cumbersome tool. Current analytical approaches are time consuming because data processing data has not been fully automated. In the past, steps have been taken to record avian and bat activity in conjunction with complicated image processing techniques that separate species from other moving objects within the field of view (i.e. clouds and portions of the wind turbine). Once the videos are collected, the post-processing does not allow real time monitoring and identification, leading to a delay in both studying the behavior of these species and determining the effectiveness of any impact reduction strategy being studied. Moreover, object identification capability is lacking, thus limiting the usefulness of video data. To resolve these issues, we are using open source computer vision and machine learning techniques allowing for automatic detection of objects in real-time with the ability to correlate these objects with environmental variables and recording the flight paths of each object. The code has gone through five rounds of development with images used to train the models. This advancement allows for automated real-time data collection, identification, and tracking, thereby eliminating the need for long and tedious post-analysis processing of the videos. We will discuss the two open source and publicly available machine learning models developed within this scope of this work: 1) a binary model with a 97.5% accuracy in identifying the difference between an object and an empty scene, including wind turbine and clouds; and 2) a multiple classification model with the capability of identifying the type of object detected: bats (90% accuracy), birds (83% accuracy), insects (69% accuracy) and non-biological (99% accuracy).

Yarbrough, John↗

Using machine learning techniques to automate sky survey catalog generation

We describe the application of machine classification techniques to the development of an automated tool for the reduction of a large scientific data set. The 2nd Palomar Observatory Sky Survey provides comprehensive photographic coverage of the northern celestial hemisphere. The photographic plates are being digitized into images containing on the order of 10(exp 7) galaxies and 10(exp 8) stars. Since the size of this data set precludes manual analysis and classification of objects, our approach is to develop a software system which integrates independently developed techniques for image processing and data classification. Image processing routines are applied to identify and measure features of sky objects. Selected features are used to determine the classification of each object. GID3* and O-BTree, two inductive learning techniques, are used to automatically learn classification decision trees from examples. We describe the techniques used, the details of our specific application, and the initial encouraging results which indicate that our approach is well-suited to the problem. The benefits of the approach are increased data reduction throughput, consistency of classification, and the automated derivation of classification rules that will form an objective, examinable basis for classifying sky objects. Furthermore, astronomers will be freed from the tedium of an intensely visual task to pursue more challenging analysis and interpretation problems given automatically cataloged data.

Fayyad, Usama M.↗

RESIDUAL DEFORMATION ANALYSIS IN COMPOSITE SHELL STRUCTURES MANUFACTURED USING AUTOMATED FIBER PLACEMENT

The manufacturing of composites typically produces residual stresses that can significantly affect the final shape of the structure. The process of automated fiber placement (AFP) has become a prominent manufacturing technique in developing layups with tailored, variable stiffness morphology. The steered patterns of fiber tows with and without overlaps produce residual deformations that are distinctive from traditional layups. Digital image correlation was used to measure the AFP lamina coefficients of thermal expansion, which were incorporated into finite element analyses (FEA) to model the cooling phase of the cure cycle. The effects of nonlinear analysis and temperature-dependent lamina properties calculated using self-consistent field micromechanics, on the resulting residual deformation of shells, were also modeled. The predicted residual deformation was analyzed by considering out-of-roundness in cylindrical shells and compared to the experimental results. The shell FEA results were well-correlated with the overall deformed shape of the AFP cylinder with overlaps, while the shell FEA model of the AFP cylinder without overlaps did not show as good of qualitative match of the deformation pattern. Analytical correlation with measured results were insensitive to material softening at elevated temperatures, geometric nonlinearities, and variations in measured lamina thermal properties. To improve the accuracy of the residual deformation analysis, these results suggest that the thermo-chemical shrinkages preceding the cooldown should be considered, as well as possible variations in ply level microstructure due to the presence of the embedded fiber tow gaps and overlaps.

Composites↗

Workflow for High-throughput Screening of Enzyme Mutant Libraries Using Matrix-assisted Laser Desorption/Ionization Mass Spectrometry Analysis of Escherichia coli Colonies

High-throughput molecular screening of microbial colonies and DNA libraries are critical procedures that enable applications such as directed evolution, functional genomics, microbial identification, and creation of engineered microbial strains to produce high-value molecules. A promising chemical screening approach is the measurement of products directly from microbial colonies via optically guided matrix-assisted laser desorption/ionization mass spectrometry (MALDI-MS). Measuring the compounds from microbial colonies bypasses liquid culture with a screen that takes approximately 5 s per sample. We describe a protocol combining a dedicated informatics pipeline and sample preparation method that can prepare up to 3,000 colonies in under 3 h. The screening protocol starts from colonies grown on Petri dishes and then transferred onto MALDI plates via imprinting. The target plate with the colonies is imaged by a flatbed scanner and the colonies are located via custom software. The target plate is coated with MALDI matrix, MALDI-MS analyzes the colony locations, and data analysis enables the determination of colonies with the desired biochemical properties. This workflow screens thousands of colonies per day without requiring additional automation. The wide chemical coverage and the high sensitivity of MALDI-MS enable diverse screening projects such as modifying enzymes and functional genomics surveys of gene activation/inhibition libraries.

Choe, Kisurb↗

An expert system for geologic mapping with imaging spectrometers

Techniques have been developed for the extraction and characterization of absorption features from visible and infrared reflectance spectra and an expert system has been designed, implemented, and successfully tested that allows automated identification of minerals based on their spectral characteristics. A suite of laboratory spectra of common minerals was analyzed and the absorption band characteristics tabulated and used to develop a generalized knowledge base for analysis of the reflectance spectra. A tree hierarchy was designed to emulate the decision process followed by an experienced analyst for analysis of laboratory and field reflectance spectra and aircraft imaging spectrometer spectra. Good results were obtained with the expert system for all three types of spectra, with the critical factor in the analysis being the signal-to-noise ratio of the spectral data.

Kruse, F. A.↗

Automated CT registration, segmentation, and quantification (AutoCT) v1.0

Processing and analyzing brain imaging is crucial in both scientific development and clinical field. In this software package, we build a pipeline that integrates automatic registration, segmentation, and quantitative analysis for subjects' CT scans. Leveraging diffeomorphic transformations, we enable optimized forward and inverse mappings between an image and the reference. Furthermore, we extract localized features from deformation field based on an online template process, which advances statistical learning downstream. The created templates, atlas as well as our methods provide the brain imaging community tools for AI implementations.

Essiari, Abdelilah↗

Automated CT registration, segmentation, and quantification (AutoCT) v1.1

Processing and analyzing brain imaging is crucial in both scientific development and clinical field. In this software package, we build a pipeline that integrates automatic registration, segmentation, and quantitative analysis for subjects' CT scans. Leveraging diffeomorphic transofrmations, we enable optimized forward and inverse mappings between an image and the reference. Furthermore, we extract localized features from deformation field based on an online template process, which advances statistical learning downstream. The created templates, atlas as well as our methods provide the brain imaging community tools for AI implementations

Bai, Zhe↗

Electron image contrast analysis of mosaicity in rutile nanocrystals using direct electron detection

Direct electron detection provides high detective quantum efficiency, significantly improved point spread function and fast read-out which have revolutionized the field of cryogenic electron microscopy. However, these benefits for high-resolution electron microscopy (HREM) are much less exploited, especially for in situ study where major impacts on crystallographic structural studies could be made. By using direct detection in electron counting mode, rutile nanocrystals have been imaged at high temperature inside an environmental transmission electron microscope. The improvements in image contrast are quantified by comparison with a charge-coupled device (CCD) camera and by image matching with simulations using an automated approach based on template matching. Together, these approaches enable a direct measurement of 3D shape and mosaicity (~1°) of a vacuum-reduced TiO 2 nanocrystal about 50 nm in size. Thus, this work demonstrates the possibility of quantitative HREM image analysis based on direct electron detection.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Qualification and Quantification of Porosity at the Top of the Fuel Pins in Metallic Fuels Using Image Processing

Approximately 130,000 metal fuel pins were irradiated in the Experimental Breeder Reactor II (EBR-II) during its 30 years of operation to develop and characterize existing and prospective fuels. For many of the metal fuel irradiation experiments, neutron radiography imaging was performed to characterize fuel behavior, such as fuel axial expansion. While several fuel expansion results obtained from neutron radiography imaging have been published, the analysis of neutron radiography for the purpose of describing statistical properties of porous matter formed on top of the fuel pins, also referred to as fluff in previous publications, is significantly less represented in the literature with just a single paper so far. This study aims to validate and augment results reported in previous publications using automated image processing. The paper describes the statistical properties of the porous matter in terms of nine parameters derived from radiography images and correlates those parameters with such fuel properties as composition, expansion, temperature, and burnup. The reported results are based on 1097 fuel pins of eight different fuel compositions. For three major fuel types, U-10Zr, U-8Pu-10Zr, and U-19Pu-10Zr, a clear negative correlation is found between the Pu content and five parameters describing the amount of porous matter generated. The parameters describing granularity properties, however, showed either negative correlation or nonlinear dependency from fuel composition. The parameters describing the amount showed a positive correlation with fuel axial expansion, while granularity parameters showed a negative correlation with axial expansion. The dependency on cladding temperature was found to be weak. A positive correlation is demonstrated for volume parameters and fuel burnup. In general, reported results confirm and validate findings published in previous studies using a much larger number of pins and automated processing techniques, which easily lend themselves to reproducibility, thus avoiding subjective bias.

36 MATERIALS SCIENCE↗

Information retrieval from holographic interferograms: Fundamentals and problems

Holographic interferograms can contain large amounts of information about flow and temperature fields. Their information content can be very high because they can be viewed from many different directions. This multidirectionality, and fringe localization add to the information contained in the fringe pattern if diffuse illumination is used. Additional information, and increased accuracy can be obtained through the use of dual reference wave holography to add reference fringes or to effect discrete phase shift or hetrodyne interferometry. Automated analysis of fringes is possible if interferograms are of simple structure and good quality. However, in practice a large number of practical problems can arise, so that a difficult image processing task results.

Vest, Charles M.↗

Semi-Automated Identification of Rocks in Images

Rock Identification Toolkit Suite is a computer program that assists users in identifying and characterizing rocks shown in images returned by the Mars Explorer Rover mission. Included in the program are components for automated finding of rocks, interactive adjustments of outlines of rocks, active contouring of rocks, and automated analysis of shapes in two dimensions. The program assists users in evaluating the surface properties of rocks and soil and reports basic properties of rocks. The program requires either the Mac OS X operating system running on a G4 (or more capable) processor or a Linux operating system running on a Pentium (or more capable) processor, plus at least 128MB of random-access memory.

Bornstein, Benjamin↗

FY25 Progress Report: SRNL Analysis of ICCWR LCM and WAMS data for Corrosion and Cracking

Algorithms for Machine Learning (ML) and image analysis for the 3013 Surveillance Program have been developed in an ongoing collaborative effort by the Savannah River National Laboratory (SRNL) and the University of South Carolina (USC). The objective of the algorithms is to automate the identification of corrosion and cracks in the Inner Container Closure Weld Region (ICCWR) of the canister system used to store Pu-bearing material. Data for corrosion and cracking is collected from large binary files generated by a Laser Confocal Microscope (LCM), the Wide Area 3D Measurement System (WAMS), or, in a recent proposal, by a Scanning Electron Microscope (SEM). The ML software uses the physical attributes in the data files (e.g., one or more of: height, color, and 16-bit grayscale values as functions of position in a plane projection) to detect signs of surface corrosion and cracking after being trained on similar data with the features to be detected. Although the initial scope included screening for broader indicators of corrosion, e.g., pitting, the identification of potential cracks was prioritized for the past several years at the request of program leadership.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Landing Site Dispersion Analysis and Statistical Assessment for the Mars Phoenix Lander

The Mars Phoenix Lander launched on August 4, 2007 and successfully landed on Mars 10 months later on May 25, 2008. Landing ellipse predicts and hazard maps were key in selecting safe surface targets for Phoenix. Hazard maps were based on terrain slopes, geomorphology maps and automated rock counts of MRO's High Resolution Imaging Science Experiment (HiRISE) images. The expected landing dispersion which led to the selection of Phoenix's surface target is discussed as well as the actual landing dispersion predicts determined during operations in the weeks, days, and hours before landing. A statistical assessment of these dispersions is performed, comparing the actual landing-safety probabilities to criteria levied by the project. Also discussed are applications for this statistical analysis which were used by the Phoenix project. These include using the statistical analysis used to verify the effectiveness of a pre-planned maneuver menu and calculating the probability of future maneuvers.

Bonfiglio, Eugene P.↗

Use of computer vision for analysis of image datasets from high temperature plasma experiments

Great strides have been made in improving the quality of x-ray radiographs in high energy density plasma experiments, enabled in part by innovations in engineering and manufacturing of integrated circuits and materials. As a consequence, the radiographs of today are filled with a great deal of detail, but few of these features are extracted in a systematic way. Analysis techniques familiar to plasma physicists tend toward brittle 1D lineout or Fourier transform type analyses. The techniques applied to process our data have not kept pace with improvements in the quality of our data. Fortunately, the field of computer vision has a wealth of tools to offer, which have been widely used in industrial imaging and, more recently, adopted in biological imaging. We demonstrate the application of computer vision techniques to the analysis of x-ray radiographs from high energy density plasma experiments, as well as give a brief tutorial on the computer vision techniques themselves. These tools robustly extract 2D contours of shocks, boundaries of inhomogeneities, and secondary flows, thereby allowing for increased automation of analysis, as well as direct and quantitative comparisons with simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Strong Lensing Parameter Estimation on Ground-Based Imaging Data Using Simulation-Based Inference

Current ground-based cosmological surveys, such as the Dark Energy Survey (DES), are predicted to discover thousands of galaxy-scale strong lenses, while future surveys, such as the Vera Rubin Observatory Legacy Survey of Space and Time (LSST) will increase that number by 1-2 orders of magnitude. The large number of strong lenses discoverable in future surveys will make strong lensing a highly competitive and complementary cosmic probe. To leverage the increased statistical power of the lenses that will be discovered through upcoming surveys, automated lens analysis techniques are necessary. We present two Simulation-Based Inference (SBI) approaches for lens parameter estimation of galaxy-galaxy lenses. We demonstrate the successful application of Neural Posterior Estimation (NPE) to automate the inference of a 12-parameter lens mass model for DES-like ground-based imaging data. We compare our NPE constraints to a Bayesian Neural Network (BNN) and find that it outperforms the BNN, producing posterior distributions that are for the most part both more accurate and more precise; in particular, several source-light model parameters are systematically biased in the BNN implementation.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗