Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image Processeing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Comparison of the spatial statistics of random and defined-sequence photoresist films

The resolution-line edge roughness-sensitivity tradeoff has motivated the exploration of potential improvements using defined sequence polymers and polymer-bound photoacid generators and quenchers. We characterize the internal structures of positive tone photoresist polymer films formed from defined sequence polymers and compare them with random copolymers of the same composition. We model their imaging to connect initially to developable film structures. We use a polymer packing algorithm to simulate films of diverse compositions and locations of photoacid generators and quenchers, using the composition of an ESCAP photoresist. We use a simple extreme ultraviolet exposure-deprotection algorithm to model developable image formation within them. In all cases, the spatial distribution of chemical moieties in the film for defined sequence polymers is nearly indistinguishable from random copolymers. We evaluate several exposure-deprotection scenarios and find that a defined sequence copolymer has a distinctive developable image under certain circumstances. The use of defined sequence polymers within a photoresist layer does not automatically result in improved imaging; however, they do have some characteristics different from random polymers of the same composition. Further study of these characteristics may provide a route to improved control over the nanoscale imaging process.

36 MATERIALS SCIENCE↗
DOE OSTI2025

FPGA-accelerated SpeckleNN with SNL for real-time X-ray single-particle imaging

We present the implementation of a specialized version of our previously published unified embedding model, SpeckleNN, for real-time speckle pattern classification in X-ray Single-Particle Imaging (SPI), using the SLAC Neural Network Library (SNL) on an FPGA platform. This hardware realization transitions SpeckleNN from a prototypic model into a practical edge solution, optimized for running inference near the detector in high-throughput X-ray free-electron laser (XFEL) facilities, such as those found at the Linac Coherent Light Source (LCLS). To address the resource constraints inherent in FPGAs, we developed a more specialized version of SpeckleNN. The original model, which was designed for broader classification across multiple biological samples, comprised ~5.6 million parameters. The new implementation, while reducing the parameter count to 64.6K (a 98.8% reduction), focuses on maintaining the model's essential functionality for real-time operation, achieving an accuracy of 90%. Furthermore, we compressed the latent space from 128 to 50 dimensions. This implementation was demonstrated on the KCU1500 FPGA board, utilizing 71% of available DSPs, 75% of LUTs, and 48% of FFs, with an average power consumption of 9.4W according to the Vivado post-implementation report. The FPGA performed inference on a single image with a latency of 45.015 microseconds at a 200 MHz clock rate. In comparison, running the same inference on an NVIDIA A100 GPU resulted in an average power consumption of ~73W and an image processing latency of around 400 microseconds. Our FPGA-accelerated version of SpeckleNN demonstrated significant improvements, achieving an 8.9 × speedup and a 7.8 × reduction in power consumption compared to the GPU implementation. Key advancements include model specialization and dynamic weight loading through SNL, which eliminates the need for time-consuming FPGA design re-synthesis, allowing fast and continuous deployment of models (re)trained online. These innovations enable real-time adaptive classification and efficient vetoing of speckle patterns, making SpeckleNN more suited for deployment in XFEL facilities. This implementation has the potential to significantly accelerate SPI experiments and enhance adaptability to evolving experimental conditions.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Automated Scoring of Morphological Changes in Images of Pentaerythritol Tetranitrate

Recent advances in characterization techniques that generate large datasets of material microstructure images require robust, automated image-processing. We applied an unsupervised anomaly detection method called feature anomaly detection system (FADS) to automatically detect and quantify microstructure changes in images of the explosive pentaerythritol tetranitrate (PETN) aged at various temperatures. We demonstrated the FADS approach on two-dimensional images extracted from computed tomography scans, but the same technique can be readily applied to other imaging modalities. FADS calculates anomaly scores on the basis of differences in filter activations of nominal and test data in pretrained convolutional neural networks. The FADS scores successfully differentiated between pristine PETN and PETN aged at a temperature where material coarsening occurred. Morphological metric analysis of segmented images verified observed trends in FADS scores as a function of aging temperature and aging time, specifically by calculating volume fractions, specific boundary lengths, two-point correlation functions, and local thicknesses. Here, the FADS technique has two important advantages compared to traditional morphological analysis: First, it uses grayscale images as input, rather than images that are segmented to separate the appropriate phases; and second, FADS scores capture any type of changes among image sets, rather than requiring prior knowledge or selection of a relevant set of metrics.

Accelerated aging↗
DOE OSTI2021

High-Resolution 3D Acoustic Borehole Integrity Monitoring (Research Performance Progress Report Q2 2021)

Real-time, in-situ, high spatial resolution (sub-cm) imaging of the near-borehole environment would revolutionize wellbore diagnostics and integrity assessment by direct observation of defects. It is becoming increasingly apparent, that better understanding of the near-wellbore environment is required to meet the safety and operational needs in challenging environments such as those present in subsurface energy extraction (geothermal) and storage (CO2 sequestration) applications. Therefore, it is important to have a more robust ability to image the near-borehole and reliably detect defects. It was proposed to further develop and improve our advanced 3D imaging system to evaluate casing defects (e.g. corrosion) and cement quality in either open- or cased-borehole with the ultimate goal to develop a commercially deployable technology. The system consists of a unique acoustic source (LANL) and advanced inversion techniques for image processing (LANL, ORNL). This system will provide comprehensive borehole integrity monitoring with improved resolution over existing techniques. As an application of this imaging system, we will characterize the effectiveness of next-generation wellbore completion technology (NETL, SNL), and will demonstrate that, unlike current technology, the proposed approach can successfully characterize foamed cements.

15 GEOTHERMAL ENERGY↗
DOE OSTI2021

Report Q3FY21 - High-Resolution 3D Acoustic Borehole Integrity Monitoring

Real-time, in-situ, high spatial resolution (sub-cm) imaging of the near-borehole environment would revolutionize wellbore diagnostics and integrity assessment by direct observation of defects. It is becoming increasingly apparent, that better understanding of the near-wellbore environment is required to meet the safety and operational needs in challenging environments such as those present in subsurface energy extraction (geothermal) and storage (CO 2 sequestration) applications. Therefore, it is important to have a more robust ability to image the near-borehole and reliably detect defects. It was proposed to further develop and improve our advanced 3D imaging system to evaluate casing defects (e.g. corrosion) and cement quality in either open- or cased-borehole with the ultimate goal to develop a commercially deployable technology. The system consists of a unique acoustic source (LANL) and advanced inversion techniques for image processing (LANL, ORNL). This system will provide comprehensive borehole integrity monitoring with improved resolution over existing techniques. As an application of this imaging system, we will characterize the effectiveness of next-generation wellbore completion technology (NETL, SNL), and will demonstrate that, unlike current technology, the proposed approach can successfully characterize foamed cements.

42 ENGINEERING↗
DOE OSTI2022

High-Resolution 3D Acoustic Borehole Integrity Monitoring (Final Report)

Real-time, in-situ, high spatial resolution (sub-cm) imaging of the near-borehole environment would revolutionize wellbore diagnostics and integrity assessment by direct observation of defects. It is becoming increasingly apparent, that better understanding of the near-wellbore environment is required to meet the safety and operational needs in challenging environments such as those present in subsurface energy extraction (geothermal) and storage (CO2 sequestration) applications. Therefore, it is important to have a more robust ability to image the near-borehole and reliably detect defects. It was proposed to further develop and improve our advanced 3D imaging system to evaluate casing defects (e.g. corrosion) and cement quality in either open- or cased-borehole with the ultimate goal to develop a commercially deployable technology. The system consists of a unique acoustic source (LANL) and advanced inversion techniques for image processing (LANL, ORNL). This system will provide comprehensive borehole integrity monitoring with improved resolution over existing techniques. As an application of this imaging system, we will characterize the effectiveness of next-generation wellbore completion technology (NETL, SNL), and will demonstrate that, unlike current technology, the proposed approach can successfully characterize foamed cements.

42 ENGINEERING↗
DOE OSTI2024

GrayQb: A Radiological Contamination Locating and Mapping Tool

Benefits Technology Overview  Easy to operate • Self-contained unit for imaging – no special power, cooling or handling requirements • Standard color camera, easy to use gamma camera and reader • Software automatically processes images, sliders to adjust intensity display • Lightweight – less than 5 lbs. without additional background shielding

Timmons, Daren↗
DOE OSTI2023

Few-shot leaf segmentation

In this work, we use few-shot learning to segment the body and vein architecture of Populus trichocarpa leaves from high-resolution scans obtained in the UC Davis common garden. Leaf and vein segmentation are formulated as separate tasks, in which convolutional neural networks (CNNs) are used to iteratively expand partial segmentations until reaching stopping criteria. Our leaf and vein segmentation approaches use just 50 and 8 manually traced images for training, respectively, and are applied to a set of 2,634 top and bottom leaf scans. We show that both methods achieve high segmentation accuracy, in some cases exceeding even human-level segmentation. The leaf and vein segmentations are subsequently used to extract 68 morphological traits using traditional open-source image processing tools, which are validated using real-world physical measurements. For a biological perspective, we perform a genome-wide association study using the "vein density" trait to discover novel genetic architectures associated with multiple physiological processes relating to leaf development and function. In addition to sharing all of the few-shot learning code, we are releasing all images, manual segmentations, model predictions, 68 extracted leaf phenotypes, and a new set of SNPs called against the v4 P. trichocarpa genome for 1,419 genotypes.

Lagergren, John [Oak Ridge National Lab. (ORNL), O↗
DOE OSTI2026

Data supporting the manuscript "Nanometer Scale Imaging to Develop Quantitative Descriptors of Bipolar Membrane Junction Structure"

This dataset contains atomic force microscopy images associated with the manuscript "Nanometer Scale Imaging to Develop Quantitative Descriptors of Bipolar Membrane Junction Structure" by Maria Kelly, Emily R. Dunn, Ellis A. Spickermann, Josephine N. Gruber, César A. Lasalde-Ramírez, P. N. Romero Zavala, Éowyn Lucas, Ankur Gupta, Harry A. Atwater, and Wilson A. Smith. The dataset contains both raw images as well as segmented images produced by the image processing workflow described in the manuscript. A readme file and meta data file are included to provide additional details regarding the sample identity, image acquisition parameters, and file naming scheme.

36 MATERIALS SCIENCE↗
DOE OSTI2022

3DBFSVBF (3D BatFinder Smart Video BioFilter and Multi-class BatFinder Smart Video BioFilter) [SWR-22-88]

Bats are notoriously difficult to study, therefore, identifying specific behavioral trends and the precise environmental conditions at the time of collision requires a monitoring solution that can reliably collect relevant data. To date, thermal infrared video surveillance has been extensively applied to study bats and has proven to be a powerful yet cumbersome tool. Current analytical approaches are time consuming because data processing data has not been fully automated. In the past, steps have been taken to record avian and bat activity in conjunction with complicated image processing techniques that separate species from other moving objects within the field of view (i.e. clouds and portions of the wind turbine). Once the videos are collected, the post-processing does not allow real time monitoring and identification, leading to a delay in both studying the behavior of these species and determining the effectiveness of any impact reduction strategy being studied. Moreover, object identification capability is lacking, thus limiting the usefulness of video data. To resolve these issues, we are using open source 3D computer vision and machine learning techniques allowing for automatic detection of objects in real-time with the ability to correlate these objects with environmental variables and recording the flight paths of each object. The machine learning has been trained on 3D data and allows for automated real-time data collection, identification and tracking, thereby eliminating the need for long and tedious post-analysis processing of the videos. This machine learning model is an added feature to the previous BatFinder Smart Video BioFilter and increases the accuracy of that systems classification by increasing the accuracy of identifying bats (90% accuracy) and insects (69% accuracy) to a 97% accuracy. There are two object classifier machine learning models, Binary and multi-classification. Binary object classifier labeled BatFinder_Smart_Video_BioFilter.h5 distinguishes between biological objects and non-biological objects. The main goal of this object classifier is to ignore the turbine blades while detecting biological object flying withing the rotor swept area of the turbine. Non-biological objects have a probability of 0 and biological objects have a probability of 1. Multi-classifier labeled Multiclass_BatFinder_Smart_Video_BioFilter.h5 distinguishes between bats, birds, insects and non-biological.

Yarbrough, John↗
DOE OSTI2021

Advanced Electron Microscopy of Nanophased Synthetic Polymers and Soft Complexes for Energy and Medicine Applications

After decades of developments, electron microscopy has become a powerful and irreplaceable tool in understanding the ionic, electrical, mechanical, chemical, and other functional performances of next-generation polymers and soft complexes. The recent progress in electron microscopy of nanostructured polymers and soft assemblies is important for applications in many different fields, including, but not limited to, mesoporous and nanoporous materials, absorbents, membranes, solid electrolytes, battery electrodes, ion- and electron-transporting materials, organic semiconductors, soft robotics, optoelectronic devices, biomass, soft magnetic materials, and pharmaceutical drug design. For synthetic polymers and soft complexes, there are four main characteristics that differentiate them from their inorganic or biomacromolecular counterparts in electron microscopy studies: (1) lower contrast, (2) abundance of light elements, (3) polydispersity or nanomorphological variations, and (4) large changes induced by electron beams. Since 2011, the Center for Nanophase Materials Sciences (CNMS) at Oak Ridge National Laboratory has been working with numerous facility users on nanostructured polymer composites, block copolymers, polymer brushes, conjugated molecules, organic–inorganic hybrid nanomaterials, organic–inorganic interfaces, organic crystals, and other soft complexes. This review crystalizes some of the essential challenges, successes, failures, and techniques during the process in the past ten years. It also presents some outlooks and future expectations on the basis of these works at the intersection of electron microscopy, soft matter, and artificial intelligence. Machine learning is expected to automate and facilitate image processing and information extraction of polymer and soft hybrid nanostructures in aspects such as dose-controlled imaging and structure analysis.

36 MATERIALS SCIENCE↗
DOE OSTI2023

BCS (CSP Beam Characterization System) [SWR-23-13]

The Beam Characterization System (BCS) is an image-processing tool for estimating heliostat tracking errors. A large mirror, or heliostat, reflects the sun onto a distant target. A carefully calibrated camera then takes an image of this target to capture the shape of the reflected beam. The software kit hosts a series of scripts to identify key features and run analysis on the captured images.

Kesseli, Devon↗
DOE OSTI2021

PhaseGAN: a deep-learning phase-retrieval approach for unpaired datasets

Phase retrieval approaches based on deep learning (DL) provide a framework to obtain phase information from an intensity hologram or diffraction pattern in a robust manner and in real-time. However, current DL architectures applied to the phase problem rely on i) paired datasets, i. e., they arc only applicable when a satisfactory solution of the phase problem has been found, and ii) the fact that most of them ignore the physics of the imaging process. Here, we present PhaseGAN, a new DL approach based on Generative Adversarial Networks, which allows the use of unpaired datasets and includes the physics of image formation. The performance of our approach is enhanced by including the image formation physics and a novel Fourier loss function, providing phase reconstructions when conventional phase retrieval algorithms fail, such as ultra-fast experiments. Thus, PhaseGAN offers the opportunity to address the phase problem in real-time when no phase reconstructions but good simulations or data from other experiments are available.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Time-resolved spray characterization via unified optical flow and binarization technique

This work leverages an unsupervised machine learning and advanced image processing techniques to characterize the breakup of fuel sprays in a small-scale combustor under reacting conditions, providing valuable insights into near-nozzle flow phenomenology. The proposed methodology integrates an improved optical flow model on a convolutional neural network to extract flow vectors with a binarization technique to assess droplets’ size and shape across the region of interest. The velocimetry approach demonstrates superior performance compared to a state-of-the-art optical flow model when applied to high-speed X-ray phase contrast spray images, achieving more accurate and reliable flow predictions. Moreover, breakup processes are quantified by breakup length and sphericity in accordance with velocity estimations, allowing a more complete characterization of the flow. This study establishes a robust methodology for analyzing spray morphology and primary breakup in compact combustors, contributing valuable means of understanding and optimizing fuel spray behavior in advanced combustion systems.

42 ENGINEERING↗
DOE OSTI2023

Supporting information for Few-Shot Learning Enables Population-Scale Analysis of Leaf Traits in Populus trichocarpa

In this work, we use few-shot learning to segment the body and vein architecture of P. trichocarpa leaves from high-resolution scans obtained in the UC Davis common garden. Leaf and vein segmentation are formulated as separate tasks, in which convolutional neural networks (CNNs) are used to iteratively expand partial segmentations until reaching stopping criteria. Our leaf and vein segmentation approaches use just 50 and 8 manually traced images for training, respectively, and are applied to a set of 2,634 top and bottom leaf scans. We show that both methods achieve high segmentation accuracy, in some cases exceeding even human-level segmentation. The leaf and vein segmentations are subsequently used to extract 68 morphological traits using traditional open-source image processing tools, which are validated using real-world physical measurements. For a biological perspective, we perform a genome-wide association study using the vein density trait to discover novel genetic architectures associated with multiple physiological processes relating to leaf development and function. In addition to sharing all of the few-shot learning code (see https://github.com/jlager/few-shot-leaf-segmentation), we are releasing all images, manual segmentations, model predictions, 68 extracted leaf phenotypes, and a new set of SNPs called against the v4 P. trichocarpa genome for 1,419 genotypes. The data folder includes all images, ground truth segmentations, predicted segmentations, and extracted leaf traits. All images encode the sample ID in the file name by indicating the treatment, block, row, position, and leaf side, respectively. For example, the file, C_1_1_2_bot.jpeg, indicates the control treatment, block 1, row 1, position 2, and the bottom side of the leaf. Tabulated results include position IDs as well as the corresponding genotype IDs. The images folder includes the 2,906 high-resolution leaf scans taken in the field. The leaf_masks folder includes 50 ground truth segmentations used for training the leaf tracing algorithm. The leaf_preds folder includes the 2,906 predicted segmentations from the leaf tracing algorithm. The vein_masks folder includes 8 ground truth segmentations used for training the vein growing algorithm. The vein_preds folder includes the 1,453 predicted segmentations from the vein growing algorithm. The vein_probs folder includes the 1,453 predicted probability maps from the vein growing algorithm before thresholding. The genomes folder includes the set of SNPs called against the v4 P. trichocarpa genome for 1,419 genotypes with a README file detailing the steps taken. The results folder includes: (i) raw values of the 68 predicted leaf traits in digital_traits.tsv, (ii) manually measured values of petiole length and width in manual_traits.tsv, (iii) thin plate spline (TPS) adjusted values of the vein density trait in vein_density_tps_adj.tsv, (iv) best linear unbiased prediction (BLUP) adjusted values of the vein density trait in vein_density_blups.tsv, and (v) GWAS results for the vein density trait, including chromosome positions and corresponding P values, in gwas_results.csv.

09 BIOMASS FUELS↗
DOE OSTI2023

An Evaluation of Three Dimensional Scene Reconstruction Tools for Safeguards Applications

Over the past 5 years, advances in digital imaging and image processing have enabled everyday computing hardware, such as that found on laptops and even phones, to easily create 3D models of scenes from a series of still images. This field is broadly known as photogrammetry. For safeguards applications, a safeguards inspector could evaluate a 3D model of a facility (such as an enrichment plant or the top of a reactor) constructed from multiple photos instead of reviewing each photo individually. This report compares the detailed capabilities of a particular commercial offering (Quidient) that Oak Ridge National Laboratory (ORNL) has investigated in depth with the general capabilities provided in the industry and recommends areas where the general technology could be pursued for potential safeguards applications.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2023

Seeing the whole picture: Methods for getting the most from micro X-ray computed tomography of TRISO nuclear fuel particles

Tristructural isotropic (TRISO) coated fuel particles are a nuclear fuel form under extensive study for use in advanced nuclear reactor concepts. TRISO fuels are subjected to high temperature neutron irradiations and then examined to assess their performance by determining fission product retention and studying morphological changes. Micro X-ray computed tomography is one method of nondestructively studying the effects of TRISO performance. This work addresses the need for image processing to remove X-ray tomographic reconstruction artifacts that prevent the study of TRISO features, as the TRISO particles’ high Z kernel can introduce metal artifacts that degrade the image quality in the surrounding low Z coating layers. These metal artifacts were reduced by imaging the TRISO particles with both high- and low-energy X-rays and applying a mask to the radiographs obtained with low-energy X-rays to digitally remove the dense fuel kernel region. These masked radiographs were then used to produce a tomographic reconstruction which was combined with the tomographic reconstruction of the high-energy data. This enabled the relatively-low-density TRISO buffer layer to be examined in more detail, providing information on irradiation induced dimensional changes of the coatings. This methodology, which helps see the full picture of a TRISO particle, is not limited to nuclear fuels but can be applied to systems that contain highly attenuating material surrounded by less dense materials.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Challenges in solving structures from radiation-damaged tomograms of protein nanocrystals assessed by simulation

Structure-determination methods are needed to resolve the atomic details that underlie protein function. X-ray crystallography has provided most of our knowledge of protein structure, but is constrained by the need for large, well ordered crystals and the loss of phase information. The rapidly developing methods of serial femtosecond crystallography, micro-electron diffraction and single-particle reconstruction circumvent the first of these limitations by enabling data collection from nanocrystals or purified proteins. However, the first two methods also suffer from the phase problem, while many proteins fall below the molecular-weight threshold required for single-particle reconstruction. Cryo-electron tomography of protein nanocrystals has the potential to overcome these obstacles of mainstream structure-determination methods. Here, a data-processing scheme is presented that combines routines from X-ray crystallography and new algorithms that have been developed to solve structures from tomograms of nanocrystals. This pipeline handles image-processing challenges specific to tomographic sampling of periodic specimens and is validated using simulated crystals. The tolerance of this workflow to the effects of radiation damage is also assessed. The simulations indicate a trade-off between a wider tilt range to facilitate merging data from multiple tomograms and a smaller tilt increment to improve phase accuracy. Since phase errors, but not merging errors, can be overcome with additional data sets, these results recommend distributing the dose over a wide angular range rather than using a finer sampling interval to solve the protein structure.

59 BASIC BIOLOGICAL SCIENCES↗