Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84

TXM-Sandbox : an open-source software for transmission X-ray microscopy data analysis

A transmission X-ray microscope (TXM) can investigate morphological and chemical information of a tens to hundred micrometre-thick specimen on a length scale of tens to hundreds of nanometres. It has broad applications in material sciences and battery research. TXM data processing is composed of multiple steps. A workflow software has been developed that integrates all the tools required for general TXM data processing and visualization. The software is written in Python and has a graphic user interface in Jupyter Notebook . Users have access to the intermediate analysis results within Jupyter Notebook and have options to insert extra data processing steps in addition to those that are integrated in the software. The software seamlessly integrates ImageJ as its primary image viewer, providing rich image visualization and processing routines. As a guide for users, several TXM specific data analysis issues and examples are also presented.

36 MATERIALS SCIENCE↗

Image Alignment and Flat-Field Correction of Film and Computed Radiography Images on the LLNL Flash Testbed

Computed radiography (CR) imaging plates and film are used in HEAF firing tanks and in the NDE group. The imaging plates allow for the creation of high-resolution digital images with flash X-ray (FXR). A typical treatment of flash X-ray radiographs is flat-field correction, where the image from an experiment is normalized by a “flat-field” or “bright-field” image. This flat-field image is taken in an identical configuration to the experimental image, but without the object or experiment in the field of view (FOV). This treatment reduces spatial effects from the FXR spot size and detector misalignment, as each pixel value in the corrected image represents a ratio of collected radiation with the object in FOV to the collected radiation without the object in FOV. One challenge in the creation of a corrected image is the misalignment of the CR plate or film pack between capturing the flat-field image and the experimental image. Fiducial structures can remedy this issue. Small (3.18mm) stainless steel ball bearings serve as good fiducial structures due to their small size and high radiographic contrast. Spheres are view-agnostic geometry, always presenting a circular cross section no matter the orientation. This process was developed for images from the flash X-ray testbed. The flash testbed was used to compare the X-ray transmission at different thicknesses of aluminum and copper step wedges. Each step wedge section is a rectangular shape, so evaluation is made much simpler if the rectangles are not rotated with respect to the image. This alignment process aligns the object and flat-field images together and leaves the rectangles of each step aligned with the image.

36 MATERIALS SCIENCE↗

Airborne hyperspectral imaging of cover crops through radiative transfer process-guided machine learning

Cover cropping between cash crop growing seasons is a multifunctional conservation practice. Timely and accurate monitoring of cover crop traits, notably aboveground biomass and nutrient content, is beneficial to agricultural stakeholders to improve management and understand outcomes. Currently, there is a scarcity of spatially and temporally resolved information for assessing cover crop growth. Remote sensing has a high potential to fill this need, but conventional empirical regression operated with coarse-resolution multispectral data has large uncertainties. Therefore, this study utilized airborne hyperspectral imaging techniques and developed new process-guided machine learning approaches (PGML) for cover crop monitoring. Specifically, we deployed an airborne hyperspectral system covering visible to shortwave-infrared wavelengths (400–2400 nm) to acquire high spatial (0.5 m) and spectral (3–5 nm) resolution reflectance over 23 cover crop fields across Central Illinois in March and April of 2021. Airborne hyperspectral surface reflectance with high spectral and spatial resolution can be well matched with field data to quantify cover crop traits. Furthermore, the PGML models were pre-trained by synthetic data from soil-vegetation radiative transfer modeling (one million records), and then fine-tuned with field data of cover crop biomass and nutrient content. Results show that airborne hyperspectral data with PGML can achieve high accuracy to predict cover crop aboveground biomass (R 2 = 0.72, relative RMSE = 15.16%) and nitrogen content (R 2 = 0.69, relative RMSE = 16.59%) through leave-one-field-out cross-validation. Unlike the pure data-driven approach (e.g., partial least-squares regression), PGML incorporated radiative transfer knowledge and obtained higher predictive performance with fewer field data. Meanwhile, with field data for model fine-tuning, PGML predicted biomass more accurately than the inversion of radiative transfer models. Here we also found that the red edge has a high contribution in quantifying aboveground biomass and nitrogen content, followed by green and shortwave spectra. This study demonstrated the first attempt of utilizing hyperspectral remote sensing to accurately quantify cover crop traits. We highlight the strength of PGML in exploiting sensing data to quantify ecosystem variables to advance agroecosystem monitoring for sustainable agricultural management.

60 APPLIED LIFE SCIENCES↗

Imaging high jitter, very fast phenomena: A remedy for shutter lag

Dielectric breakdown is an example of a natural phenomenon that occurs on very short time scales, making it incredibly difficult to capture optical images of the process. Event initiation jitter is one of the primary challenges, as even a microsecond of jitter time can cause the imaging attempt to fail. Initial attempts to capture images of dielectric breakdown using a gigahertz frame rate camera and an exploding bridge wire initiation were stymied by high initiation jitter. Subsequently, a novel optical delay line apparatus was developed in order to effectively circumvent the jitter and reliably image dielectric breakdown. Here, the design and performance of the optical delay line apparatus are presented. The optical delay line increased the image capture success rate from 25% to 94% while also permitting enhanced temporal resolution and has application in imaging other high-jitter, extremely fast phenomena.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Atomic force microscopy phase imaging of epitaxial graphene films

Abstract Dynamic mode atomic force microscopy phase imaging is known to produce distinct contrast between graphene areas of different atomic thickness. But the intrinsic complexity of the processes controlling the tip motion and the phase angle shift excludes its use as an independent technique for a quantitative type of analysis. By investigating the relationship between the phase shift, the tip-surface interaction, and the thickness of the epitaxial graphene areas grown on silicon carbide, we shed light on the origin of such phase contrast, and on the complex energy dissipation processes underlying phase imaging. In particular, we study the behavior of phase shift and energy dissipation when imaging the interfacial buffer layer, single-layer, and bilayer graphene regions as a function of the tip-surface separation and the interaction forces. Finally, we compare these results with those obtained on differently-grown quasi free standing single- and bilayer graphene samples.

Lavini, Francesco (ORCID:0000000257223040)↗

Detecting Low Surface Brightness Galaxies with Mask R-CNN

Low surface brightness galaxies (LSBGs), galaxies that are fainter than the dark night sky, are famously difficult to detect. However, studies of these galaxies are essential to improve our understanding of the formation and evolution of low-mass galaxies. In this work, we train a deep learning model using the Mask R-CNN framework on a set of simulated LSBGs inserted into images from the Dark Energy Survey (DES) Data Release 2 (DR2). This deep learning model is combined with several conventional image pre-processing steps to develop a pipeline for the detection of LSBGs. We apply this pipeline to the full DES DR2 coadd image dataset, and preliminary results show the detection of 22 large, high-quality LSBG candidates that went undetected by conventional algorithms. Furthermore, we find that Galactic cirrus represents the largest contaminant in our resulting candidate list.

Levy, Caleb↗

Parametric Reconstruction of Glass Fiber-reinforced Polymer Composites from X-ray Projection Data—A Simulation Study

We present a new approach to estimate geometry parameters of glass fibers in glass fiber-reinforced polymers from simulated X-ray micro-computed tomography scans. Traditionally, these parameters are estimated using a multi-step procedure including image reconstruction, pre-processing, segmentation and analysis of features of interest. Each step in this chain introduces errors that propagate through the pipeline and impair the accuracy of the estimated parameters. In the approach presented in this paper, we reconstruct volumes from a low number of projection angles using an iterative reconstruction technique and then estimate position, direction and length of the contained fibers incorporating a priori knowledge about their shape, modeled as a geometric representation, which is then optimized. Using simulation experiments, we show that our method can estimate those representations even in presence of noisy data and only very few projection angles available.

42 ENGINEERING↗

Determination of the Goos-Hanchen shift in dielectric waveguides via photo emission electron microscopy in the visible spectrum

Photoemission Electron Microscopy (PEEM) is a versatile tool that relies on the photoelectric effect to produce high-resolution images. Pulse lasers allow for multi-photon PEEM where multiple photons are required excite a single electron. This non-linear process can directly image the near field region of electromagnetic fields in materials. We use this ability here to analyze wave propagation in a linear dielectric waveguide with wavelengths of 410nm and 780nm. The propagation constant of the waveguide can be extracted from the interference pattern created by the coupled and incident light and shows distinct polarization dependence. Furthermore, the electromagnetic field interaction at the boundaries can then be deduced which is essential to understand power flow in wave guiding structures. These results match well with simulations using finite element techniques.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

AUTOMATED TRANSIENT IDENTIFICATION IN THE DARK ENERGY SURVEY

We describe an algorithm for identifying point-source transients and moving objects on reference-subtracted optical images containing artifacts of processing and instrumentation. The algorithm makes use of the supervised machine learning technique known as Random Forest. We present results from its use in the Dark Energy Survey Supernova program (DES-SN), where it was trained using a sample of 898,963 signal and background events generated by the transient detection pipeline. After reprocessing the data collected during the first DES-SN observing season (2013 September through 2014 February) using the algorithm, the number of transient candidates eligible for human scanning decreased by a factor of 13.4, while only 1.0% of the artificial Type Ia supernovae (SNe) injected into search images to monitor survey efficiency were lost, most of which were very faint events. Here we characterize the algorithm’s performance in detail, and we discuss how it can inform pipeline design decisions for future time-domain imaging surveys, such as the Large Synoptic Survey Telescope and the Zwicky Transient Facility. An implementation of the algorithm and the training data used in this paper are available at at http://portal.nersc.gov/project/dessn/autoscan.

79 ASTRONOMY AND ASTROPHYSICS↗

TU-FG-209-12: Treatment Site and View Recognition in X-Ray Images with Hierarchical Multiclass Recognition Models

Purpose: To investigate an approach of automatically recognizing anatomical sites and imaging views (the orientation of the image acquisition) in 2D X-ray images. Methods: A hierarchical (binary tree) multiclass recognition model was developed to recognize the treatment sites and views in x-ray images. From top to bottom of the tree, the treatment sites are grouped hierarchically from more general to more specific. Each node in the hierarchical model was designed to assign images to one of two categories of anatomical sites. The binary image classification function of each node in the hierarchical model is implemented by using a PCA transformation and a support vector machine (SVM) model. The optimal PCA transformation matrices and SVM models are obtained by learning from a set of sample images. Alternatives of the hierarchical model were developed to support three scenarios of site recognition that may happen in radiotherapy clinics, including two or one X-ray images with or without view information. The performance of the approach was tested with images of 120 patients from six treatment sites – brain, head-neck, breast, lung, abdomen and pelvis – with 20 patients per site and two views (AP and RT) per patient. Results: Given two images in known orthogonal views (AP and RT), the hierarchical model achieved a 99% average F1 score to recognize the six sites. Site specific view recognition models have 100 percent accuracy. The computation time to process a new patient case (preprocessing, site and view recognition) is 0.02 seconds. Conclusion: The proposed hierarchical model of site and view recognition is effective and computationally efficient. It could be useful to automatically and independently confirm the treatment sites and views in daily setup x-ray 2D images. It could also be applied to guide subsequent image processing tasks, e.g. site and view dependent contrast enhancement and image registration. The senior author received research grants from ViewRay Inc. and Varian Medical System.

60 APPLIED LIFE SCIENCES↗

Machine Learning Algorithms for Automated NIF Capsule Mandrel Selection

Small shells, approximately 2 mm in diameter, made from Poly(α-methylstyrene) (PAMS) are used as mandrels in the production of glow discharge polymer capsules located at the center of inertial confinement fusion experiments. The visual inspection process of microscope images of these shell mandrels, including detection of micron-sized defects on the shell surface as well as the handling and sorting, is a very labor-intensive, repetitive, and highly subjective process that stands to benefit greatly from automation. As part of an effort to decrease the number of labor hours spent in capsule handling, inspection, and metrology, the development of robotic systems was presented in a paper by Carlson et al., “Automation in Target Fabrication” [Fusion Sci. Technol., Vol. 70, p. 274 (2016)]. The current work expands the automated image acquisition systems developed previously and adds the use of convolutional neural networks to select capsules best suited for use in the downstream production process. Through the use of these machine learning algorithms, the selection process becomes robust, repeatable, and operator independent. Finally, as an added benefit the system developed as part of this work is able to provide defect statistics on entire shell batches and feed this information upstream to the production team.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The Urban Observatory: A Multi-Modal Imaging Platform for the Study of Dynamics in Complex Urban Systems

We describe an “Urban Observatory” facility designed for the study of complex urban systems via persistent, synoptic, and granular imaging of dynamical processes in cities. An initial deployment of the facility has been demonstrated in New York City and consists of a suite of imaging systems—both broadband and hyperspectral—sensitive to wavelengths from the visible (∼400 nm) to the infrared (∼13 micron) operating at cadences of ∼0.01–30 Hz (characteristically ∼0.1 Hz). Much like an astronomical survey, the facility generates a large imaging catalog from which we have extracted observables (e.g., time-dependent brightnesses, spectra, temperatures, chemical species, etc.), collecting them in a parallel source catalog. We have demonstrated that, in addition to the urban science of cities as systems, these data are applicable to a myriad of domain-specific scientific inquiries related to urban functioning including energy consumption and end use, environmental impacts of cities, and patterns of life and public health. We show that an Urban Observatory facility of this type has the potential to improve both a city’s operations and the quality of life of its inhabitants.

54 ENVIRONMENTAL SCIENCES↗

FLIMJ: An open-source ImageJ toolkit for fluorescence lifetime image data analysis

In the field of fluorescence microscopy, there is continued demand for dynamic technologies that can exploit the complete information from every pixel of an image. One imaging technique with proven ability for yielding additional information from fluorescence imaging is Fluorescence Lifetime Imaging Microscopy (FLIM). FLIM allows for the measurement of how long a fluorophore stays in an excited energy state, and this measurement is affected by changes in its chemical microenvironment, such as proximity to other fluorophores, pH, and hydrophobic regions. This ability to provide information about the microenvironment has made FLIM a powerful tool for cellular imaging studies ranging from metabolic measurement to measuring distances between proteins. The increased use of FLIM has necessitated the development of computational tools for integrating FLIM analysis with image and data processing. To address this need, we have created FLIMJ, an ImageJ plugin and toolkit that allows for easy use and development of extensible image analysis workflows with FLIM data. Built on the FLIMLib decay curve fitting library and the ImageJ Ops framework, FLIMJ offers FLIM fitting routines with seamless integration with many other ImageJ components, and the ability to be extended to create complex FLIM analysis workflows. Building on ImageJ Ops also enables FLIMJ’s routines to be used with Jupyter notebooks and integrate naturally with science-friendly programming in, e.g., Python and Groovy. We show the extensibility of FLIMJ in two analysis scenarios: lifetime-based image segmentation and image colocalization. We also validate the fitting routines by comparing them against industry FLIM analysis standards.

47 OTHER INSTRUMENTATION↗

Spontaneous imbibition of water and determination of effective contact angles in the Eagle Ford Shale Formation using neutron imaging

Understanding of fundamental processes and prediction of optimal parameters during the horizontal drilling and hydraulic fracturing process results in economically effective improvement of oil and natural gas extraction. Although, the modern analytical and computational models can capture fracture growth, there is a lack of experimental data on spontaneous imbibition and wettability in oil and gas reservoirs for the validation of further model development. In this work, we used neutron imaging to measure the spontaneous imbibition of water into fractures of Eagle Ford Shale with known geometries and fracture orientations. An analytical solution for a set of nonlinear second-order differential equations was applied to the measured imbibition data to determine effective contact angles. The analytical solution fit the measured imbibition data reasonably well and determined effective contact angles were slightly higher than static contact angles due to effects of in-situ changes in velocity, surface roughness, and heterogeneity of mineral surfaces on the fracture surface. Additionally, small fracture widths may have retarded imbibition and affected model fits, which suggests that average fracture widths are not satisfactory for modeling imbibition in natural systems.

DiStefano, Victoria H. (ORCID:0000000160239716)↗

High-performance data management for whole slide image analysis in digital pathology

When dealing with giga-pixel digital pathology in whole-slide imaging, a notable proportion of data records holds relevance during each analysis operation. For instance, when deploying an image analysis algorithm on whole-slide images (WSI), the computational bottleneck often lies in the input-output (I/O) system. This is particularly notable as patch-level processing introduces a considerable I/O load onto the computer system. However, this data management process could be further paralleled, given the typical independence of patch-level image processes across different patches. This paper details our endeavors in tackling this data access challenge by implementing the Adaptable IO System version 2 (ADIOS2). Our focus has been constructing and releasing a digital pathology-centric pipeline using ADIOS2, which facilitates streamlined data management across WSIs. Additionally, we’ve developed strategies aimed at curtailing data retrieval times. The performance evaluation encompasses two key scenarios: (1) a pure CPU-based image analysis scenario (“CPU scenario”), and (2) a GPU-based deep learning framework scenario (“GPU scenario”). Our findings reveal noteworthy outcomes. Under the CPU scenario, ADIOS2 showcases an impressive two-fold speed-up compared to the brute-force approach. In the GPU scenario, its performance stands on par with the cutting-edge GPU I/O acceleration framework, NVIDIA Magnum IO GPU Direct Storage (GDS). From what we know, this appears to be among the initial instances, if any, of utilizing ADIOS2 within the field of digital pathology. The source code has been made publicly available at https://github.com/hrlblab/adios.

Wang, Xiao↗

Multimodal Imaging of Autofluorescent Sites Reveals Varied Chemical Speciation in SSZ-13 Crystals

Here, a multimodal imaging study of chabazite is used to show the distribution of and discriminate between different emissive deposits arising as a result of the detemplation process. 3D confocal imaging, fluorescence lifetime imaging, spectral imaging, and Raman mapping are used to show three different types of emissive behaviours each characterised by different spatial distributions, trends in lifetime, spectral signals, and Raman signatures. A notable difference is seen in the morphology of agglomerated surface deposits and larger subsurface deposits, which experience lifetime augmentation due to spatial confinement. The distribution of organic residue throughout the crystal volume is comparable to XRF mapping that shows Si enrichment on the outer edges and higher Al content through the centre, demonstrating that a fluorescence-based technique can also be used to indirectly comment on the compositional chemistry of the inorganic framework.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

INR-TEM: Robust cavity detection in multifocus TEM images via implicit neural representations

When characterizing materials using transmission electron microscopy (TEM) images, detecting and quantifying small features in microstructures, such as cavities, pose significant challenges. Off-the-shelf object detection models, including YOLOv8, show considerable performance degradation, particularly when images vary in resolution and the objects of interest possess a low percentage of the total image region of interest. In this study, we introduce a novel detection pipeline that incorporates an implicit neural representation (INR)-based detection method, INR-TEM, and two-modality imaging (e.g., under-focused and over-focused images typically acquired during materials characterization) to improve object detection performance. The INR-TEM method incorporates a pixel-wise prediction principle inspired by pixel-wise centerness weighting. INR-TEM demonstrates superior robustness to resolution variability, maintaining high detection accuracy even at low image resolutions compared to YOLOv8. To leverage INR-TEM effectively in real-world two-modality characterization applications, we further integrate a two-stage motion correction pipeline designed explicitly for aligning multifocus TEM images. The alignment process, comprising keypoint (based on scale-invariant feature transform, SIFT) and intensity matching, significantly mitigates the adverse effects of perceived motion-induced image degradation during through-focal TEM imaging, directly enhancing INR-TEM’s detection capability over conventional single-focus images. Our integrated INR-TEM cavity detection framework notably improves performance across various cavity sizes, outperforming off-the-shelf YOLOv8 detections that rely on a single image modality.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Direct evidence of the dominant role of multiphoton permanent-dipole transitions in strong-field dissociation of NO 2 +

We study laser-induced dissociation of a metastable NO 2+ ion-beam target into N + +O + , focusing on the prominent contribution by molecules breaking parallel to the polarization at high peak laser intensity (~10 15 W/cm 2 ). Our experimental results and time-dependent Schrödinger equation calculations show that, contrary to commonly held intuition that electronic transitions always prevail, the dominant process underlying this highly aligned dissociation is a multiphoton permanent-dipole transition involving only the electronic ground state and leading to its vibrational continuum. Strong-field permanent-dipole transitions should thus be considered generally, as they may play a significant role in other heteronuclear molecules. Moreover, their role should only grow in importance for longer wavelengths, a trending direction in ultrafast laser studies.

74 ATOMIC AND MOLECULAR PHYSICS↗