MegaStitch: Robust Large-Scale Image Stitching
Not Available
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
SEARCH · Search NASA
Results for “image stitching”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Image Stitching in Neutron Radiography for Surface Extraction of Additively Manufactured Parts
Explore the source record for details and available documents.
Physics - Nuclear physics and radiation physics↗
A bi-channel aided stitching of atomic force microscopy images
Microscopy is an essential tool in scientific research, enabling the visualization of structures at micro- and nanoscale resolutions. However, the field of microscopy often encounters limitations in field-of-view (FOV), restricting the amount of sample that can be imaged in a single capture. To overcome this limitation, image stitching techniques have been developed to seamlessly merge multiple overlapping images into a single, high-resolution composite. The images collected from microscope need to be optimally stitched before accurate physical information can be extracted from post analysis. However, the existing stitching tools either struggle to stitch images together when the microscopy images are feature sparse or cannot address all the transformations of images when performing image stitching. To address these issues, we propose a bi-channel aided feature-based image stitching method and demonstrate its use on Atomic Force Microscopy (AFM) generated Pantoea sp. YR343 biofilm and PTO thin film sample images as experimental data. The topographical channel image of AFM data captures the morphological details of the sample, and a stitched topographical image is desired for researchers. We utilize the amplitude and phase channels of AFM data to maximize the matching features and to estimate the position of the original topographical images and show that the proposed bi-channel aided stitching method outperforms the traditional direct stitching approach in AFM topographical image stitching task. Here, we demonstrated the application on AFM, but similar approaches could be employed of optical microscopy with brightfield and fluorescence channels. We believe this proposed workflow can serve as a valuable augmentation strategy for microscopy image stitching tasks and will benefit the experimentalist to avoid erroneous analysis and discovery due to incorrect stitching.
Atomic force microscopy↗
Development of techniques for gantryless associated-particle imaging
To move fast-neutron radiography using the associated-particle imaging technique from the laboratory to the field, the development of new analysis techniques is required. In particular, the relative positions of the source and detectors need to be determined when they have been placed by hand, the normalization for a particular source–detector geometry needs to be determined without a measurement in the same geometry with no object present, and accurate image stitching is required when multiple detector positions are necessary to image an object. The present work describes methods that employ transmission neutron data to localize a fast-neutron imaging panel with respect to the neutron source, calculate a normalization for a given source–detector geometry, stitch images together, and describes the required system calibrations. The reported techniques enable in-field neutron radiography for cases in which the source–detector geometry is not well known a priori and where operational constraints preclude a normalization measurement.
Heath, Matthew↗
FDTR Subsurface Imaging and Stitching
Explore the source record for details and available documents.
Antiporda, Logan Michael↗
Characterization of Lab-Grown Cracks for Aerosol Transmission Testing
Motivation: Determine the length and opening of two lab-grown cracks, designated as LT-14 and LT-28, representative of stress corrosion cracks in spent nuclear fuel dry storage casks to supplement future testing of gas and aerosol transport. Problem: The extreme aspect ratio of the crack length to opening requires that imaging occurs in stages with the results merged before final analysis. Method: High magnification (1500x) optical images of both sides of the two plates were acquired. 20x stitched images with LSCM were acquired, fully stitched along the length, and leveled with newly developed PLATES Method in MATLAB®. Conclusion for LT-14: Side 1 is 47.25 mm long and has 366 separate crack features with an average length of 23.50 µm and an average opening of 8.27 µm. Side 2 is 69.44 mm long and has 550 separate crack features with an average length of 81.63 µm and an average opening of 67.70 µm. Conclusion for LT-28: Side 1 is 71.95 mm long and has 1,127 separate crack features with an average length of 42.27 µm and an average opening of 10.31 µm. Side 2 is 74.88 mm long and has 520 separate crack features with an average length of 98.13 µm and an average opening of 14.99 µm. The adjacent crack on side 1 is 18.95 mm long and has 37 separate crack features with an average length of 17.46 µm and an average opening of 10.42 µm. The adjacent crack on side 2 is 26.40 mm long and has 55 separate crack features with an average length of 87.26 µm and an average opening of 48.29 µm. Each adjacent crack is approximately 26 mm from the main crack.
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
Computer vision-based rock bolt detection in orthomosaic imagery obtained in the Waste Isolation Pilot Plant underground facility
Assessing structural integrity of large underground tunnel facilities is often a time consuming and human-labor intensive task. Thus, research using various modes of sensing and automated detection of key structural components in mines is posed to aid in safety assessments and establishing overall structural health. We propose an approach utilizing off-the-shelf camera and lidar technology fixed to a custom sensing platform, image stitching techniques, fine-tuned object detection models, and specialized model-inference methods to automatically detect, count, and map roof bolts for assessment of structural safety in man-made underground tunnels. Results show a novel workflow for effective object counting in orthomosaic tunnel ceiling images generated from collections in GPS-denied mining environments. Additionally, we demonstrate effective fine-tuning of EfficientDet object detectors utilizing state-of-the-art image augmentation techniques known as the mosaic and mixup transformations. Our work is demonstrated on sensed data and imagery collected from the Department of Energy (DOE) Waste Isolation Pilot Plant (WIPP) where miles of tunnel ceiling must be assessed for structural integrity.
42 ENGINEERING↗
Wide‐Field Bond Quality Evaluation Using Frequency Domain Thermoreflectance with Deep Neural Network Feature Reconstruction
Heterogeneous integration of microelectronic components provides a pathway to improve circuit/component performance; however, this comes with assembly challenges, in particular due to complex interfaces via subsurface bump bonds. The ability of these bonds to transmit electrical signals and conduct heat to the carrier substrate limits component performance. In this work, hyperspectral frequency‐domain thermoreflectance (FDTR) imaging is demonstrated as a robust technique for evaluating the quality of subsurface indium bump bonds in a surrogate microelectronic sample. By performing microscale FDTR imaging with coarse motion image stitching, thermal phase maps that cover a 4 mm by 4 mm field‐of‐view with subsurface feature sensitivity at depths greater than 50 µm are obtained. The resulting FDTR hyperspectral data contains more than three million pixels and reveal the quality of subsurface microbump arrays. Wide‐field analysis of bonded versus gap regions is enabled by deep neural network feature reconstruction, that after training, rapidly provides an interpretable representation of bond quality. Utility of noisy higher frequency FDTR phase maps, i.e., near the computationally predicted sensing depth limit, results in an average prediction error of 11%. Taken together, FDTR with neural network‐based analysis demonstrates subsurface bond monitoring at length scales relevant for heterogeneously integrated microelectronics.
FDTR↗
Analysis of biofilm assembly by large area automated AFM
Biofilms are complex microbial communities critical in medical, industrial, and environmental contexts. Understanding their assembly, structure, genetic regulation, interspecies interactions, and environmental responses is key to developing effective control and mitigation strategies. While atomic force microscopy (AFM) offers critically important high-resolution insights on structural and functional properties at the cellular and even sub-cellular level, its limited scan range and labor-intensive nature restricts the ability to link these smaller scale features to the functional macroscale organization of the films. We begin to address this limitation by introducing an automated large area AFM approach capable of capturing high-resolution images over millimeter-scale areas, aided by machine learning for seamless image stitching, cell detection, and classification. Large area AFM is shown to provide a very detailed view of spatial heterogeneity and cellular morphology during the early stages of biofilm formation which were previously obscured. Using this approach, we examined the organization of Pantoea sp. YR343 on PFOTS-treated glass surfaces. Our findings reveal a preferred cellular orientation among surface-attached cells, forming a distinctive honeycomb pattern. Detailed mapping of flagella interactions suggests that flagellar coordination plays a role in biofilm assembly beyond initial attachment. Additionally, we use large-area AFM to characterize surface modifications on silicon substrates, observing a significant reduction in bacterial density. This highlights the potential of this method for studying surface modifications to better understand and control bacterial adhesion and biofilm formation.
59 BASIC BIOLOGICAL SCIENCES↗
Data processing methods and data acquisition for samples larger than the field of view in parallel-beam tomography
Parallel-beam tomography systems at synchrotron facilities have limited field of view (FOV) determined by the available beam size and detector system coverage. Scanning the full size of samples bigger than the FOV requires various data acquisition schemes such as grid scan, 360-degree scan with offset center-of-rotation (COR), helical scan, or combinations of these schemes. Though straightforward to implement, these scanning techniques have not often been used due to the lack of software and methods to process such types of data in an easy and automated fashion. The ease of use and automation is critical at synchrotron facilities where using visual inspection in data processing steps such as image stitching, COR determination, or helical data conversion is impractical due to the large size of datasets. Here, we provide methods and their implementations in a Python package, named Algotom, for not only processing such data types but also with the highest quality possible. The efficiency and ease of use of these tools can help to extend applications of parallel-beam tomography systems.
36 MATERIALS SCIENCE↗
A New Reflected Target Optical Assessment System: Stage 1 Development Results
NREL has completed stage 1 development of an indoor optical measurement tool for fully assembled heliostats and single facets. This tool began as an indoor version of NREL’s outdoor Non-Intrusive Optical (NIO) measurement technique [1]. It uses similar techniques to other available tools (deflectometry, photogrammetry, etc.), but is designed to require very little infrastructure, labor, and time to set up and collect surface slope and canting measurements, making it a valuable tool for quality assurance and laboratory measurement of heliostat optics. It accomplishes this by using computer vision, photogrammetry, and multiple images stitched together to minimize the printed target size and required setup precision. This adaptable setup is useful for taking measurements at a variety of heliostat pointing angles, and for measuring fully assembled heliostats on the assembly line. In this paper, we describe the methodology behind the measurement system, present an initial analysis of its uncertainty and sensitivity, and compare it with established optical measurement systems.
Kesseli, Devon (ORCID:0000000193113036)↗
A New Reflected Target Optical Assessment System - Stage 1 Development Results: Preprint
NREL has completed stage 1 development of an indoor optical measurement tool for fully assembled heliostats and single facets. This tool began as an indoor version of NREL's NIO technique. It uses similar techniques to other available tools (deflectometry, photogrammetry, etc.), but is designed require very little infrastructure, labor, and time to set up and collect surface slope and canting measurements on fully assembled heliostats and parabolic trough facets, making it a valuable tool for quality assurance and laboratory measurement of helio-stat optics. It accomplishes this by using computer vision, photogrammetry, and multiple images stitched together to minimize the printed target size and required setup precision. This adaptable setup is useful for taking measurements at a variety of heliostat pointing angles, and for measuring fully assembled heliostats on the assembly line. The measurement system's methodology and an analysis of its uncertainty, sensitivity and comparison with established optical measurement systems is described below.
canting↗
Multispectral and Thermal Imager Onboard Aerial Platforms Instrument Handbook
The MicaSense Altum imager is an off-the-shelf, synchronized multispectral and thermal camera, combined with a Global Positioning System (GPS) unit and downwelling light sensor (DLS). The Altum takes images of the land surface within its field of view (FOV) across five visible bands and one longwave infrared thermal band. The sensor records the radiance and converts it to digital numbers. Imagery is radiometrically corrected, taking into account the sensor calibration, lens distortions, vignette effects, sun angle, and atmospheric effects (scattering and absorption). The photogrammetry software Agisoft PhotoScan v 1.4 is used to align and stitch the images into a larger composite image using the technique of structure from motion image capture to construct a dense cloud and 3D model of the surface, which is used to produce a digital elevation model of the terrain surveyed and orthomosaic imagery. Land surface leaf area index, albedo, and surface skin temperature are provided for the user. The user can perform raster calculations on the imagery to produce various other vegetative indices, which are used to indicate plant health and land surface characteristics, including Normalized Difference Vegetation Index (NDVI), Green Normalized Difference Vegetation Index (GNDVI), Normalized Difference Water Index (NDWI), surface temperature, and Enhanced_vegetation_index (EVI). This code is provided with the readme file for each data set. The images have a resolution of 20-60 cm/pixel, which are subsampled to 100 cm/pixel.
47 OTHER INSTRUMENTATION↗
Utah FORGE: Well 16B(78)-32 Core Photographs
This dataset includes images of core samples collected from Utah FORGE well 16B(78)-32. The images are stitched photographs showing the circumferential view of the cores exterior in two dimensions and the individual photos of the core taken at multiple angles used to construct the stitched photos.
15 GEOTHERMAL ENERGY↗
Gantryless Associated-Particle Neutron Radiography
The present work reports on the development of techniques for in-field fast-neutron radiography measurements using the associated-particle imaging (API) method. The API method employs alpha-neutron coincidences from the d+t→α+n reaction to enable fast neutron transmission imaging with excellent contrast using a wide cone beam. However, for field radiography applications, the API method is burdened by the need for the relative positions of the source and detector to be known. Fortunately, these relative positions can be inferred from transmission data. The inferred positions also enable accurate stitching of multiple images into a composite image even when using a low-resolution detector panel and acquiring images having few overlapping pixels. The developed techniques address analysis of measurements where (1) the source and detector panel are separately hand positioned rather than held in registration by a gantry, (2) multiple detector panel positions within the “coincident cone” of tagged neutrons are required to piece together an image of an item of interest, and (3) normalization measurements that have identical source-detector positioning but without the inspected object are not possible. The present work will describe the system calibrations (including timing calibrations and neutron direction calibrations) necessary for subsequent analyses, the method of locating the detector in the coincident cone of neutrons with millimeter precision using the timing and directions of coincident neutrons, the method of calculating a normalization image for a given detector panel position, and the method used to project multiple images into a common image.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Improvements in Mirror Surface Measurement with Reflected Computer Vision Targets
Over the last several years, NREL has been developing a system to measure large optical surfaces of heliostat mirrors by reflecting computer vision targets. An advantage of this system, called Reflected Target Nonintrusive Assessment (ReTNA), is that it lends itself well to stitching together many images, each reflecting only part of a larger heliostat. In the last few months, this was taken to a new extreme, with a small target (<5m2) being used to measure a >25m2 long focal length heliostat. These measurements were compared with traditional fringe deflectometry methods, which require a >50m2 target, and photogrammetry. The strengths, weaknesses and limitations of ReTNA are discussed. An estimated uncertainty in this new measurement is presented, along with software improvements and a new wireless data collection system. A bill of materials for this measurement system is presented, which has been designed to use all low-cost, off-the-shelf components. Finally, the next steps for future ReTNA development are presented. Overall, ReTNA can be a valuable optics measurement system, complimentary to existing measurement techniques available for large reflective surfaces.
14 SOLAR ENERGY↗
Utah FORGE Well 16A(78)-32 Core Photos
Images of core samples collected from Utah FORGE well 16A(78)-32. These images were created by stitching together multiple photographs resulting in a circumferential view of the cores exterior in two dimensions. Core footages (measured depths) are indicated in the file names, and are annotated on each image. The images, of which there are 30 in the .zip file, are in a .jpg format.
15 GEOTHERMAL ENERGY↗
Advanced Solar and Load Forecasting Incorporating HD Sky Imaging (Phase III)
Due to rapidly changing sky conditions, the available solar irradiance for energy generation is subject to wide swings in amplitude. As the market penetration of solar energy continues to increase rapidly, these variations in solar power generation are beginning to have an impact on grid stability and increased wear on power switches. Solar power forecasting plays a critical role in operations for Independent System Operators (ISOs) and utilities. Accurate forecasts help maintain grid reliability, optimize generation from renewables, and reduce operating costs. Of particular interest to the ISOs and utilities are sudden changes in solar irradiance, termed “ramp events,” due to the movement of clouds. One significant impact of ramp events on the grid is additional ancillary service requirements necessary to manage such variability. Ramp events can also cause voltage fluctuations in the distribution grids and trigger actions of automated line equipment (e.g., tap changers), leading to additional maintenance costs. In high penetration solar regions, forecasts must be made for both transmission-connected and distribution-connected resources – either behind the meter or in front of it. Particularly for distributed solar energy resources, forecasting can be a challenge due to the lack of visibility of the energy resource. Brookhaven National Laboratory (BNL) has been working towards nowcasting Global Horizontal Irradiance (GHI) using low-cost technologies for several years now. The Solar NowCasting technology being developed by BNL is a 0 – 30 min solar “nowcasting” technology applicable to a scale covering both large generating facilities and residential, distributed solar installations that relies on a network of ground-based high-definition (HD) cameras and surface pyranometers. GHI forecasts are being produced for both regions using 8 ground-based HD cameras and at least 2 surface pyranometers. When stitched together, the camera images can be used to forecast the impact of clouds on available solar irradiance over a domain of ~50 km 2 . Phase I of the project was the engineering scale up conceptual design stage. Phase II was the initial field test and demonstration, in which the technology was scaled up by a factor of 20 times and successfully demonstrated in eastern Long Island. In Phase III, an additional forecasting network was added in upstate NY and both networks are currently being operated until at least a full year of data is gathered by the Albany network to allow for the collection of sufficient data to evaluate performance against the persistence and smart persistence models using the Solar Arbiter.
14 SOLAR ENERGY↗