Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,495 records · Page 83
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Airborne hyperspectral imaging of cover crops through radiative transfer process-guided machine learning

Cover cropping between cash crop growing seasons is a multifunctional conservation practice. Timely and accurate monitoring of cover crop traits, notably aboveground biomass and nutrient content, is beneficial to agricultural stakeholders to improve management and understand outcomes. Currently, there is a scarcity of spatially and temporally resolved information for assessing cover crop growth. Remote sensing has a high potential to fill this need, but conventional empirical regression operated with coarse-resolution multispectral data has large uncertainties. Therefore, this study utilized airborne hyperspectral imaging techniques and developed new process-guided machine learning approaches (PGML) for cover crop monitoring. Specifically, we deployed an airborne hyperspectral system covering visible to shortwave-infrared wavelengths (400–2400 nm) to acquire high spatial (0.5 m) and spectral (3–5 nm) resolution reflectance over 23 cover crop fields across Central Illinois in March and April of 2021. Airborne hyperspectral surface reflectance with high spectral and spatial resolution can be well matched with field data to quantify cover crop traits. Furthermore, the PGML models were pre-trained by synthetic data from soil-vegetation radiative transfer modeling (one million records), and then fine-tuned with field data of cover crop biomass and nutrient content. Results show that airborne hyperspectral data with PGML can achieve high accuracy to predict cover crop aboveground biomass (R 2 = 0.72, relative RMSE = 15.16%) and nitrogen content (R 2 = 0.69, relative RMSE = 16.59%) through leave-one-field-out cross-validation. Unlike the pure data-driven approach (e.g., partial least-squares regression), PGML incorporated radiative transfer knowledge and obtained higher predictive performance with fewer field data. Meanwhile, with field data for model fine-tuning, PGML predicted biomass more accurately than the inversion of radiative transfer models. Here we also found that the red edge has a high contribution in quantifying aboveground biomass and nitrogen content, followed by green and shortwave spectra. This study demonstrated the first attempt of utilizing hyperspectral remote sensing to accurately quantify cover crop traits. We highlight the strength of PGML in exploiting sensing data to quantify ecosystem variables to advance agroecosystem monitoring for sustainable agricultural management.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Imaging high jitter, very fast phenomena: A remedy for shutter lag

Dielectric breakdown is an example of a natural phenomenon that occurs on very short time scales, making it incredibly difficult to capture optical images of the process. Event initiation jitter is one of the primary challenges, as even a microsecond of jitter time can cause the imaging attempt to fail. Initial attempts to capture images of dielectric breakdown using a gigahertz frame rate camera and an exploding bridge wire initiation were stymied by high initiation jitter. Subsequently, a novel optical delay line apparatus was developed in order to effectively circumvent the jitter and reliably image dielectric breakdown. Here, the design and performance of the optical delay line apparatus are presented. The optical delay line increased the image capture success rate from 25% to 94% while also permitting enhanced temporal resolution and has application in imaging other high-jitter, extremely fast phenomena.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Atomic force microscopy phase imaging of epitaxial graphene films

Abstract Dynamic mode atomic force microscopy phase imaging is known to produce distinct contrast between graphene areas of different atomic thickness. But the intrinsic complexity of the processes controlling the tip motion and the phase angle shift excludes its use as an independent technique for a quantitative type of analysis. By investigating the relationship between the phase shift, the tip-surface interaction, and the thickness of the epitaxial graphene areas grown on silicon carbide, we shed light on the origin of such phase contrast, and on the complex energy dissipation processes underlying phase imaging. In particular, we study the behavior of phase shift and energy dissipation when imaging the interfacial buffer layer, single-layer, and bilayer graphene regions as a function of the tip-surface separation and the interaction forces. Finally, we compare these results with those obtained on differently-grown quasi free standing single- and bilayer graphene samples.

Lavini, Francesco (ORCID:0000000257223040)↗
DOE OSTI2021

Detecting Low Surface Brightness Galaxies with Mask R-CNN

Low surface brightness galaxies (LSBGs), galaxies that are fainter than the dark night sky, are famously difficult to detect. However, studies of these galaxies are essential to improve our understanding of the formation and evolution of low-mass galaxies. In this work, we train a deep learning model using the Mask R-CNN framework on a set of simulated LSBGs inserted into images from the Dark Energy Survey (DES) Data Release 2 (DR2). This deep learning model is combined with several conventional image pre-processing steps to develop a pipeline for the detection of LSBGs. We apply this pipeline to the full DES DR2 coadd image dataset, and preliminary results show the detection of 22 large, high-quality LSBG candidates that went undetected by conventional algorithms. Furthermore, we find that Galactic cirrus represents the largest contaminant in our resulting candidate list.

Levy, Caleb↗
DOE OSTI2018

Parametric Reconstruction of Glass Fiber-reinforced Polymer Composites from X-ray Projection Data—A Simulation Study

We present a new approach to estimate geometry parameters of glass fibers in glass fiber-reinforced polymers from simulated X-ray micro-computed tomography scans. Traditionally, these parameters are estimated using a multi-step procedure including image reconstruction, pre-processing, segmentation and analysis of features of interest. Each step in this chain introduces errors that propagate through the pipeline and impair the accuracy of the estimated parameters. In the approach presented in this paper, we reconstruct volumes from a low number of projection angles using an iterative reconstruction technique and then estimate position, direction and length of the contained fibers incorporating a priori knowledge about their shape, modeled as a geometric representation, which is then optimized. Using simulation experiments, we show that our method can estimate those representations even in presence of noisy data and only very few projection angles available.

42 ENGINEERING↗
DOE OSTI2016

Determination of the Goos-Hanchen shift in dielectric waveguides via photo emission electron microscopy in the visible spectrum

Photoemission Electron Microscopy (PEEM) is a versatile tool that relies on the photoelectric effect to produce high-resolution images. Pulse lasers allow for multi-photon PEEM where multiple photons are required excite a single electron. This non-linear process can directly image the near field region of electromagnetic fields in materials. We use this ability here to analyze wave propagation in a linear dielectric waveguide with wavelengths of 410nm and 780nm. The propagation constant of the waveguide can be extracted from the interference pattern created by the coupled and incident light and shows distinct polarization dependence. Furthermore, the electromagnetic field interaction at the boundaries can then be deduced which is essential to understand power flow in wave guiding structures. These results match well with simulations using finite element techniques.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2015

AUTOMATED TRANSIENT IDENTIFICATION IN THE DARK ENERGY SURVEY

We describe an algorithm for identifying point-source transients and moving objects on reference-subtracted optical images containing artifacts of processing and instrumentation. The algorithm makes use of the supervised machine learning technique known as Random Forest. We present results from its use in the Dark Energy Survey Supernova program (DES-SN), where it was trained using a sample of 898,963 signal and background events generated by the transient detection pipeline. After reprocessing the data collected during the first DES-SN observing season (2013 September through 2014 February) using the algorithm, the number of transient candidates eligible for human scanning decreased by a factor of 13.4, while only 1.0% of the artificial Type Ia supernovae (SNe) injected into search images to monitor survey efficiency were lost, most of which were very faint events. Here we characterize the algorithm’s performance in detail, and we discuss how it can inform pipeline design decisions for future time-domain imaging surveys, such as the Large Synoptic Survey Telescope and the Zwicky Transient Facility. An implementation of the algorithm and the training data used in this paper are available at at http://portal.nersc.gov/project/dessn/autoscan.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2016

TU-FG-209-12: Treatment Site and View Recognition in X-Ray Images with Hierarchical Multiclass Recognition Models

Purpose: To investigate an approach of automatically recognizing anatomical sites and imaging views (the orientation of the image acquisition) in 2D X-ray images. Methods: A hierarchical (binary tree) multiclass recognition model was developed to recognize the treatment sites and views in x-ray images. From top to bottom of the tree, the treatment sites are grouped hierarchically from more general to more specific. Each node in the hierarchical model was designed to assign images to one of two categories of anatomical sites. The binary image classification function of each node in the hierarchical model is implemented by using a PCA transformation and a support vector machine (SVM) model. The optimal PCA transformation matrices and SVM models are obtained by learning from a set of sample images. Alternatives of the hierarchical model were developed to support three scenarios of site recognition that may happen in radiotherapy clinics, including two or one X-ray images with or without view information. The performance of the approach was tested with images of 120 patients from six treatment sites – brain, head-neck, breast, lung, abdomen and pelvis – with 20 patients per site and two views (AP and RT) per patient. Results: Given two images in known orthogonal views (AP and RT), the hierarchical model achieved a 99% average F1 score to recognize the six sites. Site specific view recognition models have 100 percent accuracy. The computation time to process a new patient case (preprocessing, site and view recognition) is 0.02 seconds. Conclusion: The proposed hierarchical model of site and view recognition is effective and computationally efficient. It could be useful to automatically and independently confirm the treatment sites and views in daily setup x-ray 2D images. It could also be applied to guide subsequent image processing tasks, e.g. site and view dependent contrast enhancement and image registration. The senior author received research grants from ViewRay Inc. and Varian Medical System.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Machine Learning Algorithms for Automated NIF Capsule Mandrel Selection

Small shells, approximately 2 mm in diameter, made from Poly(α-methylstyrene) (PAMS) are used as mandrels in the production of glow discharge polymer capsules located at the center of inertial confinement fusion experiments. The visual inspection process of microscope images of these shell mandrels, including detection of micron-sized defects on the shell surface as well as the handling and sorting, is a very labor-intensive, repetitive, and highly subjective process that stands to benefit greatly from automation. As part of an effort to decrease the number of labor hours spent in capsule handling, inspection, and metrology, the development of robotic systems was presented in a paper by Carlson et al., “Automation in Target Fabrication” [Fusion Sci. Technol., Vol. 70, p. 274 (2016)]. The current work expands the automated image acquisition systems developed previously and adds the use of convolutional neural networks to select capsules best suited for use in the downstream production process. Through the use of these machine learning algorithms, the selection process becomes robust, repeatable, and operator independent. Finally, as an added benefit the system developed as part of this work is able to provide defect statistics on entire shell batches and feed this information upstream to the production team.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

The Urban Observatory: A Multi-Modal Imaging Platform for the Study of Dynamics in Complex Urban Systems

We describe an “Urban Observatory” facility designed for the study of complex urban systems via persistent, synoptic, and granular imaging of dynamical processes in cities. An initial deployment of the facility has been demonstrated in New York City and consists of a suite of imaging systems—both broadband and hyperspectral—sensitive to wavelengths from the visible (∼400 nm) to the infrared (∼13 micron) operating at cadences of ∼0.01–30 Hz (characteristically ∼0.1 Hz). Much like an astronomical survey, the facility generates a large imaging catalog from which we have extracted observables (e.g., time-dependent brightnesses, spectra, temperatures, chemical species, etc.), collecting them in a parallel source catalog. We have demonstrated that, in addition to the urban science of cities as systems, these data are applicable to a myriad of domain-specific scientific inquiries related to urban functioning including energy consumption and end use, environmental impacts of cities, and patterns of life and public health. We show that an Urban Observatory facility of this type has the potential to improve both a city’s operations and the quality of life of its inhabitants.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

FLIMJ: An open-source ImageJ toolkit for fluorescence lifetime image data analysis

In the field of fluorescence microscopy, there is continued demand for dynamic technologies that can exploit the complete information from every pixel of an image. One imaging technique with proven ability for yielding additional information from fluorescence imaging is Fluorescence Lifetime Imaging Microscopy (FLIM). FLIM allows for the measurement of how long a fluorophore stays in an excited energy state, and this measurement is affected by changes in its chemical microenvironment, such as proximity to other fluorophores, pH, and hydrophobic regions. This ability to provide information about the microenvironment has made FLIM a powerful tool for cellular imaging studies ranging from metabolic measurement to measuring distances between proteins. The increased use of FLIM has necessitated the development of computational tools for integrating FLIM analysis with image and data processing. To address this need, we have created FLIMJ, an ImageJ plugin and toolkit that allows for easy use and development of extensible image analysis workflows with FLIM data. Built on the FLIMLib decay curve fitting library and the ImageJ Ops framework, FLIMJ offers FLIM fitting routines with seamless integration with many other ImageJ components, and the ability to be extended to create complex FLIM analysis workflows. Building on ImageJ Ops also enables FLIMJ’s routines to be used with Jupyter notebooks and integrate naturally with science-friendly programming in, e.g., Python and Groovy. We show the extensibility of FLIMJ in two analysis scenarios: lifetime-based image segmentation and image colocalization. We also validate the fitting routines by comparing them against industry FLIM analysis standards.

47 OTHER INSTRUMENTATION↗
DOE OSTI2017

Spontaneous imbibition of water and determination of effective contact angles in the Eagle Ford Shale Formation using neutron imaging

Understanding of fundamental processes and prediction of optimal parameters during the horizontal drilling and hydraulic fracturing process results in economically effective improvement of oil and natural gas extraction. Although, the modern analytical and computational models can capture fracture growth, there is a lack of experimental data on spontaneous imbibition and wettability in oil and gas reservoirs for the validation of further model development. In this work, we used neutron imaging to measure the spontaneous imbibition of water into fractures of Eagle Ford Shale with known geometries and fracture orientations. An analytical solution for a set of nonlinear second-order differential equations was applied to the measured imbibition data to determine effective contact angles. The analytical solution fit the measured imbibition data reasonably well and determined effective contact angles were slightly higher than static contact angles due to effects of in-situ changes in velocity, surface roughness, and heterogeneity of mineral surfaces on the fracture surface. Additionally, small fracture widths may have retarded imbibition and affected model fits, which suggests that average fracture widths are not satisfactory for modeling imbibition in natural systems.

DiStefano, Victoria H. (ORCID:0000000160239716)↗
DOE OSTI2024

High-performance data management for whole slide image analysis in digital pathology

When dealing with giga-pixel digital pathology in whole-slide imaging, a notable proportion of data records holds relevance during each analysis operation. For instance, when deploying an image analysis algorithm on whole-slide images (WSI), the computational bottleneck often lies in the input-output (I/O) system. This is particularly notable as patch-level processing introduces a considerable I/O load onto the computer system. However, this data management process could be further paralleled, given the typical independence of patch-level image processes across different patches. This paper details our endeavors in tackling this data access challenge by implementing the Adaptable IO System version 2 (ADIOS2). Our focus has been constructing and releasing a digital pathology-centric pipeline using ADIOS2, which facilitates streamlined data management across WSIs. Additionally, we’ve developed strategies aimed at curtailing data retrieval times. The performance evaluation encompasses two key scenarios: (1) a pure CPU-based image analysis scenario (“CPU scenario”), and (2) a GPU-based deep learning framework scenario (“GPU scenario”). Our findings reveal noteworthy outcomes. Under the CPU scenario, ADIOS2 showcases an impressive two-fold speed-up compared to the brute-force approach. In the GPU scenario, its performance stands on par with the cutting-edge GPU I/O acceleration framework, NVIDIA Magnum IO GPU Direct Storage (GDS). From what we know, this appears to be among the initial instances, if any, of utilizing ADIOS2 within the field of digital pathology. The source code has been made publicly available at https://github.com/hrlblab/adios.

Wang, Xiao↗
DOE OSTI2020

Multimodal Imaging of Autofluorescent Sites Reveals Varied Chemical Speciation in SSZ-13 Crystals

Here, a multimodal imaging study of chabazite is used to show the distribution of and discriminate between different emissive deposits arising as a result of the detemplation process. 3D confocal imaging, fluorescence lifetime imaging, spectral imaging, and Raman mapping are used to show three different types of emissive behaviours each characterised by different spatial distributions, trends in lifetime, spectral signals, and Raman signatures. A notable difference is seen in the morphology of agglomerated surface deposits and larger subsurface deposits, which experience lifetime augmentation due to spatial confinement. The distribution of organic residue throughout the crystal volume is comparable to XRF mapping that shows Si enrichment on the outer edges and higher Al content through the centre, demonstrating that a fluorescence-based technique can also be used to indirectly comment on the compositional chemistry of the inorganic framework.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2026

INR-TEM: Robust cavity detection in multifocus TEM images via implicit neural representations

When characterizing materials using transmission electron microscopy (TEM) images, detecting and quantifying small features in microstructures, such as cavities, pose significant challenges. Off-the-shelf object detection models, including YOLOv8, show considerable performance degradation, particularly when images vary in resolution and the objects of interest possess a low percentage of the total image region of interest. In this study, we introduce a novel detection pipeline that incorporates an implicit neural representation (INR)-based detection method, INR-TEM, and two-modality imaging (e.g., under-focused and over-focused images typically acquired during materials characterization) to improve object detection performance. The INR-TEM method incorporates a pixel-wise prediction principle inspired by pixel-wise centerness weighting. INR-TEM demonstrates superior robustness to resolution variability, maintaining high detection accuracy even at low image resolutions compared to YOLOv8. To leverage INR-TEM effectively in real-world two-modality characterization applications, we further integrate a two-stage motion correction pipeline designed explicitly for aligning multifocus TEM images. The alignment process, comprising keypoint (based on scale-invariant feature transform, SIFT) and intensity matching, significantly mitigates the adverse effects of perceived motion-induced image degradation during through-focal TEM imaging, directly enhancing INR-TEM’s detection capability over conventional single-focus images. Our integrated INR-TEM cavity detection framework notably improves performance across various cavity sizes, outperforming off-the-shelf YOLOv8 detections that rely on a single image modality.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Direct evidence of the dominant role of multiphoton permanent-dipole transitions in strong-field dissociation of NO 2 +

We study laser-induced dissociation of a metastable NO 2+ ion-beam target into N + +O + , focusing on the prominent contribution by molecules breaking parallel to the polarization at high peak laser intensity (~10 15 W/cm 2 ). Our experimental results and time-dependent Schrödinger equation calculations show that, contrary to commonly held intuition that electronic transitions always prevail, the dominant process underlying this highly aligned dissociation is a multiphoton permanent-dipole transition involving only the electronic ground state and leading to its vibrational continuum. Strong-field permanent-dipole transitions should thus be considered generally, as they may play a significant role in other heteronuclear molecules. Moreover, their role should only grow in importance for longer wavelengths, a trending direction in ultrafast laser studies.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2015

A multimodality segmentation framework for automatic target delineation in head and neck radiotherapy

Purpose: To develop an automatic segmentation algorithm integrating imaging information from computed tomography (CT), positron emission tomography (PET), and magnetic resonance imaging (MRI) to delineate target volume in head and neck cancer radiotherapy. Methods: Eleven patients with unresectable disease at the tonsil or base of tongue who underwent MRI, CT, and PET/CT within two months before the start of radiotherapy or chemoradiotherapy were recruited for the study. For each patient, PET/CT and T1-weighted contrast MRI scans were first registered to the planning CT using deformable and rigid registration, respectively, to resample the PET and magnetic resonance (MR) images to the planning CT space. A binary mask was manually defined to identify the tumor area. The resampled PET and MR images, the planning CT image, and the binary mask were fed into the automatic segmentation algorithm for target delineation. The algorithm was based on a multichannel Gaussian mixture model and solved using an expectation–maximization algorithm with Markov random fields. To evaluate the algorithm, we compared the multichannel autosegmentation with an autosegmentation method using only PET images. The physician-defined gross tumor volume (GTV) was used as the “ground truth” for quantitative evaluation. Results: The median multichannel segmented GTV of the primary tumor was 15.7 cm{sup 3} (range, 6.6–44.3 cm{sup 3}), while the PET segmented GTV was 10.2 cm{sup 3} (range, 2.8–45.1 cm{sup 3}). The median physician-defined GTV was 22.1 cm{sup 3} (range, 4.2–38.4 cm{sup 3}). The median difference between the multichannel segmented and physician-defined GTVs was −10.7%, not showing a statistically significant difference (p-value = 0.43). However, the median difference between the PET segmented and physician-defined GTVs was −19.2%, showing a statistically significant difference (p-value =0.0037). The median Dice similarity coefficient between the multichannel segmented and physician-defined GTVs was 0.75 (range, 0.55–0.84), and the median sensitivity and positive predictive value between them were 0.76 and 0.81, respectively. Conclusions: The authors developed an automated multimodality segmentation algorithm for tumor volume delineation and validated this algorithm for head and neck cancer radiotherapy. The multichannel segmented GTV agreed well with the physician-defined GTV. The authors expect that their algorithm will improve the accuracy and consistency in target definition for radiotherapy.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

TU-H-BRA-01: The Physics of High Power Radiofrequency Isolation in a Novel Compact Linear Accelerator Based MRI Guided Radiation Therapy System

Purpose: To develop a method for isolating the radiofrequency waves emanating from linear accelerator components from the magnetic resonance imaging (MRI) system of an integrated MRI-linac. Methods: An MRI-guided radiation therapy system has been designed that integrates a linear accelerator with simultaneous MR imaging. The radiofrequency waves created by the accelerating process would degrade MR image quality, so a method for containing the radiofrequency waves and isolating the MR imager from them was developed. The linear accelerator radiofrequency modulator was placed outside the room, so a filter was designed to eliminate the radiofrequency corresponding to the proton Larmour frequency of 14.7 MHz. Placing the radiofrequency emitting components in a typical Faraday cage would have reduced the radiofrequency emissions, but the design would be susceptible to small gaps in the shield due to the efficiency of the Faraday cage reflecting internal radiofrequency emissions. To reduce internal radiofrequency reflections, the Faraday cage was lined with carbon fiber sheets. Carbon fiber has the property of attenuating the radiofrequency energy so that the overall radiofrequency field inside the Faraday cage is reduced, decreasing any radiofrequency energy emitted from small gaps in the cage walls. Results: Within a 1.2 MHz band centered on the Larmor frequency, the radiofrequency (RF) leakage from the Faraday cage was measured to be −90 dB with no RF on, −40 dB with the RF on and no shield, returning to −90 dB with the RF on and shields in place. The radiofrequency filter attenuated the linear accelerator modulator emissions in the 14.7 MHz band by 70 dB. Conclusions: One of the major challenges in designing a compact linear accelerator based MRI-guided radiation therapy system, that of isolating the high power RF system from the MRI, has been solved. The measured radiofrequency emissions are sufficiently small to enable system integration. This research was funded by ViewRay, Inc., Oakwood, OH.

60 APPLIED LIFE SCIENCES↗