Search NASA⌕ Search

SEARCH · Search NASA

Results for “image detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Development of an Ultrahigh-bandwidth Phase Contrast Imaging System for detection of electron scale turbulence and Gigahertz Radio-Frequency Waves

The study of waves and turbulence is vital to the development of future reactor-grade plasma devices developed in the quest for fusion energy. These fluctuations are responsible for moving heat and particles across the magnetic field, and a predictive understanding of them is needed to achieve the density and temperature required to sustain a plasma fusion reaction. While many techniques have been developed for measuring waves and fluctuations, every measurement method has limitations. There are relatively few techniques for measuring very high frequency fluctuations, such as radio frequency waves injected to heat the plasma, unstable waves driven by suprathermal particles, or short wavelength electrostatic waves driven by electron temperature or density gradients. The present project builds upon the proven phase contrast imaging (PCI) technique to extend the response of the diagnostic by orders of magnitude in frequency and almost a factor of ten in spatial resolution. PCI provides a measurement of electron density based on small angle scattering of a CO-2 laser beam by using optical techniques to render a phase shift as an intensity change on a detector. Due to the telecommunications revolution, technological development by manufacturers has focused on components in the near -infrared, so that high- quality lasers and detectors at 1.55 µm are readily available. Shifting PCI design to a new, shorter wavelength has numerous advantages and challenges. Similar detector performance is available with room-temperature arrays with GHz bandwidth, while the detector arrays for 10.6 µm required liquid nitrogen cooling and were therefore limited to a bandwidth of about 1 MHz. Shifting to a shorter wavelength reduces the angle at which the laser beam scatters off of plasma waves, allowing more such scattered components to pass through the aperture of the vacuum vessel port and be collected by the PCI, which increases the spatial resolution. Concomitant with these benefits, various questions of performance arise. At shorter laser wave- length, the sensitivity to mirror and lens quality is increased, the contribution of the laser to the overall system noise is increased, and the sensitivity to vibrations is increased. The custom optical components at the heart of the PCI technique were required to be properly scaled for the shorter wavelength, so fabrication technologies needed to be explored. This project was designed to show that a low noise, high response PCI system at 1.55 µm could be constructed and operated, and then to quantify potential issues to allow extrapolation to a full-size production system providing physics measurements on a large plasma device. The first stage, producing the custom optical component called a Phase Plate, was successfully achieved using two methods. First, an easily reproduced masking and coating technique was able to produce good phase plates with the required parameters. Second, a nanofabrication technique was found to produce extremely high quality phase plates at a competitive price. The PCI constructed with the new phase plates and 1.55 µm laser was found to provide excellent wavelength measurements with the theoretically expected response. The sensitivity to optical surface quality was found to be in line with previous measurements at 10.6 µm. The observed signal-to-noise ratio was similar to the theoretically expected value. The effect of vibrations on PCI was studied with the first measurement of the effect of beam motion on PCI response and comparison to theory, allowing for a quantitative prediction of the effect of vibrations on a production PCI system and the requirements for improved beam stabilization. PCI is an extremely cost-effective method to provide a low noise, absolutely calibrated measurement of plasma fluctuations across a wide spatial scale. This project has shown that a 1.55 µm PCI using modern techniques and components is less expensive than the 10.6 µm PCI of a few years ago, with the largest savings in phase plate fabrication and the infrared detector array.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

CAMIS: A Cylindrical Active Mask Imaging System

Detecting and locating radiological and nuclear materials at distances of 10 m or more in urban and cluttered environments continues to pose challenges in nuclear security and proliferation detection. Previous approaches have focused on large-area radiation imaging using planar configurations of detectors and passive masks. However, these approaches suffer from limitations such as limited field-of-view (FOV) and reduced detection efficiency due to absorption in the mask. To address these limitations, we have developed the cylindrical active mask imaging system (CAMIS). This system comprises 128 NaI(Tl) (10 cm)3 detectors. These detectors are arranged in a cylindrical configuration, enabling gamma-ray imaging with a full 360° azimuthal FOV. The active mask elements within the system are arranged in a pseudorandom configuration, providing unique encoding for all incident directions within the FOV. CAMIS offers an effective detection area of approximately 1 m2 across the entire 360° FOV in the horizontal plane, achieving a mean angular resolution of 10.9° in the azimuthal direction and 12.9° in the polar direction measured by taking the full-width at half-maximum (FWHM) of a cross-section at the maximum reconstructed intensity.

Lamb, C↗
DOE OSTI2026

RU-net for automatic characterization of TRISO fuel cross sections

During irradiation, phenomena such as kernel swelling and buffer densification may impact the performance of tristructural isotropic (TRISO) particle fuel. Post-irradiation microscopy is often used to identify these irradiation-induced morphologic changes. However, each fuel compact generally contains thousands of TRISO particles. Manually performing the work to get statistical information on these phenomena is cumbersome and subjective. Here, to reduce the subjectivity inherent in that process and to accelerate data analysis, we used convolutional neural networks (CNNs) to automatically segment cross-sectional images of microscopic TRISO layers. CNNs are a class of machine-learning algorithms specifically designed for processing structured grid data. They have gained popularity in recent years due to their remarkable performance in various computer vision tasks, including image classification, object detection, and image segmentation. In this research, we generated a large irradiated TRISO layer dataset with more than 2,000 microscopic images of cross-sectional TRISO particles and the corresponding annotated images. Based on these annotated images, we used different CNNs to automatically segment different TRISO layers. These CNNs include RU-Net (developed in this study), as well as three existing architectures: U-Net, Residual Network (ResNet), and Attention U-Net. The preliminary results show that the model based on RU-Net performs best in terms of Intersection over Union (IoU). Using CNN models, we can expedite the analysis of TRISO particle cross sections, significantly reducing the manual labor involved and improving the objectivity of the segmentation results.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

A unified large language model–based framework for heterogeneous PV image diagnosis

With advances in imaging technologies, modern photovoltaic (PV) systems generate large volumes of heterogeneous image data, including visible, electroluminescence (EL), and infrared (IR) images. Existing PV image analysis models, particularly deep learning approaches, are typically task-specific and lack cross-modality generalization. To address this limitation, this paper proposes an open-source large language model (LLM)–based unified framework for heterogeneous PV image diagnostics. Through task-aware diagnostic prompting, the framework enables analysis of visible, EL, and IR images within a single pipeline, supporting both zero-shot and few-shot inference and binary and multiclass classification. It is compatible with state-of-the-art multimodal LLMs, including ChatGPT, Gemini, Claude, Qwen, and CLIP. The framework is evaluated on PV module condition classification (clean, soiling, snow, hail, and bird droppings) using visible images, cell crack detection using EL images, and hotspot detection using IR images. GPT-5.1 in few-shot mode achieves the best performance, with classification accuracy exceeding 97.3%. Open-source models such as Qwen and CLIP also deliver competitive results on visible images (around 90% accuracy), though their performance is more limited on EL and IR modalities. On the full ELPV dataset, the framework achieves 83.5% zero-shot accuracy, within 2.8% of the supervised CNN baseline, confirming scalability to larger benchmarks. Practical aspects such as reproducibility, response latency, and confidence estimation are systematically analyzed. The framework operates across PV image modalities without modality- or task-specific training, making it well suited as a rapid pre-screening tool to support downstream detailed diagnostics. A benchmark dataset of diverse labeled PV images is also released.

Li, Baojie↗
DOE OSTI2026

RU Net for Automatic Characterization of TRISO Fuel Cross Sections

TRistructural ISOtropic (TRISO) particle fuel is a type of nuclear fuel known for its high-temperature and high-burnup performance. Each sub-millimeter diameter TRISO particle consists of uranium-oxycarbide (UCO) or UO2 fuel kernel, coated with buffer, inner pyrolytic carbon (IPyC), silicon carbide (SiC), and outer pyrolytic carbon (OPyC) layers. The SiC layer acts as the main containment barrier for the TRISO particle to retain the fission products, while the IPyC and OPyC layers provide additional barriers to the release of fission products, especially fission gases. During irradiation, phenomena like kernel swelling, buffer densification, and IPyC fracture may impact fuel performance. Post-irradiation microscopy on entire compact cross sections or samples of individual particles deconsolidated from compacts is often used to identify these irradiation-induced changes in morphology. However, each fuel compact generally contains thousands of TRISO particles. To get statistical information on these phenomena, it is cumbersome work if done manually. For example, to get information about swelling/densification behaviors of different layers or kernels after irradiation, researchers previously manually measured the perimeter of each TRISO layer in hundreds of particles after four rounds of iterative grinding and polishing encompassing more than 2000 cross-section images for a total of four fuel compacts. To attempt to reduce the subjectivity inherent in that process and accelerate data analysis, we conducted a study on the automatic TRISO layer segmentation on cross-sectional microscopic images using Convolutional Neural Networks (CNNs). CNNs are a class of machine learning algorithms specifically designed for processing structured grid data that have gained popularity in recent years due to their remarkable performance in various computer vision tasks, including image classification, object detection, and image segmentation. In this research, we have generated the large irradiated TRISO layer dataset with more than 2000 cross-section TRISO microscopic images and the corresponding annotated images. Based on these annotated images, we have employed different CNNs for automatic segmentation of different TRISO layers. These include RU-Net (developed in this study), as well as three existing architectures: U-Net, Residual Network (ResNet), and Attention U-Net. The preliminary results show that the model based on RU-Net has the best performance in terms of intersection-over-union (IoU). Through the aid of these CNN models, we can expedite the analysis of TRISO particle cross-sections, significantly reducing the manual labor involved and improving the objectivity of the segmentation results.

Convolutional Neural Networks↗
DOE OSTI2023

Deep learning methods for event verification and image re-purposing detection

Systems and methods herein describe accessing an image, generating a resized image, generating an image feature vector by applying an image classification neural network to the resized image, generating analysis of the image by processing the image feature vector using a machine-learning classifier trained to analyze the image feature vector, and based on the analysis, determining an event that is attributed to the image.

Nataraj, Lakshmanan↗
DOE OSTI2023

Wavelength domain spatial frequency modulation imaging: enabling fiber optic delivery and detection

Spatial frequency modulation imaging (SPIFI) provides a simple architecture for modulating an extended illumination source that is compatible with single pixel imaging. We demonstrate wavelength domain SPIFI (WD-SPIFI) by encoding time-varying spatial frequencies in the spectral domain that can produce enhanced resolution images, like its spatial domain counterpart, spatial domain (SD) SPIFI. However, contrary to SD-SPIFI, WD-SPIFI enables remote delivery by single mode fiber, which can be attractive for applications where free-space imaging is not practical. Finally, we demonstrate a cascaded system incorporating WD-SPIFI in-line with SD-SPIFI enabling single pixel 2D imaging without any beam or sample scanning.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Fault Detection on Seismic Structural Images Using a Nested Residual U-Net

Automatic identification of faults on seismic structural images is a challenging yet crucial task in quantitative seismic interpretation. Human picking or attribute-based fault detection methods may misidentify faults on noisy, complex seismic images. In this work, we develop a new automatic fault detection method using a nested residual U-shaped convolutional neural network. Each of the encoders and decoders in this neural network is a residual U-Net, leading to a nested architecture. The final fault map results from the fusion of three fault maps with low, medium, and high fault resolutions. We demonstrate the excellent fault-detection capability of our nested neural network using a series of synthetic and field seismic images. We find that our approach produces clearer and more interpretable fault maps than the current state-of-the-art U-Net fault detection method, particularly on noisy seismic images. Our new automatic fault detection method can facilitate reliable quantitative seismic interpretation on field seismic images.

58 GEOSCIENCES↗
DOE OSTI2025

Robust Spectral Anomaly Detection in EELS Spectral Images via 3D Convolutional Variational Autoencoders

Abstract A 3D Convolutional Variational Autoencoder (3D‐CVAE) is introduced for automated anomaly detection in electron energy‐loss spectroscopy spectrum imaging (EELS‐SI) data. This approach leverages the full 3D structure of EELS‐SI data to detect subtle spectral anomalies while preserving both spatial and spectral correlations across the datacube. By employing cross‐entropy loss and training on bulk spectra, the model learns to reconstruct bulk features characteristic of the defect‐free material. In exploring methods for anomaly detection, both the 3D‐CVAE approach and principal component analysis (PCA) are evaluated, testing their performance using FeL‐edge ΔEpeak shifts designed to simulate material defects. These results show that 3D‐CVAE achieves superior anomaly detection and maintains consistent performance across various shift magnitudes. The method demonstrates clear bimodal separation between bulk and anomalous spectra, enabling reliable classification. Further analysis verifies that lower‐dimensional representations are robust to anomalies in the data. While performance advantages over PCA diminish with decreasing anomaly concentration, our method maintains high reconstruction quality even in challenging, noise‐dominated spectral regions. This approach provides a robust framework for unsupervised automated detection of spectral anomalies in EELS‐SI data, particularly valuable for analyzing complex material systems.

Chemistry↗
DOE OSTI2025

Wafer-scale waveguide sidewall roughness scattering loss characterization by image processing

Photonic integrated circuits (PICs) are vital for developing affordable, high-performance optoelectronic devices that can be manufactured at an industrial scale, driving innovation and efficiency in various applications. Optical loss of modes in thin film waveguides and devices is a critical measure of their performance. Thin film growth, lithography, masking, and etching processes are imperfect processes that introduce significant sidewall and top-surface roughness and cause dominating optical losses in waveguides and photonic structures. This roughness, as perturbations couple light from guided to far-field radiation modes, leads to scattering losses that can be estimated from theoretical models. Typically, with UV-based lithography, sidewall roughness is significantly larger than wafer-top surface roughness. Atomic force microscopy (AFM) imaging measurement gives a 3D and high-resolution roughness profile, but the measurement is inconvenient, costly, and unscalable for large-scale PICs and at wafer-scale. Here, we evaluate the sidewall roughness profile based on 2D high-resolution scanning electron microscope (SEM) imaging. We characterized the loss on two homemade nitride and oxide films on 3-inch silicon wafers with 12 waveguide devices on each and correlated the scattering loss estimated from a 2D image-based sidewall profile and theoretical Payne model. The lowest loss of guided fundamental transverse electric (TE 0 ) mode is found at 0.075 dB/cm at 633 nm across 24 devices, a record at visible wavelength. Our work shows 100% success (edge continuity span exceeding 95% of image width/height) in edge detection in image processing of all images to estimate autocorrelation function and optical mode loss. These demonstrations offer valuable insights into waveguide sidewall roughness and a comparison of experimental and 2D SEM image processing based loss estimations with applications in loss characterization at wafer-scale PICs.

Khurana, Mohit (ORCID:0000000207898672)↗
DOE OSTI2020

An Analysis of the Statistics and Systematics of Limb Anomaly Detections in HST/STIS Transit Images of Europa

Several recent studies derived the existence of plumes on Jupiter’s moon Europa. The only technique that provided multiple detections is the far-ultraviolet imaging observations of Europa in transit of Jupiter taken by the Space Telescope Imaging Spectrograph (STIS) on the Hubble Space Telescope (HST). In this study, we reanalyze the three HST/STIS transit images in which Sparks et al. identified limb anomalies as evidence for Europa’s plume activity. After reproducing the results of Sparks et al., we find that positive outliers are similarly present in the images as the negative outliers that were attributed to plume absorption. A physical explanation for the positive outliers is missing. We then investigate the systematic uncertainties and statistics in the images and identify two factors that are crucial when searching for anomalies around the limb. One factor is the alignment between the actual and assumed locations of Europa on the detector. A misalignment introduces distorted statistics, most strongly affecting the limb above the darker trailing hemisphere where the plumes were detected. The second factor is a discrepancy between the observation and the model used for comparison, adding uncertainty in the statistics. When accounting for these two factors, the limb minima (and maxima) are consistent with random statistical occurrence in a sample size given by the number of pixels in the analyzed limb region. The plume candidate features in the three analyzed images can be explained by purely statistical fluctuations and do not provide evidence for absorption by plumes.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Automatic Detection and Classification of Radio Galaxy Images by Deep Learning

Abstract Surveys conducted by radio astronomy observatories, such as SKA, MeerKAT, Very Large Array, and ASKAP, have generated massive astronomical images containing radio galaxies (RGs). This generation of massive RG images has imposed strict requirements on the detection and classification of RGs and makes manual classification and detection increasingly difficult, even impossible. Rapid classification and detection of images of different types of RGs help astronomers make full use of the observed astronomical image data for further processing and analysis. The classification of FRI and FRII is relatively easy, and there are more studies and literature on them at present, but FR0 and FRI are similar, so it is difficult to distinguish them. It poses a greater challenge to image processing. At present, deep learning has made breakthrough progress in the field of image analysis and processing and has preliminary applications in astronomical data processing. Compared with classification algorithms that can only classify galaxies, object detection algorithms that can locate and classify RGs simultaneously are preferred. In target detection algorithms, YOLOv5 has outstanding advantages in the classification and positioning of small targets. Therefore, we propose a deep-learning method based on an improved YOLOv5 object detection model that makes full use of multisource data, combining FIRST radio with SDSS optical image data, and realizes the automatic detection of FR0, FRI, and FRII RGs. The innovation of our work is that on the basis of the original YOLOv5 object detection model, we introduce the SE Net attention mechanism, increase the number of preset anchors, adjust the network structure of the feature pyramid, and modify the network structure, thereby allowing our model to demonstrate galaxy classification and position detection effects. Our improved model produces satisfactory results, as evidenced by experiments. Overall, the mean average precision (mAP@0.5) of our improved model on the test set reaches 89.4%, which can determine the position (R.A. and decl.) and automatically detect and classify FR0s, FRIs, and FRIIs. Our work contributes to astronomy because it allows astronomers to locate FR0, FRI, and FRII galaxies in a relatively short time and can be further combined with other astronomically generated data to study the properties of these galaxies. The target detection model can also help astronomers find FR0s, FRIs, and FRIIs in future surveys and build a large-scale star RG catalog. Moreover, our work is also useful for the detection of other types of galaxies.

Astronomy & Astrophysics↗