Search NASA⌕ Search

SEARCH · Search NASA

Results for “image edge detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Wafer-scale waveguide sidewall roughness scattering loss characterization by image processing

Photonic integrated circuits (PICs) are vital for developing affordable, high-performance optoelectronic devices that can be manufactured at an industrial scale, driving innovation and efficiency in various applications. Optical loss of modes in thin film waveguides and devices is a critical measure of their performance. Thin film growth, lithography, masking, and etching processes are imperfect processes that introduce significant sidewall and top-surface roughness and cause dominating optical losses in waveguides and photonic structures. This roughness, as perturbations couple light from guided to far-field radiation modes, leads to scattering losses that can be estimated from theoretical models. Typically, with UV-based lithography, sidewall roughness is significantly larger than wafer-top surface roughness. Atomic force microscopy (AFM) imaging measurement gives a 3D and high-resolution roughness profile, but the measurement is inconvenient, costly, and unscalable for large-scale PICs and at wafer-scale. Here, we evaluate the sidewall roughness profile based on 2D high-resolution scanning electron microscope (SEM) imaging. We characterized the loss on two homemade nitride and oxide films on 3-inch silicon wafers with 12 waveguide devices on each and correlated the scattering loss estimated from a 2D image-based sidewall profile and theoretical Payne model. The lowest loss of guided fundamental transverse electric (TE 0 ) mode is found at 0.075 dB/cm at 633 nm across 24 devices, a record at visible wavelength. Our work shows 100% success (edge continuity span exceeding 95% of image width/height) in edge detection in image processing of all images to estimate autocorrelation function and optical mode loss. These demonstrations offer valuable insights into waveguide sidewall roughness and a comparison of experimental and 2D SEM image processing based loss estimations with applications in loss characterization at wafer-scale PICs.

Khurana, Mohit (ORCID:0000000207898672)↗
DOE OSTI2025

Light-powered end-to-end neutron detection and imaging with an edge-deployed optical AI chip

Neutron detection is widely used in many applications including nuclear physics, nuclear energy, nuclear technologies and nuclear safeguards. Developing an end-to-end neutron detection and imaging workflow paves way towards fully automated processes for many applications. We implemented an automated workflow for neutron detection experiments which use a solid state image sensor to capture neutron hits as a digital image. We deploy the workflow to an edge-based optical neural network (ONN) to increase the radiation-hardness and lifetime of neutron detection instruments. We present a two-stage neural network framework for detection of neutrons at sub-pixel resolution. The first stage uses a region proposal network to efficiently detect and extract neutron hits from the input camera image. The second stage feeds the extracted hits into a fully connected neural network to predict the sub-pixel hit position. The performance of the two-stage framework is evaluated using the edge-based ONN. The results show that we can achieve above 96% neutron detection accuracy as well as sub-pixel and sub-micron position resolution, while enjoying the advantages of the ONN hardware including radiation-hardness, low energy consumption and high computing speed for integrated edge camera and hardware deployment, when compared with electronic counterparts.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Heliostat optical error inspection with polarimetric imaging drone

On a Concentrated Solar Power (CSP) field, optical errors have significant impacts on the collection efficiency of heliostats. Fast, cost-effective, labor-efficient, and non-intrusive autonomous field inspection remains a challenge. Approaches using imaging drone, i.e., Unmanned Aerial Vehicle (UAV) system integrated with high resolution visible imaging sensors, have been developed to address these challenges; however, these approaches are often limited by insufficient imaging contrast. Here, in this study, we report a polarimetry-based method with a polarization imaging system integrated on UAV to enhance imaging contrast for in-situ detection of heliostat mirrors without interrupting field operation. We developed an optical model for skylight polarization pattern to simulate the polarization images of heliostat mirrors and obtained optimized waypoints for polarimetric imaging drone flight path to capture images with enhanced contrast. The polarimetric imaging-based method improved the success rate of edge detections in scenarios which were challenging for mirror edge detection with conventional imaging sensors. We have performed field tests to achieve significantly enhanced heliostat edge detection success rate and investigate the feasibility of integrating polarimetric imaging method with existing imaging-based heliostat inspection methods, i.e., Polarimetric Imaging Heliostat Inspection Method (PIHIM). Our preliminary field test results suggest that the PIHIM hold the promise to enable sufficient imaging contrast for real-time autonomous imaging and detection of heliostat field, thus suitable for non-interruptive fast CSP field inspection during its operation.

CSP Field↗
DOE OSTI2025

Self-Supervised and Interpretable Anomaly Detection Using Network Transformers

Machine learning and deep neural networks (DNNs) have been proposed as a tool to identify anomalies in computer network communications. However, due the obfuscated nature of off-the-shelf machine learning models, their output often does not provide enough information to isolate the source of the anomaly to take corrective measures. In this article, we introduce the network transformer (NeT), a DNN model for anomaly detection that incorporates the graph structure of the communication network in order to improve interpretability. Further, the presented approach has the following advantages: first, enhanced interpretability by incorporating the graph structure of computer networks; second, provides a hierarchical set of features that enables analysis at different levels of granularity; second, self-supervised training that does not require labeled data. The NeT model was evaluated on a set of anomalous scenarios executed in a real industrial control system. The presented approach successfully identified the anomalies, the devices affected, and the specific connections causing the anomalies, providing a data-driven hierarchical approach to analyze the behavior of a cyber network.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Hyper Spectral Anomaly Detection

Anomaly detection is a common machine learning (ML) task with growing importance in the fields of imaging, quality assurance, and multiple security related disciplines. Anomaly detection is more difficult than traditional machine learning methods due to the inherent unlabeled nature of the datasets. Existing anomaly detection architectures commonly face challenges with explainability, retaining information related to the relational structure of the data, and false positive rates. Hyperspectral Imaging Anomaly Detection (HSI) is a statistical model that employs vertex and edge weighted graphs to preserve the data’s relationships on different topographical scales. The model is able to generalize from anomaly detection in 2D images to novel datasets related to cyber-security. Furthermore, the use of multi-spectral and other filtering methods results in fewer false positives and increases the explainability of model predictions. When applying HSI to cyber-security datasets, we are able to successfully detect malicious activity with a relatively high degree of accuracy.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Energy-resolved neutron imaging and diffraction including grain orientation mapping using event camera technology

Time-of-flight neutron diffraction and energy-resolved imaging each provide unique perspectives into material properties. Neutron diffraction is useful for assessing microstructural parameters such as phase composition, texture, and dislocation densities, though it typically provides averaged data over the sampled volume. Energy-resolved imaging, on the other hand, offers both spatial and spectral information by detecting Bragg edges and neutron absorption resonances, which enables detailed mapping of microstructure and isotopic composition. When combined, these techniques have the potential to enrich our understanding of material behavior across different scales, enhancing our understanding of complex materials. Traditionally, these modalities are conducted on separate instruments, which is time-consuming and poses challenges for data integration. Here, we report the integration of the LumaCam, an event-mode energy-resolved neutron imaging camera with the HIPPO time-of-flight diffractometer at LANSCE. This integration enables simultaneous diffraction and imaging across the full spectrum, with analysis optimized for diffraction and Bragg-edge imaging in the thermal range (0.45–10 Å) and resonance imaging in the epithermal range (0.5–3000 eV), facilitating comprehensive multi-modal analysis. We demonstrate its capabilities through case studies, including spatial mapping of grain orientations in a steel sample and accurate thickness estimations for irregular samples including a depleted uranium cylinder and a natural silver-containing mineral specimen. The combined setup enhances real-time sample alignment and provides comprehensive data for crystal structure, texture, and isotopic composition analysis. This approach opens new possibilities for advanced applications in nuclear engineering, archaeology, and materials science.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Two-Stage Wildlife Event Classification for Edge Deployment

Camera-based wildlife monitoring is often overwhelmed by non-target triggers and slowed by manual review or cloud-dependent inference, which can prevent timely intervention for high stakes human–wildlife conflicts. Our key contribution is a deployable, fully offline edge vision sensor that achieves near-real-time, highly accurate wildlife event classification by combining detector-based empty-image suppression with a lightweight classifier trained with a staged transfer-learning curriculum. Specifically, Stage 1 uses a pretrained You Only Look Once (YOLO)-family detector for permissive animal localization and empty-trigger suppression, and Stage 2 uses a lightweight EfficientNet-based binary classifier to confirm puma on detector crops and gate downstream actions. Our design is robust to low-quality nighttime monochrome imagery (motion blur, low contrast, illumination artifacts, and partial-body captures) and operates using commercially available components in connectivity-limited settings. In field deployments running since May 2025, end-to-end latency from camera trigger to action command is approximately 4 s. Ablation studies using a dataset of labeled wildlife images (pumas, not pumas) show that the two-stage approach substantially reduces false alarms in identifying pumas relative to a full-image classifier while maintaining high recall. On the held-out test set (N = 1434 events), the proposed two-stage cascade achieves precision 0.983, recall 0.975, F1 0.979, accuracy 0.986, and balanced accuracy 0.983, with only 8 false positives and 12 false negatives. The system can be easily adapted for other species, as demonstrated by rapid retraining of the second stage to classify ringtails. Downstream responses (e.g., notifications and optional audio/light outputs) provide flexible actuation capabilities that can be configured to support intervention.

58 GEOSCIENCES↗
DOE OSTI2025

ARMing the Edge: Demonstration of Edge Computing Field Campaign Report

Edge computing enables “next-to-instrument” control and intelligent data volume reduction and the potential for autonomous, adaptive measurement strategies such as for automated control of scan strategies for Doppler lidar (DL). Instruments with narrow bandwidth connections (e.g., ship and remote sites) can do scene determination and save phenomenon-appropriate data. For example, Doppler spectrum can be saved when clouds are detected by the instrument or automatic moment detection can take place in camera images and only preserve spectrum when non-monomodal spectra are detected. Automated control at the edge involves changing the sampling (temporal or scanning strategy) of an instrument to suit the phenomena both present and being studied (Jackson et al. 2020). Both data processing and instrument control introduces the possibility of a software-defined instrument.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Bolometric Superconducting Optical Nanoscopy (BOSON)

Superconducting transition-edge sensors are renowned for their extraordinary photon sensitivity and energy resolution, finding applications spanning quantum information, astronomy, and nanophotonics. Here, we report the development of bolometric superconducting optical nanoscopy (BOSON), a novel platform that integrates bolometric detection at the superconducting transition edges with near-field optical techniques. BOSON enables the mapping of photoinduced changes in superconductivity with unprecedented spatial resolution and photon sensitivity. By incorporating BOSON with low-dimensional materials, we achieved polariton imaging at nanowatt excitation levels—at least 4 orders of magnitude lower than the power typically required in prior near-field nanoscopy experiments. Our findings highlight the potential for BOSON to advance scanning-probe-based optical platforms to enable the detection of photons, polaritons, and Cooper pair dynamics at the nanoscale. This paves the way for quantum sensing applications using single-polariton detection and can offer deeper insights into quasiparticle dynamics.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Estimation of cutting tool wear using an elastomeric tactile sensor

Machining performance of cutting tools and part quality are affected by the geometric condition of the cutting edge, which is influenced by thermomechanical loads experienced during the process. Tool condition monitoring (TCM) systems provide insight for timely replacement of cutting tools. However, existing TCM systems are expensive and require specialized equipment or sensors, hindering widespread adoption. A novel TCM system is developed herein using an elastomeric tactile sensor. Sensor images of the cutting edge are used to quantify wear using two distinct algorithms. In the first algorithm, the unworn and worn edges are identified based on Canny edge detect. In the second, the unworn edge is identified using edge detection while the region of wear is identified using a relative intensity method. In both cases, the maximum wear width is calculated based on an experimentally determined pixel to-physical distance scale. The TCM system is first used to estimate flank wear on a solid carbide helical end mill before evaluating its robustness by employing it to estimate insert wear of an indexable helical end mill. Measurements are also performed manually using an optical microscope and a high-resolution focus variation microscope for verification. The novel technique estimates flank wear in the solid carbide tool with a high accuracy of 98%. Larger discrepancies are observed for the inserts, however, with overlapping uncertainties. In conclusion, the technique shows promise in adaptability, automation, and closed loop control of machine tools.

Machining↗
DOE OSTI2026

The Double-edged Sword of Data-driven Super-Resolution: Adversarial Super-resolution Models

Data-driven super-resolution (SR) methods are often integrated into imaging pipelines as preprocessing steps to improve downstream tasks such as classification and detection. However, these SR models introduce a previously unexplored attack surface into imaging pipelines. In this paper, we present AdvSR, a framework demonstrating that adversarial behavior can be embedded directly into SR model weights during training, requiring no access to inputs at inference time. Unlike prior attacks that perturb inputs or rely on backdoor triggers, AdvSR operates entirely at the model level. By jointly optimizing for reconstruction quality and targeted adversarial outcomes, AdvSR produces models that appear benign under standard image quality metrics while inducing downstream misclassification. We evaluate AdvSR on three SR architectures (SRCNN, EDSR, SwinIR) paired with a YOLOv11 classifier and demonstrate that AdvSR models can achieve high attack success rates with minimal quality degradation. These findings highlight a new model-level threat for imaging pipelines, with implications for how practitioners source and validate models in safety-critical applications.

Sullivan, Haley [ORNL] (ORCID:0000000274069217)↗
NASA NTRS2026

A Multi-Tier Autonomous Aerial Architecture for Wildfire Detection, Characterization, and Communication in Infrastructure-Denied Environments

Wildfire response depends on how fast an ignition can be confirmed and located, especially in remote regions where ground-based communication and monitoring may be limited. Geostationary sensors provide frequent observations but at kilometer-scale resolution, which is too coarse to resolve small fires in remote terrain. Ground camera networks require sightlines and infrastructure that back-country areas lack. To address these limitations, this work proposes a Multi-Tier Autonomous Wildfire Intelligence System that combines wide-area monitoring with targeted, high-resolution sensing. A solar-powered high-altitude long endurance (HALE) platform operating at approximately 60,000 ft provides persistent wide-area thermal and optical surveillance, running onboard edge inference to screen candidate ignitions and reduce false positives and downlink bandwidth. When a candidate ignition is detected, low-altitude uncrewed aircraft systems (UAS) can be deployed to conduct localized observations, including high-resolution imaging and atmospheric measurements such as wind and plume observation. By combining persistent detection with local sensing, the proposed architecture is designed to provide first responders with timely, high-resolution information about fire location and behavior to aid in emergency decision making.

Wildfire management, UAS, drones↗
DOE OSTI2026

On the formation of swelling and related flaws in laser powder bed fusion

Process monitoring in laser powder bed fusion additive manufacturing can provide insights into stochastic anomalies, melt pool and plume dynamics, and part quality. Swelling, a build anomaly where overbuilt material protrudes through the powder layer after recoating, is readily detectable in post-recoat visible light images of the powder bed. Here, this work identifies several of the underlying mechanisms driving swelling formation by analyzing the influence of processing parameters, laser scan paths, and build plate locations on the presence of swelling detected in situ. Swelling near the edge of the part and swelling in the internal region of the part are shown to correlate with different process conditions. Edge and internal swelling may be driven by different phenomena, with edge swelling predominately occurring on the edge of a part facing the laser module and correlated to clusters of near-surface voids (detected with X-ray computed tomography). A larger spot size, higher laser power, and lower scan velocity also increased the presence of edge swelling. Laser spot size and scan path influenced internal swelling, which occurred preferentially with a larger spot size and in regions with large melt pools, caused by localized heat accumulation due to non-optimal processing parameters or scan path strategies. For coupons processed with a slicer-defined maximum scan vector length, swelling seldom occurred at internal vector-stripe boundaries. These results provide a mechanistic understanding of how swelling can be linked to material flaws, insight into how some instances of swelling can be avoided, and evidence supporting the use of swelling as an in situ indicator for quality assurance and part qualification.

Anomaly↗
DOE OSTI2025

Soft x-ray spectroscopy of ammonium sulfate aerosols at varied pH conditions

Aqueous aerosols are useful model systems for understanding the physical chemistry that takes place in the Earth’s atmosphere, as well as the chemistry of other solar system objects. Ammonium sulfate aerosols are impacted by anthropogenic sources such as farming and shipping and are understood to be important seeds of cloud nucleation in the atmosphere, affecting climate. X-ray photoelectron spectroscopy and near edge x-ray absorption fine structure spectroscopy were used in tandem to probe the surface and bulk properties of aqueous (NH 4 ) 2 SO 4 , respectively. Aerosolized solutions of (NH 4 ) 2 SO 4 , some altered with NaOH to modify pH, were introduced via an aerodynamic lens to a velocity map imaging instrument for detection. The results show that as pH and sodium cation concentration increase, sulfate anion and ammonia become more prevalent at the surface, and the aerosol surface appears to become drier. However, most of the aerosol remains aqueous, with ion concentrations insensitive to the addition of NaOH. Density functional theory calculations were also performed to probe the coordination environment at the aerosol surfaces to understand the underlying phenomena. Finally, the changes seen on the surface of the aerosol underscore the importance of pH in regulating the structure and chemical properties of atmospherically relevant aerosols.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Strong ultrafast nonlinear optical response from megaelectronvolt electrons in semiconductors

Understanding radiation–matter interactions on ultrafast timescales is essential for radiation detection technologies, particularly those requiring precise timing, such as plasma monitoring, synchrotron diagnostics and medical imaging. However, the detection of highly ionizing radiation is challenging due to the stochastic nature of the interactions, resulting in dispersed energy deposition. Here we show a nonlinear optical response in semiconductors induced by 150-fs, 4.2-MeV electrons that generate highly localized charge carriers. The induced sub-10-ps optical modulation reached up to 24.5%, accompanied by a blueshift in the absorption edge consistent with band filling and carrier densities of 10 18 cm −3 . These carrier densities are 100-fold higher than expected from the deposited energy, indicating the extreme spatial localization of carriers at inelastic collisions along the ionization trajectories, thereby leading to the observed modulation. The strong nonlinearity of the MeV-electron-induced optical response enables the precise spatiotemporal detection of ionizing radiation at room temperature using common semiconductors and laser systems.

Jeong, D. [Stanford Univ., CA (United States)] (OR↗
DOE OSTI2025

FIRM image analysis: A machine learning workflow for quantifying extracellular matrix components from electron microscopy images

The extracellular matrix (ECM) is a complex network of biomolecules that plays an integral role in the structure, processes, and signaling mechanisms of cells and tissues. Identifying and quantifying changes in these matrix components provides insight into the mechanisms behind specific tissue remodeling processes; however, quantifying these changes is challenging due to difficult imaging conditions, complexity of the ECM, and the subtlety of these changes. Current imaging techniques allow us to visualize these critical remodeling events and developments in image analysis have employed a combination of analysis software and machine learning techniques to improve the efficiency and accuracy with which features are measured. Although image analysis has seen much improvement in recent years, there has been no technique developed to address ambiguity in feature edges in electron microscopy images. Presented here is a new machine learning-based workflow for the analysis of microscopy images named FIRM (Feature Identification from Raw Microscopy) that uses a random forest classifier to identify ECM features of interest and generate binary segmentation masks for quantification with ImageJ-FIJI. FIRM performed with an F1 score of 0.794 and greater than 80% accuracy for number and size of features detected. FIRM had similar deviation from the ground truth in the number of identified fibrils, fibril size, and size distributions when compared to human analyses. The results suggest that FIRM performs as well as manual analysis and requires a fraction of the time. This analysis technique is more efficient, eliminates user bias, and can be easily optimized to identify a variety of features, making it useful for any discipline requiring image analysis.

Science & Technology - Other Topics↗
DOE OSTI2025

Robust Spectral Anomaly Detection in EELS Spectral Images via 3D Convolutional Variational Autoencoders

Abstract A 3D Convolutional Variational Autoencoder (3D‐CVAE) is introduced for automated anomaly detection in electron energy‐loss spectroscopy spectrum imaging (EELS‐SI) data. This approach leverages the full 3D structure of EELS‐SI data to detect subtle spectral anomalies while preserving both spatial and spectral correlations across the datacube. By employing cross‐entropy loss and training on bulk spectra, the model learns to reconstruct bulk features characteristic of the defect‐free material. In exploring methods for anomaly detection, both the 3D‐CVAE approach and principal component analysis (PCA) are evaluated, testing their performance using FeL‐edge ΔEpeak shifts designed to simulate material defects. These results show that 3D‐CVAE achieves superior anomaly detection and maintains consistent performance across various shift magnitudes. The method demonstrates clear bimodal separation between bulk and anomalous spectra, enabling reliable classification. Further analysis verifies that lower‐dimensional representations are robust to anomalies in the data. While performance advantages over PCA diminish with decreasing anomaly concentration, our method maintains high reconstruction quality even in challenging, noise‐dominated spectral regions. This approach provides a robust framework for unsupervised automated detection of spectral anomalies in EELS‐SI data, particularly valuable for analyzing complex material systems.

Chemistry↗