Search NASA⌕ Search

SEARCH · Search NASA

Results for “image detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Detection of Obstacles in Monocular Image Sequences

The ability to detect and locate runways/taxiways and obstacles in images captured using on-board sensors is an essential first step in the automation of low-altitude flight, landing, takeoff, and taxiing phase of aircraft navigation. Automation of these functions under different weather and lighting situations, can be facilitated by using sensors of different modalities. An aircraft-based Synthetic Vision System (SVS), with sensors of different modalities mounted on-board, complements the current ground-based systems in functions such as detection and prevention of potential runway collisions, airport surface navigation, and landing and takeoff in all weather conditions. In this report, we address the problem of detection of objects in monocular image sequences obtained from two types of sensors, a Passive Millimeter Wave (PMMW) sensor and a video camera mounted on-board a landing aircraft. Since the sensors differ in their spatial resolution, and the quality of the images obtained using these sensors is not the same, different approaches are used for detecting obstacles depending on the sensor type. These approaches are described separately in two parts of this report. The goal of the first part of the report is to develop a method for detecting runways/taxiways and objects on the runway in a sequence of images obtained from a moving PMMW sensor. Since the sensor resolution is low and the image quality is very poor, we propose a model-based approach for detecting runways/taxiways. We use the approximate runway model and the position information of the camera provided by the Global Positioning System (GPS) to define regions of interest in the image plane to search for the image features corresponding to the runway markers. Once the runway region is identified, we use histogram-based thresholding to detect obstacles on the runway and regions outside the runway. This algorithm is tested using image sequences simulated from a single real PMMW image.

Kasturi, Rangachar↗

Utilization of an Airborne Plant Chlorophyll Imaging System for Detection of Septic System Malfunction

Malfunctioning, or leaking, sewer systems increase the supply of water and nutrients to surface vegetation. Excess nutrients and harmful bacteria in the effluent pollute ground water and local water bodies and are dangerous to humans and the aquatic ecosystems. An airborne multispectral plant chlorophyll imaging system (PCIS) was used to identify growth patterns in the vegetation covering onsite and public sewer systems. The objective was to evaluate overall performance of the PCIS as well as to determine the best operational configuration for this application. The imaging system was flown in a light aircraft over selected locations Mobile County, Alabama. Calibration panels were used to help characterize instrument performance. Results demonstrated that the PCIS performed well and was capable of detecting septic leakage patterns from altitudes as high as 915 m. From 915 m, 6 of 18 sites were suspected to have sewage leakage. Subsequent ground inspections confirmed leakage on 3 of the 6 sites. From 610 m, 3 of 8 known leakage sites were detected. Tree cover and shadows near residential structures prevented detection of several known malfunctioning systems. Also some leakages known to occur in clear areas were not detected. False detections occurred in areas characterized by surface water drainage problems or recent excavation.

Spiering, Bruce A.↗

Fully Integrated Ultra-thin Intraoperative Micro-imager for Cancer Detection Using Upconverting Nanoparticles

Abstract Purpose Intraoperative detection and removal of microscopic residual disease (MRD) remain critical to the outcome of cancer surgeries. Today’s minimally invasive surgical procedures require miniaturization and surgical integration of highly sensitive imagers to seamlessly integrate into the modern clinical workflow. However, current intraoperative imagers remain cumbersome and still heavily dependent on large lenses and rigid filters, precluding further miniaturization and integration into surgical tools. Procedures We have successfully engineered a chip-scale intraoperative micro-imager array—without optical filters or lenses—integrated with lanthanide-based alloyed upconverting nanoparticles (aUCNPs) to achieve tissue imaging using a single micro-chip. This imaging platform is able to leverage the unique optical properties of aUCNPs (long luminescent lifetime, high-efficiency upconversion, no photobleaching) by utilizing a time-resolved imaging method to acquire images using a 36-by-80-pixel, 2.3 mm $$\times$$ × 4.8 mm silicon-based electronic imager micro-chip, that is, less than 100-µm thin. Each pixel incorporates a novel architecture enabling automated background measurement and cancellation. We have validated the performance, spatial resolution, and the background cancellation scheme of the imaging platform, using resolution test targets and mouse prostate tumor sample intratumorally injected with aUCNPs. To demonstrate the ability to image MRD, or tumor margins, we evaluated the imaging platform in visualizing a single-cell thin section of the injected prostate tumor sample. Results Tested on USAF resolution targets, the imager is able to achieve a resolution of 71 µm. We have also demonstrated successful background cancellation, achieving a signal-to-background ratio of 8 when performing ex vivo imaging on aUCNP-injected prostate tumor sample, improved from originally 0.4. The performance of the imaging platform on single-cell layer sections was also evaluated and the sensor achieved a signal-to-background ratio of 4.3 in resolving cell clusters with sizes as low as 200 cells. Conclusion The imaging system proposed here is a scalable chip-scale ultra-thin alternative for bulky conventional intraoperative imagers. Its novel pixel architecture and background correction scheme enable visualization of microscopic-scale residual disease while remaining completely free of lenses and filters, achieving an ultra-miniaturized form factor—critical for intraoperative settings.

59 BASIC BIOLOGICAL SCIENCES↗

Ice Sheet Change Detection by Satellite Image Differencing

Differencing of digital satellite image pairs highlights subtle changes in near-identical scenes of Earth surfaces. Using the mathematical relationships relevant to photoclinometry, we examine the effectiveness of this method for the study of localized ice sheet surface topography changes using numerical experiments. We then test these results by differencing images of several regions in West Antarctica, including some where changes have previously been identified in altimeter profiles. The technique works well with coregistered images having low noise, high radiometric sensitivity, and near-identical solar illumination geometry. Clouds and frosts detract from resolving surface features. The ETM(plus) sensor on Landsat-7, ALI sensor on EO-1, and MODIS sensor on the Aqua and Terra satellite platforms all have potential for detecting localized topographic changes such as shifting dunes, surface inflation and deflation features associated with sub-glacial lake fill-drain events, or grounding line changes. Availability and frequency of MODIS images favor this sensor for wide application, and using it, we demonstrate both qualitative identification of changes in topography and quantitative mapping of slope and elevation changes.

Bindschadler, Robert A.↗

Lenslet Array to Further Suppress Star Light for Direct Exoplanet Detection

Direct imaging plays a key role in the detection and characterization of exoplanets orbiting within its host star's habitable zone. Many innovative ideas for starlight suppression and wavefront control have been proposed and developed over the past decade. However, several technological challenges still lie ahead to achieve the required contrast, including controlling the observatory pointing performance, fabricating occulting masks with tight optical tolerances, developing wavefront control algorithms, controlling stray light, advancing single photon detecting detectors, and integrated system-level issues. This paper explores how a lenslet array and pinhole mask may be implemented to further suppress uncorrected starlight that leaks through the occulting mask. An external occulter, or star shade, is simulated to demonstrate this concept, although this approach can be implemented for internal coronagraphs as well. We describe how to use simple relay optics to control the scene near the inner working angle and the level of the suppression expected. Furthermore, if the lenslet array is the input to an integral field spectrograph, as planned for the WFIRST mission, the spectral content of the exoplanet atmospheres can be obtained to determine if the observed planet is habitable and ultimately, if it is inhabited.

Integral Field spectrograph↗

IBIS: An Interferometer-Based Imaging System for Detecting Extrasolar Planets with a Next Generation Space Telescope

The direct detection of extrasolar planetary systems is a challenging observational objective. The observing system must be able to detect faint planetary signals against the background of diffracted and scattered starlight, zodiacal light, and in the IR, mirror thermal radiation. As part of a JPL study, we concluded that the best long-term approach is a 10-20 m filled-aperture telescope operating in the thermal IR (10-15 microns). At these wavelengths, the star/planet flux ratio is on the order of 10(exp 6)-10(exp 8). Our study supports the work of Angel et al., who proposed a cooled 16-m IR telescope and a special apodization mask to suppress the stellar light within a limited angular region around the star. Our scheme differs in that it is capable of stellar suppression over a much broader field-of- view, enabling more efficient planet searches. To do this, certain key optical signal-processing components are needed, including a coronagraph to apodize the stellar diffraction pattern, an infrared interferometer to provide further starlight suppression, a complementary visible-wavelength interferometer to sense figure errors in the telescope optics, and a deformable mirror to adaptively compensate for these errors. Because of the central role of interferometry we have designated this concept the Interferometer-Based Imaging System (IBIS). IBIS incorporates techniques originally suggested by Ken Knight for extrasolar planet detection at visible wavelengths. The type of telescope discussed at this workshop is well suited to implementation of the IBIS concept.

Diner, David J.↗

Wellbore Fracture Imaging Using Inflow Detection Measurements

One of the most striking measurements taken during DOE’s EGS Collab project at the 4850-foot depth location was the so-called ‘sewer cam’, which enabled direct visualization of the flow of water into the production well through fractures during the stimulation. The ability to see directly which fractures were flowing and (roughly) how much was a breakthrough in understanding the topology of the created fracture network. Achieving this kind of fracture flow imaging at FORGE would be more challenging because of the 225°C temperature, but equally or even more valuable if it could be achieved. In 2017, a joint project between Sandia and Stanford developed a downhole tool concept to measure the enthalpy of multiphase fluid entering a geothermal well from individual fractures (Gao et al., 2017). For the FORGE project, measuring enthalpy is of less interest because the fluid is expected to be single-phase liquid water. However, the foundation of the device was the measurement of chloride ion concentration, which could form the basis for a direct measurement of inflow from fractures. During the 2017 project, this novel chloride sensing system was implemented into a laboratory test instrument, and we confirmed the capability of the system to measure the ion concentration of fluid entering a model wellbore through a small entry port. The wellbore was a 6-inch diameter model well, and the port was approximately 0.08 inch (2mm) in diameter. The device could measure the chloride concentration accurately even when the well was flowing in a bubbly flow. Given its accuracy, the tool should be able to identify locations of water entering the wellbore even if the ion concentration differs only slightly from that of the water in the well. It is likely that different fractures may flow slightly different chloride concentrations, which would make it feasible to detect individual fractures as well as to estimate the volume of their flow. Ultimately, we could also recognize different fractures flowing back significantly different ion concentrations after fracturing in the FORGE wells. This could be realized by adding different ions in the fracturing fluids in different fractures created at different stages of stimulation (and modifying the tool to include different ion specificity). Sandia’s tool was shown during the study to have the capability to withstand the 225°C temperature, and the electrochemical sensing elements were tested in the laboratory to 225°C at 1500 psia for 24 hours. An early implementation of the fully integrated downhole electrochemical tool, including high-temperature electronics, robust housing, and wireline truck interface, had previously been constructed and tested successfully at Sandia; thus, hardware development tasks focused on advancing the technology readiness level (TRL) of this promising technology for FORGE deployment, rather than on developing a new scientific basis for its operation. The data collection electronics in this tool allowed for several other sensors (pressure, temperature, flow spinner) to be implemented in parallel as well. The research was a new collaboration between Stanford and Sandia to modify and refine the tool for FORGE deployment, to make the downhole measurements, and to characterize the evolving fractures.

15 GEOTHERMAL ENERGY↗

Trainable Cataloging for Digital Image Libraries with Applications to Volcano Detection

Users of digital image libraries are often not interested in image data per se but in derived products such as catalogs of objects of interest. Converting an image database into a usable catalog is typically carried out manually at present. For many larger image databases the purely manual approach is completely impractical. In this paper we describe the development of a trainable cataloging system: the user indicates the location of the objects of interest for a number of training images and the system learns to detect and catalog these objects in the rest of the database. In particular we describe the application of this system to the cataloging of small volcanoes in radar images of Venus. The volcano problem is of interest because of the scale (30,000 images, order of 1 million detectable volcanoes), technical difficulty (the variability of the volcanoes in appearance) and the scientific importance of the problem. The problem of uncertain or subjective ground truth is of fundamental importance in cataloging problems of this nature and is discussed in some detail. Experimental results are presented which quantify and compare the detection performance of the system relative to human detection performance. The paper concludes by discussing the limitations of the proposed system and the lessons learned of general relevance to the development of digital image libraries.

digital image libraries, trainable cataloging↗

Incorporating the effects of objects in an approximate model of light transport in scattering media

A computationally efficient radiative transport model is presented that predicts a camera measurement and accounts for the light reflected and blocked by an object in a scattering medium. The model is in good agreement with experimental data acquired at the Sandia National Laboratory Fog Chamber Facility (SNLFC). The model is applicable in computational imaging to detect, localize, and image objects hidden in scattering media. Here, a statistical approach was implemented to study object detection limits in fog.

42 ENGINEERING↗

Development of an Ultrahigh-bandwidth Phase Contrast Imaging System for detection of electron scale turbulence and Gigahertz Radio-Frequency Waves

The study of waves and turbulence is vital to the development of future reactor-grade plasma devices developed in the quest for fusion energy. These fluctuations are responsible for moving heat and particles across the magnetic field, and a predictive understanding of them is needed to achieve the density and temperature required to sustain a plasma fusion reaction. While many techniques have been developed for measuring waves and fluctuations, every measurement method has limitations. There are relatively few techniques for measuring very high frequency fluctuations, such as radio frequency waves injected to heat the plasma, unstable waves driven by suprathermal particles, or short wavelength electrostatic waves driven by electron temperature or density gradients. The present project builds upon the proven phase contrast imaging (PCI) technique to extend the response of the diagnostic by orders of magnitude in frequency and almost a factor of ten in spatial resolution. PCI provides a measurement of electron density based on small angle scattering of a CO-2 laser beam by using optical techniques to render a phase shift as an intensity change on a detector. Due to the telecommunications revolution, technological development by manufacturers has focused on components in the near -infrared, so that high- quality lasers and detectors at 1.55 µm are readily available. Shifting PCI design to a new, shorter wavelength has numerous advantages and challenges. Similar detector performance is available with room-temperature arrays with GHz bandwidth, while the detector arrays for 10.6 µm required liquid nitrogen cooling and were therefore limited to a bandwidth of about 1 MHz. Shifting to a shorter wavelength reduces the angle at which the laser beam scatters off of plasma waves, allowing more such scattered components to pass through the aperture of the vacuum vessel port and be collected by the PCI, which increases the spatial resolution. Concomitant with these benefits, various questions of performance arise. At shorter laser wave- length, the sensitivity to mirror and lens quality is increased, the contribution of the laser to the overall system noise is increased, and the sensitivity to vibrations is increased. The custom optical components at the heart of the PCI technique were required to be properly scaled for the shorter wavelength, so fabrication technologies needed to be explored. This project was designed to show that a low noise, high response PCI system at 1.55 µm could be constructed and operated, and then to quantify potential issues to allow extrapolation to a full-size production system providing physics measurements on a large plasma device. The first stage, producing the custom optical component called a Phase Plate, was successfully achieved using two methods. First, an easily reproduced masking and coating technique was able to produce good phase plates with the required parameters. Second, a nanofabrication technique was found to produce extremely high quality phase plates at a competitive price. The PCI constructed with the new phase plates and 1.55 µm laser was found to provide excellent wavelength measurements with the theoretically expected response. The sensitivity to optical surface quality was found to be in line with previous measurements at 10.6 µm. The observed signal-to-noise ratio was similar to the theoretically expected value. The effect of vibrations on PCI was studied with the first measurement of the effect of beam motion on PCI response and comparison to theory, allowing for a quantitative prediction of the effect of vibrations on a production PCI system and the requirements for improved beam stabilization. PCI is an extremely cost-effective method to provide a low noise, absolutely calibrated measurement of plasma fluctuations across a wide spatial scale. This project has shown that a 1.55 µm PCI using modern techniques and components is less expensive than the 10.6 µm PCI of a few years ago, with the largest savings in phase plate fabrication and the infrared detector array.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

CAMIS: A Cylindrical Active Mask Imaging System

Detecting and locating radiological and nuclear materials at distances of 10 m or more in urban and cluttered environments continues to pose challenges in nuclear security and proliferation detection. Previous approaches have focused on large-area radiation imaging using planar configurations of detectors and passive masks. However, these approaches suffer from limitations such as limited field-of-view (FOV) and reduced detection efficiency due to absorption in the mask. To address these limitations, we have developed the cylindrical active mask imaging system (CAMIS). This system comprises 128 NaI(Tl) (10 cm)3 detectors. These detectors are arranged in a cylindrical configuration, enabling gamma-ray imaging with a full 360° azimuthal FOV. The active mask elements within the system are arranged in a pseudorandom configuration, providing unique encoding for all incident directions within the FOV. CAMIS offers an effective detection area of approximately 1 m2 across the entire 360° FOV in the horizontal plane, achieving a mean angular resolution of 10.9° in the azimuthal direction and 12.9° in the polar direction measured by taking the full-width at half-maximum (FWHM) of a cross-section at the maximum reconstructed intensity.

Lamb, C↗

RU-net for automatic characterization of TRISO fuel cross sections

During irradiation, phenomena such as kernel swelling and buffer densification may impact the performance of tristructural isotropic (TRISO) particle fuel. Post-irradiation microscopy is often used to identify these irradiation-induced morphologic changes. However, each fuel compact generally contains thousands of TRISO particles. Manually performing the work to get statistical information on these phenomena is cumbersome and subjective. Here, to reduce the subjectivity inherent in that process and to accelerate data analysis, we used convolutional neural networks (CNNs) to automatically segment cross-sectional images of microscopic TRISO layers. CNNs are a class of machine-learning algorithms specifically designed for processing structured grid data. They have gained popularity in recent years due to their remarkable performance in various computer vision tasks, including image classification, object detection, and image segmentation. In this research, we generated a large irradiated TRISO layer dataset with more than 2,000 microscopic images of cross-sectional TRISO particles and the corresponding annotated images. Based on these annotated images, we used different CNNs to automatically segment different TRISO layers. These CNNs include RU-Net (developed in this study), as well as three existing architectures: U-Net, Residual Network (ResNet), and Attention U-Net. The preliminary results show that the model based on RU-Net performs best in terms of Intersection over Union (IoU). Using CNN models, we can expedite the analysis of TRISO particle cross sections, significantly reducing the manual labor involved and improving the objectivity of the segmentation results.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A unified large language model–based framework for heterogeneous PV image diagnosis

With advances in imaging technologies, modern photovoltaic (PV) systems generate large volumes of heterogeneous image data, including visible, electroluminescence (EL), and infrared (IR) images. Existing PV image analysis models, particularly deep learning approaches, are typically task-specific and lack cross-modality generalization. To address this limitation, this paper proposes an open-source large language model (LLM)–based unified framework for heterogeneous PV image diagnostics. Through task-aware diagnostic prompting, the framework enables analysis of visible, EL, and IR images within a single pipeline, supporting both zero-shot and few-shot inference and binary and multiclass classification. It is compatible with state-of-the-art multimodal LLMs, including ChatGPT, Gemini, Claude, Qwen, and CLIP. The framework is evaluated on PV module condition classification (clean, soiling, snow, hail, and bird droppings) using visible images, cell crack detection using EL images, and hotspot detection using IR images. GPT-5.1 in few-shot mode achieves the best performance, with classification accuracy exceeding 97.3%. Open-source models such as Qwen and CLIP also deliver competitive results on visible images (around 90% accuracy), though their performance is more limited on EL and IR modalities. On the full ELPV dataset, the framework achieves 83.5% zero-shot accuracy, within 2.8% of the supervised CNN baseline, confirming scalability to larger benchmarks. Practical aspects such as reproducibility, response latency, and confidence estimation are systematically analyzed. The framework operates across PV image modalities without modality- or task-specific training, making it well suited as a rapid pre-screening tool to support downstream detailed diagnostics. A benchmark dataset of diverse labeled PV images is also released.

Li, Baojie↗