Search NASA⌕ Search

SEARCH · Search NASA

Results for “Computer Vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

A Public Data Set of Auto-Generated Geotagged PV Site Equipment, Generated via Deep Learning

In this research, we present a data set over 100 photovoltaic (PV) sites in TX, which have been automatically geotagged via a fully autonomous deep learning (DL) pipeline. Specifically, locations of inverters, tracker/fixed tilt rows, batteries, and substations are labeled algorithmically. To ensure high data quality, all systems have been reviewed manually and any deep learning errors have been corrected. This public data set, as well as the open-sourced pipeline used to generate it, is valuable for site planning, modelling, and insurance purposes. Given time and resources, we hope to extend the data set to additional states/regions in the US.

14 SOLAR ENERGY↗
DOE OSTI2017

In Situ Height and Width Estimation of Sorghum Plants from 2.5d Infrared Images

Plant phenotyping, or the measurement of plant traits such as stem width and plant height, is a critical step in the development and evaluation of higher yield biofuel crops. Phenotyping allows biologists to quantitatively estimate the biomass of plant varieties and therefore their potential for biofuel production. Manual phenotyping is costly, time-consuming, and errorprone, requiring a person to walk through the fields measuring individual plants with a tape measure and notebook. In this work we describe an alternative system consisting of an autonomous robot equipped with two infrared cameras that travels through fields, collecting 2.5D image data of sorghum plants. We develop novel image processing based algorithms to estimate plant height and stem width from the image data. Our proposed method has the advantage of working in situ using images of plants from only one side. This allows phenotypic data to be collected nondestructively throughout the growing cycle, providing biologists with valuable information on crop growth patterns. Our approach first estimates plant heights and stem widths from individual frames. It then uses tracking algorithms to refine these estimates across frames and avoid double counting the same plant in multiple frames. The result is a histogram of stem widths and plant heights for each plot of a particular genetically engineered sorghum variety. In-field testing and comparison with human collected ground truth data demonstrates that our system achieves 13% average absolute error for stem width estimation and 15% average absolute error for plant height estimation.

09 BIOMASS FUELS↗
DOE OSTI2023

The advanced characterization, post-irradiation examination, and materials informatics for the development of ultra high-burnup annular U-10Zr metallic fuel

U-Zr metallic fuel is a promising fuel candidate for Gen Ⅳ fast spectrum reactors. Previous experimental irradiation campaigns showed that the sodium thermal bonded U-10Zr fuel design can achieve a burnup of 10% fissions per initial heavy metal atom (FIMA). Advanced metallic fuel designs are pushing the burnup limit to 20% or even 30% FIMA. To achieve the higher burnup and eliminate the pyrophoric sodium, a prototypical annular fuel has been designed, fabricated, clad with HT-9 in the Materials and Fuels Complex, and irradiated in the Advanced Test Reactors of Idaho National Laboratory (INL) to a peak burnup of 3.3% FIMA. During irradiation, the mechanical contact between fuel and cladding acts as a thermal bond. The irradiation lasted for 132 days in the reactor. Recently, the archived fresh and irradiated fuel samples were characterized using advanced characterization capabilities in the Irradiated Materials Characterization Laboratory (IMCL) of INL. This article summarizes the results of advanced characterization and computer vision-based materials informatics to reveal the irradiation effects on U-Zr metallic fuel. Future work will focus on further implementation of advanced characterization and statistical data mining to improve the fidelity of fuel performance modeling and support U-Zr metallic fuel qualification for fast spectrum reactors.

Yao, Tiankai↗
DOE OSTI2020

Tracking Robot Location for Non-Destructive Evaluation of Double-Shell Tanks

(1) Background: Non-destructive evaluation of double-shell nuclear-waste storage tanks at the U.S. Department of Energy’s Hanford site requires a robot to navigate a network of air slots in the confined space between primary and secondary tanks. Situational awareness, data collection, and data interpretation require continuous tracking of the robot’s location. (2) Methods: Robot location is continuously monitored using video image analysis for short distances and laser ranging for absolute location. (3) Results: The technique was demonstrated in our laboratory using a mockup of air slot and robot. (4) Conclusions: Location tracking and display provide decision support to inspectors and lay the groundwork for automated data collection.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Microstructure of Neutron-Irradiated Al 3 Hf-Al Thermal Neutron Absorber Materials

A thermal neutron-absorbing metal matrix composite (MMC) comprised of Al 3 Hf particles in an aluminum matrix was developed to filter out thermal neutrons and create a fast flux environment for material testing in a mixed-spectrum nuclear reactor. Intermetallic Al 3 Hf particles capture thermal neutrons and are embedded in a highly conductive aluminum matrix that provides conductive cooling of the heat generated due to thermal neutron capture by the hafnium. These Al 3 Hf-Al MMCs were fabricated using powder metallurgy via hot pressing. The specimens were neutron-irradiated to between 1.12 and 5.38 dpa and temperatures ranging from 286 °C to 400 °C. The post-irradiation examination included microstructure characterization using transmission electron microscopy (TEM) and energy-dispersive X-ray spectroscopy. This study reports the microstructural observations of four irradiated samples and one unirradiated control sample. All the samples showed the presence of oxide at the particle–matrix interface. The irradiated specimens revealed needle-like structures that extended from the surface of the Al 3 Hf particles into the Al matrix. An automated segmentation tool was implemented based on a YOLO11 computer vision-based approach to identify dislocation lines and loops in TEM images of the irradiated Al-Al 3 Hf MMCs. This work provides insight into the microstructural stability of Al 3 Hf-Al MMCs under irradiation, supporting their consideration as a novel neutron absorber that enables advanced spectral tailoring.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Identifying Critical Infrastructure in Imagery Data Using Explainable Convolutional Neural Networks

To date, no method utilizing satellite imagery exists for detailing the locations and functions of critical infrastructure across the United States, making response to natural disasters and other events challenging due to complex infrastructural interdependencies. This paper presents a repeatable, transferable, and explainable method for critical infrastructure analysis and implementation of a robust model for critical infrastructure detection in satellite imagery. This model consists of a DenseNet-161 convolutional neural network, pretrained with the ImageNet database. The model was provided additional training with a custom dataset, containing nine infrastructure classes. The resultant analysis achieved an overall accuracy of 90%, with the highest accuracy for airports (97%), hydroelectric dams (96%), solar farms (94%), substations (91%), potable water tanks (93%), and hospitals (93%). Critical infrastructure types with relatively low accuracy are likely influenced by data commonality between similar infrastructure components for petroleum terminals (86%), water treatment plants (78%), and natural gas generation (78%). Local interpretable model-agnostic explanations (LIME) was integrated into the overall modeling pipeline to establish trust for users in critical infrastructure applications. The results demonstrate the effectiveness of a convolutional neural network approach for critical infrastructure identification, with higher than 90% accuracy in identifying six of the critical infrastructure facility types.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Vehicle Localization in 3D World Coordinates Using Single Camera at Traffic Intersection

Optimizing traffic control systems at traffic intersections can reduce the network-wide fuel consumption, as well as emissions of conventional fuel-powered vehicles. While traffic signals have been controlled based on predetermined schedules, various adaptive signal control systems have recently been developed using advanced sensors such as cameras, radars, and LiDARs. Among these sensors, cameras can provide a cost-effective way to determine the number, location, type, and speed of the vehicles for better-informed decision-making at traffic intersections. In this research, a new approach for accurately determining vehicle locations near traffic intersections using a single camera is presented. For that purpose, a well-known object detection algorithm called YOLO is used to determine vehicle locations in video images captured by a traffic camera. YOLO draws a bounding box around each detected vehicle, and the vehicle location in the image coordinates is converted to the world coordinates using camera calibration data. During this process, a significant error between the center of a vehicle’s bounding box and the real center of the vehicle in the world coordinates is generated due to the angled view of the vehicles by a camera installed on a traffic light pole. As a means of mitigating this vehicle localization error, two different types of regression models are trained and applied to the centers of the bounding boxes of the camera-detected vehicles. The accuracy of the proposed approach is validated using both static camera images and live-streamed traffic video. Based on the improved vehicle localization, it is expected that more accurate traffic signal control can be made to improve the overall network-wide energy efficiency and traffic flow at traffic intersections.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Multi-Task Learning of Scanning Electron Microscopy and Synthetic Thermal Tomography Images for Detection of Defects in Additively Manufactured Metals

One of the key challenges in laser powder bed fusion (LPBF) additive manufacturing of metals is the appearance of microscopic pores in 3D-printed metallic structures. Quality control in LPBF can be accomplished with non-destructive imaging of the actual 3D-printed structures. Thermal tomography (TT) is a promising non-contact, non-destructive imaging method, which allows for the visualization of subsurface defects in arbitrary-sized metallic structures. However, because imaging is based on heat diffusion, TT images suffer from blurring, which increases with depth. We have been investigating the enhancement of TT imaging capability using machine learning. In this work, we introduce a novel multi-task learning (MTL) approach, which simultaneously performs the classification of synthetic TT images, and segmentation of experimental scanning electron microscopy (SEM) images. Synthetic TT images are obtained from computer simulations of metallic structures with subsurface elliptical-shaped defects, while experimental SEM images are obtained from imaging of LPBF-printed stainless-steel coupons. MTL network is implemented as a shared U-net encoder between the classification and the segmentation tasks. Results of this study show that the MTL network performs better in both the classification of synthetic TT images and the segmentation of SEM images tasks, as compared to the conventional approach when the individual tasks are performed independently of each other.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Mapping Benthic Habitat Conditions and Seafloor Deposits using Sediment Profile Imaging and a Semiautomated Image Processing System

Objectives/Scope: Sediment profile imaging (SPI) technology characterizes in situ physical, geochemical, and biological seafloor features. SPI was required by Mexico’s Agency for Safety, Energy, and Environment in 2017 for environmental baseline surveys (EBS) of oil lease blocks in the southern Gulf of Mexico. Because of its ability to provide information on benthic community health and the distribution of very thin (down to the centimeter scale) layers of deposited materials, SPI technology is highly effective for mapping drill cuttings or drilling muds released around wellheads during exploration or production and documenting their ecological impacts. SPI technology has not been widely used in the oil and gas industry for EBS or other monitoring activities. A primary objective of this work is to improve the transparency and consistency of the SPI data generation and data management process. Methods, Procedures, Process: The SPI camera works like an inverted periscope and obtains an undisturbed 21x15-cm cross-sectional image of the upper sediment column. The camera is internally powered and can be deployed rapidly from a standard winch in depths to 4,000 m. Many stations can be sampled in a single day by “pogo-sticking” across a survey area. Sediment grain size, penetration depth, surface boundary roughness, natural and anthropogenic depositional layers, depth of the oxidized surface sediment layer, maximum biogenic mixing depth, and infaunal successional stage can be directly measured at sea or immediately following the cruise. Final SPI data sets can be provided within a few weeks of the survey. Results, Observations, Conclusions: Details on the features measured in SPI images and the underlying interpretive paradigms are presented. To standardize the SPI data generation process, Integral Consulting Inc. has developed 1) a semiautomated image analysis platform, and 2) a SPI data-specific database architecture that allows both numerical and non-numerical metrics to be incorporated into a standard database structure. An integrated, software-based SPI analysis platform has been developed that imports image files and metadata and provides a graphical user interface. The software automatically stores the data, which can then be reviewed for quality assurance, plotted, statistically analyzed, and mapped or exported to other platforms (e.g., Esri ArcGIS©) for further evaluation. Image processing algorithms have been developed using a combination of open-source and commercially available software packages (e.g., MATLAB® and OpenCV) to automatically quantify key parameters. Novel/Additive Information: SPI technology’s underutilization in the oil and gas industry may be in part due to a lack of standardization in the measurement of basic features in SPI images. A primary objective of this work is to develop a streamlined, standardized, and transparent process for generating and managing SPI data.

02 PETROLEUM↗
DOE OSTI2026

Commercialization of Reflected Target Non-Intrusive Assessment (ReTNA) Tool, for Indoor Optical Analysis of Heliostats

Under HelioCon, NLR began developing a new optical measurement system, called Reflected Target Non-Intrusive Assessment (ReTNA). ReTNA has shown promise towards addressing metrology gaps for heliostat used in concentrated solar thermal (CST) plant. This project is focused on advancing this measurement system from the laboratory into industry, where it can provide valuable information for heliostat developers during research, development, and qualification of a heliostat design, and be used for quality assurance during heliostat manufacture. Over the course of this project, ReTNA was deployed at several commercial heliostat facilities. The system developed and deployed with the primary project partner, Solar Dynamics LLC, is described in detail. The report discusses each project Milestone, the ending status, the achieved value, and how these Milestones improve and qualify the ReTNA measurement tool. Finally, the final report covers the market advancements, path forward, commercial successes, and lessons learned. Final Technical report for TCF Base Technology-Specific project TCF-23-20118, Commercialization of Reflected Target Non-Intrusive Assessment (ReTNA) tool, for indoor optical analysis of Heliostats.

14 SOLAR ENERGY↗
DOE OSTI2021

Data supporting manuscript from L. Sheneman, G. Stephanopoulos, A.E. Vasdekis titled "Deep learning classification of lipid droplets in quantitative phase images" as currently under review at PLOS ONE. This includes: 1) raw and binary labeled Quantitative Phase Images (QPI) of Y. lipolytica cells used in the analyses described within the manuscript. 2) various derived data including classifier scores, etc.

Data supporting manuscript from L. Sheneman, G. Stephanopoulos, A.E. Vasdekis titled "Deep learning classification of lipid droplets in quantitative phase images" as currently under review at PLOS ONE. This includes: 1) raw and binary labeled Quantitative Phase Images (QPI) of Y. lipolytica cells used in the analyses described within the manuscript. 2) various derived data including classifier scores, etc.

ANN↗
NASA NTRS1988

Image Control In Automatic Welding Vision System

Orientation and brightness varied to suit welding conditions. Commands from vision-system computer drive servomotors on iris and Dove prism, providing proper light level and image orientation. Optical-fiber bundle carries view of weld area as viewed along axis of welding electrode. Image processing described in companion article, "Processing Welding Images for Robot Control" (MFS-26036).

Richardson, Richard W.↗
NASA NTRS1990

Pyramid image codes

All vision systems, both human and machine, transform the spatial image into a coded representation. Particular codes may be optimized for efficiency or to extract useful image features. Researchers explored image codes based on primary visual cortex in man and other primates. Understanding these codes will advance the art in image coding, autonomous vision, and computational human factors. In cortex, imagery is coded by features that vary in size, orientation, and position. Researchers have devised a mathematical model of this transformation, called the Hexagonal oriented Orthogonal quadrature Pyramid (HOP). In a pyramid code, features are segregated by size into layers, with fewer features in the layers devoted to large features. Pyramid schemes provide scale invariance, and are useful for coarse-to-fine searching and for progressive transmission of images. The HOP Pyramid is novel in three respects: (1) it uses a hexagonal pixel lattice, (2) it uses oriented features, and (3) it accurately models most of the prominent aspects of primary visual cortex. The transform uses seven basic features (kernels), which may be regarded as three oriented edges, three oriented bars, and one non-oriented blob. Application of these kernels to non-overlapping seven-pixel neighborhoods yields six oriented, high-pass pyramid layers, and one low-pass (blob) layer.

Watson, Andrew B.↗
NASA NTRS1990

Flight data acquisition methodology for validation of passive ranging algorithms for obstacle avoidance

An account is given of the methodology used to develop a data base containing low altitude imagery, augmented with the rotorcraft and sensor parameters required for passive-range estimation. The bata base is predicated on flight test data encompassing imagery, rotorcraft and sensor parameters, and ground truth range measurements. Data preparation was conducted by means of a novel technique for obtaining the sensor-calibration parameters. The data-base thus obtained will facilitate further development of computer vision-based obstacle-detection and passive range-estimation algorithms, as well as furnish a benchmark for verification of range estimates against ground-truth estimates.

Smith, Phillip N.↗