Search NASA⌕ Search

SEARCH · Search NASA

Results for “vision systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Metal sorter

A material sorting system sorts materials utilizing a vision system that implements a machine learning system in order to identify or classify each of the materials, which are then sorted into separate groups based on such an identification or classification determining that the materials are composed of either wrought aluminum, extruded aluminum, or cast aluminum.

Kumar, Nalin↗

Contactless Position Measurement System for Remote Alignment of Highly Reflective Objects

The Contactless Position Measurement System (CPMS) permits automatic alignment of highly-reflecting components that cannot or should not be touched by human hands, such as those used in SRF cavities. CPMS also has application during maintenance of fusion reactors, when the components in the reactor are radioactive. The length of time for which humans can handle the components in order to carry out maintenance or repairs is limited. We would like to measure the relative positions of such objects so we can bring them into alignment with motorized stages, thus eliminating the need for human contact. The CPMS is a computer vision system that measures the location of highly reflective components to within a fraction of a millimeter by finding the edges of silhouette images. This is done by placing a uniform, infrared backlight behind the components, and viewing each component with two low-aberration, infrared cameras. Each of these stereoscopic cameras are located within a coordinate system we set up with reference platforms, light sources, and survey cameras distributed around the perimeter of the string assembly room, or fusion reactor. We obtain stereoscopic silhouette images of each component, and we use these to determine the position of the component within our string assembly coordinate system. The CPMS combines the silhouette images with knowledge of the dimensions of the objects to obtain the relative positions of components in its field of view. These position measurements then allow us to mechanically maneuver the components into contact. Once we know where they are, we can move the components to where they are supposed to be with motorized stages or other mechanical means, check they are in the right place, and bolt them together. In Phase I, we built a prototype infrared backlights and cameras, tested it, wrote an analysis program to fit the images. At a range of 50 cm, we are able to measure the relative positions of two stainless steel flanges with an accuracy of 150 μm rms. The next steps are to test the analysis program with motorized stages, build a full-size prototype, and implement it in an cleanroom with SRF cavity assembly. This can be done in a cost effective way given the materials with which the system is designed. As Open Source Instruments achieved more in Phase I than anticipated, despite not receiving a Phase II SBIR grant, we hope to move forward with product development and sales with a testing partner.

43 PARTICLE ACCELERATORS↗

Method and system for automated plant surveillance and manipulation

A method and a system for automated plant surveillance and manipulation are provided. Pursuant to the method and the system, images of target plants are obtained through a machine vision system having multiple cameras. The obtained images of the target plants are processed to determine tissue candidates of the target plants and to determine a position and an orientation of each tissue candidate. A tool is manipulated, based on the position and the orientation of each tissue candidate, to excise each tissue candidate to obtain tissue samples. The tissue samples are transported for subsequently manipulation including live processing of the tissue samples or destructive processing of the tissue samples.

Kalluri, Udaya C.↗

Sorting between metal alloys

A material sorting system sorts materials utilizing an x-ray fluorescence and/or a vision system that implements a machine learning system in order to identify or classify each of the materials, which are then sorted into separate groups based on such an identification or classification determining that the materials are composed of either wrought aluminum, extruded aluminum, or cast aluminum. The system is capable of sorting between cast aluminum alloys and also between wrought aluminum alloys.

Kumar, Nalin↗

Multiple stage sorting

A material sorting system sorts materials utilizing multiple stages of classification and sorting, including a vision system that implements a machine learning system in order to identify or classify each of the materials, and Laser Induced Breakdown Spectroscopy to perform a subsequent classification and sorting of the remaining materials.

97 MATHEMATICS AND COMPUTING↗

TORONE: Total Characterisation by Remote Observation of Nuclear Environments - 20591

This paper describes the autonomous robotic systems developed in the TORONE project (Total Characterisation by Remote Observation of Nuclear Environments) for combined characterisation by remote techniques in nuclear environments. There are four main components to the system. Firstly, robot operation which uses a Robot Operating System (ROS) allowing ease of communication between hardware and software alongside robot vision systems such as Lidar and/or photogrammetry. Secondly, radiation detection instrumentation for gamma and neutron sources which is also collimated for spatial resolution. Thirdly, photonic characterisation instrumentation for remote material identification by means of Raman spectroscopy and Laser induced breakdown spectroscopy (LIBS). Finally, a data management system is described which contains the TORONE characterisation data with the ability to overlay material characterisation information onto 3D maps of the nuclear environment. Preliminary results are described alongside discussion of some of the synergies of the combined approach. There are many applications of such an autonomous system in nuclear decommissioning, waste management and asset management. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Sorting of plastics

Systems and methods for classifying and sorting of plastic materials utilizing a vision system and one or more sensor systems, which may implement a machine learning system in order to identify or classify each of the materials, which may then be sorted into separate groups based on such an identification or classification.

Kumar, Nalin↗

Automating Testing of DUNE Electronics via a Finite State Machine

The Deep Underground Neutrino Experiment (DUNE) is a flagship international collaboration designed to study neutrinos tiny, nearly massless particles that may hold answers to fundamental questions about the Universe. Fermilab s Robotic Test Stand (RTS) plays a critical role in ensuring the quality of approximately 50,000 Application-Specific Integrated Circuit (ASIC) chips that will be used in DUNE s massive liquid argon detectors. These electronics will be inside the cryostat; therefore, they will need to have a high yield of working chips and low noise. To improve the automation and reliability of the RTS, this project focused on designing and implementing a Python-based finite state machine (FSM) to manage chip handling workflows. The FSM was developed as a modular software framework to coordinate robotic arm movements, manage chip tray positions, and monitor system states during testing. Key features include robust error handling routines, a pause/resume system for safe mid-cycle interruptions, and a simulation mode for iterative testing without hardware dependencies. The system was designed to prepare for seamless integration with RTS hardware components such as the robotic arm and vision system. This integration will streamline collaboration and enable efficient deployment of updates across the six total institutions performing testing. The outcomes of this internship contribute to Fermilab s mission to advance high-energy physics and support the DOE s national goals by directly improving the testing of equipment to be used in DUNE. The project also provided valuable experience in software design and contributing to the success of DUNE.

Kang, Caleb [William Rainey Harper Coll.]↗

Automating Testing of DUNE Electronics via a Finite State Machine

The Deep Underground Neutrino Experiment (DUNE) is a flagship international collaboration designed to study neutrinos—tiny, nearly massless particles that may hold answers to fundamental questions about the Universe. Fermilab’s Robotic Test Stand (RTS) plays a critical role in ensuring the quality of approximately 50,000 Application-Specific Integrated Circuit (ASIC) chips that will be used in DUNE’s massive liquid argon detectors. These electronics will be inside the cryostat; therefore, they will need to have a high yield of working chips and low noise. To improve the automation and reliability of the RTS, this project focused on designing and implementing a Python-based finite state machine (FSM) to manage chip handling workflows. The FSM was developed as a modular software framework to coordinate robotic arm movements, manage chip tray positions, and monitor system states during testing. Key features include robust error handling routines, a pause/resume system for safe mid-cycle interruptions, and a simulation mode for iterative testing without hardware dependencies. The system was designed to prepare for seamless integration with RTS hardware components such as the robotic arm and vision system. This integration will streamline collaboration and enable efficient deployment of updates across the six institutions performing testing. The outcomes of this internship contribute to Fermilab’s mission to advance high-energy physics and support the DOE’s national goals by directly improving the testing of equipment to be used in DUNE. The project also provided valuable experience in software design and contributing to the success of DUNE.

Kang, Caleb [Fermilab]↗

Validation Testing for Molten Chloride Reactor Experiment Equipment Removal and Disposal Techniques

The Molten Chloride Reactor Experiment (MCRE) will be the first reactor featuring a fast-spectrum molten chloride circulating nuclear fuel system in the world. Planning for equipment removal and disposal (ERD) of MCRE has identified several technology gaps due to the unique environment of this nuclear experiment. Some of the gaps arise from the application of existing disassembly and/or sizing methods to novel material forms or in novel configurations. Others arise from unknown material behavior. This paper summarizes proposed test plans for ERD validation experiments to address these complicated or unknown equipment removal procedures. At the Waste Management Symposia in 2024, the Idaho National Laboratory (INL) MCRE ERD team presented the challenges associated with hosting multiple nuclear experiments in series with only brief transition periods between systems. Such difficulties include higher dose rates, the presence of radioisotopes infrequently encountered in reactor decommissioning and radioactive waste management, lack of intrinsic remote-operations infrastructure in the test bed, space constraints in the test bed, and contamination minimization requirements. To address these challenges, remote or semi-remote technologies are planned to be implemented in a non-hot cell environment with limited space availability. The team also discussed how a systems engineering approach is being used for conceptual development and design of equipment removal systems to address these challenges. For example, to reduce constraints for the removal of more difficult components, non-activated, noncontaminated elements are planned to be taken out first where possible. Still, there are complexities associated with the remaining components. In this work, the operational framework for MCRE ERD was reviewed for technical gaps and open questions, and test plans were drafted to address these areas. The tests plans were written for the following categories: vision systems, pipe cutting, drill/grout/filler, flush salt, and miscellaneous, with the miscellaneous group consisting of tests like techniques for removing bearings and reflector bricks. The test plans explore material, infrastructure, and staffing requirements needed for test execution. The test plans additionally focus on the evaluation of success. Determining the outcome of a test is imperative - as these explorative actions have the potential to rearrange or re-scope planned ERD activities. Success criteria identified thus far include required tool output, required area(s), debris production and mitigation, and repeatability. Test plans are an essential aspect of the systems engineering approach to MCRE ERD. They are used as the beginning steps in defining use cases for the ERD system. Performance of the validation tests is expected to begin in the summer of 2025 and will take approximately 9 to 12 months to complete. Execution of these plans will be expedited by specifying test needs ahead of time, facilitating efficient interactions with any subcontractors tasked with running the requested tests. Evaluating the outcomes of these tests will inform MCRE ERD procedures and timing and will also identify additional technical constraints for the MCRE ERD System. This upfront process optimization effort will help the project save time and resources at the end of the experiment.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

Supervised Learning-Based Spatial Position Estimation with Vertical Displacement for Hovering UAV Wireless Power Transfer

This study presents a supervised learning-based spatial position estimation approach for wireless power transfer (WPT) systems supporting hovering unmanned aerial vehicle (UAV) charging. Unlike stationary charging scenarios, hovering UAVs introduce continuous lateral misalignment and vertical displacement, leading to variations in magnetic coupling and reduced power transfer efficiency. To address this challenge, the proposed method estimates the relative spatial position of the receiver coil using only electrical measurements obtained at the secondary side. A supervised learning model is trained to map output voltage and current features to spatial coordinates, enabling position awareness without requiring external sensors, vision systems, or communication links. The sensing functionality is inherently integrated into the WPT system, allowing simultaneous power transfer and localization through the same magnetic interface. Experimental validation is conducted on a laboratory-scale prototype under varying lateral offsets and air-gap conditions. In addition, spline-based interpolation is employed to increase spatial data density for training. The results demonstrate that the proposed framework can capture spatial variations associated with both lateral and vertical displacement, providing reliable position estimation under hovering conditions. This work establishes a hardware-efficient, sensorless solution for UAV wireless charging and serves as a baseline for advanced data-driven position estimation methods in dynamic WPT systems.

Asa, Erdem [ORNL] (ORCID:0000000190884812)↗

Efficient multi-scale representation of visual objects using a biologically plausible spike-latency code and winner-take-all inhibition

Deep neural networks have surpassed human performance in key visual challenges such as object recognition, but require a large amount of energy, computation, and memory. In contrast, spiking neural networks (SNNs) have the potential to improve both the efficiency and biological plausibility of object recognition systems. Here we present a SNN model that uses spike-latency coding and winner-take-all inhibition (WTA-I) to efficiently represent visual stimuli using multi-scale parallel processing. Mimicking neuronal response properties in early visual cortex, images were preprocessed with three different spatial frequency (SF) channels, before they were fed to a layer of spiking neurons whose synaptic weights were updated using spike-timing-dependent-plasticity. We investigate how the quality of the represented objects changes under different SF bands and WTA-I schemes. We demonstrate that a network of 200 spiking neurons tuned to three SFs can efficiently represent objects with as little as 15 spikes per neuron. Furthermore, studying how core object recognition may be implemented using biologically plausible learning rules in SNNs may not only further our understanding of the brain, but also lead to novel and efficient artificial vision systems.

59 BASIC BIOLOGICAL SCIENCES↗

Automated Waterbox Inspection for Nuclear Power Plants Using Computer Vision - Based Change Detection

Nuclear power plant waterboxes require regular inspection for leaks, missing components, and structural damage during maintenance outages. Traditional manual inspection is time-consuming and poses safety risks from confined space entry. We developed an automated computer vision system for drone-based waterbox inspection in partnership with Florida Light and Power. Our approach uses feature detection and matching to identify critical changes between baseline and current inspection images, automatically flagging additions (leaks/debris), removals (missing plugs), and translations (displaced components) while compensating for drone movement and environmental variations. We systematically evaluated six feature matching methods, from classical approaches (SIFT+BF) to state-of-the-art neural networks (SuperPoint+SuperGlue), using both standard benchmarks (HPatches) and waterbox-specific validation with real-world augmentations. SuperPoint+SuperGlue achieved superior performance with 7.82 pixels RMSE and 100% success rate—2.8x better accuracy than our baseline. While the pre-trained model has commercial licensing restrictions for nuclear deployment, our findings validate this architecture for custom training. We implemented a real-time GUI demonstrating the SIFT+BF approach for immediate deployment, processing drone feeds at 30 FPS with color-coded change visualization. Future work includes training a custom SuperPoint+SuperGlue model on waterbox data and integrating Vision-Language Models for automated reporting and maintenance guidance.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

A Benthic Habitat Monitoring Approach for Marine and Hydrokinetic Sites (Final Technical Report)

This final technical report summarizes the work completed as part of the Standardized and Cost-Effective Benthic Habitat Mapping and Monitoring Tools for MHK Environmental Assessments project funded by U.S. Department of Energy (DOE) under contract DE-EE007826 to Integral Consulting Inc. The overall goal of this project was to demonstrate a consistent, repeatable, and semi-automated seafloor and sediment mapping approach for rapidly characterizing benthic physical and biological/habitat conditions to support marine environmental assessments for marine and hydrokinetic energy sites. The approach evaluated combines sediment profile imaging and plan view (SPI/PV) technology with multibeam echosounder surveys as an effective and low-cost benthic habitat mapping protocol. A key innovation was the development of a semi-automated computer vision system that standardizes the extraction of data from the SPI/PV images. Other elements of the project were SPI camera hardware modifications, including the design and fabrication of a prototype “power” SPI camera to improve camera prism penetration in firm substrates, and outreach to agency regulators and other stakeholders on this habitat mapping approach. This technical report consists of five main subsections that summarize: 1) the benthic mapping approach; 2) benthic mapping results from the three areas’ surveys; 3) the development and performance of the image processing algorithms; 4) SPI camera hardware improvements and prototype testing; and 5) the regulatory outreach efforts.

16 TIDAL AND WAVE POWER↗

Large‐Scale 2D Perovskite Nanocrystals Photodetector Array via Ultrasonic Spray Synthesis

Abstract 2D perovskite (PVSK) single crystals have received significant attention due to their unique optical and optoelectronic properties. However, current synthesis methods face limitations, particularly in large‐area fabrication, which remain critical barriers to practical applications. In this study, the synthesis of red/green/purple‐blue‐colored 2D PVSK nanocrystals over a large area (4‐inch wafer) and the fabrication of high‐performance photodetector arrays are presented via a facile yet efficient spray‐coating approach with a liquid‐bridge transport effect. The photodetector array achieves 100% working yield, high photo‐responsivity (1.5 × 10 6 A W −1 ) and specific‐detectivity (1.1 × 10 16 Jones) with competitive photomapping characteristics. An intelligent vision system for automatic shape recognition is further demonstrated with a recognition rate exceeding 90%. This study provides significant advances in the scalable synthesis of nanoscale 2D PVSK crystals, their integration into large‐area optoelectronic devices, and their potential use in artificial‐intelligence systems.

Lee, Yoon Ho [Davidson School of Chemical Engineer↗

Using dorsal surface for individual identification of dairy calves through 3D deep learning algorithms

Advances in machine learning techniques have allowed the development of computer vision systems (CVS) that can accurately predict several phenotypes of interest for livestock operations. In this context, 3D images taken from a top-down view are particularly useful for estimating body condition score, growth development, and body biometrics in cattle. Frequently, such CVS rely on identification (ID) systems, such as electronic tags, as a way to match animal ID and the predicted phenotype. However, the same 3D images used to predict body weight and other animal biometrics could be adopted for animal recognition as well. Such alternative would optimize CVS to recognize animal ID and monitor growth development simultaneously while leveraging the same hardware infrastructure. Furthermore, this strategy could be used to recognize animals with similar color patterns. Nonetheless, growing animals are continuously changing body shape, which could limit its use as an invariant feature for pattern recognition. Thus, the objectives of this study were: (1) to compare algorithms for different 3D object representations to identify individual animals; and (2) to evaluate how short-term changes in body shape due to animal growth affect the predictive performance of these algorithms. For objective 1, the algorithms were trained (n = 4,558) and tested (n = 1,139) using images from 38 Holstein calves. For objective 2, we designed three different experiments using images (n = 2,347) from five Holstein calves taken over six weeks during their growing period, always training and testing on different weeks. Each experiment evaluated how changing a different parameter of the image capturing procedure affected the predictive ability of the trained algorithms. In the first experiment, we varied the total number of images per animal in the training set; in the second experiment, we varied the number of weeks while keeping a fixed number of images in the training set; and in the third experiment, we skipped weeks between images in the training and test sets. The F 1 score for objective (1) was up to 0.804 when testing with the last frames of each video, and up to 0.959 when using random frames for testing. For objective (2), the F 1 score was up to 0.947 for the first experiment when using 130 images per animal; up to 0.979 for the second experiment when using all five weeks; and up to 0.917 when not skipping weeks between training and testing. In conclusion, these results show that deep learning algorithms can be used to identify individual animals through their dorsal area 3D surfaces, and, from our experiments using calves in their growing period, that they are robust enough to account for changes in body shape and size, making them a promising tool for animal recognition during growth.

3D neural networks↗

GWAS identifies candidate genes controlling adventitious rooting in Populus trichocarpa

Adventitious rooting (AR) is critical to the propagation, breeding, and genetic engineering of trees. The capacity for plants to undergo this process is highly heritable and of a polygenic nature; however, the basis of its genetic variation is largely uncharacterized. To identify genetic regulators of AR, we performed a genome-wide association study (GWAS) using 1148 genotypes of Populus trichocarpa. GWASs are often limited by the abilities of researchers to collect precise phenotype data on a high-throughput scale; to help overcome this limitation, we developed a computer vision system to measure an array of traits related to adventitious root development in poplar, including temporal measures of lateral and basal root length and area. GWAS was performed using multiple methods and significance thresholds to handle non-normal phenotype statistics and to gain statistical power. These analyses yielded a total of 277 unique associations, suggesting that genes that control rooting include regulators of hormone signaling, cell division and structure, reactive oxygen species signaling, and other processes with known roles in root development. Numerous genes with uncharacterized functions and/or cryptic roles were also identified. These candidates provide targets for functional analysis, including physiological and epistatic analyses, to better characterize the complex polygenic regulation of AR.

59 BASIC BIOLOGICAL SCIENCES↗