Search NASA⌕ Search

SEARCH · Search NASA

Results for “Vision Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Integration of computer vision system to track the alignment SRF cavities into the test cryostat for PIP-II at Fermilab

PIP-II cryomodules use a computer vision system (H-BCAMs system) to monitor the alignment of SRF cavities and focusing lenses during assembly, testing, and operation. This contribution details the integration of the H-BCAMs into the Spoke Test Cryostat (STC) at Fermilab, which is utilized for cold testing SRF cavities prior to their integration into the string assembly. Thermal and structural finite element analyses were employed to estimate the cavities’ deformations, to be validated during cold testing in the STC using H-BCAMs. Notably, this marks the first instance of H-BCAMs integration into a cryostat and operation within a cryogenic environment.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

In Search of Optimum Fresh-Cut Raw Material: Using Computer Vision Systems as a Sensory Screening Tool for Browning-Resistant Romaine Lettuce Accessions

The popularity of ready-to-eat (RTE) salads has prompted novel technology to prolong the shelf life of their ingredients. Fresh-cut romaine lettuce is widely used in RTE salads; however, its tendency to quickly discolor continues to be a challenge for the industry. Selecting the ideal lettuce accessions for use in RTE salads is essential to ensure maximum shelf life, and it is critical to have a practical way to assess and compare the quality of multiple lettuce accessions that are being considered for use in fresh-cut applications. Thus, in this work we aimed to determine whether a computer vision system (CVS) composed of image acquisition, processing, and analysis could be effective to detect visual quality differences among 16 accessions of fresh-cut romaine lettuce during postharvest storage. The CVS involved a post-capturing color correction, effective image segmentation, and calculation of a browning index, which was tested as a predictor of quality and shelf life of fresh-cut romaine lettuce. The results demonstrated that machine vision software can be implemented to replace or supplement the scoring of a trained panel and instrumental quality measurements. Overall visual quality, a key sensory parameter that determines food preferences and consumer behavior, was highly correlated with the browning index, with a Pearson correlation coefficient of −0.85. Other important sensory decision parameters were also strongly or moderately correlated with the browning index, with Pearson correlation coefficients of −0.84 for freshness, 0.79 for off odor, and 0.57 for browning. The ranking of the accessions according to quality acceptability from the sensory evaluation produced a similar pattern to those obtained with the CVS. This study revealed that multiple lettuce accessions can be effectively benchmarked for their performance as fresh-cut sources via a CVS-based method. Future opportunities and challenges in using machine vision image processing to predict consumer preferences for RTE salad greens is also discussed.

Agriculture↗
DOE OSTI2025

Automating Testing of DUNE Electronics via a Finite State Machine

The Deep Underground Neutrino Experiment (DUNE) is a flagship international collaboration designed to study neutrinos tiny, nearly massless particles that may hold answers to fundamental questions about the Universe. Fermilab s Robotic Test Stand (RTS) plays a critical role in ensuring the quality of approximately 50,000 Application-Specific Integrated Circuit (ASIC) chips that will be used in DUNE s massive liquid argon detectors. These electronics will be inside the cryostat; therefore, they will need to have a high yield of working chips and low noise. To improve the automation and reliability of the RTS, this project focused on designing and implementing a Python-based finite state machine (FSM) to manage chip handling workflows. The FSM was developed as a modular software framework to coordinate robotic arm movements, manage chip tray positions, and monitor system states during testing. Key features include robust error handling routines, a pause/resume system for safe mid-cycle interruptions, and a simulation mode for iterative testing without hardware dependencies. The system was designed to prepare for seamless integration with RTS hardware components such as the robotic arm and vision system. This integration will streamline collaboration and enable efficient deployment of updates across the six total institutions performing testing. The outcomes of this internship contribute to Fermilab s mission to advance high-energy physics and support the DOE s national goals by directly improving the testing of equipment to be used in DUNE. The project also provided valuable experience in software design and contributing to the success of DUNE.

Kang, Caleb [William Rainey Harper Coll.]↗
DOE OSTI2025

Automating Testing of DUNE Electronics via a Finite State Machine

The Deep Underground Neutrino Experiment (DUNE) is a flagship international collaboration designed to study neutrinos—tiny, nearly massless particles that may hold answers to fundamental questions about the Universe. Fermilab’s Robotic Test Stand (RTS) plays a critical role in ensuring the quality of approximately 50,000 Application-Specific Integrated Circuit (ASIC) chips that will be used in DUNE’s massive liquid argon detectors. These electronics will be inside the cryostat; therefore, they will need to have a high yield of working chips and low noise. To improve the automation and reliability of the RTS, this project focused on designing and implementing a Python-based finite state machine (FSM) to manage chip handling workflows. The FSM was developed as a modular software framework to coordinate robotic arm movements, manage chip tray positions, and monitor system states during testing. Key features include robust error handling routines, a pause/resume system for safe mid-cycle interruptions, and a simulation mode for iterative testing without hardware dependencies. The system was designed to prepare for seamless integration with RTS hardware components such as the robotic arm and vision system. This integration will streamline collaboration and enable efficient deployment of updates across the six institutions performing testing. The outcomes of this internship contribute to Fermilab’s mission to advance high-energy physics and support the DOE’s national goals by directly improving the testing of equipment to be used in DUNE. The project also provided valuable experience in software design and contributing to the success of DUNE.

Kang, Caleb [Fermilab]↗
DOE OSTI2025

Validation Testing for Molten Chloride Reactor Experiment Equipment Removal and Disposal Techniques

The Molten Chloride Reactor Experiment (MCRE) will be the first reactor featuring a fast-spectrum molten chloride circulating nuclear fuel system in the world. Planning for equipment removal and disposal (ERD) of MCRE has identified several technology gaps due to the unique environment of this nuclear experiment. Some of the gaps arise from the application of existing disassembly and/or sizing methods to novel material forms or in novel configurations. Others arise from unknown material behavior. This paper summarizes proposed test plans for ERD validation experiments to address these complicated or unknown equipment removal procedures. At the Waste Management Symposia in 2024, the Idaho National Laboratory (INL) MCRE ERD team presented the challenges associated with hosting multiple nuclear experiments in series with only brief transition periods between systems. Such difficulties include higher dose rates, the presence of radioisotopes infrequently encountered in reactor decommissioning and radioactive waste management, lack of intrinsic remote-operations infrastructure in the test bed, space constraints in the test bed, and contamination minimization requirements. To address these challenges, remote or semi-remote technologies are planned to be implemented in a non-hot cell environment with limited space availability. The team also discussed how a systems engineering approach is being used for conceptual development and design of equipment removal systems to address these challenges. For example, to reduce constraints for the removal of more difficult components, non-activated, noncontaminated elements are planned to be taken out first where possible. Still, there are complexities associated with the remaining components. In this work, the operational framework for MCRE ERD was reviewed for technical gaps and open questions, and test plans were drafted to address these areas. The tests plans were written for the following categories: vision systems, pipe cutting, drill/grout/filler, flush salt, and miscellaneous, with the miscellaneous group consisting of tests like techniques for removing bearings and reflector bricks. The test plans explore material, infrastructure, and staffing requirements needed for test execution. The test plans additionally focus on the evaluation of success. Determining the outcome of a test is imperative - as these explorative actions have the potential to rearrange or re-scope planned ERD activities. Success criteria identified thus far include required tool output, required area(s), debris production and mitigation, and repeatability. Test plans are an essential aspect of the systems engineering approach to MCRE ERD. They are used as the beginning steps in defining use cases for the ERD system. Performance of the validation tests is expected to begin in the summer of 2025 and will take approximately 9 to 12 months to complete. Execution of these plans will be expedited by specifying test needs ahead of time, facilitating efficient interactions with any subcontractors tasked with running the requested tests. Evaluating the outcomes of these tests will inform MCRE ERD procedures and timing and will also identify additional technical constraints for the MCRE ERD System. This upfront process optimization effort will help the project save time and resources at the end of the experiment.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗
DOE OSTI2026

Supervised Learning-Based Spatial Position Estimation with Vertical Displacement for Hovering UAV Wireless Power Transfer

This study presents a supervised learning-based spatial position estimation approach for wireless power transfer (WPT) systems supporting hovering unmanned aerial vehicle (UAV) charging. Unlike stationary charging scenarios, hovering UAVs introduce continuous lateral misalignment and vertical displacement, leading to variations in magnetic coupling and reduced power transfer efficiency. To address this challenge, the proposed method estimates the relative spatial position of the receiver coil using only electrical measurements obtained at the secondary side. A supervised learning model is trained to map output voltage and current features to spatial coordinates, enabling position awareness without requiring external sensors, vision systems, or communication links. The sensing functionality is inherently integrated into the WPT system, allowing simultaneous power transfer and localization through the same magnetic interface. Experimental validation is conducted on a laboratory-scale prototype under varying lateral offsets and air-gap conditions. In addition, spline-based interpolation is employed to increase spatial data density for training. The results demonstrate that the proposed framework can capture spatial variations associated with both lateral and vertical displacement, providing reliable position estimation under hovering conditions. This work establishes a hardware-efficient, sensorless solution for UAV wireless charging and serves as a baseline for advanced data-driven position estimation methods in dynamic WPT systems.

Asa, Erdem [ORNL] (ORCID:0000000190884812)↗
DOE OSTI2025

Automated Waterbox Inspection for Nuclear Power Plants Using Computer Vision - Based Change Detection

Nuclear power plant waterboxes require regular inspection for leaks, missing components, and structural damage during maintenance outages. Traditional manual inspection is time-consuming and poses safety risks from confined space entry. We developed an automated computer vision system for drone-based waterbox inspection in partnership with Florida Light and Power. Our approach uses feature detection and matching to identify critical changes between baseline and current inspection images, automatically flagging additions (leaks/debris), removals (missing plugs), and translations (displaced components) while compensating for drone movement and environmental variations. We systematically evaluated six feature matching methods, from classical approaches (SIFT+BF) to state-of-the-art neural networks (SuperPoint+SuperGlue), using both standard benchmarks (HPatches) and waterbox-specific validation with real-world augmentations. SuperPoint+SuperGlue achieved superior performance with 7.82 pixels RMSE and 100% success rate—2.8x better accuracy than our baseline. While the pre-trained model has commercial licensing restrictions for nuclear deployment, our findings validate this architecture for custom training. We implemented a real-time GUI demonstrating the SIFT+BF approach for immediate deployment, processing drone feeds at 30 FPS with color-coded change visualization. Future work includes training a custom SuperPoint+SuperGlue model on waterbox data and integrating Vision-Language Models for automated reporting and maintenance guidance.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗
DOE OSTI2025

Large‐Scale 2D Perovskite Nanocrystals Photodetector Array via Ultrasonic Spray Synthesis

Abstract 2D perovskite (PVSK) single crystals have received significant attention due to their unique optical and optoelectronic properties. However, current synthesis methods face limitations, particularly in large‐area fabrication, which remain critical barriers to practical applications. In this study, the synthesis of red/green/purple‐blue‐colored 2D PVSK nanocrystals over a large area (4‐inch wafer) and the fabrication of high‐performance photodetector arrays are presented via a facile yet efficient spray‐coating approach with a liquid‐bridge transport effect. The photodetector array achieves 100% working yield, high photo‐responsivity (1.5 × 10 6 A W −1 ) and specific‐detectivity (1.1 × 10 16 Jones) with competitive photomapping characteristics. An intelligent vision system for automatic shape recognition is further demonstrated with a recognition rate exceeding 90%. This study provides significant advances in the scalable synthesis of nanoscale 2D PVSK crystals, their integration into large‐area optoelectronic devices, and their potential use in artificial‐intelligence systems.

Lee, Yoon Ho [Davidson School of Chemical Engineer↗
DOE OSTI2026

3D reconstruction and neural rendering for adversarial machine learning

While evasion attacks on computer vision systems have been widely studied, creating attacks that remain effective under significant changes in viewpoint continues to be challenging. Traditional approaches often rely on affine transformations of images, but these approaches degrade at larger perspective shifts and often produce unrealistic or ineffective perturbations. Recent methods use differentiable renderers to improve viewpoint robustness, but they typically depend on manually constructed 3D models. We introduce a semi-automated pipeline that generates physically printable and perspective-invariant adversarial patches using only a small set of 2D images. Our method integrates 3D reconstruction, neural rendering, adversarial patch optimization, and an object detection victim model into a unified workflow. We use 2D Gaussian Splatting for high fidelity mesh reconstruction and FlexPara for surface parameterization that produces texture maps suitable for patch editing. Together, these components form a fully differentiable pipeline in PyTorch3D that links texture modification to model outputs, enabling efficient optimization of patches that remain effective across many viewpoints. The complete process, from image capture to patch printing and physical evaluation, can be completed within a few hours. We demonstrate the effectiveness of the resulting patches through attacks on the YOLOv8 object detection model and discuss remaining challenges and opportunities for improving robustness and scalability.

Singhvi, Vivaan [ORNL] (ORCID:0009000586288221)↗
DOE OSTI2025

AI-powered municipal solid waste management: a comprehensive review from generation to utilization

The accumulation of municipal solid waste (MSW) continues to rise due to burgeoning population, rapid global urbanization and economic growth, intensifying ecological concerns associated with landfills and greenhouse gas (GHG) emissions. Over the past 2 decades, global waste generation has surged by 50%, with one-third remaining uncollected and about 70% sent to landfills. This review examines the critical role of integrating emerging technologies, such as advanced sensors and artificial intelligence (AI), into end-to-end MSW management to alleviate landfill burdens. The suitability of various AI tools for different stages of MSW management is assessed, alongside the deployment of advanced sensors including hyperspectral cameras, computer vision systems, and internet of things (IoT) devices for material identification. Applications of genetic algorithms and reinforcement learning for optimizing collection routes, reducing costs, and lowering emissions are highlighted. Life cycle assessment (LCA) across all stages of MSW management is also reviewed, along with future trends in leveraging generative AI, natural language processing (NLP), and agent-based AI systems to analyze waste generation patterns and public sentiment. Efficient collection and handling can be enhanced through route optimization with geographic information systems and real-time bin-level monitoring. Furthermore, sensor-embedded, real-time object detection systems paired with robotics enable material characterization and automated sorting, thereby lowering costs and diverting waste from landfills into value-added products for diverse industrial sectors including packaging, chemicals, textiles, metals and glass, transportation, and electronics industries. Without intervention, global waste is projected to reach 4.54 billion tons by 2050, contributing direct economic costs of $\$$400 billion and roughly 2.38 billion tons of CO 2 -equivalent emissions annually. This review demonstrates how AI-driven, end-to-end solutions for MSW management can mitigate economic and environmental challenges, while directly supporting the United Nations Sustainable Development (UNDP) goals related to innovation and infrastructure (SDG 9), sustainable cities (SDG 11), responsible consumption and production (SDG 12), and climate action (SDG 13).

09 BIOMASS FUELS↗
DOE OSTI2026

Stereo-vision thermal imaging system for tracking flying animals in wind farm areas (CRADA #763) Abstract

CRADA 763: abstract ThermalTracker-3D (TT3D) is a stereo vision thermal imaging system that provides 3D flight information on detected birds, bats, and other flying targets. The system was initially developed for use in the siting and monitoring of offshore wind projects to establish pre-construction and operation collision risk data but can be applied to terrestrial wind energy projects as well as national security monitoring. This technology will reduce monitoring cost, decrease processing time, and provide more accurate data for wind energy developers/operators and regulatory agencies. While the current technology is at a high level of readiness, Technology Readiness Level (TRL) 7, there remain several barriers to commercialization, particularly around ease-of-use, that result in a low Adoption Readiness Level (ARL). The proposed work will advance commercialization readiness by streamlining calibration methods for built systems. This work will:1. 1. develop a software package for factory and dynamic calibration processes 2. test that package with existing prototype TT3D systems, and 3. conduct outreach with industry end-users.

ThermalTracker↗
DOE OSTI2025

Integrating Machine-learning-assisted Computer Vision with RICH System

Developments in artificial intelligence have vastly expanded the capabilities of robots. Currently, the Spallation Neutron Source (SNS) beamlines at Oak Ridge National Lab (ORNL) have robotic sample loaders to increase the efficiency of running experiments. However, they require retraining if anything about the situation changes, e.g., where the samples are, and cannot notice if errors occur. So, the viability of using computer vision and machine learning to enhance these sample loaders’ functionality was investigated. In this project, the RICH system with a Dobot CR3 6-axis robot present at the VULCAN beamline assisted by an Intel Realsense D435i camera, a unique camera that enables convenient translation of 2D pixel coordinates to 3D world points, was programmed to load ceramic crucibles into a thermogravimetric analyzer (TGA) furnace. An algorithm was constructed in Python with three major phases planned: (1) obtaining a sample, (2) moving it to the target location, and then (3) bringing the sample back to its original location once the experiment finished. In the first phase, the algorithm would dynamically detect sample locations using ArUco markers to recognize the samples’ general location and a custom-trained yolov5 object detection model to locate the crucibles’ centers. Afterward, the robot would be directed to pick up samples based on the crucibles’ calculated positions. In the second phase, the robot would move the sample to a secondary point, reorient its grip, and place the sample at the target location. In the final phase, the robot would determine whether the sample was intact and would bring it back to its original place if it was or raise an alarm. Using this algorithm, the robot was able to pick up different types of crucibles at varying positions. These results indicate that integrating machine-learning-assisted computer vision with robotic sample loaders can result in effective autonomous detection of samples.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Management and Operation of the Oak Ridge National Laboratory

ThermaMatrix, Inc provides novel vision inspection solutions for a wide range of manufacturers and industries, providing and implementing the leading technologies for nondestructive inspection (NDI) and material characterization. Many other inspection solutions are either not adequate or are not approachable due to implementation barriers needing expert level operators, excessive inspection time, and high cost. ThermaMatrix’sadvanced vision inspection technology addresses all of these limitations. The Lab Embedded Entrepreneurial Program (LEEP) opportunity by the Department of Energy (DOE) allows small-business start-ups to leverage national laboratory capabilities and skilled scientists to rapidly develop their technology that aligns with DOE goals. ThermaMatrix, Inc.was positioned in the Innovation Crossroads program at Oak Ridge National Laboratory to further develop thenovel Watson Vision Inspection System to support manufacturing quality control efforts. Theresearch goals were (1) explore fundamental parameters that would improve preexisting capabilities, (2) full-scale industrial setup for demonstration, and (3) capability testing and verification. Manufacturing is demanding more NDI implementation to support their quality control needs, which this technology development would support. Figure 1: Ryan Spencer of ThermaMatrix with Watson Vision Inspection System.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2026

MATEY: multiscale adaptive transformer models for spatiotemporal physical systems

Accurate representation of the multiscale features in spatiotemporal physical systems using vision transformer architectures requires extremely long, computationally prohibitive token sequences. To address this issue, we propose two novel adaptive tokenization schemes that dynamically adjust patch sizes based on local features: one ensures convergent behavior to uniform patch refinement, while the other offers better computational efficiency. Moreover, we present a set of spatiotemporal attention schemes, where the temporal or axial spatial dimensions are decoupled, to evaluate their baseline computational and data efficiencies and to determine whether adaptive tokenization can improve this performance. We assess the performance of the proposed multiscale adaptive model, MATEY, in a sequence of experiments. Compared to a full spatiotemporal attention scheme or a scheme that decouples only the temporal dimension, we find that fully decoupled axial attention is less efficient and expressive, requiring more training time and model parameters to achieve the same accuracy. The experiments on the adaptive tokenization schemes show that, compared to a uniformly refined model, the proposed schemes achieve comparable or improved accuracy at a much lower cost in the tested two-dimensional settings. While the asymptotic analysis suggests the potential for favorable scaling, empirical validation at substantially longer sequence lengths remains to be performed in future work. Finally, we demonstrate in two fine-tuning tasks featuring different physics that models pretrained on PDEBench data outperform the ones trained from scratch, especially in the low data regime with frozen attention.

adaptive tokenization↗
DOE OSTI2025

CRADA Final Report: CRADA Number NFE-24-10036 with ThermaMatrix, Inc.

ThermaMatrix, Inc provides novel vision inspection solutions for a wide range of manufacturers and industries, providing and implementing the leading technologies for nondestructive inspection (NDI) and material characterization. Many other inspection solutions are either not adequate or are not approachable due to implementation barriers needing expert level operators, excessive inspection time, and high cost. ThermaMatrix’s advanced vision inspection technology addresses all of these limitations. The Lab Embedded Entrepreneurial Program (LEEP) opportunity by the Department of Energy (DOE) allows small-business start-ups to leverage national laboratory capabilities and skilled scientists to rapidly develop their technology that aligns with DOE goals. ThermaMatrix, Inc. was positioned in the Innovation Crossroads program at Oak Ridge National Laboratory to further develop the novel Watson Vision Inspection System to support manufacturing quality control efforts. The research goals were (1) explore fundamental parameters that would improve preexisting capabilities, (2) full-scale industrial setup for demonstration, and (3) capability testing and verification. Manufacturing is demanding more NDI implementation to support their quality control needs, which this technology development would support.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Defect Detection Model Development for Large Scale Thermoplastic Printing

Large-format additive manufacturing (LFAM) offers several advantages, including high throughput, cost-effective pellet-fed extrusion, and the capability to produce large-scale structures. The main pain points of LFAM include start and stops during the printing process, warpage, long layer times that lead to bead freezing, and bead separation due to shrinkage. These issues can lead to overfill, underfill and buildup of material in different sections of a print. This can lead to hidden defects embedded within the printed layers, or even ultimate failure of the printed structure. This ensures these defects can only be identified through nondestructive testing (NDT) inspection methods after printing, which can be timely and costly. Aligned Vision work specializes in 2D projectors with visual inspection systems and machine learning. Traditionally system is used for composite layup and layup inspections. In this work we used the LFAM system at Oak Ridge National Laboratory to create defect rich samples. The Aligned Vision inspection system then performed in-situ monitoring of the print process after each part was printed. This in-situ vision inspection system was used to develop a layer-by-layer inspection model that looks for overfill, underfill, and the buildup of defects using only a camera-based vision system. This leads to the assurance of high-quality production components.

36 MATERIALS SCIENCE↗
DOE OSTI2026

A Smart Vision-Aided RICH (Robotic Interface Control and Handling) System for VULCAN

High-flux neutron beams and high-efficiency detectors enable rapid neutron diffraction measurements at the Engineering Materials Diffractometer (VULCAN) at the Spallation Neutron Source (SNS), Oak Ridge National Laboratory (ORNL). To optimize beam time utilization, efficient sample exchange, alignment, and automated measurements are essential. Recent advances in artificial intelligence (AI) have expanded the capabilities of robotic systems. Here, we report the development of a Robotic Interactive Control and Handling (RICH) system for sample handling at VULCAN, designed to support high-throughput experiments and reduce overhead time. The RICH system employs a six-axis desktop robot integrated with AI-based computer vision models capable of recognizing and localizing samples in real time from instrument and depth-resolving cameras. Vision algorithms combine these detections to align samples with designated measurement positions or place them within complex sample environments such as furnaces. This integration of machine learning-assisted vision with robotic handling demonstrates the feasibility of autonomous sample detection and preparation, offering a pathway toward fully unmanned neutron scattering experiments.

automation↗