Search NASA⌕ Search

SEARCH · Search NASA

Results for “vision systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Manufacturing Management System Overview [Slides]

Vision: Institute a trusted manufacturing capability within the ALDWP Production Agency enabling digital product acceptance and access to digital manufacturing post-production activities. Mission: Establish a modern manufacturing infrastructure that ensures operator credentials, minimized human transcription errors, capable of managing all aspects of manufacturing including digital data acquisition, NCR resolution, and product acceptance, while providing an effective and intuitive user experience. Strategy: Constitute the modern manufacturing infrastructure to minimize risk and plant disruption while incrementally involving the capability.

42 ENGINEERING↗

Defect Detection Model Development for Large Scale Thermoplastic Printing

Large-format additive manufacturing (LFAM) offers several advantages, including high throughput, cost-effective pellet-fed extrusion, and the capability to produce large-scale structures. The main pain points of LFAM include start and stops during the printing process, warpage, long layer times that lead to bead freezing, and bead separation due to shrinkage. These issues can lead to overfill, underfill and buildup of material in different sections of a print. This can lead to hidden defects embedded within the printed layers, or even ultimate failure of the printed structure. This ensures these defects can only be identified through nondestructive testing (NDT) inspection methods after printing, which can be timely and costly. Aligned Vision work specializes in 2D projectors with visual inspection systems and machine learning. Traditionally system is used for composite layup and layup inspections. In this work we used the LFAM system at Oak Ridge National Laboratory to create defect rich samples. The Aligned Vision inspection system then performed in-situ monitoring of the print process after each part was printed. This in-situ vision inspection system was used to develop a layer-by-layer inspection model that looks for overfill, underfill, and the buildup of defects using only a camera-based vision system. This leads to the assurance of high-quality production components.

36 MATERIALS SCIENCE↗

DLMP of Competitive Markets in Active Distribution Networks: Models, Solutions, Applications, and Visions

Traditionally, the electric distribution system operates with uniform energy prices across all system nodes. However, as the adoption of distributed energy resources (DERs) propels a shift from passive to active distribution network (ADN) operation, a distribution-level electricity market has been proposed to manage new complexities efficiently. In addition, distribution locational marginal price (DLMP) has been established in the literature as the primary pricing mechanism. The DLMP inherits the LMP concept in the transmission-level wholesale market but incorporates characteristics of the distribution system, such as high $R/X$ ratios and power losses, system imbalance, and voltage regulation needs. The DLMP provides a solution that can be essential for competitive market operation in future distribution systems. This article first provides an overview of the current distribution-level market architectures and their early implementations. Next, the general clearing model, model relaxations, and DLMP formulation are comprehensively reviewed. The state-of-the-art solution methods for distribution market clearing are summarized and categorized into centralized, distributed, and decentralized methods. Then, DLMP applications for the operation and planning of DERs and distribution system operators (DSOs) are discussed in detail. Finally, visions of future research directions and possible barriers and challenges are presented.

42 ENGINEERING↗

NRIC EBR-II Test Bed Pre-Conceptual Design Report

Authorized by the Nuclear Energy Innovation Capabilities Act (NEICA), the National Reactor Innovation Center (NRIC) provides private sector technology developers access to strategic infrastructures and assets for commercial nuclear energy research, development, demonstration, and deployment activities. The mission is to support a timely and cost-effective path to the licensing and commercialization of new nuclear energy systems. To meet these needs, NRIC is developing two test beds at Idaho National Laboratory (INL). The ZPPR Test bed (ZTB) and the EBR-II Test bed (ETB). The EBR-II test bed will support the demonstration of systems that operate at less than 10 MWt. The baseline objective is for the EBR-II Dome to act as a safety significant containment structure capable of siting reactors that utilize Safeguards Category 4 material for operations. The major areas addressed in the pre-conceptual design include: • Installation of an access door • Electrical Power • Heat Removal • Ventilation in the Dome • Module handling system Along with the design for ETB a concept of operations (COP) has also been developed. The COP is intended to facilitate a common understanding of ideas, challenges, and issues. As systems continue to evolve in complexity System Engineers and Project Directors will utilize the COP to develop and sustain a common vision of the system for stakeholders.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

ZPPR Test Bed (ZTB) Pre-Conceptual Design Report

Authorized by the Nuclear Energy Innovation Capabilities Act (NEICA), the National Reactor Innovation Center (NRIC) provides private sector technology developers access to strategic infrastructures and assets for commercial nuclear energy research, development, demonstration, and deployment activities. The mission is to support a timely and cost-effective path to the licensing and commercialization of new nuclear energy systems. To meet these needs, NRIC is developing two reactor demonstration test beds at Idaho National Laboratory (INL), the ZPPR Test bed (ZTB) and the EBR-II Test bed (ETB). ZTB will support the demonstration of systems that operate at less than 500 kWt. The baseline objective is for the ZPPR Cell to act as a confinement structure capable of siting reactors that utilize Safeguards Category 1 material for operations. The major areas addressed in the pre-conceptual design include: • Installation of an access door • Electrical Power • Heat Removal • Ventilation in the Cell • Reactor Installation Along with the design for ZTB, a concept of operations (COP) has also been developed. The COP is intended to facilitate a common understanding of ideas, challenges, and issues. As systems continue to evolve in complexity System Engineers and Project Directors will utilize and update the COP to develop and sustain a common vision of the system for stakeholders.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

van der Waals Semiconductor Empowered Vertical Color Sensor

We report biomimetic artificial vision is receiving significant attention nowadays, particularly for the development of neuromorphic electronic devices, artificial intelligence, and microrobotics. Nevertheless, color recognition, the most critical vision function, is missed in the current research due to the difficulty of downscaling of the prevailing color sensing devices. Conventional color sensors typically adopt a lateral color sensing channel layout and consume a large amount of physical space, whereas compact designs suffer from an unsatisfactory color detection accuracy. In this work, we report a van der Waals semiconductor-empowered vertical color sensing structure with the emphasis on compact device profile and precise color recognition capability. More attractive, we endow color sensor hardware with the function of chromatic aberration correction, which can simplify the design of an optical lens system and, in turn, further downscales the artificial vision systems. Also, the dimension of a multiple pixel prototype device in our study confirms the scalability and practical potentials of our developed device architecture toward the above applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Smart Vision-Aided RICH (Robotic Interface Control and Handling) System for VULCAN

High-flux neutron beams and high-efficiency detectors enable rapid neutron diffraction measurements at the Engineering Materials Diffractometer (VULCAN) at the Spallation Neutron Source (SNS), Oak Ridge National Laboratory (ORNL). To optimize beam time utilization, efficient sample exchange, alignment, and automated measurements are essential. Recent advances in artificial intelligence (AI) have expanded the capabilities of robotic systems. Here, we report the development of a Robotic Interactive Control and Handling (RICH) system for sample handling at VULCAN, designed to support high-throughput experiments and reduce overhead time. The RICH system employs a six-axis desktop robot integrated with AI-based computer vision models capable of recognizing and localizing samples in real time from instrument and depth-resolving cameras. Vision algorithms combine these detections to align samples with designated measurement positions or place them within complex sample environments such as furnaces. This integration of machine learning-assisted vision with robotic handling demonstrates the feasibility of autonomous sample detection and preparation, offering a pathway toward fully unmanned neutron scattering experiments.

automation↗

Sandia's Integrated Methodology for Energy and Infrastructure Resilience Analysis

Sandia National Laboratories' (Sandia) Resilient Energy Systems (RES) Strategic Initiative is establishing a strategic vision for U.S. energy systems' resilience through threat-informed research and development, enabling energy and interdependent infrastructure systems to successfully adapt in an environment of accelerating change. A key challenge in promoting energy systems resilience lies in developing rigorous resilience analysis methodologies to quantify system performance. Resilience analysis methodologies should enable evaluation of the consequences of various disruptions and the relative effectiveness of potential mitigations. To address this challenge, RES synthesized the common components of Sandia's resilience frameworks into an integrated methodology for energy and infrastructure resilience analysis. This report documents, demonstrates, and extends this methodology.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Expanding NREL's Advanced Research on Integrated Energy Systems (ARIES) Capabilities

NREL's Integrated Energy Pathways vision represents a transformed, future integrated energy system that is more affordable, clean, secure, and resilient than today. Key to this vision is the unique Advanced Research on Integrated Energy Systems (ARIES) research platform. With a focus on advancing modern grid infrastructure, making investments in energy efficiency building technology research, and innovating battery storage and much more, the unique ARIES research platform can be used to accelerate the integration of new technologies into a modern grid.

advanced research↗

Multi-Source Machine Learning and Thermoplastics Enhanced Aerostructure Manufacturing (mTEAM)

RTX Technology Research Center (RTRC), together with Collins Aerospace (Collins) and Oak Ridge National Laboratory (ORNL) has developed an Artificial Intelligence (AI) / Machine Learning (ML) guided solution to advance the manufacturing and assembly of high performance and lightweight thermoplastic composite (TPC) aerospace products. The solution aims to lower risk, cost and lead time for induction heating based welding and consolidation processes for TPC structure. The cost and lead time of part and material specific process development for induction welding (IW) and induction consolidation will be reduced by replacing traditional empirical methods with optimization methods that merge AI/ML and physics-based process simulations and process experiments with sensing and controls. TPC-IW process development is empirical in nature, and uncertainties in material & process behavior exist near & far from the induction coil. Physics-based simulations can be leveraged directly for process optimization but can be too computationally expensive to run in high fidelity and real time to do robust process optimization. The key impact of successful TPC induction consolidation and welding is cost & lead time reduction for part & material specific consolidation and welding recipes. This is an enabler for more rapid deployment of TPC structures via joining assembly, which can reduce energy & cost intensive usage of autoclaves & ovens. The solution aimed to advance the U.S. Department of Energy’s interests in using thermoplastics and automation in composite manufacturing for improvement of products for existing markets via increased production speeds, reduced costs, and lowered use of energy. Welded TPC structures can offer significant weight & energy savings for high-value commercial aerospace & industrial applications compared to metal & thermoset composite structures assembled by mechanical fastening and/or adhesive bonding. The project was organized into two Budget Periods. Budget Period 1 (BP1) was 15 months and its goal was to perform ML process optimization framework development & deployment on lab-coupon aerostructure components. A Go/No-Go Review was performed at the end of BP1 to verify fulfilment of key tasks & milestones to justify a Go Decision to move into the next Budget Period. Budget Period 2 (BP2) was 12 months and its goal was the deployment of the ML framework for ML process optimization of pilot industrial scale aerostructure components. The overall project aim was to develop & demonstrate ML-enhanced modeling framework that learns process-property mapping from multiple data sources at different fidelities. During BP1, the team accomplished key tasks & milestones to demonstrate the concept of multi-source ML for TPC aerostructure consolidation and assembly. First, the team completed documentation of induction based TPC heating requirements including baseline metrics to compare measured results against. Next the team completed demonstration of data generation from physics-based simulations for ML surrogate model generation and demonstrated the integration of physics-based simulation data into multi-source AI/ML algorithms. In parallel, the team established the lab-coupon scale induction welding system and completed a process to label and reduce generated data from physics-based simulation and experiments for ML surrogate models to enable multi-source ML model training & testing. To complete BP1, the team integrated physics-based simulation data and experimental data into multi-source ML algorithms. This was based on the team completing ML deployment of the induction welding on a lab system at RTRC and AI/ML deployment on existing induction welding line at Collins. ORNL visited both Collins and RTRC sites to witness the TPC induction welding process. Then, ORNL designed and constructed a new version of their vision-based sensing system better adapted to acquire process signals of the TPC induction welding process for process anomaly and defect detection. In BP2, the team accomplished key tasks & milestones to scale up multi-source ML for TPC aerostructure consolidation and assembly from the lab-coupon scale to the pilot-industrial scale. In BP2, the team demonstrated real time anomaly & defect detection via experiments performed by ORNL & RTRC. The team completed ML-optimization heating trials for TPC induction consolidation at Collins, and the team confirmed pilot industrial scale experimental data from Collins was compatible with the developed ML pipeline from RTRC. The team completed sub-element scale ML process optimization demonstration at RTRC, where the team leveraged RTRC’s robotic TPC welding setup to de-risk the ML process optimization by performing ML analysis of recorded temperatures to account for complex part features. Then, the team applied its ML-derived control strategies and ML process optimization framework at Collins to the pilot-industrial scale on a demo skin-stiffener part representative of a nacelle aerostructure fan cowl section. The key innovation is the AI/ML framework enabling effective process development of high performance, lightweight, energy efficient TPCs for composite aircraft structures.

36 MATERIALS SCIENCE↗

Real-time Object Bounding in LiDAR Data With Computer Vision

The Multimodal Measurement System is a roadside radiation measurement testbed used to detect radiation sources in passing vehicles. It works by combining sensor signals from various modalities to produce a thorough scan of the source. A LiDAR sensor is used to measure the dimensions of the vehicle and provide a velocity estimate. However, the current LiDAR setup uses propriety software for which the source code is unavailable and cannot be updated to improve performance. Therefore, it is imperative to the accuracy of the analysis to create a custom vehicle detection that can return the dimensions and velocity of passing vehicles in real time. This new custom detection is written in C++ using the PointCloud Library, which keeps it lightweight. It also utilizes Docker and the Robot Operating System, which allows the versatility of running both on a small computer or the Lawrence Livermore National Laboratory cluster while utilizing different models of LiDAR sensors. The custom detection outperforms the current detection model, which increases the accuracy of radiation source detection.

97 MATHEMATICS AND COMPUTING↗

Solar-Plus-Storage Program Design: Frameworks and Examples [Slides]

The Columbia River Treaty Tribes in the Pacific Northwest - the Nez Perce, Umatilla, Warm Springs, and Yakama - hold treaty-reserved fishing rights for the Columbia River, the largest river in North America flowing into the Pacific Ocean. The four Tribes, through the Columbia River Inter-Tribal Fish Commission (CRITFC), prepared a vision for a more harmonized energy and water system in their 2022 Energy Vision for the Columbia River Basin. In it, the four Tribes envision a future where the Columbia Basin electric power system supports healthy and harvestable fish and wildlife populations, protects Tribal treaty and cultural resources, and provides clean, reliable, and affordable electricity. To help realize the Energy Vision, CRITFC received technical assistance from the National Renewable Energy Laboratory (NREL) through the Communities Local Energy Action Program (LEAP) pilot with the goal of ensuring that the Tribes are fully informed and prepared to integrate their interests into regional power system planning. This resource aims to provide an overview of program and policy design frameworks for behind-the-meter (BTM) energy storage and solar-plus-storage programs and examples from across the United States. This information is intended to build CRITFC's understanding of potential policies and program designs that could support the deployment of solar photovoltaics (PV) and energy storage in the Pacific Northwest.

14 SOLAR ENERGY↗

Hydra: computer vision for data quality monitoring

Hydra, initially developed for Hall-D in 2019, is a system that utilizes computer vision to perform near real time data quality monitoring. Since then, it has been deployed across all experimental halls at Jefferson Lab, with the CLAS12 collaboration in Hall-B being the first outside of GlueX to fully utilize Hydra. The system comprises back end processes that manage the models, their inferences, and the data flow. Finally, the front-end components, accessible via web pages, allow detector experts and shift crews to view and interact with the system.

47 OTHER INSTRUMENTATION↗

Capsule network-based semantic segmentation model for thermal anomaly identification on building envelopes

Thermography technology is widely used to inspect thermal anomalies in building façade systems. Computer vision-based techniques provide opportunities to autonomously detect such heat anomalies to significantly improve the efficiency of decision-making for building envelope retrofitting and maintenance. Here, in this work, we propose a novel Capsule Network-based deep learning model – CapsLab – that detects and identifies thermal anomalies by semantic segmentation. CapsLab is built based on our proposed prediction-tuning capsule (PT-Capsule) layer. Different from a traditional capsule layer, which consists of part-whole transformation and capsule-routing process, the proposed layer is composed of a prediction and tuning process, which helps decreasing the number of model parameters significantly. While the applicability of traditional Capsule Networks (CapsNets) has been limited to simpler tasks and smaller datasets due to their scalability issue, we can leverage the lightweight of the proposed PT-Capsule layer, and apply it to the semantic segmentation task. In this work, we also employ our previously presented performance metric, referred to as the Anomaly Identification Metric (AIM) (Kakillioglua et al. 2021), to evaluate the segmentation outputs. Traditional performance metrics do not accurately reflect the true performance of the segmentation models in thermal anomaly identification due to the high subjectivity in the annotation process and higher overlap ratio sensitivity of the standard metrics. AIM, on the other hand, is robust to these drawbacks. Experimental results show, both qualitatively and quantitatively, that our proposed segmentation method can effectively segment the thermal anomalies. Specifically, our model provides 9.38% and 13.53% improvements over the baseline model – DeepLabV3+ – based on traditional mIoU score and the AIM score, respectively, while requiring less model parameters and less computation at the same time. In addition, the scores that the AIM metric generates better align with the scores provided by building performance experts.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Carbon-13 Radiofrequency Amplification by Stimulated Emission of Radiation of the Hyperpolarized Ketone and Hemiketal Forms of Allyl [1- 13 C]Pyruvate

13 C hyperpolarized pyruvate is an emerging MRI contrast agent for sensing molecular events in cancer and other diseases with aberrant metabolic pathways. This metabolic contrast agent can be produced via several hyperpolarization techniques. Despite remarkable success in research settings, widespread clinical adoption faces substantial roadblocks because the current sensing technology utilized to sense this contrast agent requires the excitation of 13 C nuclear spins that also need to be synchronized with MRI field gradient pulses. Here, we demonstrate sensing of hyperpolarized allyl [1- 13 C]pyruvate via the stimulated emission of radiation that mitigates the requirements currently blocking broader adoption. Specifically, 13 C Radiofrequency Amplification by Stimulated Emission of Radiation ( 13 C RASER) was obtained after pairwise addition of parahydrogen to a pyruvate precursor, detected in a commercial inductive detector with a quality factor (Q) of 32 for sample concentrations as low as 0.125 M with 13 C polarization of 4%. Moreover, parahydrogen-induced polarization allowed for the preparation of a mixture of ketone and hemiketal forms of hyperpolarized allyl [1- 13 C]pyruvate, which are separated by 10 ppm in 13 C NMR spectra. This is a good model system to study the simultaneous 13 C RASER signals of multiple 13 C species. This system models the metabolic production of hyperpolarized [1- 13 C]lactate from hyperpolarized [1- 13 C]pyruvate, which has a similar chemical shift difference. Our results show that 13 C RASER signals can be obtained from both species simultaneously when the emission threshold is exceeded for both species. On the other hand, when the emission threshold is exceeded only for one of the hyperpolarized species, 13 C stimulated emission is confined to this species only, therefore enabling the background-free detection of individual hyperpolarized 13 C signals. Furthermore, the reported results pave the way to novel sensing approaches of 13 C hyperpolarized pyruvate, potentially unlocking hyperpolarized 13 C MRI on virtually any MRI system–an attractive vision for the future molecular imaging and diagnostics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Radsource Mr: Mixed Reality Planning Tool For Radioactive Recovery

The RadSource MR system leverages Meta Quest 3's advanced mixed reality capabilities to create a comprehensive spatial planning platform for end-of-life sealed radioactive source recovery operations. The application utilizes the Quest 3's high-resolution passthrough cameras and spatial mapping algorithms to generate accurate 3D environmental models. Core technical components include: (1) Real-time spatial measurement algorithms calculating distances, angles, slopes, and surface areas with sub-centimeter accuracy; (2) Virtual object placement system allowing users to position digital representations of recovery equipment (trailers, containment vessels, protective barriers) within the real environment; (3) Voice recording and annotation system for hands-free documentation in protective equipment; (4) 3D mesh capture and storage capabilities for post-operation analysis and regulatory documentation. (5) Procedure documentation is available for viewing in Mixed Reality, providing an innovative and convenient way to access the information during pre-visit and inspection activities. (6) Support for screen capture for the view for real world and virtual objects together to use it later for planning. The system integrates computer vision techniques for environmental understanding, spatial mathematics for precise measurements, and human-computer interaction principles optimized for hazardous environment operations. Data persistence allows teams to save and share planning sessions across multiple stakeholders while maintaining operational security requirements.

Khadka, Rajiv [Idaho National Laboratory (INL), Id↗

A holistic cyber-physical security protocol for authenticating the provenance and integrity of structural health monitoring imagery data

Modern infrastructure systems, such as bridges, dams, power generation stations, and buildings increasingly have an intrinsic cyber-physical nature to them. Infrastructure now commonly, includes actuators, network connections, sensors, control systems, and computational resources. It is of increasing concern that modern infrastructure is vulnerable to cyber-attacks that can damage both the cyber and physical nature of the infrastructure. To date, the physical and cyber health of infrastructure has been considered separately. However, the increasing concerns associated with the cyber-physical security of infrastructure coupled with the emergence of 5G networks made using components that are not universally considered trustworthy, and the emergence of techniques for creating deepfakes and adversarial examples suggests the time has come to begin considering cyber health and structural health with a more holistic approach. In this work, a protocol is developed for ensuring the imagery data captured by a structural health monitoring system can be unambiguously attributed to legitimate sensors associated with the structural health monitoring system. A computer vision approach based on the idea of mutual information is then presented to detect damage in an image. This work presents the protocol for authenticating the provenance of imager data and demonstrates that this protocol does not have overly adverse effects when used with the mutual information-based technique for detecting damage in the resulting imagery data.

Jung, HweeKwon↗