Search NASA⌕ Search

SEARCH · Search NASA

Results for “Computer Vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
NASA NTRS2022

Bayesian Deep Learning for Segmentation for Autonomous Safe Planetary Landing

Hazard detection is critical for enabling autonomous landing on planetary surfaces. Current state-of-the-art methods leverage traditional computer vision approaches to automate the identification of safe terrain from input digital elevation models (DEMs). However, performance for these methods can degrade for input DEMs with increased sensor noise. In the last decade, deep learning techniques have been developed for various applications. Nevertheless, their applicability to safety-critical space missions has often been limited due to concerns regarding their outputs’ reliability. In response to these limitations, this paper proposes an application of the Bayesian deep learning segmentation method for hazard detection. The developed approach enables reliable, safe landing site detection by i) generating simultaneously a safety prediction map and its uncertainty map via Bayesian deep learning and semantic segmentation, and ii) using the uncertainty map to filter out the uncertain pixels in the prediction map so that the safe site identification is performed only based on the certain pixels (i.e., pixels for which the model is certain about its safety prediction). Experiments are presented with simulated data based on a Mars HiRISE digital terrain model by varying uncertainty threshold and noise levels to demonstrate the performance of the proposed approach.

Kento Tomita↗
NASA NTRSDate not supplied

ARCTRON: A Rapid Experimental Proving Ground for TPS Experiments and Arcjet Technology Development

Innovation in high-enthalpy facilities is fundamentally limited by the cost and risk of experimentation. New concepts for plasma control, diagnostics, facility components, and plasma-material interaction often require repeated iterations that are impractical to perform in production arcjets. As a result, promising ideas may remain unexplored or reach operational facilities only after significant development effort. ARCTRON is being developed as a rapid experimental proving ground where new ideas in plasma science, arcjet engineering, diagnostics, and material response can be conceived, tested, and quantitatively evaluated before transition to large-scale facilities. The platform combines radio-frequency (RF) and DC arc plasma generation, externally applied magnetic fields, configurable gas composition, reduced-pressure operation, laser heating, electrical biasing, and modular diagnostic access. These capabilities permit the plasma source, applied forcing, test article, and measurement configuration to be modified independently, allowing individual physical mechanisms to be isolated more readily than in a traditional test environment. One class of investigations addresses fundamental plasma-surface interaction physics. Conventional material tests often expose a specimen simultaneously to convective heating, reactive species, pressure, shear, radiation, and surface-current effects. The resulting material response may be measured accurately, while the contribution of each mechanism remains difficult to identify. ARCTRON is designed to vary these effects selectively. Plasma chemistry can be changed independently through configurable gas mixtures; magnetic fields and electrical biasing can modify charged-particle transport; laser heating can provide a non-plasma thermal input; and pressure, flow, and discharge mode can be varied over a broad operating space. This enables controlled tests of hypotheses involving surface catalycity, reactive-species transport, plasma-assisted oxidation, electromagnetic effects, shear, and the relative contributions of thermal and chemical loading. A second class of investigations enabled by this approach concerns the engineering of high-enthalpy facilities themselves. Arc-heated facilities are limited by electrode erosion, unstable arc attachment, localized heating, and damage to nozzles and other plasma-facing components. ARCTRON provides a lower-cost environment for testing concepts intended to mitigate these limitations. Candidate investigations include the use of applied magnetic fields to alter current paths and reduce plasma interaction with nozzle walls, ExB forcing to introduce controlled plasma rotation, magnetic or geometric approaches for distributing arc attachment, and alternative electrode or discharge configurations intended to reduce erosion and improve stability. Because the platform is reconfigurable, these concepts can be evaluated through repeated design--build--test cycles before they are considered for implementation in operational facilities. The platform also supports the development and validation of diagnostics that may be difficult to introduce initially into a large arcjet. Current and planned measurements include spatially resolved optical emission spectroscopy, electrostatic probes, fast imaging, pyrometry, calorimetry, laser-induced fluorescence, and absorption spectroscopy. These diagnostics are intended not merely to document a nominal operating condition, but to constrain the local plasma state and its relationship to component or material response. The modular facility geometry allows diagnostic concepts to be tested, calibrated, and compared under repeatable conditions before deployment in more demanding environments. ARCTRON is also supported by an integrated software suite. Automated control and data acquisition allow discharge parameters, gas composition, magnetic fields, diagnostic timing, and test configuration to be recorded as part of each experiment (STARDAC - Software for Testing, Analysis, Research Data, and Control). The Backend for Experiment Analysis, Storage, and Traceability (BEAST) is a database that provides the infrastructure needed to associate heterogeneous measurements with facility configuration, specimen identity, calibration state, geometry, and analysis provenance. This backend is particularly important for exploratory campaigns, in which many related configurations may be tested, and the value of an individual experiment depends on its connection to earlier and subsequent iterations. Complementary analysis capabilities, including computer-vision-based transient response measurements (arcjetCV), three-dimensional surface reconstruction (STARSCAN), and model-based Bayesian inference (SHIELD), and tomography data analysis (TOMATO, PuMA) can be incorporated when required by a specific hypothesis without becoming the focus of every campaign. The central objective of ARCTRON is therefore not to maximize heat flux or reproduce a complete flight environment. Its purpose is to reduce the cost and time required to ask consequential questions about plasma behavior, plasma-facing materials, diagnostics, and arcjet technology. By providing a controlled environment for rapid reconfiguration, mechanism isolation, quantitative measurement, and iterative engineering, ARCTRON can help mature concepts that would otherwise remain too speculative or too risky for evaluation in production facilities. The resulting knowledge can then guide the design of material models, focus test objectives in larger arcjets, reduce facility-development risk, and improve the physical basis of high-enthalpy ground testing. This work will present the ARCTRON architecture, operating modes, diagnostic suite, and digital experimental workflow. Initial experimental results from the first integrated operation of the facility will be presented, including flow characterization, power limitations, and deployment of the initial diagnostic suite. Ongoing development efforts aimed at catalycity characterization, magnetic plasma control, and advanced optical diagnostics will also be discussed, illustrating how the platform supports rapid iteration from concept to experiment.

experimental diagnostics↗
NASA NTRSDate not supplied

BEAST: Expanding Sustainable Data Infrastructure for High-Enthalpy Facilities

Reproducible, data-driven thermal protection system (TPS) research requires that experimental records from high-enthalpy testing be consistently structured, traceable, and accessible across campaigns and institutions. In practice, however, arcjet and plasma facilities data remain largely fragmented: raw diagnostics are stored in ad hoc formats, material sample histories are disconnected from test conditions, and metadata standards are absent, precluding systematic cross-campaign analysis and long-term reuse. BEAST (Backend for Experiment Analysis, Storage, and Traceability) is an open-source, web-based platform that addresses these limitations by providing a unified, queryable infrastructure for high-enthalpy ground-test data [1]. First presented at the 15th Ablation Workshop [2], BEAST has since undergone significant development. The platform ingests and structures multi-channel time-series diagnostics, facility configurations, and material property records within a common provenance model, ensuring end-to-end traceability from raw sensor acquisition to reduced experimental quantities. A versioned material library links specimen identity and processing history to the specific runs in which each sample was tested. An integrated modeling workbench enables training and evaluation of regression models directly on archived experimental data, supporting condition interpolation and the construction of empirical material response databases. Beyond its original deployment at NASA Ames Research Center, BEAST has been designed to be facility-agnostic, with ongoing efforts to extend its adoption to other facilities. Its modular architecture accommodates heterogeneous diagnostic setups and facility types, and its future open-source distribution allows institutions to build on a common data standard rather than maintaining isolated, bespoke solutions. BEAST is further integrated within a broader ecosystem of companion tools: arcjetCV [3] extracts recession rates and shock standoff distances from high-speed video using computer vision, and miniSTARscan [4] provides sub-minute, portable photogrammetric surface reconstruction of test articles before and after exposure. All tools share a common data schema, enabling seamless ingestion of surface geometry, imagery, and time-series data into a single, coherent experimental record.

Database↗
NASA NTRSDate not supplied

ARCTRON: A Rapid Experimental Proving Ground for TPS Experiments and Arcjet Technology Development

Innovation in high-enthalpy facilities is fundamentally limited by the cost and risk of experimentation. New concepts for plasma control, diagnostics, facility components, and plasma-material interaction often require repeated iterations that are impractical to perform in production arcjets. As a result, promising ideas may remain unexplored or reach operational facilities only after significant development effort. ARCTRON is being developed as a rapid experimental proving ground where new ideas in plasma science, arcjet engineering, diagnostics, and material response can be conceived, tested, and quantitatively evaluated before transition to large-scale facilities. The platform combines radio-frequency (RF) and DC arc plasma generation, externally applied magnetic fields, configurable gas composition, reduced-pressure operation, laser heating, electrical biasing, and modular diagnostic access. These capabilities permit the plasma source, applied forcing, test article, and measurement configuration to be modified independently, allowing individual physical mechanisms to be isolated more readily than in a traditional test environment. One class of investigations addresses fundamental plasma-surface interaction physics. Conventional material tests often expose a specimen simultaneously to convective heating, reactive species, pressure, shear, radiation, and surface-current effects. The resulting material response may be measured accurately, while the contribution of each mechanism remains difficult to identify. ARCTRON is designed to vary these effects selectively. Plasma chemistry can be changed independently through configurable gas mixtures; magnetic fields and electrical biasing can modify charged-particle transport; laser heating can provide a non-plasma thermal input; and pressure, flow, and discharge mode can be varied over a broad operating space. This enables controlled tests of hypotheses involving surface catalycity, reactive-species transport, plasma-assisted oxidation, electromagnetic effects, shear, and the relative contributions of thermal and chemical loading. A second class of investigations enabled by this approach concerns the engineering of high-enthalpy facilities themselves. Arc-heated facilities are limited by electrode erosion, unstable arc attachment, localized heating, and damage to nozzles and other plasma-facing components. ARCTRON provides a lower-cost environment for testing concepts intended to mitigate these limitations. Candidate investigations include the use of applied magnetic fields to alter current paths and reduce plasma interaction with nozzle walls, ExB forcing to introduce controlled plasma rotation, magnetic or geometric approaches for distributing arc attachment, and alternative electrode or discharge configurations intended to reduce erosion and improve stability. Because the platform is reconfigurable, these concepts can be evaluated through repeated design--build--test cycles before they are considered for implementation in operational facilities. The platform also supports the development and validation of diagnostics that may be difficult to introduce initially into a large arcjet. Current and planned measurements include spatially resolved optical emission spectroscopy, electrostatic probes, fast imaging, pyrometry, calorimetry, laser-induced fluorescence, and absorption spectroscopy. These diagnostics are intended not merely to document a nominal operating condition, but to constrain the local plasma state and its relationship to component or material response. The modular facility geometry allows diagnostic concepts to be tested, calibrated, and compared under repeatable conditions before deployment in more demanding environments. ARCTRON is also supported by an integrated software suite. Automated control and data acquisition allow discharge parameters, gas composition, magnetic fields, diagnostic timing, and test configuration to be recorded as part of each experiment (STARDAC - Software for Testing, Analysis, Research Data, and Control). The Backend for Experiment Analysis, Storage, and Traceability (BEAST) is a database that provides the infrastructure needed to associate heterogeneous measurements with facility configuration, specimen identity, calibration state, geometry, and analysis provenance. This backend is particularly important for exploratory campaigns, in which many related configurations may be tested, and the value of an individual experiment depends on its connection to earlier and subsequent iterations. Complementary analysis capabilities, including computer-vision-based transient response measurements (arcjetCV), three-dimensional surface reconstruction (STARSCAN), and model-based Bayesian inference (SHIELD), and tomography data analysis (TOMATO, PuMA) can be incorporated when required by a specific hypothesis without becoming the focus of every campaign. The central objective of ARCTRON is therefore not to maximize heat flux or reproduce a complete flight environment. Its purpose is to reduce the cost and time required to ask consequential questions about plasma behavior, plasma-facing materials, diagnostics, and arcjet technology. By providing a controlled environment for rapid reconfiguration, mechanism isolation, quantitative measurement, and iterative engineering, ARCTRON can help mature concepts that would otherwise remain too speculative or too risky for evaluation in production facilities. The resulting knowledge can then guide the design of material models, focus test objectives in larger arcjets, reduce facility-development risk, and improve the physical basis of high-enthalpy ground testing. This work will present the ARCTRON architecture, operating modes, diagnostic suite, and digital experimental workflow. Initial experimental results from the first integrated operation of the facility will be presented, including flow characterization, power limitations, and deployment of the initial diagnostic suite. Ongoing development efforts aimed at catalycity characterization, magnetic plasma control, and advanced optical diagnostics will also be discussed, illustrating how the platform supports rapid iteration from concept to experiment.

experimental diagnostics↗
NASA NTRSDate not supplied

BEAST: Expanding Sustainable Data Infrastructure for High-Enthalpy Facilities

Reproducible, data-driven thermal protection system (TPS) research requires that experimental records from high-enthalpy testing be consistently structured, traceable, and accessible across campaigns and institutions. In practice, however, arcjet and plasma facilities data remain largely fragmented: raw diagnostics are stored in ad hoc formats, material sample histories are disconnected from test conditions, and metadata standards are absent, precluding systematic cross-campaign analysis and long-term reuse. BEAST (Backend for Experiment Analysis, Storage, and Traceability) is an open-source, web-based platform that addresses these limitations by providing a unified, queryable infrastructure for high-enthalpy ground-test data [1]. First presented at the 15th Ablation Workshop [2], BEAST has since undergone significant development. The platform ingests and structures multi-channel time-series diagnostics, facility configurations, and material property records within a common provenance model, ensuring end-to-end traceability from raw sensor acquisition to reduced experimental quantities. A versioned material library links specimen identity and processing history to the specific runs in which each sample was tested. An integrated modeling workbench enables training and evaluation of regression models directly on archived experimental data, supporting condition interpolation and the construction of empirical material response databases. Beyond its original deployment at NASA Ames Research Center, BEAST has been designed to be facility-agnostic, with ongoing efforts to extend its adoption to other facilities. Its modular architecture accommodates heterogeneous diagnostic setups and facility types, and its future open-source distribution allows institutions to build on a common data standard rather than maintaining isolated, bespoke solutions. BEAST is further integrated within a broader ecosystem of companion tools: arcjetCV [3] extracts recession rates and shock standoff distances from high-speed video using computer vision, and miniSTARscan [4] provides sub-minute, portable photogrammetric surface reconstruction of test articles before and after exposure. All tools share a common data schema, enabling seamless ingestion of surface geometry, imagery, and time-series data into a single, coherent experimental record.

Database↗
NASA NTRS1990

A computational model for dynamic vision

This paper describes a novel computational model for dynamic vision which promises to be both powerful and robust. Furthermore the paradigm is ideal for an active vision system where camera vergence changes dynamically. Its basis is the retinotopically indexed object-centered encoding of the early visual information. Specifically, the relative distances of objects to a set of referents is encoded in image registered maps. To illustrate the efficacy of the method, it is applied to the problem of dynamic stereo vision. Integration of depth information over multiple frames obtained by a moving robot generally requires precise information about the relative camera position from frame to frame. Usually, this information can only be approximated. The method facilitates the integration of depth information without direct use or knowledge of camera motion.

Moezzi, Saied↗
NASA NTRS1985

Computational models of human vision with applications

Perceptual problems in aeronautics were studied. The mechanism by which color constancy is achieved in human vision was examined. A computable algorithm was developed to model the arrangement of retinal cones in spatial vision. The spatial frequency spectra are similar to the spectra of actual cone mosaics. The Hartley transform as a tool of image processing was evaluated and it is suggested that it could be used in signal processing applications, GR image processing.

Wandell, B. A.↗
NASA NTRS1985

Application of a computable model of human spatial vision to phase discrimination

A computable model of human spatial vision is used to make predictions for phase-discrimination experiments. This model is being developed to deal with a broad range of problems in vision and was not specifically formulated to deal with phase discrimination. In the model, cross-correlation of the stimuli with an array of sensors produces feature vectors that are operated on by a position-uncertain ideal observer to simulate detection and discrimination experiments. In this report, the stimuli are compound sinusoidal gratings composed of a fundamental and a higher-frequency component added in various phases. Model predictions are compared with three key results from the literature: (1) the effect of the contrast of the fundamental on phase discrimination, (2) threshold phase difference as a function of the fundamental frequency, and (3) the contrast required for phase discrimination as a function of the frequency ratio of the two grating components. In the first two cases, the predictions capture the main features of the data, although quantitative discrepancies remain. In the third case, the model fails, and this failure suggests additional restrictions on the combination of information across sensors.

Nielsen, K. R. K.↗
NASA NTRSDate not supplied

NASA’s Vision for Spaceflight Computing

Future NASA mission applications demand onboard computing performance, power efficiency, and flexibility not available from current products. To address these needs, NASA’s High Performance Spaceflight Computing (HPSC) project is developing a radiation hardened, general purpose multi-core processor. Key HPSC objectives include natural space radiation hardness, fault tolerance, computation performance and extensibility, and power scalability. This presentation will first highlight how advances in spaceflight computing are key to NASA’s envisioned future for advanced avionics. Descriptions will then be provided for NASA mission applications and use cases that demand advanced spaceflight computing. The presentation will then provide an overview of NASA’s HPSC project and how it will address the computational demands of future missions.

Wesley Powell↗
NASA NTRSDate not supplied

3D Localization of Defects in Facility Inspection

Wind tunnels are crucial facilities that support the aerospace industry. However, these facilities are large, complex, and pose unique maintenance and inspection requirements. Manual inspections to identify defects such as cracks, missing fasteners, leaks, and foreign objects are important but labor and schedule intensive. Our goal is to utilize small Unmanned Aircraft Systems (sUAS) and computer vision-based analysis to automate the inspection of the interior and exterior of NASA’s critical wind tunnel facilities. We detect missing fasteners as our defect class, and detect existing fasteners to provide potential future missing fastener sites for preventative maintenance. These detections are done on both 2D raw images and in 3D space to provide a visual reference and real world location to facilitate repairs. A dataset was created consisting of images taken along a grid-like pattern of an interior tunnel section in the AEDC National Full-Scale Aerodynamics Complex (NFAC) at NASA Ames Research Center. Our method uses object detection to create image level bounding boxes of the fasteners and missing fasteners, then uses photogrammetry to create a mapping from 2D image locations to 3D real world locations. The image level bounding boxes and the 2D to 3D mapping are then combined to determine the 3D location of the defects. We describe the data collection, photogrammetry, and computer vision techniques used for object detection as well as a quantitative analysis of the method.

Small Unmanned Aircraft Systems (sUAS)↗
NASA NTRS2014

CFD Vision 2030 Study: A Path to Revolutionary Computational Aerosciences

This report documents the results of a study to address the long range, strategic planning required by NASA's Revolutionary Computational Aerosciences (RCA) program in the area of computational fluid dynamics (CFD), including future software and hardware requirements for High Performance Computing (HPC). Specifically, the "Vision 2030" CFD study is to provide a knowledge-based forecast of the future computational capabilities required for turbulent, transitional, and reacting flow simulations across a broad Mach number regime, and to lay the foundation for the development of a future framework and/or environment where physics-based, accurate predictions of complex turbulent flows, including flow separation, can be accomplished routinely and efficiently in cooperation with other physics-based simulations to enable multi-physics analysis and design. Specific technical requirements from the aerospace industrial and scientific communities were obtained to determine critical capability gaps, anticipated technical challenges, and impediments to achieving the target CFD capability in 2030. A preliminary development plan and roadmap were created to help focus investments in technology development to help achieve the CFD vision in 2030.

Jeffrey P Slotnick↗
NASA NTRS1987

Computational models of human vision with applications

The research program supported by this grant was initiated in l977 by the Joint Institute for Aeronautics and Acoustics of the Department of Aeronautics and Astronautics at Stanford University. The purpose of the research was to study human performance with the goal of improving the design of flight instrumentation. By mutual agreement between the scientists at NASA-Ames and Stanford, all research activities in this area were consolidated into a single funding mechanism, NCC 2-307 (Center of Excellence Grant, 7/1/84 - present). This is the final report on this research grant.

Wandell, Brian A.↗
NASA NTRS1991

US automated rendezvous and capture capabilities review. Remote umbilical system abstract

This document will describe the technology developed at Kennedy Space Center (KSC) to demonstrate automatic tracking, docking, and mating of umbilical systems. Specifically the use of a real time six degree of freedom (6DOF) target tracking vision system, (developed by Adaptive Automation, Inc. under contract to KSC), is discussed in detail. The paper describes the use of mechanical compliance in the docking, mating, and tracking-after-mating operations. The vision system computes six coordinates that define the position and orientation of a three dimensional target using data from a single CCD camera. The camera is mounted on a 6DOF robot arm. After target coordinates are computed, they are transmitted to a supervisory computer which controls the robot motion in real time. Details of the image processing algorithms, image processing hardware, and target configuration used in the vision system are discussed in the paper. The motion of the space vehicle relative to the service structure after mating led us to the development of a compliant system that allows enough displacement of the target relative to the camera so that tracking after mating may continue. This reduces internal stresses between flight and ground hardware.

Delcastillo, Eduardo Lopez↗
NASA NTRSDate not supplied

VSLAM and Vision-based Approach and Landing for Advanced Air Mobility

Advanced Air Mobility (AAM) aircraft have many challenges in landing accurately and safely in urban, suburban, and rural environments. Localization in large and open rural environments could utilize GPS, but AAM aircraft in urban environments will encounter GPS degradation. Another challenge involves flight operation time, i.e., flying during the day or at night. There are different guidelines, landmarks, and landing light configurations at runways, heliports, and vertiports for daytime and nighttime applications. Tailoring feature detection methods for AAM approach and landing during the day and night pose different issues and challenges. It is easier to detect edges, lines, and other runway markers during the day than at night. Conversely, it is easier to see landing light configurations and patterns at nighttime than daytime. Consequently, utilizing the same feature detector for daytime and nighttime operations may not be feasible. This paper focuses on a vision-based precision approach and landing (PAL) by comparing ORB SLAM 2, a Vision Simultaneous Localization and Mapping (VSLAM) algorithm, and a novel EKF that combines onboard IMU measurements with coplanar pose from orthography and scaling with iterations (COPOSIT). Conducting unmanned aerial system (UAS) flight tests at NASA Armstrong Flight Research Center (AFRC) with landmarks and fiducials distributed around the landing zone provides a simulated AAM approach and landing data to test vision-based PAL methods to provide Alternative Position, Navigation, and Timing (APNT) solutions for AAM PAL applications. The novel vision-based PAL EKF with IMU and COPOSIT provides accurate state estimation when distributed landmarks and fiducials are in the field of view.

distributed sensing↗