Search NASA⌕ Search

SEARCH · Search NASA

Results for “Vision Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
NASA NTRS2006

Runway Safety Monitor Algorithm for Single and Crossing Runway Incursion Detection and Alerting

The Runway Safety Monitor (RSM) is an aircraft based algorithm for runway incursion detection and alerting that was developed in support of NASA's Runway Incursion Prevention System (RIPS) research conducted under the NASA Aviation Safety and Security Program's Synthetic Vision System project. The RSM algorithm provides warnings of runway incursions in sufficient time for pilots to take evasive action and avoid accidents during landings, takeoffs or when taxiing on the runway. The report documents the RSM software and describes in detail how RSM performs runway incursion detection and alerting functions for NASA RIPS. The report also describes the RIPS flight tests conducted at the Reno/Tahoe International Airport (RNO) and the Wallops Flight Facility (WAL) during July and August of 2004, and the RSM performance results and lessons learned from those flight tests.

Green, David F., Jr.↗
NASA NTRS2005

Insect-Inspired Optical-Flow Navigation Sensors

Integrated circuits that exploit optical flow to sense motions of computer mice on or near surfaces ( optical mouse chips ) are used as navigation sensors in a class of small flying robots now undergoing development for potential use in such applications as exploration, search, and surveillance. The basic principles of these robots were described briefly in Insect-Inspired Flight Control for Small Flying Robots (NPO-30545), NASA Tech Briefs, Vol. 29, No. 1 (January 2005), page 61. To recapitulate from the cited prior article: The concept of optical flow can be defined, loosely, as the use of texture in images as a source of motion cues. The flight-control and navigation systems of these robots are inspired largely by the designs and functions of the vision systems and brains of insects, which have been demonstrated to utilize optical flow (as detected by their eyes and brains) resulting from their own motions in the environment. Optical flow has been shown to be very effective as a means of avoiding obstacles and controlling speeds and altitudes in robotic navigation. Prior systems used in experiments on navigating by means of optical flow have involved the use of panoramic optics, high-resolution image sensors, and programmable imagedata- processing computers.

Thakoor, Sarita↗
NASA NTRS2016

Performance Evaluation of Speech Recognition Systems as a Next-Generation Pilot-Vehicle Interface Technology

During the flight trials known as Gulfstream-V Synthetic Vision Systems Integrated Technology Evaluation (GV-SITE), a Speech Recognition System (SRS) was used by the evaluation pilots. The SRS system was intended to be an intuitive interface for display control (rather than knobs, buttons, etc.). This paper describes the performance of the current "state of the art" Speech Recognition System (SRS). The commercially available technology was evaluated as an application for possible inclusion in commercial aircraft flight decks as a crew-to-vehicle interface. Specifically, the technology is to be used as an interface from aircrew to the onboard displays, controls, and flight management tasks. A flight test of a SRS as well as a laboratory test was conducted.

Arthur, Jarvis J., III↗
NASA NTRS2024

Exploration Systems Exterior Lighting Design Guidance

Humans are returning to the Moon — this time, to stay. NASA has selected a location that maximizes line-of-sight communication with Earth, solar visibility, and access to water ice: the Lunar South Pole (LSP). While the Sun is more consistently in the lunar sky at the poles, it never rises more than 7° above the horizon in the target landing regions. This harsh lighting environment--never experienced during the Apollo missions or in human spaceflight--presents an engineering challenge: Support and protect functional vision. The human vision system, which despite having a high-dynamic range, cannot see well into bright light and cannot adapt quickly from bright to dark or vice versa. The design of helmets, windows, and lighting solutions must work in a complementary fashion to achieve a system of lighting and functional vision support that enables crews to see into darkness while their eyes are light-adapted and see in bright light while still dark-adapted that protects their eyes from injury. This report brings together information and identifies gaps related to LSP Natural environment (topology, regolith, temperature, lighting, and so forth), NASA historical experience exploring the Moon, human vision capabilities and needs, exploration operations, simulation capabilities and needs (for design verification, training, mission planning, and so forth) and existing engineering, safety, medical and performance requirements related to support human exploration.

Simulation↗
NASA NTRS1992

Visual information processing; Proceedings of the Meeting, Orlando, FL, Apr. 20-22, 1992

Topics discussed in these proceedings include nonlinear processing and communications; feature extraction and recognition; image gathering, interpolation, and restoration; image coding; and wavelet transform. Papers are presented on noise reduction for signals from nonlinear systems; driving nonlinear systems with chaotic signals; edge detection and image segmentation of space scenes using fractal analyses; a vision system for telerobotic operation; a fidelity analysis of image gathering, interpolation, and restoration; restoration of images degraded by motion; and information, entropy, and fidelity in visual communication. Attention is also given to image coding methods and their assessment, hybrid JPEG/recursive block coding of images, modified wavelets that accommodate causality, modified wavelet transform for unbiased frequency representation, and continuous wavelet transform of one-dimensional signals by Fourier filtering.

Huck, Friedrich O.↗
NASA NTRS2019

Demonstration of stereo vision for deorbit descent and landing

This paper describes results from a recent helicopter field test of a binocular stereo vision system for deorbit descent and landing applications. The system consisted of two 18.6˚ field of view cameras mounted 1.7m apart. Post processing of the images showed ranging accuracy better than 1% up to 500m and 17 cm/s velocimetry accuracy at 37m. For a flight system these images could be input into an FPGA-based processor which processes dense stereo and visual odometry in less than 1 second to achieve the stereo ranging frame rates required for soft landing. When coupled with vision based Terrain Relative Navigation this stereo system enables landing accuracies on the order of 10m.

Johnson, Andrew E.↗
NASA NTRS2006

An Automated Classification Technique for Detecting Defects in Battery Cells

Battery cell defect classification is primarily done manually by a human conducting a visual inspection to determine if the battery cell is acceptable for a particular use or device. Human visual inspection is a time consuming task when compared to an inspection process conducted by a machine vision system. Human inspection is also subject to human error and fatigue over time. We present a machine vision technique that can be used to automatically identify defective sections of battery cells via a morphological feature-based classifier using an adaptive two-dimensional fast Fourier transformation technique. The initial area of interest is automatically classified as either an anode or cathode cell view as well as classified as an acceptable or a defective battery cell. Each battery cell is labeled and cataloged for comparison and analysis. The result is the implementation of an automated machine vision technique that provides a highly repeatable and reproducible method of identifying and quantifying defects in battery cells.

McDowell, Mark↗
DOE OSTI2025

Automating Testing of DUNE Electronics via a Finite State Machine

The Deep Underground Neutrino Experiment (DUNE) is a flagship international collaboration designed to study neutrinos tiny, nearly massless particles that may hold answers to fundamental questions about the Universe. Fermilab s Robotic Test Stand (RTS) plays a critical role in ensuring the quality of approximately 50,000 Application-Specific Integrated Circuit (ASIC) chips that will be used in DUNE s massive liquid argon detectors. These electronics will be inside the cryostat; therefore, they will need to have a high yield of working chips and low noise. To improve the automation and reliability of the RTS, this project focused on designing and implementing a Python-based finite state machine (FSM) to manage chip handling workflows. The FSM was developed as a modular software framework to coordinate robotic arm movements, manage chip tray positions, and monitor system states during testing. Key features include robust error handling routines, a pause/resume system for safe mid-cycle interruptions, and a simulation mode for iterative testing without hardware dependencies. The system was designed to prepare for seamless integration with RTS hardware components such as the robotic arm and vision system. This integration will streamline collaboration and enable efficient deployment of updates across the six total institutions performing testing. The outcomes of this internship contribute to Fermilab s mission to advance high-energy physics and support the DOE s national goals by directly improving the testing of equipment to be used in DUNE. The project also provided valuable experience in software design and contributing to the success of DUNE.

Kang, Caleb [William Rainey Harper Coll.]↗
NASA NTRS1990

Photon detection with parallel asynchronous processing

An approach to photon detection with a parallel asynchronous signal processor is described. The visible or IR photon-detection capability of the silicon p(+)-n-n(+) detectors and the parallel asynchronous processing are addressed separately. This approach would permit an independent analog processing channel to be dedicated to every pixel. A laminar architecture consisting of a stack of planar arrays of the devices would form a 2D array processor with a 2D array of inputs located directly behind a focal-plane detector array. A 2D image data stream would propagate in neuronlike asynchronous pulse-coded form through the laminar processor. Such systems can integrate image acquisition and image processing. Acquisition and processing would be performed concurrently as in natural vision systems. The possibility of multispectral image processing is addressed.

Coon, D. D.↗
NASA NTRS1994

Airborne Windshear Detection and Warning Systems. Fifth and Final Combined Manufacturers' and Technologists' Conference, part 1

The Fifth (and Final) Combined Manufacturers' and Technologists' Airborne Windshear Review Meeting was hosted jointly by the NASA Langley Research Center (LaRC) and the Federal Aviation Administration (FAA) in Hampton, Virginia, on September 28-30, 1993. The purpose of the meeting was to report on the highly successful windshear experiments conducted by government, academic institutions, and industry; to transfer the results to regulators, manufacturers, and users; and to set initiatives for future aeronautics technology research. The formal sessions covered recent developments in windshear flight testing; windshear modeling, flight management, and ground-based systems; airborne windshear detection systems; certification and regulatory issues; development and applications of sensors for wake vortex detection; and synthetic and enhanced vision systems.

Delnore, Victor E.↗
NASA NTRS2013

Understanding Crew Decision-Making in the Presence of Complexity: A Flight Simulation Experiment

Crew decision making and response have long been leading causal and contributing factors associated with aircraft accidents. Further, it is anticipated that future aircraft and operational environments will increase exposure to risks related to these factors if proactive steps are not taken to account for ever-increasing complexity. A flight simulation study was designed to collect data to help in understanding how complexity can, or may, be manifest. More specifically, an experimental apparatus was constructed that allowed for manipulation of information complexity and uncertainty, while also manipulating operational complexity and uncertainty. Through these manipulations, and the aid of experienced airline pilots, several issues have been discovered, related most prominently to the influence of information content, quality, and management. Flight crews were immersed in an environment that included new operational complexities suggested for the future air transportation system as well as new technological complexities (e.g. electronic flight bags, expanded data link services, synthetic and enhanced vision systems, and interval management automation). In addition, a set of off-nominal situations were emulated. These included, for example, adverse weather conditions, traffic deviations, equipment failures, poor data quality, communication errors, and unexpected clearances, or changes to flight plans. Each situation was based on one or more reference events from past accidents or incidents, or on a similar case that had been used in previous developmental tests or studies. Over the course of the study, 10 twopilot airline crews participated, completing over 230 flights. Each flight consisted of an approach beginning at 10,000 ft. Based on the recorded data and pilot and research observations, preliminary results are presented regarding decision-making issues in the presence of the operational and technological complexities encountered during the flights.

Young, Steven D.↗
DOE OSTI2025

Automating Testing of DUNE Electronics via a Finite State Machine

The Deep Underground Neutrino Experiment (DUNE) is a flagship international collaboration designed to study neutrinos—tiny, nearly massless particles that may hold answers to fundamental questions about the Universe. Fermilab’s Robotic Test Stand (RTS) plays a critical role in ensuring the quality of approximately 50,000 Application-Specific Integrated Circuit (ASIC) chips that will be used in DUNE’s massive liquid argon detectors. These electronics will be inside the cryostat; therefore, they will need to have a high yield of working chips and low noise. To improve the automation and reliability of the RTS, this project focused on designing and implementing a Python-based finite state machine (FSM) to manage chip handling workflows. The FSM was developed as a modular software framework to coordinate robotic arm movements, manage chip tray positions, and monitor system states during testing. Key features include robust error handling routines, a pause/resume system for safe mid-cycle interruptions, and a simulation mode for iterative testing without hardware dependencies. The system was designed to prepare for seamless integration with RTS hardware components such as the robotic arm and vision system. This integration will streamline collaboration and enable efficient deployment of updates across the six institutions performing testing. The outcomes of this internship contribute to Fermilab’s mission to advance high-energy physics and support the DOE’s national goals by directly improving the testing of equipment to be used in DUNE. The project also provided valuable experience in software design and contributing to the success of DUNE.

Kang, Caleb [Fermilab]↗
NASA NTRS1994

Airborne Windshear Detection and Warning Systems. Fifth and Final Combined Manufacturers' and Technologists' Conference, part 2

The Fifth Combined Manufacturers' and Technologists' Airborne Windshear Review Meeting was hosted by the NASA Langley Research Center and the Federal Aviation Administration in Hampton, Virginia, on September 28-30, 1993. The purpose was to report on the highly successful windshear experiments conducted by government, academic institutions, and industry; to transfer the results to regulators, manufacturers, and users; and to set initiatives for future aeronautics technology research. The formal sessions covered recent developments in windshear flight testing, windshear modeling, flight management, and ground-based systems, airborne windshear detection systems, certification and regulatory issues, and development and applications of sensors for wake vortices and for synthetic and enhanced vision systems. This report was compiled to record and make available the technology updates and materials from the conference.

Delnore, Victor E.↗
NASA NTRS2008

Range Imaging without Moving Parts

Range-imaging instruments of a type now under development are intended to generate the equivalent of three-dimensional images from measurements of the round-trip times of flight of laser pulses along known directions. These instruments could also provide information on characteristics of targets, including roughnesses and reflectivities of surfaces and optical densities of such semi-solid objects as trees and clouds. Unlike in prior range-imaging instruments based on times of flight along known directions, there would be no moving parts; aiming of the laser beams along the known directions would not be accomplished by mechanical scanning of mirrors, prisms, or other optical components. Instead, aiming would be accomplished by using solid-state devices to switch input and output beams along different fiber-optic paths. Because of the lack of moving parts, these instruments could be extraordinarily reliable, rugged, and long-lasting. An instrument of this type would include an optical transmitter that would send out a laser pulse along a chosen direction to a target. An optical receiver coaligned with the transmitter would measure the temporally varying intensity of laser light reflected from the target to determine the distance and surface characteristics of the target. The transmitter would be a combination of devices for generating precise directional laser illumination. It would include a pulsed laser, the output of which would be coupled into a fiber-optic cable with a fan-out and solid-state optical switches that would enable switching of the laser beam onto one or more optical fibers terminated at known locations in an array on a face at the focal plane of a telescope. The array would be imaged by the telescope onto the target space. The receiver optical system could share the aforementioned telescope with the transmitter or could include a separate telescope aimed in the same direction as that of the transmitting telescope. In either case, light reflected from the target would be focused by the receiver optical system onto an array of optical fibers matching the array in the transmitter. These optical fibers would couple the received light to one or more photodetector( s). Optionally, the receiver could include solid-state optical switches for choosing which optical fiber(s) would couple light to the photodetector(s). This instrument architecture is flexible and can be optimized for a wide variety of applications and levels of performance. For example, it is scalable to any number of pixels and pixel resolutions and is compatible with a variety of ranging and photodetection methodologies, including, for example, ranging by use of modulated (including pulsed and encoded) light signals. The use of fixed arrays of optical fibers to generate controlled illumination patterns would eliminate the mechanical complexity and much of the bulk of optomechanical scanning assemblies. Furthermore, digital control of the selection of the fiber-optic pathways for the transmitted beams could afford capabilities not seen in previous three-dimensional range-imaging systems. Instruments of this type could be specialized for use as, for example, proximity detectors, three-dimensional robotic vision systems, airborne terrain-mapping systems, and inspection systems.

Blair, J. Bryan↗
NASA NTRS2011

Autonomous Landing and Ingress of Micro-Air-Vehicles in Urban Environments Based on Monocular Vision

Unmanned micro air vehicles (MAVs) will play an important role in future reconnaissance and search and rescue applications. In order to conduct persistent surveillance and to conserve energy, MAVs need the ability to land, and they need the ability to enter (ingress) buildings and other structures to conduct reconnaissance. To be safe and practical under a wide range of environmental conditions, landing and ingress maneuvers must be autonomous, using real-time, onboard sensor feedback. To address these key behaviors, we present a novel method for vision-based autonomous MAV landing and ingress using a single camera for two urban scenarios: landing on an elevated surface, representative of a rooftop, and ingress through a rectangular opening, representative of a door or window. Real-world scenarios will not include special navigation markers, so we rely on tracking arbitrary scene features; however, we do currently exploit planarity of the scene. Our vision system uses a planar homography decomposition to detect navigation targets and to produce approach waypoints as inputs to the vehicle control algorithm. Scene perception, planning, and control run onboard in real-time; at present we obtain aircraft position knowledge from an external motion capture system, but we expect to replace this in the near future with a fully self-contained, onboard, vision-aided state estimation algorithm. We demonstrate autonomous vision-based landing and ingress target detection with two different quadrotor MAV platforms. To our knowledge, this is the first demonstration of onboard, vision-based autonomous landing and ingress algorithms that do not use special purpose scene markers to identify the destination.

micro air vehicles (MAVs)↗
NASA NTRS2015

ALHAT COBALT: CoOperative Blending of Autonomous Landing Technology

The COBALT project is a flight demonstration of two NASA ALHAT (Autonomous precision Landing and Hazard Avoidance Technology) capabilities that are key for future robotic or human landing GN&C (Guidance, Navigation and Control) systems. The COBALT payload integrates the Navigation Doppler Lidar (NDL) for ultraprecise velocity and range measurements with the Lander Vision System (LVS) for Terrain Relative Navigation (TRN) position estimates. Terrestrial flight tests of the COBALT payload in an open-loop and closed-loop GN&C configuration will be conducted onboard a commercial, rocket-propulsive Vertical Test Bed (VTB) at a test range in Mojave, CA.

Carson, John M.↗
NASA NTRS2021

Assessing Ceres’ Past and Current Habitability

Dwarf planet Ceres is a compelling target as an evolved ocean world with, at least, regional brine reservoirs and potentially ongoing geological activity. Situated in the Main Belt of asteroids, Ceres is the most water-rich body in the inner solar system (in relative abundance) and is accessible enough for a sample return with the resources of a typical medium-class (New Frontiers) NASA mission. NASA’s Dawn mission at Ceres revealed the presence of liquid, brine-driven activity, organic matter, and a rich salt chemistry. With this evidence, the overarching goals of the mission concept presented herein are to quantify Ceres’ current habitability potential and origin. A sample return from young evaporite deposits in Occator crater offers greater science return than an in situ exploration mission by enabling high-resolution analysis of (1) organic matter expected from terrestrial and chondritic analogs that are trapped in salt minerals and (2) isotopes of refractory elements for a similar cost and less science risk. The sample return concept would be executed with a single flight system due to Ceres’ relative proximity to Earth and low gravity. Solar electric propulsion was identified as the most cost-effective approach for getting to Ceres and back. De-orbiting, landing, and takeoff are performed with a throttleable monopropellant hydrazine system. The solar arrays are stowed prior to landing and takeoff. Sample acquisition builds on the pneumatic system designed by Honeybee Robotics. The sample return mission concept relies on the availability of key technologies: an enhanced landing vision system leveraging investments from Mars 2020; retractable/redeployable solar arrays, which have been demonstrated on the International Space Station but not at Ceres’ gravity; and an emerging design from upcoming missions for sample transfer from the pneumatic sampling system to the sample return capsule. Return of a sample of mass ~100 g from Ceres, maintained at ≤ -20°C, is without precedent for any currently advocated Ocean World mission, enabling a vast range of experimental techniques back on Earth with sensitivities and accuracies far beyond those feasible with in situ instruments. A sample of this size also enables analyses to benefit from techniques that will become available in the future.

Casillas, Raul Polit↗
NASA NTRS1994

Autonomous navigation system for the Marsokhod rover project

This paper presents a general overview of the Marsokhod rover mission. The autonomous navigation for a Mars exploration rover is controlled by a vision system which has been developed on the basis of two CCD cameras, stereovision and path planning algorithms. Its performances have been tested on a Mars-like experimentation site.

Proy, C.↗