Search NASA⌕ Search

SEARCH · Search NASA

Results for “VISION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2005

Flight Test Comparison Between Enhanced Vision (FLIR) and Synthetic Vision Systems

Limited visibility and reduced situational awareness have been cited as predominant causal factors for both Controlled Flight Into Terrain (CFIT) and runway incursion accidents. NASA s Synthetic Vision Systems (SVS) project is developing practical application technologies with the goal of eliminating low visibility conditions as a causal factor to civil aircraft accidents while replicating the operational benefits of clear day flight operations, regardless of the actual outside visibility condition. A major thrust of the SVS project involves the development/demonstration of affordable, certifiable display configurations that provide intuitive out-the-window terrain and obstacle information with advanced pathway guidance. A flight test evaluation was conducted in the summer of 2004 by NASA Langley Research Center under NASA s Aviation Safety and Security, Synthetic Vision System - Commercial and Business program. A Gulfstream G-V aircraft, modified and operated under NASA contract by the Gulfstream Aerospace Corporation, was flown over a 3-week period at the Reno/Tahoe International Airport and an additional 3-week period at the NASA Wallops Flight Facility to evaluate integrated Synthetic Vision System concepts. Flight testing was conducted to evaluate the performance, usability, and acceptance of an integrated synthetic vision concept which included advanced Synthetic Vision display concepts for a transport aircraft flight deck, a Runway Incursion Prevention System, an Enhanced Vision Systems (EVS), and real-time Database Integrity Monitoring Equipment. This paper focuses on comparing qualitative and subjective results between EVS and SVS display concepts.

Arthur, Jarvis J., III↗
NASA NTRS2000

Passive Night Vision Sensor Comparison for Unmanned Ground Vehicle Stereo Vision Navigation

One goal of the "Demo III" unmanned ground vehicle program is to enable autonomous nighttime navigation at speeds of up to 10 m.p.h. To perform obstacle detection at night with stereo vision will require night vision cameras that produce adequate image quality for the driving speeds, vehicle dynamics, obstacle sizes, and scene conditions that will be encountered. This paper analyzes the suitability of four classes of night vision cameras (3-5 micrometer cooled FLIR, 8-12 micrometer cooled FLIR, 8-12 micrometer uncooled FLIR, and image intensifiers) for night stereo vision, using criteria based on stereo matching quality, image signal to noise ratio, motion blur and synchronization capability. We find that only cooled FLIRs will enable stereo vision performance that meets the goals of the Demo III program for nighttime autonomous mobility.

Owens, Ken↗
NASA NTRS1990

A discrepancy within primate spatial vision and its bearing on the definition of edge detection processes in machine vision

The visual perception of form information is considered to be based on the functioning of simple and complex neurons in the primate striate cortex. However, a review of the physiological data on these brain cells cannot be harmonized with either the perceptual spatial frequency performance of primates or the performance which is necessary for form perception in humans. This discrepancy together with recent interest in cortical-like and perceptual-like processing in image coding and machine vision prompted a series of image processing experiments intended to provide some definition of the selection of image operators. The experiments were aimed at determining operators which could be used to detect edges in a computational manner consistent with the visual perception of structure in images. Fundamental issues were the selection of size (peak spatial frequency) and circular versus oriented operators (or some combination). In a previous study, circular difference-of-Gaussian (DOG) operators, with peak spatial frequency responses at about 11 and 33 cyc/deg were found to capture the primary structural information in images. Here larger scale circular DOG operators were explored and led to severe loss of image structure and introduced spatial dislocations (due to blur) in structure which is not consistent with visual perception. Orientation sensitive operators (akin to one class of simple cortical neurons) introduced ambiguities of edge extent regardless of the scale of the operator. For machine vision schemes which are functionally similar to natural vision form perception, two circularly symmetric very high spatial frequency channels appear to be necessary and sufficient for a wide range of natural images. Such a machine vision scheme is most similar to the physiological performance of the primate lateral geniculate nucleus rather than the striate cortex.

Jobson, Daniel J.↗
NASA NTRS2013

Enhanced Flight Vision Systems and Synthetic Vision Systems for NextGen Approach and Landing Operations

Synthetic Vision Systems and Enhanced Flight Vision System (SVS/EFVS) technologies have the potential to provide additional margins of safety for aircrew performance and enable operational improvements for low visibility operations in the terminal area environment with equivalent efficiency as visual operations. To meet this potential, research is needed for effective technology development and implementation of regulatory standards and design guidance to support introduction and use of SVS/EFVS advanced cockpit vision technologies in Next Generation Air Transportation System (NextGen) operations. A fixed-base pilot-in-the-loop simulation test was conducted at NASA Langley Research Center that evaluated the use of SVS/EFVS in NextGen low visibility approach and landing operations. Twelve crews flew approach and landing operations in a simulated NextGen Chicago O'Hare environment. Various scenarios tested the potential for using EFVS to conduct approach, landing, and roll-out operations in visibility as low as 1000 feet runway visual range (RVR). Also, SVS was tested to evaluate the potential for lowering decision heights (DH) on certain instrument approach procedures below what can be flown today. Expanding the portion of the visual segment in which EFVS can be used in lieu of natural vision from 100 feet above the touchdown zone elevation to touchdown and rollout in visibilities as low as 1000 feet RVR appears to be viable as touchdown performance was acceptable without any apparent workload penalties. A lower DH of 150 feet and/or possibly reduced visibility minima using SVS appears to be viable when implemented on a Head-Up Display, but the landing data suggests further study for head-down implementations.

Kramer, Lynda J.↗
DOE OSTI2025

ORBIT-2 Dataset for Scaling Exascale Vision Foundation Models for Weather and Climate Downscaling

This dataset release corresponds to the work conducted in ORBIT-2: Scaling Exascale Vision Foundation Models for Weather and Climate Downscaling, where large-scale AI methods were applied to improve climate and weather resolution. The collection integrates four widely used, publicly available datasets: ERA5, PRISM, DAYMET, and IMERG. To prepare the data for ORBIT-2 model training and evaluation, we applied a preprocessing pipeline that generates paired low-resolution and high-resolution samples, enabling supervised downscaling experiments. The transformation from coarse to fine scales was performed using bilinear regridding, consistent with the procedures described in WeatherBench2, a community benchmark for weather and climate AI models. This dataset supports the development and evaluation of foundation models designed for weather and climate downscaling at exascale. Additional details on methodology and applications can be found in Wang et al., ORBIT-2 (arXiv:2505.04802, 2025).

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2005

Database Integrity Monitoring for Synthetic Vision Systems Using Machine Vision and SHADE

In an effort to increase situational awareness, the aviation industry is investigating technologies that allow pilots to visualize what is outside of the aircraft during periods of low-visibility. One of these technologies, referred to as Synthetic Vision Systems (SVS), provides the pilot with real-time computer-generated images of obstacles, terrain features, runways, and other aircraft regardless of weather conditions. To help ensure the integrity of such systems, methods of verifying the accuracy of synthetically-derived display elements using onboard remote sensing technologies are under investigation. One such method is based on a shadow detection and extraction (SHADE) algorithm that transforms computer-generated digital elevation data into a reference domain that enables direct comparison with radar measurements. This paper describes machine vision techniques for making this comparison and discusses preliminary results from application to actual flight data.

Cooper, Eric G.↗
NASA NTRS2014

Are Medications Involved in Vision and Intracrancial Pressure Changes Seen in Spaceflight?

The Food and Drug Association Adverse Event Reports (FDA AER) from 2009-2011 were used to create a database from millions of known and suspected medication-related adverse events among the general public. Vision changes, sometimes associated with intracranial pressure changes (VIIP), have been noted in some long duration crewmembers. Changes in vision and blood pressure (which can subsequently affect intracranial pressure) are fairly common side effects of medications. The purpose of this study was to explore the possibility of medication involvement in crew VIIP symptoms. Reports of suspected medication-related adverse events may be filed with the Food and Drug Administration (FDA) by medical professionals or consumers. Quarterly compilations of these reports are available for public download. Adverse Event Reporting System (AERS) reports from 1/1/2009- 6/30/2012 were downloaded and compiled into a searchable database for this study. Reports involving individuals under the age of 18 and older than 65 were excluded from this analysis. Case reports involving chronic diseases such as cancer, diabetes, multiple sclerosis and other serious conditions were also excluded. A scan of the medical literature for medication-related VIIP-like adverse events was used to create a list of suspect medications. These medications, as well as certain medications used frequently by ISS crew, were used to query the database. Queries for use of suspected medications were run, and the nature of the symptoms reported in those cases were tabulated. Symptoms searched in the FDA AERS were chosen to include the typical symptoms noted in crewmembers with VIIP. Vision symptoms searched were: visual acuity reduced, visual impairment, and vitreous floaters. Pressure changes included: abnormal sensation in eye, intracranial pressure increased, intraocular pressure increased, optic neuritis, optic neuropathy, and papilloedema. Limited demographic information is included with the FDA AERS; relevant data were also sorted by age and sex from each report. RESULTS Steroid-containing oral contraceptives had the highest number of reports associated with vision (n=166) and pressure symptoms (n=54). Corticosteroid-containing medications were also high; prednisone, for example, had 137 reports of vision issues and 79 of pressure issues. Pain relievers were also a medication class with vision and pressure-related adverse events reported. Common over-the-counter medications such as acetaminophen, aspirin and ibuprofen each had multiple reports for both vision and pressure symptoms. Antimicrobial medications ciprofloxacin and diflucan were also associated with a number of vision and pressure-related AERS. Unexpectedly, pseudoephedrine and promethazine were mentioned in fewer than 20 reports each over the 3.5 years of data examined. The FDA AERS represents a wealth of data, but there are several limitations to its use. The data are entered by the public or medical professionals, but are not checked for accuracy or completeness and may even be entered multiple times. The causal relationship between a particular adverse event and a particular medication is not tested. The cases represent a broad spectrum of demographics, occupations, and health histories, and thus do not model the astronaut population well. There is no information on the frequency of use of a medication for comparison purposes; it is not possible to assign a rate for any particular adverse event. Nonetheless, there are compelling trends. Use of corticosteroid-containing medications, pain relievers (even over-the-counter), and oral contraceptives were associated with higher numbers of vision- or intracranial pressure-related adverse events. In general, there were more vision problems than pressure problems reported. Certain medications that were once suspected of playing a role in the crew VIIP syndrome, namely pseudoephedrine and promethazine, were found to have extremely low numbers of VIIP-like AERS in the FDA data. However, crew use of corticosteroid-containing medications and pain relievers may warrant additional investigation

Faust, K. M.↗
NASA NTRS2020

UAM Vision Concept of Operations (ConOps) UAM Maturity Level (UML) 4

This Vision ConOps is intended as a foundation to engage members of the UAM community and provide a consensus on the future vision of UAM operations. It provides a concept for more detailed discussion and a basis for the exploration of ideas using a common framework to inform the continued development and integration of UAM as part of the broader transportation system. Advanced Air Mobility (AAM) encompasses a range of innovative aviation technologies (small drones, electric aircraft, automated air traffic management, etc.) that are transforming aviation’s role in everyday life, including the movement of goods and people. Urban Air Mobility (UAM) represents one of the most exciting and complex AAM concepts with highly automated aircraft, providing commercial services to the public over densely populated cities. This concept has generated tremendous interest and industry investment. UAM envisages a future in which advanced technologies and new operational procedures enable practical, cost-effective air travel as an integral mode of transportation in metropolitan areas. It represents one of the most exciting and complex AAM concepts with highly automated aircraft providing commercial services to the public over densely populated cities. For this reason, the National Aeronautics and Space Administration (NASA) selected UAM as the initial goal of its AAM efforts and the focus of this Vision Concept of Operations (ConOps) document. UAM Community Vision ConOps: This Vision ConOps effort was led by experts from NASA’s Aeronautics Research Mission Directorate (ARMD) in collaboration with the Federal Aviation Administration (FAA) and Deloitte’s Ecosystem Advisory Group (a cohort of advisers with aviation, aerospace, and regulatory expertise). To develop this Vision ConOps, NASA, FAA, and Deloitte built upon the current body of aeronautical research and consulted with more than 100 stakeholder organizations. This UAM community includes entities ranging from legacy aviation leaders to innovators and new market entrants. Stakeholders consulted included the federal government, state and local government, aerospace original equipment manufacturers (OEMs), local transportation organizations, prospective UAM operators, academia, industry standards-setting bodies, airports, service suppliers, and others (as described in Appendix G). This input was captured through the following methods: • A series of more than two dozen interviews with industry experts, federal regulators, state and local governments, and industry trade groups provided insight into the challenges of UAM integration into the National Airspace System (NAS), as well as technology developments and a variety of perspectives as to how UAM systems will integrate. • A series of two-day community workshops enabling active, detailed engagement of nearly 100 industry, academic, federal, and state stakeholder individuals. These workshops, hosted by NASA and Deloitte, explored UAM concepts in detail, and stakeholders were invited to collaboratively analyze and propose solutions to some of the greatest conceptual challenges behind UAM at an intermediate state. • A review of more than 160 sources of UAM literature from across government, industry, and academia, which are listed in Appendix H. • The public sharing of workshop input and document drafts for review and input across the UAM community. Feedback in the form of more than 1,000 comments and inputs on the document was received from industry groups, individual companies, academia, and government (federal, state, and local), among others. Although effort was made to incorporate inputs from across the UAM stakeholder group, not all comments could ultimately be incorporated in this version. The team resolved conflicting comments or ideas while maintaining consistency with the known direction of regulators and ensuring the document was coherent and consistent. It is recognized that this is a rapidly evolving area and that concepts will likely change over time; as such, this Vision ConOps is a living document and is expected to evolve as concepts mature. The ConOps does, however, provide a vision of UAM concepts and solutions based on the broad insights from across the UAM stakeholder community at the time of its publication and is intended to serve as a UAM North Star for continued research and development of UAM. As a broad Vision ConOps, is not a detailed engineering document; rather, it focuses primarily on outlining a broad, high-level vision across all aspects of a UAM transportation system.

Urban Air Mobility↗
NASA NTRS1989

Use of 3D vision for fine robot motion

An integration of 3-D vision systems with robot manipulators will allow robots to operate in a poorly structured environment by visually locating targets and obstacles. However, by using computer vision for objects acquisition makes the problem of overall system calibration even more difficult. Indeed, in a CAD based manipulation a control architecture has to find an accurate mapping between the 3-D Euclidean work space and a robot configuration space (joint angles). If a stereo vision is involved, then one needs to map a pair of 2-D video images directly into the robot configuration space. Neural Network approach aside, a common solution to this problem is to calibrate vision and manipulator independently, and then tie them via common mapping into the task space. In other words, both vision and robot refer to some common Absolute Euclidean Coordinate Frame via their individual mappings. This approach has two major difficulties. First a vision system has to be calibrated over the total work space. And second, the absolute frame, which is usually quite arbitrary, has to be the same with a high degree of precision for both robot and vision subsystem calibrations. The use of computer vision to allow robust fine motion manipulation in a poorly structured world which is currently in progress is described along with the preliminary results and encountered problems.

Lokshin, Anatole↗
NASA NTRS1980

Clipping polygon faces through a polyhedron of vision

A flight simulator combines flight data and polygon face terrain data to provide a CRT display at each window of the simulated aircraft. The data base specifies the relative position of each vertex of each polygon face therein. Only those terrain faces currently appearing within the pyramid of vision defined by the pilots eye and the edges of the pilots window need be displayed at any given time. As the orientation of the pyramid of vision changes in response to flight data, the displayed faces are correspondingly displaced, eventually moving out of the pyramid of vision. Faces which are currently not visible (outside the pyramid of vision) are clipped from the data flow. In addition, faces which are only partially outside of pyramid of vision are reconstructed to eliminate the outside portion. Window coordinates are generated defining the distance between each vertex and each of the boundary planes forming the pyramid of vision. The sign bit of each window coordinate indicates whether the vertex is on the pyramid of vision side of the associated boundary panel (positive), or on the other side thereof (negative). The set of sign bits accompanying each vertex constitute the outcode of that vertex. The outcodes (O.C.) are systematically processed and examined to determine which faces are completely inside the pyramid of vision (Case A--all signs positive), which faces are completely outside (Case C--All signs negative) and which faces must be reconstructed (Case B--both positive and negative signs).

Rohner, Michel A.↗
NASA NTRSDate not supplied

Concept-based Analysis of Neural Networks via Vision-Language Models

The analysis of vision-based deep neural networks (DNNs) is highly desirable but it is very challenging due to the difficulty of expressing formal specifications for vision tasks and the lack of efficient verification procedures. In this paper, we propose to leverage emerging multimodal, vision-language, foundation models (VLMs) as a lens through which we can reason about vision models. VLMs have been trained on a large body of images accompanied by their textual description, and are thus implicitly aware of high-level, human-understandable concepts describing the images. We describe a logical specification language Con spec designed to facilitate writing specifications in terms of these concepts. To define and formally check Con spec specifications, we build a map between the internal representations of a given vision model and a VLM, leading to an efficient verification procedure of natural-language properties for vision models. We demonstrate our techniques on a ResNet-based classifier trained on the RIVAL-10 dataset using CLIP as the multimodal model.

Large Vision Language Models↗
NASA NTRSDate not supplied

Simulated Vision-based Approach and Landing System for Advanced Air Mobility

Advanced Air Mobility (AAM) aircraft require precision approach and landing systems (PALS) in several environments, such as urban, suburban, and rural. It is challenging to implement current state-of-the-art methods approved for automated approach and landing for AAM operations with challenges such as GPS degradation in urban environments and visual navigation aids like the glideslope and localizer being narrow and not allowing alternative incoming landing angles at vertiports. However, existing technology and systems, i.e., the instrument landing system (ILS) with glideslope and localizer indicators that use vision, IR, radar, or GPS methods, provide baseline perception and sensing requirements for AAM aircraft approach and landing. This paper focuses on vision-based PAL and computer vision feature correspondence methods to demonstrate a baseline navigation system while adhering to the Federal Aviation Administration requirements and regulations about heliport design (FAA AC 150/5390-2C), which is one of the closest references for vertiport requirements and regulations. The coplanar pose from orthography and scaling with iterations (COPOSIT) algorithm determines pose estimation, which feeds into an Extended Kalman filter that combines IMU with vision to create a vision-based approach and landing (VAL) sensor fusion navigation solution for GPS-denied environments. The VAL navigation solution provides promising simulation results for AAM PALS with Hough circle detection and feature correspondence, which demonstrate robustness to false positives. This paper incorporates moderately high- fidelity simulations with computer graphics rendering to show a distributed sensor network to track an AAM aircraft during approach and landing to compare with the aircraft’s onboard vision-based navigation solution.

distributed sensing↗
NASA NTRS1989

Parallel Architectures and Parallel Algorithms for Integrated Vision Systems

Computer vision is regarded as one of the most complex and computationally intensive problems. An integrated vision system (IVS) is a system that uses vision algorithms from all levels of processing to perform for a high level application (e.g., object recognition). An IVS normally involves algorithms from low level, intermediate level, and high level vision. Designing parallel architectures for vision systems is of tremendous interest to researchers. Several issues are addressed in parallel architectures and parallel algorithms for integrated vision systems.

Choudhary, Alok Nidhi↗