Search NASA⌕ Search

SEARCH · Search NASA

Results for “computer vision system”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Techniques and potential capabilities of multi-resolutional information (knowledge) processing

A concept of nested hierarchical (multi-resolutional, pyramidal) information (knowledge) processing is introduced for a variety of systems including data and/or knowledge bases, vision, control, and manufacturing systems, industrial automated robots, and (self-programmed) autonomous intelligent machines. A set of practical recommendations is presented using a case study of a multiresolutional object representation. It is demonstrated here that any intelligent module transforms (sometimes, irreversibly) the knowledge it deals with, and this tranformation affects the subsequent computation processes, e.g., those of decision and control. Several types of knowledge transformation are reviewed. Definite conditions are analyzed, satisfaction of which is required for organization and processing of redundant information (knowledge) in the multi-resolutional systems. Providing a definite degree of redundancy is one of these conditions.

Meystel, A.↗

Microwave vision for robots

Microwave Vision (MV), a concept originally developed in 1985, could play a significant role in the solution to robotic vision problems. Originally our Microwave Vision concept was based on a pattern matching approach employing computer based stored replica correlation processing. Artificial Neural Network (ANN) processor technology offers an attractive alternative to the correlation processing approach, namely the ability to learn and to adapt to changing environments. This paper describes the Microwave Vision concept, some initial ANN-MV experiments, and the design of an ANN-MV system that has led to a second patent disclosure in the robotic vision field.

Lewandowski, Leon↗

Synthetic Vision Displays for Planetary and Lunar Lander Vehicles

Aviation research has demonstrated that Synthetic Vision (SV) technology can substantially enhance situation awareness, reduce pilot workload, improve aviation safety, and promote flight path control precision. SV, and related flight deck technologies are currently being extended for application in planetary exploration vehicles. SV, in particular, holds significant potential for many planetary missions since the SV presentation provides a computer-generated view for the flight crew of the terrain and other significant environmental characteristics independent of the outside visibility conditions, window locations, or vehicle attributes. SV allows unconstrained control of the computer-generated scene lighting, terrain coloring, and virtual camera angles which may provide invaluable visual cues to pilots/astronauts, not available from other vision technologies. In addition, important vehicle state information may be conformally displayed on the view such as forward and down velocities, altitude, and fuel remaining to enhance trajectory control and vehicle system status. The paper accompanies a conference demonstration that introduced a prototype NASA Synthetic Vision system for lunar lander spacecraft. The paper will describe technical challenges and potential solutions to SV applications for the lunar landing mission, including the requirements for high-resolution lunar terrain maps, accurate positioning and orientation, and lunar cockpit display concepts to support projected mission challenges.

Arthur, Jarvis J., III↗

Vestibular plasticity following orbital spaceflight: recovery from postflight postural instability

Results of previous studies suggested that the vestibular mediated postural instability observed in astronauts upon return to earth from orbital spaceflight may be exacerbated by an increased weighting of visual inputs for spatial orientation and control of movement. This study was performed to better understand the roles of visual and somatosensory contributions to recovery of normal sensori-motor postural control in returning astronauts. Preflight and postflight, 23 astronaut volunteers were presented randomly with three trials of six sensory organization test (SOT) conditions in the EquiTest system test battery. Sagittal plane center-of-gravity (COG) excursions computed from ground reaction forces were significantly higher on landing day than preflight for those test conditions presenting sway-referenced visual and/or somatosensory orientation cues. The ratio of summed peak-to-peak COG sway amplitudes on the two sway-referenced vision tests (SOTs 3 + 6) compared to the two eyes closed tests (SOTs 2 + 5) was increased on landing day, indicating an increased reliance on visual orientation cues for postural control. The ratio of peak-to-peak COG excursions on sway-referenced surfaces (SOTs 4, 5 & 6) to an earth fixed support surfaces (SOTs 1, 2 & 3) increased even more after landing suggesting primary reliance on somatosensory orientation cues for recovery of postflight postural stability. Readaptation to sway-referenced support surfaces took longer than readaptation to sway-referenced vision. The increased reliance on visual and somatosensory inputs disappeared in all astronauts 4-8 days following return to earth.

NASA Program Space Physiology and Countermeasures↗

Method and apparatus for predicting the direction of movement in machine vision

A computer-simulated cortical network is presented. The network is capable of computing the visibility of shifts in the direction of movement. Additionally, the network can compute the following: (1) the magnitude of the position difference between the test and background patterns; (2) localized contrast differences at different spatial scales analyzed by computing temporal gradients of the difference and sum of the outputs of paired even- and odd-symmetric bandpass filters convolved with the input pattern; and (3) the direction of a test pattern moved relative to a textured background. The direction of movement of an object in the field of view of a robotic vision system is detected in accordance with nonlinear Gabor function algorithms. The movement of objects relative to their background is used to infer the 3-dimensional structure and motion of object surfaces.

Lawton, Teri B.↗

The robot's eyes - Stereo vision system for automated scene analysis

Attention is given to the robot stereo vision system which maintains the image produced by solid-state detector television cameras in a dynamic random access memory called RAPID. The imaging hardware consists of sensors (two solid-state image arrays using a charge injection technique), a video-rate analog-to-digital converter, the RAPID memory, and various types of computer-controlled displays, and preprocessing equipment (for reflexive actions, processing aids, and object detection). The software is aimed at locating objects and transversibility. An object-tracking algorithm is discussed and it is noted that tracking speed is in the 50-75 pixels/s range.

Williams, D. S.↗

Grayscale/resolution trade-off for text: Model predictions and psychophysical results for letter confusion and letter discrimination

In a series of papers presented in 1994, we examined the grayscale/resolution trade-off for natural images displayed on devices with discrete pixellation, such as AMLCD's. In the present paper we extend this study by examining the grayscale/resolution trade-off for text images on discrete-pixel displays. Halftoning in printing is an example of the grayscale/resolution trade-off. In printing, spatial resolution is sacrificed to produce grayscale. Another example of this trade-off is the inherent low-pass spatial filter of a CRT, caused by the point-spread function of the electron beam in the phosphor layer. On a CRT, sharp image edges are blurred by this inherent low-pass filtering, and the block noise created by spatial quantization is greatly reduced. A third example of this trade-off is text anti-aliasing, where grayscale is used to improve letter shape, size and location when rendered at a low spatial resolution. There are additional implications for display system design from the grayscale/resolution trade-off. For example, reduced grayscale can reduce system costs by requiring less complexity in the framestore, allowing the use of lower cost drivers, potentially increasing data transfer rates in the image subsystem, and simplifying the manufacturing processes that are used to construct the active matrix for AMLCD (active-matrix liquid-crystal display) or AMTFEL (active-matrix thin-film electroluminescent) devices. Therefore, the study of these trade-offs is important for display designers and manufacturing and systems engineers who wish to create the highest performance, lowest cost device possible. Our strategy for investigating this trade-off is to generate a set of simple test images, manipulate grayscale and resolution, predict discrimination performance using the ViDEOS(Sarnoff) Human Vision Model, conduct an empirical study of discrimination using psychophysical procedures, and verify the computational results using the psychophysical results.

Gille, Jennifer↗

Precise Image-Based Motion Estimation for Autonomous Small Body Exploration

Because they hold answers to questions about the origin of our solar system, comets and asteroids play a prominent role in NASA's roadmap for solar system exploration. This paper presents an algorithm for autonomous onboard motion estimation that will enable the precision guidance and landing necessary for small body sample return.

precision↗

A Structurally-Adaptive Framework for Distributed Airborne Sensing over Real-time Collaborative Information Sharing Networks

The emergence and maturation of wireless communication technologies continue to transform the aviation industry and are enabling new solutions to challenges faced by NASA’s Advanced Air Mobility (AAM) initiative. AAM is leading towards high-density autonomous aircraft operations in areas underserved by traditional aviation, such as over densely populated urban centers. In this paper, we build on concepts from distributed sensing and smart spaces - where sensing, processing, and communication are embedded in an environment, and agents are operating within the space can exploit these capabilities in real-time through collaborative information sharing networks. Building from these concepts, we propose a framework to enable a dynamic, topologically-adaptive, and distributed estimation system for man-rated aviation to address challenges faced by autonomous AAM operations. This paper presents the initial concept of operations and system design for this framework, presents a mathematical formulation for abstraction of the problem, identifies requirements and constraints for operation, and presents algorithmic constructs to demonstrate operation. The initial framework design will focus on supporting precision navigation and independent surveillance supporting conformance monitoring of aircraft in airspace corridors and vertiport airspaces. Preliminary results from this framework shows promise in addressing gaps in current technologies needed to enable future AAM concepts, while promising greater capabilities, performance, robustness, and safety over current aviation systems and operations.

Distributed sensing↗

Computer vision techniques for rotorcraft low-altitude flight

A description is given of research that applies techniques from computer vision to automation of rotorcraft navigation. The effort emphasizes the development of a methodology for detecting the ranges to obstacles in the region of interest based on the maximum utilization of passive sensors. The range map derived from the obstacle detection approach can be used as obstacle data for the obstacle avoidance in an automataic guidance system and as advisory display to the pilot. The lack of suitable flight imagery data, however, presents a problem in the verification of concepts for obstacle detection. This problem is being addressed by the development of an adequate flight database and by preprocessing of currently available flight imagery. Some comments are made on future work and how research in this area relates to the guidance of other autonomous vehicles.

Sridhar, Banavar↗

Institute for Scientific and Educational Technology (ISET)-Education, Research and Training Programs in Engineering and Sciences

The 'Institute for Scientific and Educational Technology' has been established to provide a mechanism through which universities and other research organizations may cooperate with one another and with different government agencies and industrial organizations to further and promote research, education, and training programs in science, engineering, and related fields. This effort has been undertaken consistent with the national vision to 'promote excellence in America s educational system through enhancing and expanding scientific and technological competence.' The specific programs are directed in promoting and achieving excellence for individuals at all levels (elementary and secondary schools, undergraduate and graduate education, and postdoctoral and faculty research). The program is consistent with the existing activities of the Institute for Computational and Applied Mechanics (ICAM) and the American Society for Engineering Education (ASEE) at NASA Langley Research Center (LaRC). The efforts will be directed to embark on other research, education, and training activities in various fields of engineering, scientific, and educational technologies. The specific objectives of the present program may be outlined briefly as follows: 1) Cooperate in the various research, education, and technology programs of the Office of Education at LaRC. 2) Develop procedures for interactions between precollege, college, and graduate students, and between faculty and students at all levels. 3) Direct efforts to increase the participation by women and minorities in educational programs at all levels. 4) Enhance existing activities of ICAM and ASEE in education, research, and training of graduate students and faculty. 5) Invite distinguished scholars as appropriate and consistent with ISET goals to spend their summers and/or sabbaticals at NASA Langley andor ODU and interact with different researchers and graduate students. Perform research and administrative activities as needed to carry out the above mentioned activities. 6) The implementation of various activities of the ISET programs is carried out through cooperative efforts between Old Dominion University (ODU) and the Office of Education at LaRC. At present, major efforts are directed on the following ISET Programs: ICAM Programs, Academic Programs, Educational Research, Outreach Programs, Educational Technology and Cooperative Programs. These programs are described in the following sections.

Tiwari, S. N.↗

NASA Tech Briefs, September 2012

Topics covered include: Beat-to-Beat Blood Pressure Monitor; Measurement Techniques for Clock Jitter; Lightweight, Miniature Inertial Measurement System; Optical Density Analysis of X-Rays Utilizing Calibration Tooling to Estimate Thickness of Parts; Fuel Cell/Electrochemical Cell Voltage Monitor; Anomaly Detection Techniques with Real Test Data from a Spinning Turbine Engine-Like Rotor; Measuring Air Leaks into the Vacuum Space of Large Liquid Hydrogen Tanks; Antenna Calibration and Measurement Equipment; Glass Solder Approach for Robust, Low-Loss, Fiber-to-Waveguide Coupling; Lightweight Metal Matrix Composite Segmented for Manufacturing High-Precision Mirrors; Plasma Treatment to Remove Carbon from Indium UV Filters; Telerobotics Workstation (TRWS) for Deep Space Habitats; Single-Pole Double-Throw MMIC Switches for a Microwave Radiometer; On Shaft Data Acquisition System (OSDAS); ASIC Readout Circuit Architecture for Large Geiger Photodiode Arrays; Flexible Architecture for FPGAs in Embedded Systems; Polyurea-Based Aerogel Monoliths and Composites; Resin-Impregnated Carbon Ablator: A New Ablative Material for Hyperbolic Entry Speeds; Self-Cleaning Particulate Prefilter Media; Modular, Rapid Propellant Loading System/Cryogenic Testbed; Compact, Low-Force, Low-Noise Linear Actuator; Loop Heat Pipe with Thermal Control Valve as a Variable Thermal Link; Process for Measuring Over-Center Distances; Hands-Free Transcranial Color Doppler Probe; Improving Balance Function Using Low Levels of Electrical Stimulation of the Balance Organs; Developing Physiologic Models for Emergency Medical Procedures Under Microgravity; PMA-Linked Fluorescence for Rapid Detection of Viable Bacterial Endospores; Portable Intravenous Fluid Production Device for Ground Use; Adaptation of a Filter Assembly to Assess Microbial Bioburden of Pressurant Within a Propulsion System; Multiplexed Force and Deflection Sensing Shell Membranes for Robotic Manipulators; Whispering Gallery Mode Optomechanical Resonator; Vision-Aided Autonomous Landing and Ingress of Micro Aerial Vehicles; Self-Sealing Wet Chemistry Cell for Field Analysis; General MACOS Interface for Modeling and Analysis for Controlled Optical Systems; Mars Technology Rover with Arm-Mounted Percussive Coring Tool, Microimager, and Sample-Handling Encapsulation Containerization Subsystem; Fault-Tolerant, Real-Time, Multi-Core Computer System; Water Detection Based on Object Reflections; SATPLOT for Analysis of SECCHI Heliospheric Imager Data; Plug-in Plan Tool v3.0.3.1; Frequency Correction for MIRO Chirp Transformation Spectroscopy Spectrum; Nonlinear Estimation Approach to Real-Time Georegistration from Aerial Images; Optimal Force Control of Vibro-Impact Systems for Autonomous Drilling Applications; Low-Cost Telemetry System for Small/Micro Satellites; Operator Interface and Control Software for the Reconfigurable Surface System Tri-ATHLETE; and Algorithms for Determining Physical Responses of Structures Under Load.

Source record↗

Capturing, Analyzing, Maintaining, and Disseminating Shape Memory Material Data Between Information Management Systems

With an increased demand on reducing the time, cost, and effort to develop new materials, Integrated Computational Materials Engineering (ICME) has received widespread attention in various engineering disciplines as a catalyst for significantly reducing experimental testing during the material design process. An ICME approach to design can enable ‘fit-for-purpose’ materials to be realized in engineering applications by incorporating well-understood process-property-performance relationships between the various length and time scales in a material’s structure, enabling material optimization. However, such an approach requires validated multiscale models at the various length scales for a material, which in turn requires a large amount of data, a robust means of storing the data, and the ability to link data to developed material models. The NASA Vision 2040 [1] has identified nine key elements to enabling ICME approaches in system level design, with one being “Data, Information, and Visualization”, thus outlining the importance of a robust information management system for ICME. As the relationship between microstructure, properties, and material performance become better understood and incorporated into multiscale models that can be leveraged in application design, the emergence of new materials with application-driven properties can be realized. One such new material class that has seen growing attention are shape memory materials (SMM), in which a material can transition between a deformed and undeformed state via a reversible phase transformation when subject to a thermal, mechanical, or magnetic load [2]. SMMs have been used widely in aerospace and biomedical industries, including applications such as actuators, low-shock mechanisms, medical staples, braces, and stents [3, 4]. These materials exhibit unique behavior due to their ability to transition between phases, and thus the mechanisms that enable this transition must be captured in a data information management system and incorporated into SMM material models. At NASA Glenn Research Center, the Shape Memory Materials Database (SMMD) Tool has been developed to capture the necessary information that governs SMM material behavior and provide users the ability to select and visualize various SMMs for a specific application [5]. The database contains point-wise data for published SMM materials, along with the pedigree metadata for traceability necessary for a robust information management system. The database is also capable of storing in-house test data performed at NASA GRC by interacting with the developed Shape Memory Alloy (SMA) Analytics tool to extract the necessary point-wise values and populate the database. Although the SMMD Tool offers its users a single, authoritative source for SMM material data that is critical for model development and material design, the full material pedigree of the in-house test data for SMMs is not currently captured and is out of the scope for the SMMD tool. In this work, the schema for capturing SMM test data within the larger NASA GRC ICME Schema [6, 7, 8, 9] will be developed and implemented for thermomechanical tests conducted at NASA GRC. The developed schema will not only store the relevant data needed for the SMMD tool, but also the material pedigree (i.e., production of the bulk material, bulk material analysis, sample cut-out diagrams, sample fabrication procedure, etc.), test pedigree (i.e., test equipment used, measurement systems used, raw test data), and analysis pedigree (i.e., how the data in the SMMD tool is calculated). Furthermore, a Python-based framework will be developed to seamlessly interact between the SMA Analytics and SMMD tools, which will write the full dataset and associated metadata to the GRC Information Management System before passing the required point-wise data to the SMMD tool. Data informatics is a key element of the NASA Vision 2040, which requires not only that data is stored and maintained throughout the material lifecycle, but that the data is also accessible and reusable such that material development efforts can be minimized. Therefore, for an ICME design approach to be realized, a centralized information management system that drives the ICME process must be able to communicate with other databases. The work that will be presented in this presentation will therefore not only demonstrate the ability of NASA GRC’s information management system to capture SMM data, but also its ability to interact with pre-existing tools specialized for such materials.

Data management↗

Health Management Applications for International Space Station

Traditional mission and vehicle management involves teams of highly trained specialists monitoring vehicle status and crew activities, responding rapidly to any anomalies encountered during operations. These teams work from the Mission Control Center and have access to engineering support teams with specialized expertise in International Space Station (ISS) subsystems. Integrated System Health Management (ISHM) applications can significantly augment these capabilities by providing enhanced monitoring, prognostic and diagnostic tools for critical decision support and mission management. The Intelligent Systems Division of NASA Ames Research Center is developing many prototype applications using model-based reasoning, data mining and simulation, working with Mission Control through the ISHM Testbed and Prototypes Project. This paper will briefly describe information technology that supports current mission management practice, and will extend this to a vision for future mission control workflow incorporating new ISHM applications. It will describe ISHM applications currently under development at NASA and will define technical approaches for implementing our vision of future human exploration mission management incorporating artificial intelligence and distributed web service architectures using specific examples. Several prototypes are under development, each highlighting a different computational approach. The ISStrider application allows in-depth analysis of Caution and Warning (C&W) events by correlating real-time telemetry with the logical fault trees used to define off-nominal events. The application uses live telemetry data and the Livingstone diagnostic inference engine to display the specific parameters and fault trees that generated the C&W event, allowing a flight controller to identify the root cause of the event from thousands of possibilities by simply navigating animated fault tree models on their workstation. SimStation models the functional power flow for the ISS Electrical Power System and can predict power balance for nominal and off-nominal conditions. SimStation uses realtime telemetry data to keep detailed computational physics models synchronized with actual ISS power system state. In the event of failure, the application can then rapidly diagnose root cause, predict future resource levels and even correlate technical documents relevant to the specific failure. These advanced computational models will allow better insight and more precise control of ISS subsystems, increasing safety margins by speeding up anomaly resolution and reducing,engineering team effort and cost. This technology will make operating ISS more efficient and is directly applicable to next-generation exploration missions and Crew Exploration Vehicles.

Alena, Richard↗

Self-organization via active exploration in robotic applications

We describe a neural network based robotic system. Unlike traditional robotic systems, our approach focussed on non-stationary problems. We indicate that self-organization capability is necessary for any system to operate successfully in a non-stationary environment. We suggest that self-organization should be based on an active exploration process. We investigated neural architectures having novelty sensitivity, selective attention, reinforcement learning, habit formation, flexible criteria categorization properties and analyzed the resulting behavior (consisting of an intelligent initiation of exploration) by computer simulations. While various computer vision researchers acknowledged recently the importance of active processes (Swain and Stricker, 1991), the proposed approaches within the new framework still suffer from a lack of self-organization (Aloimonos and Bandyopadhyay, 1987; Bajcsy, 1988). A self-organizing, neural network based robot (MAVIN) has been recently proposed (Baloch and Waxman, 1991). This robot has the capability of position, size rotation invariant pattern categorization, recognition and pavlovian conditioning. Our robot does not have initially invariant processing properties. The reason for this is the emphasis we put on active exploration. We maintain the point of view that such invariant properties emerge from an internalization of exploratory sensory-motor activity. Rather than coding the equilibria of such mental capabilities, we are seeking to capture its dynamics to understand on the one hand how the emergence of such invariances is possible and on the other hand the dynamics that lead to these invariances. The second point is crucial for an adaptive robot to acquire new invariances in non-stationary environments, as demonstrated by the inverting glass experiments of Helmholtz. We will introduce Pavlovian conditioning circuits in our future work for the precise objective of achieving the generation, coordination, and internalization of sequence of actions.

Ogmen, H.↗

Design of a reading test for low vision image warping

NASA and the University of Houston College of Optometry are examining the efficacy of image warping as a possible prosthesis for at least two forms of low vision - maculopathy and retinitis pigmentosa. Before incurring the expense of reducing the concept to practice, one would wish to have confidence that a worthwhile improvement in visual function would result. NASA's Programmable Remapper (PR) can warp an input image onto arbitrary geometric coordinate systems at full video rate, and it has recently been upgraded to accept computer-generated video text. We have integrated the Remapper with an SRI eye tracker to simulate visual malfunction in normal observers. A reading performance test has been developed to determine if the proposed warpings yield an increase in visual function; i.e., reading speed. We will describe the preliminary experimental results of this reading test with a simulated central field defect with and without remapped images.

Loshin, David S.↗

Remote Sensing Methods

Remotely sensed data allows archeologists and historic preservationists the ability to non-destructively detect phenomena previously unobservable to them. Archeologists have successfully used aerial photography since the turn of the century and it continues to be an important research tool today. Multispectral scanners and computer-implemented analysis techniques extend the range of human vision and provides the investigator with innovative research designs at scales previously unimaginable. Pioneering efforts in the use of remote sensing technology have demonstrated its potential, but it is the recent technological developments in remote sensing instrumentation and computer capability that provide for unlimited, cost-effective applications in the future. The combination of remote sensing, Global Positioning System (GPS) technology, and Geographic Information Systems (GIS) are radically altering survey, inventory, and modelling approaches.

Sever, Thomas L.↗

Symbology Development for General Aviation Synthetic Vision Primary Flight Displays for the Approach and Missed-Approach Modes of Flight

Spatial disorientation induced by inadvertent flight into instrument meteorological conditions (IMC) continues to be a leading cause of fatal accidents in general aviation. The Synthetic Vision Systems General Aviation (SVS-GA) research element, an integral part of NASA s Aviation Safety and Security Program (AvSSP), is investigating a revolutionary display technology designed to mitigate low visibility events such as controlled flight into terrain (CFIT) and low-visibility loss of control (LVLoC). The integrated SVS Primary Flight Display (SVS-PFD) utilizes computer generated 3-dimensional imagery of the surrounding terrain augmented with flight path guidance symbology. This unique combination will provide GA pilots with an accurate representation of their environment and projection of their flight path, regardless of time of day or out-the-window (OTW) visibility. The initial Symbology Development for Head-Down Displays (SD-HDD) simulation experiment examined 16 display configurations on a centrally located high-resolution PFD installed in NASA s General Aviation Work Station (GAWS) flight simulator. The results of the experiment indicate that situation awareness (SA) can be enhanced without having a negative impact on flight technical error (FTE), by providing a general aviation pilot with an integrated SVS display to use when OTW visibility is obscured.

Bartolone, Anthony P.↗