Search NASASearch

SEARCH · Search NASA

Results for “Pattern vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

A multifunction recognition operator for telerobotic vision

Research on developing an operator capable of performing the various subtasks required of a telerobot's vision sensor is reported. The operator uses a goal-driven matching technique which is an application of a linear programming method that readily adapts to the elastic template matching approach to pattern recognition. Four applications of the operator are discussed: (1) three-space location of an isolated object; (2) shape determination of isolated planar figures; (3) image compression/restoration; and (4) shape decomposition.

Goode, P. W., IV

Observations from Exploration of VTOL Urban Air Mobility Designs

NASA is exploring rotorcraft designs for VTOL air taxi operations, also known as urban air mobility (UAM) or on-demand mobility (ODM) applications. Several concept vehicles have been developed, intended to focus and guide NASA research activities in support of aircraft development for this emerging market. This paper summarizes the work conducted to date. To initially explore the broad design trade-space, three concept vehicles were designed: a quadrotor with electric propulsion; a side-by-side helicopter with hybrid propulsion; and a tiltwing with turbo-electric propulsion. Next a specific UAM mission was developed, accounting for the existing geography, population patterns, infrastructure, and weather in twenty-eight markets across the United States of America. Then in order to quantify the tradeoffs and performance targets necessary for practical implementation of the UAM vision, aircraft were designed to perform this mission, considering a range of aircraft types and propulsion system architectures: quadrotor aircraft, with turboshaft and all-electric propulsion; side-by-side aircraft, with turboshaft and all-electric propulsion; and lift+cruise aircraft with all-electric and turbo-electric propulsion. In examining these vehicles, performance targets and recurring technology themes emerged, which can guide investments in research and development within NASA, other government agencies, academia, and industry. In addition, results from the designs support observations about the trade-offs and key design decisions.

Observations from Exploration

Fluid Shifts

NASA is focusing on long-duration missions on the International Space Station (ISS) and future exploration-class missions beyond low-Earth orbit. Visual acuity changes observed after short-duration missions were largely transient, but more than 50% of ISS astronauts experienced more profound, chronic changes with objective structural and functional findings such as papilledema and choroidal folds. Globe flattening, optic nerve sheath dilation, and optic nerve tortuosity also are apparent. This pattern is referred to as the visual impairment and intracranial pressure (VIIP) syndrome. VIIP signs and symptoms, as well as postflight lumbar puncture data, suggest that elevated intracranial pressure (ICP) may be associated with the spaceflight-induced cephalad fluid shifts, but this hypothesis has not been tested. The purpose of this study is to characterize fluid distribution and compartmentalization associated with long-duration spaceflight, and to correlate these findings with vision changes and other elements of the VIIP syndrome. We also seek to determine whether the magnitude of fluid shifts during spaceflight, as well as the VIIP-related effects of those shifts, is predicted by the crewmember's preflight conditions and responses to acute hemodynamic manipulations (such as head-down tilt). Lastly, we will evaluate the patterns of fluid distribution in ISS astronauts during acute reversal of fluid shifts through application of lower body negative pressure (LBNP) interventions to characterize and explain general and individual responses. METHODS: We will examine a variety of physiologic variables in 10 long-duration ISS crewmembers using the test conditions and timeline presented in the Figure below. Measures include: (1) fluid compartmentalization (total body water by D2O, extracellular fluid by NaBr, intracellular fluid by calculation, plasma volume by CO rebreathe, interstitial fluid by calculation); (2) forehead/eyelids, tibia, calcaneus tissue thickness (by ultrasound); (3) vascular dimensions by ultrasound (jugular veins, cerebral and carotid arteries, vertebral arteries and veins, portal vein); (4) vascular dynamics by MRI (head/neck blood flow, cerebrospinal fluid pulsatility); (5) ocular measures (optical coherence tomography, intraocular pressure, 2-dimensional ultrasound including optic nerve sheath diameter, globe flattening, and retina-choroid thickness, Doppler ultrasound of ophthalmic and retinal arteries, and veins); (6) cardiac variables by ultrasound (inferior vena cava, tricuspid flow and tissue Doppler, pulmonic valve, stroke volume, right heart dimensions and function, four-chamber views); and (7) ICP measures (tympanic membrane displacement, distortion-product otoacoustic emissions, and ICP calculated by MRI). On the ground, acute head-down tilt will induce cephalad fluid shifts, whereas LBNP will oppose these shifts. Controlled Mueller maneuvers will manipulate cardiovascular variables. Through interventions applied before, during, and after flight, we intend to fully evaluate the relationship between fluid shifts and the VIIP syndrome.

Stenger, M.

The Representation of Action Plans in Long Term Memory

A sequence of experiments conducted on a two hand chord typewriter, to compare the efficiency of different coding principles employed to associate letters with their chord productions is described. This keyboard represents an effort to identify effective alternatives to the existing typewriter. It consists of two seperate 5-key panels (one for each hand), and letters are entered by typing chords composed of one to five fingers. Each panel is capable of producing the full alphabet. One group of experiments was designed to separate between perceptual and motor factors in the acivation of single letter chords. The results underline the importance of perceptual factors in the activation of motor plans. The complexity of the patterns employed to represent letters was shown to account for 50 percent of variance in the typing speeds of single letters. The theoretical implications of these results are discussed in relation to a vision based theory of action plans.

Fussfeld, G. N.

Fluid Shifts

NASA is focusing on long-duration missions on the International Space Station (ISS) and future exploration-class missions beyond low Earth orbit. Visual acuity changes observed after short-duration missions were largely transient, but more than 30% of ISS astronauts experience more profound, chronic changes with objective structural and functional findings such as papilledema and choroidal folds. Globe flattening, optic nerve sheath dilation, and optic nerve tortuosity also are apparent. This pattern is referred to as the visual impairment and intracranial pressure (VIIP) syndrome. VIIP signs and symptoms, as well as postflight lumbar puncture data, suggest that elevated intracranial pressure (ICP) may be associated with the space flight-induced cephalad fluid shifts, but this hypothesis has not been tested. The purpose of this study is to characterize fluid distribution and compartmentalization associated with long-duration space flight, and to correlate these findings with vision changes and other elements of the VIIP syndrome. We also seek to determine whether the magnitude of fluid shifts during space flight, as well as the VIIP-related effects of those shifts, is predicted by the crewmember's pre-flight condition and responses to acute hemodynamic manipulations (such as head-down tilt). Lastly, we will evaluate the patterns of fluid distribution in ISS astronauts during acute reversal of fluid shifts through application of lower body negative pressure (LBNP) interventions to characterize and explain general and individual responses. We will examine a variety of physiologic variables in 10 long-duration ISS crewmembers using the test conditions and timeline presented in the Figure below. Measures include: (1) fluid compartmentalization (total body water by D2O, extracellular fluid by NaBr, intracellular fluid by calculation, plasma volume by CO rebreathe, interstitial fluid by calculation); (2) forehead/eyelids, tibia, calcaneus tissue thickness (by ultrasound); (3) vascular dimensions by ultrasound (jugular veins, cerebral and carotid arteries, vertebral arteries and veins, portal vein); (4) vascular dynamics by MRI (head/neck blood flow, cerebrospinal fluid pulsatility); (5) ocular measures (optical coherence tomography, intraocular pressure, 2-dimensional ultrasound including optic nerve sheath diameter, globe flattening, and retina-choroid thickness, Doppler ultrasound of ophthalmic and retinal arteries, and veins); (6) cardiac variables by ultrasound (inferior vena cava, tricuspid flow and tissue Doppler, pulmonic valve, stroke volume, right heart dimensions and function, four-chamber views); and (7) ICP measures (tympanic membrane displacement, distortion-product otoacoustic emissions, and ICP calculated by MRI). On the ground, acute head-down tilt will induce cephalad fluid shifts, whereas LBNP will oppose these shifts. Controlled Mueller maneuvers will manipulate cardiovascular variables. Through interventions applied before, during, and after flight, we intend to fully evaluate the relationship between fluid shifts and the VIIP syndrome. This study has been selected for flight implementation and is one of the candidate investigations being considered for the one year mission.

Stenger, Michael

Sensing Super-position: Visual Instrument Sensor Replacement

The coming decade of fast, cheap and miniaturized electronics and sensory devices opens new pathways for the development of sophisticated equipment to overcome limitations of the human senses. This project addresses the technical feasibility of augmenting human vision through Sensing Super-position using a Visual Instrument Sensory Organ Replacement (VISOR). The current implementation of the VISOR device translates visual and other passive or active sensory instruments into sounds, which become relevant when the visual resolution is insufficient for very difficult and particular sensing tasks. A successful Sensing Super-position meets many human and pilot vehicle system requirements. The system can be further developed into cheap, portable, and low power taking into account the limited capabilities of the human user as well as the typical characteristics of his dynamic environment. The system operates in real time, giving the desired information for the particular augmented sensing tasks. The Sensing Super-position device increases the image resolution perception and is obtained via an auditory representation as well as the visual representation. Auditory mapping is performed to distribute an image in time. The three-dimensional spatial brightness and multi-spectral maps of a sensed image are processed using real-time image processing techniques (e.g. histogram normalization) and transformed into a two-dimensional map of an audio signal as a function of frequency and time. This paper details the approach of developing Sensing Super-position systems as a way to augment the human vision system by exploiting the capabilities of the human hearing system as an additional neural input. The human hearing system is capable of learning to process and interpret extremely complicated and rapidly changing auditory patterns. The known capabilities of the human hearing system to learn and understand complicated auditory patterns provided the basic motivation for developing an image-to-sound mapping system.

Maluf, David A.

Sensing Super-Position: Human Sensing Beyond the Visual Spectrum

The coming decade of fast, cheap and miniaturized electronics and sensory devices opens new pathways for the development of sophisticated equipment to overcome limitations of the human senses. This paper addresses the technical feasibility of augmenting human vision through Sensing Super-position by mixing natural Human sensing. The current implementation of the device translates visual and other passive or active sensory instruments into sounds, which become relevant when the visual resolution is insufficient for very difficult and particular sensing tasks. A successful Sensing Super-position meets many human and pilot vehicle system requirements. The system can be further developed into cheap, portable, and low power taking into account the limited capabilities of the human user as well as the typical characteristics of his dynamic environment. The system operates in real time, giving the desired information for the particular augmented sensing tasks. The Sensing Super-position device increases the image resolution perception and is obtained via an auditory representation as well as the visual representation. Auditory mapping is performed to distribute an image in time. The three-dimensional spatial brightness and multi-spectral maps of a sensed image are processed using real-time image processing techniques (e.g. histogram normalization) and transformed into a two-dimensional map of an audio signal as a function of frequency and time. This paper details the approach of developing Sensing Super-position systems as a way to augment the human vision system by exploiting the capabilities of Lie human hearing system as an additional neural input. The human hearing system is capable of learning to process and interpret extremely complicated and rapidly changing auditory patterns. The known capabilities of the human hearing system to learn and understand complicated auditory patterns provided the basic motivation for developing an image-to-sound mapping system. The human brain is superior to most existing computer systems in rapidly extracting relevant information from blurred, noisy, and redundant images. From a theoretical viewpoint, this means that the available bandwidth is not exploited in an optimal way. While image-processing techniques can manipulate, condense and focus the information (e.g., Fourier Transforms), keeping the mapping as direct and simple as possible might also reduce the risk of accidentally filtering out important clues. After all, especially a perfect non-redundant sound representation is prone to loss of relevant information in the non-perfect human hearing system. Also, a complicated non-redundant image-to-sound mapping may well be far more difficult to learn and comprehend than a straightforward mapping, while the mapping system would increase in complexity and cost. This work will demonstrate some basic information processing for optimal information capture for headmounted systems.

Maluf, David A.

Microcomputer-based programmable optical signal processor

A microcomputer-based real-time programmable optical signal processing system utilizing a magneto-optic spatial light modulator (MOSLM) and a liquid crystal light valve (LCLV) is described. This system can perform a myriad of complicated optical operations, such as image correlation, image subtraction, and matrix multiplication. Its important asserts are its programmability and the capability of real-time addressing. These are important for telerobotic vision in space automation applications. Design specifications and suggestions for practical implementation of the system are discussed. Some preliminary experimental demonstrations are conducted to demonstrate applications of the proposed system to image correlation for optical pattern recognition, image subtraction for lC chip inspection, and matrix multiplication for optical computing.

Yu, F. T. S.

Laser electro-optic system for rapid three-dimensional /3-D/ topographic mapping of surfaces

It is pointed out that the generic utility of a robot in a factory/assembly environment could be substantially enhanced by providing a vision capability to the robot. A standard videocamera for robot vision provides a two-dimensional image which contains insufficient information for a detailed three-dimensional reconstruction of an object. Approaches which supply the additional information needed for the three-dimensional mapping of objects with complex surface shapes are briefly considered and a description is presented of a laser-based system which can provide three-dimensional vision to a robot. The system consists of a laser beam array generator, an optical image recorder, and software for controlling the required operations. The projection of a laser beam array onto a surface produces a dot pattern image which is viewed from one or more suitable perspectives. Attention is given to the mathematical method employed, the space coding technique, the approaches used for obtaining the transformation parameters, the optics for laser beam array generation, the hardware for beam array coding, and aspects of image acquisition.

Altschuler, M. D.

Development of Collaborative Research Initiatives to Advance the Aerospace Sciences-via the Communications, Electronics, Information Systems Focus Group

The primary goal of the Adaptive Vision Laboratory Research project was to develop advanced computer vision systems for automatic target recognition. The approach used in this effort combined several machine learning paradigms including evolutionary learning algorithms, neural networks, and adaptive clustering techniques to develop the E-MOR.PH system. This system is capable of generating pattern recognition systems to solve a wide variety of complex recognition tasks. A series of simulation experiments were conducted using E-MORPH to solve problems in OCR, military target recognition, industrial inspection, and medical image analysis. The bulk of the funds provided through this grant were used to purchase computer hardware and software to support these computationally intensive simulations. The payoff from this effort is the reduced need for human involvement in the design and implementation of recognition systems. We have shown that the techniques used in E-MORPH are generic and readily transition to other problem domains. Specifically, E-MORPH is multi-phase evolutionary leaming system that evolves cooperative sets of features detectors and combines their response using an adaptive classifier to form a complete pattern recognition system. The system can operate on binary or grayscale images. In our most recent experiments, we used multi-resolution images that are formed by applying a Gabor wavelet transform to a set of grayscale input images. To begin the leaming process, candidate chips are extracted from the multi-resolution images to form a training set and a test set. A population of detector sets is randomly initialized to start the evolutionary process. Using a combination of evolutionary programming and genetic algorithms, the feature detectors are enhanced to solve a recognition problem. The design of E-MORPH and recognition results for a complex problem in medical image analysis are described at the end of this report. The specific task involves the identification of vertebrae in x-ray images of human spinal columns. This problem is extremely challenging because the individual vertebra exhibit variation in shape, scale, orientation, and contrast. E-MORPH generated several accurate recognition systems to solve this task. This dual use of this ATR technology clearly demonstrates the flexibility and power of our approach.

Knasel, T. Michael

Vision Algorithm for the Solar Aspect System of the High Energy Replicated Optics to Explore the Sun Mission

This work covers the design and test of a machine vision algorithm for generating high- accuracy pitch and yaw pointing solutions relative to the sun on a high altitude balloon. It describes how images were constructed by focusing an image of the sun onto a plate printed with a pattern of small cross-shaped fiducial markers. Images of this plate taken with an off-the-shelf camera were processed to determine relative position of the balloon payload to the sun. The algorithm is broken into four problems: circle detection, fiducial detection, fiducial identification, and image registration. Circle detection is handled by an "Average Intersection" method, fiducial detection by a matched filter approach, and identification with an ad-hoc method based on the spacing between fiducials. Performance is verified on real test data where possible, but otherwise uses artificially generated data. Pointing knowledge is ultimately verified to meet the 20 arcsecond requirement.

0000000

3D Localization of Defects in Facility Inspection

Wind tunnels are crucial facilities that support the aerospace industry. However, these facilities are large, complex, and pose unique maintenance and inspection requirements. Manual inspections to identify defects such as cracks, missing fasteners, leaks, and foreign objects are important but labor and schedule intensive. Our goal is to utilize small Unmanned Aircraft Systems (sUAS) and computer vision-based analysis to automate the inspection of the interior and exterior of NASA’s critical wind tunnel facilities. We detect missing fasteners as our defect class, and detect existing fasteners to provide potential future missing fastener sites for preventative maintenance. These detections are done on both 2D raw images and in 3D space to provide a visual reference and real world location to facilitate repairs. A dataset was created consisting of images taken along a grid-like pattern of an interior tunnel section in the AEDC National Full-Scale Aerodynamics Complex (NFAC) at NASA Ames Research Center. Our method uses object detection to create image level bounding boxes of the fasteners and missing fasteners, then uses photogrammetry to create a mapping from 2D image locations to 3D real world locations. The image level bounding boxes and the 2D to 3D mapping are then combined to determine the 3D location of the defects. We describe the data collection, photogrammetry, and computer vision techniques used for object detection as well as a quantitative analysis of the method.

Small Unmanned Aircraft Systems (sUAS)

Stroboscopic Vision as a Treatment for Retinal Slip Induced Motion Sickness

Motion sickness in the general population is a significant problem driven by the increasingly more sophisticated modes of transportation, visual displays, and virtual reality environments. It is important to investigate non-pharmacological alternatives for the prevention of motion sickness for individuals who cannot tolerate the available anti-motion sickness drugs, or who are precluded from medication because of different operational environments. Based on the initial work of Melvill Jones, in which post hoc results indicated that motion sickness symptoms were prevented during visual reversal testing when stroboscopic vision was used to prevent retinal slip, we have evaluated stroboscopic vision as a method of preventing motion sickness in a number of different environments. Specifically, we have undertaken a five part study that was designed to investigate the effect of stroboscopic vision (either with a strobe light or LCD shutter glasses) on motion sickness while: (1) using visual field reversal, (2) reading while riding in a car (with or without external vision present), (3) making large pitch head movements during parabolic flight, (4) during exposure to rough seas in a small boat, and (5) seated and reading in the cabin area of a UH60 Black Hawk Helicopter during 20 min of provocative flight patterns.

Reschke, M. F.

Evaluation of Tablet-Based Methods for Assessment of Contrast Sensitivity

Some astronauts have suffered degradation of vision during long-duration space flight, suffering from a condition that has come to be known as Spaceflight Associated Neuro-ocular Syndrome (SANS). While related morphological changes can be observed with imaging technologies such as optical coherence tomography (OCT), it may be useful to have a rapid method for functional vision assessment. In this paper, we compare three tablet-based methods for rapid assessment of contrast sensitivity. First, a relatively novel method developed expressly for touch screens, in which the subject ”swipes” a frequency/contrast sweep grating to indicate the boundary between visible and invisible patterns; second, a method-of-adjustment task in which the subject adjusts the contrast of a grating patch up and down to bracket the visual threshold; and third, a traditional temporal two-alternative forced choice (2AFC) task, in which the subject is presented with a near-threshold stimulus in one of two intervals, and must report the interval containing the stimulus. The swipe method shows variability comparable to the 2AFC method, and shows good agreement in estimates of the spatial frequency of peak sensitivity. The absolute sensitivity estimated with the swipe method is higher than that of the other methods, perhaps because subjects are biased to trace outside of the visible pattern region, or perhaps due to stimulus differences.

Mulligan, Jeffrey B.

Identification and Evaluation of Integration and Cross Cutting Issues Across HRP Risks

The HRP Integrated Research Plan contains the research plans for the 32 risks requiring research to characterize and mitigate. These risks to human health and performance in spaceflight are identified by evidence and each one focuses on a single aspect of human physiology or performance. They are further categorized by aspects of the spaceflight environment, such as altered gravity or space radiation, that that play a major role in their likelihood and consequence. From its inception the "integrate" in the Research Plan has denoted the integrated nature of risks to human health and performance, the connectedness of physiological systems within the human body regardless of the spaceflight environment, and the integrated response of the human body to the spaceflight environment. Common characteristics of the spaceflight environment include altered gravity, atmospheres and light/dark cycles, space radiation, isolation, noise, and periods of high or low workload. Long term exposure to this unique environment produces a suite of physiological effects such as stress; vision, neurocognitive and anthropometric changes; circadian misalignment; fluid shifts, deconditioning; immune dysregulation; and altered nutritional requirements. Matrix diagraming was used to systematically identify, analyze and rate the many-to-many relationships between environmental characteristics and the suite of physiological effects. It was also to identify patterns in the relationships of common physiological effects to each other. Analyses of patterns or relationships in these diagrams help to identify issues that cut across multiple risks. Cross cutting issues benefit from a multidisciplinary approach that synthesizes concepts or data from two or more disciplines to identify and characterize risk factors or develop countermeasures relevant to multiple risks. They also help to illuminate possible problem areas that may arise when a countermeasure impacts risks other than those which it was developed to mitigate, or identify groupings of physiological changes that are likely to occur that may impact the overall risk posture.

Steinberg, S. L.

Digital Images and Human Vision

Processing of digital images destined for visual consumption raises many interesting questions regarding human visual sensitivity. This talk will survey some of these questions, including some that have been answered and some that have not. There will be an emphasis upon visual masking, and a distinction will be drawn between masking due to contrast gain control processes, and due to processes such as hypothesis testing, pattern recognition, and visual search.

Watson, Andrew B.

Vision Algorithm for the Solar Aspect System of the HEROES Mission

This work covers the design and test of a machine vision algorithm for generating high-accuracy pitch and yaw pointing solutions relative to the sun for the High Energy Replicated Optics to Explore the Sun (HEROES) mission. It describes how images were constructed by focusing an image of the sun onto a plate printed with a pattern of small fiducial markers. Images of this plate were processed in real time to determine relative position of the balloon payload to the sun. The algorithm is broken into four problems: circle detection, fiducial detection, fiducial identification, and image registration. Circle detection is handled by an "Average Intersection" method, fiducial detection by a matched filter approach, identification with an ad-hoc method based on the spacing between fiducials, and image registration with a simple least squares fit. Performance is verified on a combination of artificially generated images, test data recorded on the ground, and images from the 2013 flight

Solar Aspect

Vision Algorithm for the Solar Aspect System of the HEROES Mission

This work covers the design and test of a machine vision algorithm for generating high-accuracy pitch and yaw pointing solutions relative to the sun for the High Energy Replicated Optics to Explore the Sun (HEROES) mission. It describes how images were constructed by focusing an image of the sun onto a plate printed with a pattern of small fiducial markers. Images of this plate were processed in real time to determine relative position of the balloon payload to the sun. The algorithm is broken into four problems: circle detection, fiducial detection, fiducial identification, and image registration. Circle detection is handled by an Average Intersection method, fiducial detection by a matched filter approach, identification with an ad-hoc method based on the spacing between fiducials, and image registration with a simple least squares fit. Performance is verified on a combination of artificially generated images, test data recorded on the ground, and images from the 2013 flight.

HEROES