Search NASA⌕ Search

SEARCH · Search NASA

Results for “VISUAL TASK”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Two New Aircraft Traffic Surveillance Symbology Concepts: Range Filter and Inboard Field-of-View Symbology

The objective of this preliminary experiment was to investigate two head-up surveillance symbology (HUSS) display issues. The first issue was concerned with the benefits of adding a range filter to the current HUSS concept. A range filter limits the amount of traffic symbols displayed head-up by setting a range boundary (e.g., 7-nmi) around the ownship. The second issue was concerned with the need to incorporate HUSS in the inboard field-of-view (IFOV) display of the eXternal Visibility System (XVS) concept. The hypothesis tested was that adding a range filter to the XVS display and HUSS to the IFOV display would enhance the pilot's effectiveness in traffic surveillance tasks. Using a high-resolution graphics flight simulator, each of three pilots flew departure and arrival scenarios under visual meteorological conditions. The pilots' main tasks, while managing flight path, were to detect and assess potential airborne traffic hazards and to maintain overall situation awareness. Upon completing all the runs, each pilot completed a subjective questionnaire. Results showed that having both the HUSS on the IFOV and the range filter on each of the XVS displays enhanced the effectiveness of the XVS surveillance display concept. This configuration had the least head down time and the lowest mental workload. Combining both features gave the best target detection and, the earliest threat recognition performances, and enabled the pilots to create a better strategy for evasive action when it became necessary.

Wong, Douglas T.↗

Descriptive Linear modeling of steady-state visual evoked response

A study is being conducted to explore use of the steady state visual-evoke electrocortical response as an indicator of cognitive task loading. Application of linear descriptive modeling to steady state Visual Evoked Response (VER) data is summarized. Two aspects of linear modeling are reviewed: (1) unwrapping the phase-shift portion of the frequency response, and (2) parsimonious characterization of task-loading effects in terms of changes in model parameters. Model-based phase unwrapping appears to be most reliable in applications, such as manual control, where theoretical models are available. Linear descriptive modeling of the VER has not yet been shown to provide consistent and readily interpretable results.

Levison, W. H.↗

A Metric to Quantify Shared Visual Attention in Two-Person Teams

Introduction: Critical tasks in high-risk environments are often performed by teams, the members of which must work together efficiently. In some situations, the team members may have to work together to solve a particular problem, while in others it may be better for them to divide the work into separate tasks that can be completed in parallel. We hypothesize that these two team strategies can be differentiated on the basis of shared visual attention, measured by gaze tracking. 2) Methods: Gaze recordings were obtained for two-person flight crews flying a high-fidelity simulator (Gontar, Hoermann, 2014). Gaze was categorized with respect to 12 areas of interest (AOIs). We used these data to construct time series of 12 dimensional vectors, with each vector component representing one of the AOIs. At each time step, each vector component was set to 0, except for the one corresponding to the currently fixated AOI, which was set to 1. This time series could then be averaged in time, with the averaging window time (t) as a variable parameter. For example, when we average with a t of one minute, each vector component represents the proportion of time that the corresponding AOI was fixated within the corresponding one minute interval. We then computed the Pearson product-moment correlation coefficient between the gaze proportion vectors for each of the two crew members, at each point in time, resulting in a signal representing the time-varying correlation between gaze behaviors. We determined criteria for concluding correlated gaze behavior using two methods: first, a permutation test was applied to the subjects' data. When one crew member's gaze proportion vector is correlated with a random time sample from the other crewmember's data, a distribution of correlation values is obtained that differs markedly from the distribution obtained from temporally aligned samples. In addition to validating that the gaze tracker was functioning reasonably well, this also allows us to compute probabilities of coordinated behavior for each value of the correlation. As an alternative, we also tabulated distributions of correlation coefficients for synthetic data sets, in which the behavior was modeled as a first-order Markov process, and compared correlation distributions for identical processes with those for disparate processes, allowing us to choose criteria and estimate error rates. 3) Discussion: Our method of gaze correlation is able to measure shared visual attention, and can distinguish between activities involving different instruments. We plan to analyze whether pilots strategies of sharing visual attention can predict performance. Possible measurements of performance include expert ratings from instructors, fuel consumption, total task time, and failure rate. While developed for two-person crews, our approach can be applied to larger groups, using intra-class correlation coefficients instead of the Pearson product-moment correlation.

Gontar, Patrick↗

Flight tests of a helmet-mounted display synthetic visibility system

A short flight test program was conducted using the NASA Langley Research Center's B737 Advanced Transport Operating Systems (ATOPS) research airplane to determine if pilots could land a transport category airplane under visual meteorological conditions (VMC) by reference to a synthetic visibility system. No external guidance was to be used. The program was undertaken jointly by NASA and the McDonnel-Douglas Corporation. The airplane was fitted with forward-looking television cameras fixed in the nose. Inputs from the television cameras were mixed with internally generated symbology and displayed to the pilot on helmet-mounted eyepieces. The pilot task was to execute a visual approach and landing. Two NASA and two McDonnel-Douglas engineering test pilots participated in the program completing over 200 landings in a 32-hour test program. Landings accomplished with the helmet-mounted display (HMD) were compared with visual landings for each pilot.

Yenni, Kenneth R.↗

Advanced Multimodal Solutions for Information Presentation

High-workload, fast-paced, and degraded sensory environments are the likeliest candidates to benefit from multimodal information presentation. For example, during EVA (Extra-Vehicular Activity) and telerobotic operations, the sensory restrictions associated with a space environment provide a major challenge to maintaining the situation awareness (SA) required for safe operations. Multimodal displays hold promise to enhance situation awareness and task performance by utilizing different sensory modalities and maximizing their effectiveness based on appropriate interaction between modalities. During EVA, the visual and auditory channels are likely to be the most utilized with tasks such as monitoring the visual environment, attending visual and auditory displays, and maintaining multichannel auditory communications. Previous studies have shown that compared to unimodal displays (spatial auditory or 2D visual), bimodal presentation of information can improve operator performance during simulated extravehicular activity on planetary surfaces for tasks as diverse as orientation, localization or docking, particularly when the visual environment is degraded or workload is increased. Tactile displays offer a third sensory channel that may both offload information processing effort and provide a means to capture attention when urgently required. For example, recent studies suggest that including tactile cues may result in increased orientation and alerting accuracy, improved task response time and decreased workload, as well as provide self-orientation cues in microgravity on the ISS (International Space Station). An important overall issue is that context-dependent factors like task complexity, sensory degradation, peripersonal vs. extrapersonal space operations, workload, experience level, and operator fatigue tend to vary greatly in complex real-world environments and it will be difficult to design a multimodal interface that performs well under all conditions. As a possible solution, adaptive systems have been proposed in which the information presented to the user changes as a function of taskcontext-dependent factors. However, this presupposes that adequate methods for detecting andor predicting such factors are developed. Further, research in adaptive systems for aviation suggests that they can sometimes serve to increase workload and reduce situational awareness. It will be critical to develop multimodal display guidelines that include consideration of smart systems that can select the best display method for a particular contextsituation.The scope of the current work is an analysis of potential multimodal display technologies for long duration missions and, in particular, will focus on their potential role in EVA activities. The review will address multimodal (combined visual, auditory andor tactile) displays investigated by NASA, industry, and DoD (Dept. of Defense). It also considers the need for adaptive information systems to accommodate a variety of operational contexts such as crew status (e.g., fatigue, workload level) and task environment (e.g., EVA, habitat, rover, spacecraft). Current approaches to guidelines and best practices for combining modalities for the most effective information displays are also reviewed. Potential issues in developing interface guidelines for the Exploration Information System (EIS) are briefly considered.

multimodal display↗

Conditions for Interference Versus Facilitation During Sequential Sensorimotor Adaptation

We investigated how sensorimotor adaptation acquired during one experimental session influenced the adaptation in a subsequent session. The subjects' task was to track a visual target using a joystick-controlled cursor, while the relationship between joystick and cursor position was manipulated to introduce a sensorimotor discordance. Each subject participated in two sessions, separated by a pause of 2 min to 1 month duration. We found that adaptation was achieved within minutes, and persisted in the memory for at least a month, with only a small decay (experiment A). When the discordances administered in the two sessions were in mutual conflict, we found evidence for task interference (experiment B). However, when the discordances were independent, we found facilitation rather than interference (experiment C); the latter finding could not be explained by the use of an "easier" discordance in the second session (experiment D). We conclude that interference is due to an incompatibility between task requirements, and not to a competition of tasks for short-term memory. We further conclude that the ability to adapt to a sensorimotor discordance.

Bock, Otmar↗

Degradation of learned skills: Effectiveness of practice methods on visual approach and landing skill retention

Flight control and procedural task skill degradation, and the effectiveness of retraining methods were evaluated for a simulated space vehicle approach and landing under instrument and visual flight conditions. Fifteen experienced pilots were trained and then tested after 4 months either without the benefits of practice or with static rehearsal, dynamic rehearsal or with dynamic warmup practice. Performance on both the flight control and procedure tasks degraded significantly after 4 months. The rehearsal methods effectively countered procedure task skill degradation, while dynamic rehearsal or a combination of static rehearsal and dynamic warmup practice was required for the flight control tasks. The quality of the retraining methods appeared to be primarily dependent on the efficiency of visual cue reinforcement.

Sitterley, T. E.↗

Manual control of yaw motion with combined visual and vestibular cues

Measurements are made of manual control performance in the closed-loop task of nulling perceived self-rotation velocity about an earth-vertical axis. Self-velocity estimation was modelled as a function of the simultaneous presentation of vestibular and peripheral visual field motion cues. Based on measured low-frequency operator behavior in three visual field environments, a parallel channel linear model is proposed which has separate visual and vestibular pathways summing in a complementary manner. A correction to the frequency responses is provided by a separate measurement of manual control performance in an analogous visual pursuit nulling task. The resulting dual-input describing function for motion perception dependence on combined cue presentation supports the complementary model, in which vestibular cues dominate sensation at frequencies above 0.05 Hz. The describing function model is extended by the proposal of a non-linear cue conflict model, in which cue weighting depends on the level of agreement between visual and vestibular cues.

Zacharias, G. L.↗

An investigation of side-stick-controller/stability and control-augmentation system requirements for helicopter terrain flight under reduced visibility conditions

Simulation of the reduced visibility tasks is effected by providing the pilot with a visually coupled, helmet-mounted display of flight-control symbols superimposed upon terrain-board imagery. Forward-flight, low-speed, and precision-hover control modes are implemented, and a method is developed for the blending of control laws between each control mode. An investigation is made of the variations in the level of integration of primary control functions on a single side-stick controller. For most of the flight tasks investigated, separated controller configurations are preferred to a single, fully integrated side-stick device. Satisfactory handling qualities over all controller configurations are attained only for a precision-hover task conducted with a high level of stability and control augmentation. For most tasks flown with the helmet-mounted display significant degradation in handling qualities occurs relative to the identical tasks flown under visual flight conditions.

Landis, K. H.↗

Documentarian’s Support Role: Recording Active Research for Outreach

The Space Crop Production Team at NASA’s Kennedy Space Center recently conducted a campaign of parabolic flights to study the best techniques for harvesting and collecting microgreens in microgravity. During this process, the research team invited a student with scientific training to the field sites, contributing as the documentarian and aiding in recording audio visual data. The documentarian was tasked with photographing and filming the preparation of experiments for parabolic flight, hardware installation in the parabolic flight plane, the crew performing their experiments, and the harvesting hardware and samples post-flight. Through having a documentarian on the team during experiments, the processes of problem-solving, teamwork, and data collection were able to be captured. This allows for these methods to be reflected upon post-experiment as a means of improving the procedures for the future. Additionally, the picture and video evidence became data that were analyzed following the flight test. The Space Crop Production team benefited by having a documentarian present, as they were able to develop a 45 second social media video with the intent of being published through official NASA outlets. Longer videos for classroom use are also in work. In addition to outreach usage, the collection of footage and visual data the documentarian provides has the potential to be scientifically published both in video-based scientific journals, and as supplemental data in online journal publications. Capturing research in this manner helps share an unseen side of the research practices with a larger audience and increases the potential for scientific engagement and activation.

Christopher Bermudez↗

Spatial orientation - Visual-vestibular-somatic interaction

The compensation signals from somatosensory and vestibular receptors, which act to compensate for disturbances produced by the displacement of our eyes relative to other parts of our bodies and for visual disturbances such as tilted frames or moving visual fields, are investigated. Disturbances were evoked by tilting the head and by rotating a large visual display, while compensation signals related to gravity were altered by placing the subjects horizontally on a board or seating them vertically. The first experiment studied the effects of visual disturbance on the ability of supine observers to set a line to the longitudinal body axis while the head was tilted toward one shoulder or while the head was straight. Results showed that the effects of the visual disturbance were greater when the head was tilted than when it was straight, which indicates that the effects of visual disturbance were greater for a task that required compensation. The second experiment compared the performance of supine and erect observers. No differences were found between the performance of observers on a task requiring the use of compensation signals under these two conditions, which suggests that the enrichment of compensatory signals did not reduce the effects of visual disturbancs.

Parker, D. E.↗

A vision architecture for the extravehicular activity retriever

The Extravehicular Activity Retriever (EVAR) is a robotic device currently being developed by the Automation and Robotics Division at the NASA Johnson Space Center to support activities in the neighborhood of the Space Shuttle or Space Station Freedom. As the name implies, the Retriever's primary function will be to provide the capability to retrieve tools, equipment or other objects which have become detached from the spacecraft, but it will also be able to rescue a crew member who may have become inadvertently de-tethered. Later goals will include cooperative operations between a crew member and the Retriever such as fetching a tool that is required for servicing or maintenance operations. This report documents a preliminary design for a Vision System Planner (VSP) for the EVAR that is capable of achieving visual objectives provided to it by a high level task planner. Typical commands which the task planner might issue to the VSP relate to object recognition, object location determination, and obstacle detection. Upon receiving a command from the task planner, the VSP then plans a sequence of actions to achieve the specified objective using a model-based reasoning approach. This sequence may involve choosing an appropriate sensor, selecting an algorithm to process the data, reorienting the sensor, adjusting the effective resolution of the image using lens zooming capability, and/or requesting the task planner to reposition the EVAR to obtain a different view of the object. An initial version of the Vision System Planner which realizes the above capabilities using simulated images has been implemented and tested. The remaining sections describe the architecture and capabilities of the VSP and its relationship to the high level task planner. In addition, typical plans that are generated to achieve visual goals for various scenarios will be discussed. Specific topics to be addressed will include object search strategies, repositioning of the EVAR to improve the quality of information obtained from the sensors, complementary usage of the sensors and redundant capabilities.

Magee, Michael↗

A vision system planner for increasing the autonomy of the Extravehicular Activity Helper/Retriever

The Extravehicular Activity Retriever (EVAR) is a robotic device currently being developed by the Automation and Robotics Division at the NASA Johnson Space Center to support activities in the neighborhood of the Space Shuttle or Space Station Freedom. As the name implies, the Retriever's primary function will be to provide the capability to retrieve tools and equipment or other objects which have become detached from the spacecraft, but it will also be able to rescue a crew member who may have become inadvertently de-tethered. Later goals will include cooperative operations between a crew member and the Retriever such as fetching a tool that is required for servicing or maintenance operations. This paper documents a preliminary design for a Vision System Planner (VSP) for the EVAR that is capable of achieving visual objectives provided to it by a high level task planner. Typical commands which the task planner might issue to the VSP relate to object recognition, object location determination, and obstacle detection. Upon receiving a command from the task planner, the VSP then plans a sequence of actions to achieve the specified objective using a model-based reasoning approach. This sequence may involve choosing an appropriate sensor, selecting an algorithm to process the data, reorienting the sensor, adjusting the effective resolution of the image using lens zooming capability, and/or requesting the task planner to reposition the EVAR to obtain a different view of the object. An initial version of the Vision System Planner which realizes the above capabilities using simulated images has been implemented and tested. The remaining sections describe the architecture and capabilities of the VSP and its relationship to the high level task planner. In addition, typical plans that are generated to achieve visual goals for various scenarios are discussed. Specific topics to be addressed will include object search strategies, repositioning of the EVAR to improve the quality of information obtained from the sensors, and complementary usage of the sensors and redundant capabilities.

Magee, Michael↗

Effects of simulator motion and visual characteristics on rotorcraft handling qualities evaluations

The pilot's perceptions of aircraft handling qualities are influenced by a combination of the aircraft dynamics, the task, and the environment under which the evaluation is performed. When the evaluation is performed in a groundbased simulator, the characteristics of the simulation facility also come into play. Two studies were conducted on NASA Ames Research Center's Vertical Motion Simulator to determine the effects of simulator characteristics on perceived handling qualities. Most evaluations were conducted with a baseline set of rotorcraft dynamics, using a simple transfer-function model of an uncoupled helicopter, under different conditions of visual time delays and motion command washout filters. Differences in pilot opinion were found as the visual and motion parameters were changed, reflecting a change in the pilots' perceptions of handling qualities, rather than changes in the aircraft model itself. The results indicate a need for tailoring the motion washout dynamics to suit the task. Visual-delay data are inconclusive but suggest that it may be better to allow some time delay in the visual path to minimize the mismatch between visual and motion, rather than eliminate the visual delay entirely through lead compensation.

Mitchell, David G.↗

Scalable edge clustering of dynamic graphs via weighted line graphs

Timestamped relational datasets consisting of records (or connections) between pairs of entities are ubiquitous in network science. For applications like peer-to-peer communication, email, various social network interactions, and computer network security, it is useful to organize these records into groups based on how and when they are occurring. Weighted line graphs offer a natural way to model how records are related in such datasets but for large real-world graph topologies, building and utilizing the line graph is prohibitively expensive. Here, we present the framework to cluster the edges of a dynamic graph via the associated line graph that contains two major contributions. The first is a method to work with the line graph implicitly and the second is a distributed scale implementation of an agglomerative hierarchical graph clustering algorithm. We outline a novel hierarchical dynamic graph edge clustering approach that efficiently breaks massive relational datasets into small sets of edges containing events at various timescales. This is in stark contrast to traditional graph clustering algorithms that prioritize highly connected (clique-like) community structures. Our approach relies on constructing a sufficient subgraph of a weighted line graph and applying a hierarchical agglomerative clustering. This approach is related to scalable techniques from spatial clustering, nonlinear-dimension reduction, topological data analysis, and draws particular inspiration from HDBSCAN. As an edge clustering, this method yields an overlapping node clustering. Our algorithm is parallelizable and we demonstrate efficient clustering of a billion-scale, real-world dynamic graph into small edge sets that correlate in topology and time. The entire clustering process for a graph with tens of billions of edges takes just a few minutes of run time on 256 nodes of a distributed compute environment. We argue how the output of the edge clustering is useful for a multitude of data visualization and powerful machine learning tasks, both involving the original massive dynamic graph data and metadata associated with the nodes and edges. Finally, we describe how this approach can be extended to dynamic hypergraphs and dynamic graphs/hypergraphs with unstructured data living on vertices and edges.

Data Analysis↗

Fixed-base simulator study of the effect of time delays in visual cues on pilot tracking performance

Factors were examined which determine the amount of time delay acceptable in the visual feedback loop in flight simulators. Acceptable time delays are defined as delays which significantly affect neither the results nor the manner in which the subject 'flies' the simulator. The subject tracked a target aircraft as it oscillated sinusoidally in a vertical plane only. The pursuing aircraft was permitted five degrees of freedom. Time delays of from 0.047 to 0.297 second were inserted in the visual feedback loop. A side task was employed to maintain the workload constant and to insure that the pilot was fully occupied during the experiment. Tracking results were obtained for 17 aircraft configurations having different longitudinal short-period characteristics. Results show a positive correlation between improved handling qualities and a longer acceptable time delay.

Queijo, M. J.↗

In-flight assessment of workload using instrument scan

During instrument flight, the pilot obtains information concerning aircraft state by cross checking or scanning the flight instruments. The exact method of scanning the instrument panel varies from pilot to pilot but there are some basic features common to a good scan pattern. The method discussed may be considered a candidate for workload studies with piloting tasks which will invoke a regular visual scan (spatial/temporal pattern of eye movements) during instrument flight. It is important to point out that instrument scan by itself is not a complete indicator of workload nor is task attention necessarily associated with where the pilot happens to be looking at a particular instant. However, whenever instrument scan is required in a piloting task, analysis of scanning behavior may yield important direct or indirect information concerning workload.

Tole, J. R.↗