Engineering topics

Ellis, Stephen R.

Publications and source records attributed to Ellis, Stephen R..

At least 37 records · Page 2

NASA NTRS2001

Discriminability of Prediction Artifacts in a Time Delayed Virtual Environment

Overall latency remains an impediment to perceived image stability and consequently to human performance in virtual environment (VE) systems. Predictive compensators have been proposed as a means to mitigate these shortcomings, but they introduce rendering errors because of induced motion overshoot and heightened noise. Discriminability of these compensator artifacts was investigated by a protocol in which head tracked image stability for 35 ms baseline VE system latency was compared against artificially added (16.7 to 100 ms) latency compensated by a previously studied Kalman Filter (K-F) predictor. A control study in which uncompensated 16.7 to 100 ms latencies were compared against the baseline was also performed. Results from 10 subjects in the main study and 8 in the control group indicate that predictive compensation artifacts are less discernible than the disruptions of uncompensated time delay for the shorter but not the longer added latencies. We propose that noise magnification and overshoot are contributory cues to the presence of predictive compensation.

Adelstein, Bernard D.↗

NASA NTRS1998

Localization of Virtual Objects in the Near Visual Field (Operator Interaction with Simple Virtual Objects)

Errors in the localization of nearby virtual objects presented via see-through, helmet mounted displays are examined as a function of viewing conditions and scene content in four experiments using a total of 38 subjects. Monocular, biocular or stereoscopic presentation of the virtual objects, accommodation (required focus), subjects' age, and the position of physical surfaces are examined. Nearby physical surfaces are found to introduce localization errors that differ depending upon the other experimental factors. These errors apparently arise from the occlusion of the physical background by the optically superimposed virtual objects. But they are modified by subjects' accommodative competence and specific viewing conditions. The apparent physical size and transparency of the virtual objects and physical surfaces respectively are influenced by their relative position when superimposed. The design implications of the findings are discussed in a concluding section.

Ellis, Stephen R.↗

NASA NTRS1998

Pursuit Latency for Chromatic Targets

The temporal dynamics of eye movement response to a change in direction of stimulus motion has been used to compare the processing speeds of different types of stimuli (Mulligan, ARVO '97). In this study, the pursuit response to colored targets was measured to test the hypothesis that the slow response of the chromatic system (as measured using traditional temporal sensitivity measures such as contrast sensitivity) results in increased eye movement latencies. Subjects viewed a small (0.4 deg) Gaussian spot which moved downward at a speed of 6.6 deg/sec. At a variable time during the trajectory, the dot's direction of motion changed by 30 degrees, either to the right or left. Subjects were instructed to pursue the spot. Eye movements were measured using a video ophthalmoscope with an angular resolution of approximately 1 arc min and a temporal sampling rate of 60 Hz. Stimuli were modulated in chrominance for a variety of hue directions, combined with a range of small luminance increments and decrements, to insure that some of the stimuli fell in the subjects' equiluminance planes. The smooth portions of the resulting eye movement traces were fit by convolving the stimulus velocity with an exponential having variable onset latency, time constant and amplitude. Smooth eye movements with few saccades were observed for all stimuli. Pursuit responses to stimuli having a significant luminance component are well-fit by exponentials having latencies and time constants on the order of 100 msec. Increases in pursuit response latency on the order of 100-200 msec are observed in response to certain stimuli, which occur in pairs of complementary hues, corresponding to the intersection of the stimulus section with the subjects' equiluminant plane. Smooth eye movements can be made in response to purely chromatic stimuli, but are slower than responses to stimuli with a luminance component.

Mulligan, Jeffrey B.↗

NASA NTRS1998

Operator Localization of Virtual Objects

Errors in the localization of nearby virtual objects presented via see-through, helmet mounted displays are examined as a function of viewing conditions and scene content. Monocular, biocular or stereoscopic presentation of the virtual objects, accommodation (required focus), subjects'age, and the position of physical surfaces are examined. Nearby physical surfaces are found to introduce localization errors that differ depending upon the other experimental factors. The apparent physical size and transparency of the virtual objects and physical surfaces respectively are also influenced by their relative position when superimposed. Design implications are discussed.

Ellis, Stephen R.↗

NASA NTRS1998

Headphone and Head-Mounted Visual Displays for Virtual Environments

A realistic auditory environment can contribute to both the overall subjective sense of presence in a virtual display, and to a quantitative metric predicting human performance. Here, the role of audio in a virtual display and the importance of auditory-visual interaction are examined. Conjectures are proposed regarding the effectiveness of audio compared to visual information for creating a sensation of immersion, the frame of reference within a virtual display, and the compensation of visual fidelity by supplying auditory information. Future areas of research are outlined for improving simulations of virtual visual and acoustic spaces. This paper will describe some of the intersensory phenomena that arise during operator interaction within combined visual and auditory virtual environments. Conjectures regarding audio-visual interaction will be proposed.

Begault, Duran R.↗

NASA NTRS1997

Automated Assessment of Visual Quality of Digital Video

The advent of widespread distribution of digital video creates a need for automated methods for evaluating visual quality of digital video. This is particularly so since most digital video is compressed using lossy methods, which involve the controlled introduction of potentially visible artifacts. Compounding the problem is the bursty nature of digital video, which requires adaptive bit allocation based on visual quality metrics. In previous work, we have developed visual quality metrics for evaluating, controlling, and optimizing the quality of compressed still images[1-4]. These metrics incorporate simplified models of human visual sensitivity to spatial and chromatic visual signals. The challenge of video quality metrics is to extend these simplified models to temporal signals as well. In this presentation I will discuss a number of the issues that must be resolved in the design of effective video quality metrics. Among these are spatial, temporal, and chromatic sensitivity and their interactions, visual masking, and implementation complexity. I will also touch on the question of how to evaluate the performance of these metrics.

Watson, Andrew B.↗

NASA NTRS1997

The Search for Optimal Visual Stimuli

In 1983, Watson, Barlow and Robson published a brief report in which they explored the relative visibility of targets that varied in size, shape, spatial frequency, speed, and duration (referred to subsequently here as WBR). A novel aspect of that paper was that visibility was quantified in terms of threshold contrast energy, rather than contrast. As they noted, this provides a more direct measure of the efficiency with which various patterns are detected, and may be more edifying as to the underlying detection machinery. For example, under certain simple assumptions, the waveform of the most efficiently detected signal is an estimate of the receptive field of the visual system's most efficient detector. Thus one goal of their experiment Basuto search for the stimulus that the 'eye sees best'. Parenthetically, the search for optimal stimuli may be seen as the most general and sophisticated variant of the traditional 'subthreshold summation' experiment, in which one measures the effect upon visibility of small probes combined with a base stimulus.

Watson, Andrew B.↗

NASA NTRS1997

Perceptual Fidelity Versus Engineering Compromises in Virtual Acoustic Displays

Immersive, three-dimensional displays are increasingly becoming a goal of advanced human-machine interfaces. While the technology for achieving truly useful multisensory environments is still being developed, techniques for generating three-dimensional sound are now both sophisticated and practical enough to be applied to acoustic displays. The ultimate goal of virtual acoustics is to simulate the complex acoustic field experienced by a listener freely moving around within an environment. Of course, such complexity, freedom of movement and interactivity is not always possible in a 'true' virtual environment, much less in lower-fidelity multimedia systems. However, many of the perceptual and engineering constraints (and frustrations) that researchers, engineers and listeners have experienced in virtual audio are relevant to multimedia. In fact, some of the problems that have been studied will be even more of an issue for lower fidelity systems that are attempting to address the requirements of a huge, diverse and ultimately unknown audience. Examples include individual differences in head-related transfer functions, A lack of real interactively (head-tracking) in many multimedia displays, and perceptual degradation due to low sampling rates and/or low-bit compression. This paper discusses some of the engineering constraints faced during implementation of virtual acoustic environments and the perceptual consequences of these constraints. Specific examples are given for NASA applications such as telerobotic control, aeronautical displays, and shuttle launch communications. An attempt will also be made to relate these issues to low-fidelity implementations such as the internet.

Wenzel, Elizabeth M.↗

NASA NTRS1997

Response Classification Images in Vernier Acuity

Orientation selective and local sign mechanisms have been proposed as the basis for vernier acuity judgments. Linear image features contributing to discrimination can be determined for a two choice task by adding external noise to the images and then averaging the noises separately for the four types of stimulus/response trials. This method is applied to a vernier acuity task with different spatial separations to compare the predictions of the two theories. Three well-practiced observers were presented around 5000 trials of a vernier stimulus consisting of two dark horizontal lines (5 min by 0.3 min) within additive low-contrast white noise. Two spatial separations were tested, abutting and a 10 min horizontal separation. The task was to determine whether the target lines were aligned or vertically offset. The noises were averaged separately for the four stimulus/response trial types (e.g., stimulus = offset, response = aligned). The sum of the two 'not aligned' images was then subtracted from the sum of the 'aligned' images to obtain an overall image. Spatially smoothed images were quantized according to expected variability in the smoothed images to allow estimation of the statistical significance of image features. The response images from the 10 min separation condition are consistent with the local sign theory, having the appearance of two linear operators measuring vertical position with opposite sign. The images from the abutting stimulus have the same appearance with the two operators closer together. The image predicted by an oriented filter model is similar, but has its greatest weight in the abutting region, while the response images fall to nonsignificance there. The response correlation image method, previously demonstrated for letter discrimination, clarifies the features used in vernier acuity.

Ahumada, Albert J., Jr.↗

NASA NTRS1995

The design of pictorial instruments

An historical overview of the development and design of pictorial displays is presented with particular emphasis on the research related to civilian aerospace applications carried out at the Ames Research Center. The use of geometric and symbolic enhancements to counteract the inherent ambiguities in perspective projections is discussed with reference to an aircraft traffic display application. Current design and perceptual issues related to head-mounted systems for virtual environment simulation and telepresence displays are also discussed. Finally, the importance of incorporating error display and control in the design of pictorial displays is addressed in the context of an orbital maneuver planning application.

Ellis, Stephen R.↗

NASA NTRS1995

Human Interfaces In Teleoperations And Virtual Environments

Conference report contains compilation of papers relating to interactions between humans and machines from perspectives of telepresence and sensorimotor adaptation, measurement and evaluation of performance, and design principles and predictive models. Topics discussed include neural networks, sensory technology, display, and feedback controls. Covers state of art of remote sensing and control by humans for space or other operations.

Durlach, Nathaniel I.↗

NASA NTRS1995

Presence of Mind... A Reaction to Sheridan's "Musing on Telepresence"

What are the benefits and significance of developing a scientifically useful measure of the human sense of presence in an environment? Such a scale could be conceived to measure the extent to which users of telerobotics interfaces feel or behave as if they were present at the site of a remotely controlled robot. The essay examines some issues raised in order to identify characteristics, a scale of 'presence' ought to have to be useful as an explanatory scientific concept. It also addresses the utility of worrying about developing such a scale at all. To be useful in the same manner as a traditional scientific concept such as mass, for example, it is argued that such scales not only need to be precisely defined and co-vary with determinative factors but also need to establish equivalence classes of its independent constituents. This simplifying property is important for either subjective or objective scales of presence and arises if the constituents of presence are truly independent.

Ellis, Stephen R.↗

NASA NTRS1995

Binocular Convergence and Errors in Judged Distance While Using Head-mounted See-through Displays

Previous observations have shown that optical superposition of a physical backdrops at the judged depth of a stereoscopic virtual image moves the judged depth closer to the observer. This effect was more pronounced for slowly moving physical backdrops and was not enhanced when the virtual image was rendered as a flat shaded solid object rather than a open wire-frame. Since this change in rendering making the virtual image more completely occlude the backdrop did not effect its judged depth and since the motion of the backdrop which would have attracted visual attention and binocular convergence did Increase its perceptual displacement, it was concluded that the change In Judged depth was not due to the perceived occlusion. Rather it was concluded to be due to an increase in binocular convergence. An experimental test of this hypothesis using a unobtrusive nonius technique to detect absolute and relative convergence has confirmed the presence of convergence correlated with the magnitude of the change in judged position of this virtual Image. The practical implications of this cause are demonstrated by a second study using monocular, biocular and stereoscopic viewing conditions and the consequences for the design of head-mounted see-through displays for near work are discussed.

Ellis, Stephen R.↗

NASA NTRS1994

Interactive orbital proximity operations planning system instruction and training guide

This guide instructs users in the operation of a Proximity Operations Planning System. This system uses an interactive graphical method for planning fuel-efficient rendezvous trajectories in the multi-spacecraft environment of the space station and allows the operator to compose a multi-burn transfer trajectory between orbit initial chaser and target trajectories. The available task time (window) of the mission is predetermined and the maneuver is subject to various operational constraints, such as departure, arrival, spatial, plume impingement, and en route passage constraints. The maneuvers are described in terms of the relative motion experienced in a space station centered coordinate system. Both in-orbital plane as well as out-of-orbital plane maneuvering is considered. A number of visual optimization aids are used for assisting the operator in reaching fuel-efficient solutions. These optimization aids are based on the Primer Vector theory. The visual feedback of trajectory shapes, operational constraints, and optimization functions, provided by user-transparent and continuously active background computations, allows the operator to make fast, iterative design changes that rapidly converge to fuel-efficient solutions. The planning tool is an example of operator-assisted optimization of nonlinear cost functions.

Grunwald, Arthur J.↗

NASA NTRS1994

Simulation fidelity of a virtual environment display

We assessed the degree to which a virtual environment system produced a faithful simulation of three-dimensional space by investigating the influence of a pitched optic array on the perception of gravity-referenced eye level (GREL). We compared the results with those obtained in a physical environment. In a within-subjects factorial design, 12 subjects indicated GREL while viewing virtual three-dimensional arrays at different static orientations. A physical array biased GREL more than did a geometrically identical virtual pitched array. However, addition of two sets of orthogonal parallel lines (a grid) to the virtual pitched array resulted in as large a bias as that obtained with the physical pitched array. The increased bias was caused by longitudinal, but not the transverse, components of the grid. We discuss implications of our results for spatial orientation models and for designs of virtual displays.

Nemire, Kenneth↗

NASA NTRS1994

Distance Perception of Stereoscopically Presented Virtual Objects Optically Superimposed on Physical Objects by a Head-Mounted See-Through Display

The influence of physically presented background stimuli on the perceived depth of optically overlaid, stereoscopic virtual images has been studied using headmounted stereoscopic, virtual image displays. These displays allow presentation of physically unrealizable stimulus combinations. Positioning of an opaque physical object either at the initial perceived depth of the virtual image or at a position substantially in front of the virtual image, causes the virtual image to perceptually move closer to the observer. In the case of objects positioned substantially in front of the virtual image, subjects often perceive the opaque object to become transparent. Evidence is presented that the apparent change of position caused by interposition of the physical object is not due to occlusion cues. According, it may have an alternative cause such as variation in the binocular vengeance position of the eyes caused by introduction of the physical object. This effect may complicate design of overlaid virtual image displays for near objects and appears to be related to the relative conspicuousness of the overlaid virtual image and the background. Consequently, it may be related to earlier analyses of John Foley which modeled open-loop pointing errors to stereoscopically presented points of light in terms of errors in determination of a reference point for interpretation of observed retinal disparities. Implications for the design of see-through displays for manufacturing will be discussed.

Ellis, Stephen R.↗

NASA NTRS1993

Interactive displays for trajectory planning and proximity operations

Rendezvous, docking, and other Space Station proximity operations (PROX OPS) will be conducted routinely in space. Real-time interactive visual aids and planning tools will be helpful, if not necessary, for future missions both in preflight training and on orbit. Two such displays, eivaN and Navie, are currently available for examination and human factors testing. A study was conducted in which data were collected from eight test subjects. Solution times for both devices decreased rapidly with experience. Neither fuel usage nor the number of waypoints (burns) decreased with experience. With Navie, medians of solution time and fuel consumption totaled over all subjects peaked at one of two starting points above the V-bar with monotonically decreasing values in both directions. This pattern did not appear with eivaN values. Since the docking tasks were fundamentally different with each device, and because Navie imposed more constraints on the users than eivaN did, the orbital mechanics effects had a more pronounced effect on the Navie results than on the eivaN data.

Brody, Adam R.↗

NASA NTRS1993

Visual display aid for orbital maneuvering - Design considerations

This paper describes the development of an interactive proximity operations planning system that allows on-site planning of fuel-efficient multiburn maneuvers in a potential multispacecraft environment. Although this display system most directly assists planning by providing visual feedback to aid visualization of the trajectories and constraints, its most significant features include: (1) the use of an 'inverse dynamics' algorithm that removes control nonlinearities facing the operator, and (2) a trajectory planning technique that separates, through a 'geometric spreadsheet', the normally coupled complex problems of planning orbital maneuvers and allows solution by an iterative sequence of simple independent actions. The visual feedback of trajectory shapes and operational constraints, provided by user-transparent and continuously active background computations, allows the operator to make fast, iterative design changes that rapidly converge to fuel-efficient solutions. The planning tool provides an example of operator-assisted optimization of nonlinear cost functions.

Grunwald, Arthur J.↗