Engineering topics

Johnson, Debra Steele

Publications and source records attributed to Johnson, Debra Steele.

6 records

NASA NTRS1993

The effects of instructional sets on reactions to and performance on an intelligent tutoring system

The effects of a contextual factor, i.e., task instructions, on performance on and reactions to an Intellegent Tutoring System (ITS) training Remote Manipulator System (RMS) tasks were examined. The results supported the first prediction that task instructions could be used to successfully induce a mastery versus an achievement orientation. Previous research suggests that a mastery orientation can result in beneficial effects on learning and performance of complex tasks. Furthermore, the results supported the second prediction that a mastery orientation would have beneficial effects on learning and performance as well as affective and cognitive reactions to the ITS tasks. Moreover, the results indicated that a mastery orientation was especially beneficial for the more complex ITS tasks and later in task practice, i.e., when a task was performed for the second time. A mastery orientation is posited to have its beneficial effects by focusing more effort and attention on task performance. Conclusions are drawn with some caution due to the small number of subjects, although the results for these subjects were consistent across multiple trials and multiple measures of performance. ITS designers are urged to consider contextual factors such as task instructions and feedback in terms of their potential to induce a mastery versus an achievement orientation.

Johnson, Debra Steele↗

NASA NTRS1992

An evaluation of training effectiveness of an intelligent tutoring system

The study evaluated the training effectiveness of an intelligent tutoring system (ITS) for the Remote Manipulator System (RMS). The study examined how well individuals learn the training content and skills from the RMS ITS and to what extent the content and skills learned using the ITS transfer to RMS task performance in the SES, a high fidelity simulator. Three astronauts completed 8 2-hour ITS sessions addressing movement in three coordinate systems, grapple, ungrapple, berth, and unberth procedures, and singularities and reach limits. Their performance was also observed in an SES training session. Performance data were collected using multiple measures: ITS task performance, transfer performance on the SES, a conceptual knowledge test, an opinion survey completed by astronauts, and comments and observations from astronauts and trainers. Results indicated the RMS ITS to be moderately effective and provided evidence of the efficacy of ITS's, in general. Comments and suggestions are provided relating to how the ITS could be improved and to enable decision makers to judge the effectiveness of the RMS ITS.

Johnson, Debra Steele↗

NASA NTRS1991

The development of expertise using an intelligent computer-aided training system

An initial examination was conducted of an Intelligent Tutoring System (ITS) developed for use in industry. The ITS, developed by NASA, simulated a satellite deployment task. More specifically, the PD (Payload Assist Module Deployment)/ICAT (Intelligent Computer Aided Training) System simulated a nominal Payload Assist Module (PAM) deployment. The development of expertise on this task was examined using three Flight Dynamics Officer (FDO) candidates who has no previous experience with this task. The results indicated that performance improved rapidly until Trial 5, followed by more gradual improvements through Trial 12. The performance dimensions measured included performance speed, actions completed, errors, help required, and display fields checked. Suggestions for further refining the software and for deciding when to expose trainees to more difficult task scenarios are discussed. Further, the results provide an initial demonstration of the effectiveness of the PD/ICAT system in training the nominal PAM deployment task and indicate the potential benefits of using ITS's for training other FDO tasks.

Johnson, Debra Steele↗

NASA NTRS1990

Training effectiveness of an intelligent tutoring system for a propulsion console trainer

A formative evaluation was conducted on an Intelligent Tutoring System (ITS) developed for tasks performed on the Propulsion Console. The ITS, which was developed primarily as a research tool, provides training on use of the Manual Select Keyboard (MSK). Three subjects completed three phases of training using the ITS: declarative, speed, and automaticity training. Data were collected on several performance dimensions, including training time, number of trials performed in each training phase, and number of errors. Information was also collected regarding the user interface and content of training. Suggestions for refining the ITS are discussed. Further, future potential uses and limitations of the ITS are discussed. The results provide an initial demonstration of the effectiveness of the Propulsion Console ITS and indicate the potential benefits of this form of training tool for related tasks.

Johnson, Debra Steele↗

NASA NTRS1990

The effects of outcome and process feedback

A study was conducted to examine the effects of process and outcome feedback on performance during a skill acquisition phase and a transfer test phase. The research also examined the role of two moderators: self-efficacy and intrinsic motivation. Subjects were college students participating for course credit. The task involved using a computerized simulation of the Space Shuttle's Remote Manipulation System (RMS). Results provided evidence of the beneficial effects of process feedback during skill acquisition. Results also provided evidence that self-efficacy and intrinsic motivation moderate the effects of feedback type on performance.

Johnson, Debra Steele↗

NASA NTRS1989

The development of expertise on an intelligent tutoring system

An initial examination was conducted of an Intelligent Tutoring System (ITS) developed for use in industry. The ITS, developed by NASA, simulated a satellite deployment task. More specifically, the PD (Payload Assist Module Deployment)/ICAT (Intelligent Computer Aided Training) System simulated a nominal Payload Assist Module (PAM) deployment. The development of expertise on this task was examined using three Flight Dynamics Officer (FDO) candidates who had no previous experience with this task. The results indicated that performance improved rapidly until Trial 5, followed by more gradual improvements through Trial 12. The performance dimensions measured included performance speed, actions completed, errors, help required, and display fields checked. Suggestions for further refining the software and for deciding when to expose trainees to more difficult task scenarios are discussed. Further, the results provide an initial demonstration of the effectiveness of the PD/ICAT system in training the nominal PAM deployment task and indicate the potential benefits of using ITS's for training other FDO tasks.

Johnson, Debra Steele↗