SMART: Situated Multimodal Advanced Real-time Trainer

Abstract

We have begun work on an intelligent support tool (SMART) for operating and maintenance procedures. This work extends McDonnell Douglas's recent success in developing electronic job aids for onboard applications. SMART is based on advanced AI technology that derives the sequential, situational, operational, and temporal views of operating and maintenance procedures from a single internal representation of the procedures. SMART guides the astronauts through detailed operating and maintenance procedures. It also helps the astronauts decide when and how it is safe to deviate from the established procedures. SMART's user interface presents the sequential and procedural views of the procedures to the astronauts. The views are supplemented with vivid color graphics of internal system functions, digitized photographs of flight hardware, and full-motion video. SMART also allows the astronauts to keep their own personal notes attached to a procedure. SMART will be delivered on portable hand-held systems. SMART provides highly descriptive, realistic, 'hands-on' training which is available 'on-demand' wherever and whenever it it needed.