Engineering topics
Publications and source records attributed to Lewis, C. M..
Rule-based models of human problem solving have typically not been tested for statistical significance. Three methods of testing rules - analysis of variance, randomization, and contingency tables - are presented. Advantages and disadvantages of the methods are also described.
The relationship between language and empirical fitting of data is discussed. The production system is presented as an appropriate description of human behavior in Man-Machine systems. Issues arising in the identification of rules from data are examined. Rules identified through logical generalization are shown to be equivocal. Difficulties arising from the use of logic-based procedures with human performance data containing errors are explored. Problems relating to rule sets which are not disjoint are discussed and a solution presented. Significant testing issues are raised for rule identification and a procedure based on controlling contrivedness is presented. A synthesis of data and knowledge-based approaches is suggested as a remedy to many of the difficulties discussed.
Progress was made in the three following areas. In the rule-based modeling area, two papers related to identification and significane testing of rule-based models were presented. In the area of operator aiding, research focused on aiding operators in novel failure situations; a discrete control modeling approach to aiding PLANT operators was developed; and a set of guidelines were developed for implementing automation. In the area of flight simulator hardware and software, the hardware will be completed within two months and initial simulation software will then be integrated and tested.
Within the constraints of the syntax language, the set of observation descriptions which determines the discriminations which can be made, and the number of observations classified, a method is to be devised for determining the relative frequency over instantiation with which a rule of equal or greater generality would be identified. Generality, here, is defined as the number of observations described by a rule. A covering algorithm (Aq, Michalski 1973) was used to identify pilot strategy (system of rules) in maneuvering to avoid intruders.
The application of the rule identification technique to the analysis of human performance data is proposed. The relation between the language and identifiable consistencies is discussed. The advantages of production system models for the description of complex human behavior are studied. The use of a Monte Carlo significance testing procedure to assure the validity of the rule identification is examined. An example of the rule-based analysis of Palmer's (1983) data is presented.
Two project areas were pursued: the intelligent cockpit and human problem solving. The first area involves an investigation of the use of advanced software engineering methods to aid aircraft crews in procedure selection and execution. The second area is focused on human problem solving in dynamic environments, particulary in terms of identification of rule-based models land alternative approaches to training and aiding. Progress in each area is discussed.