Human-in-the-Loop Evaluations: Process and Mockup Fidelity

Abstract

Human-in-the-loop (HITL) evaluations are iterative events used during design and development to identify issues with the implementation of human systems integration. HITL evaluations involve human test subjects who are user-representative participants performing activities with representative hardware, software, and procedures. The paper will describe the process by which HITL evaluations can be implemented in a program or project. This will include definitions for developmental and verification HITL evaluations, levels of mockup fidelity, and certification of HITL articles. The proposed process can be tailored depending on the type of HITL evaluation being conducted. It is highly recommended that findings are timely reported and incorporated in the hardware and/or software design.