NA84 Auto Aiming Tool (Final Report)

Abstract

The Microsoft Hololens is capable of bi-directional communication between units. This allows many users to share a common visual experience and is the primary capability of interest due to the collaborative scenarios it may enable. One scenario pursued in the Automated Aiming Tool project is shown in figure 1 which conceptualizes the reciprocal workflow between remote team members wearing these devices. In this scenario, the down-range team member leverages the depth-scanning capability of the Hololens to scan and texture map the environment and any objects of interest. This data and any associated metadata are then packaged and transmitted to remote team members where it is then unpackaged and visualized. The remote team member can then insert computer generated imagery – a type of “virtual indicator” – within the visualized environment and that object is then rendered in the field of view of the down-range operator in real time. These virtual objects can be indicators for the placement of instrumentation, items of interest, areas from which data has been collected, etc. Pursuant to the above scenario, the primary objective has been to assess the feasibility of its implementation with current v1 hardware. Certain limitations were found to limit the degree to which the above scenario can currently be implemented. However, the future potential of this approach is clear for revolutionizing the speed and precision of multi-object registration at a single site, instrumentation placement and orientation (aiming), and for full-scene communication and coordination among two or more sites.