Neeter, Eduardo | Search NASA

DOE OSTI2023

SmallTAL: Real-Time Egocentric Online Temporal Action Localization for the Data-Impoverished

Abstract We propose a real-time, online temporal action localization system that requires a small amount of annotated data. The main challenges we address are high intra-class variability and a large and diverse background class. We address these using a flexible frame descriptor, dynamic time warping, and a novel approach to database construction. Our solution receives egocentric RGB-D streams as input and makes predictions at regular temporal intervals. We validate our approach by localizing actions in a digital twin of an electrical substation, in which certain objects have been replaced by functional virtual replicas.

Computer Science↗

DOE OSTI2022

System and method for error detection and correction in virtual reality and augmented reality environments

Embodiments of the present disclosure are related to training one or more of machine learning algorithms in a virtual reality environment for error detection and correction and/or for employing one or more trained machine learning models in an augmented reality environment to detect and/or correct user errors associated the performance of one or more tasks.

97 MATHEMATICS AND COMPUTING↗