NASA Summer 2014
Create a motion validation system using Google Glass and Microsoft Kinect to provide instantaneous feedback for integration with NASA tutorials and procedures.
Fares, Hannelle↗
SEARCH · Search NASA
Results for “Microsoft Kinect”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A Tool for the Automated Collection of Space Utilization Data: Three Dimensional Space Utilization Monitor
Space Human Factors and Habitability (SHFH) Element within the Human Research Program (HRP), in collaboration with the Behavioral Health and Performance (BHP) Element, is conducting research regarding Net Habitable Volume (NHV), the internal volume within a spacecraft or habitat that is available to crew for required activities, as well as layout and accommodations within that volume. NASA is looking for innovative methods to unobtrusively collect NHV data without impacting crew time. Data required includes metrics such as location and orientation of crew, volume used to complete tasks, internal translation paths, flow of work, and task completion times. In less constrained environments methods for collecting such data exist yet many are obtrusive and require significant post‐processing. Example technologies used in terrestrial settings include infrared (IR) retro‐reflective marker based motion capture, GPS sensor tracking, inertial tracking, and multiple camera filmography. However due to constraints of space operations many such methods are infeasible, such as inertial tracking systems which typically rely upon a gravity vector to normalize sensor readings, and traditional IR systems which are large and require extensive calibration. However multiple technologies have not yet been applied to space operations for these explicit purposes. Two of these include 3‐Dimensional Radio Frequency Identification Real‐Time Localization Systems (3D RFID‐RTLS) and depth imaging systems which allow for 3D motion capture and volumetric scanning (such as those using IR‐depth cameras like the Microsoft Kinect or Light Detection and Ranging / Light‐Radar systems, referred to as LIDAR).
Vos, Gordon A.↗
A Tool for the Automated Collection of Space Utilization Data: Three Dimensional Space Utilization Monitor
Space Human Factors and Habitability (SHFH) Element within the Human Research Program (HRP) and the Behavioral Health and Performance (BHP) Element are conducting research regarding Net Habitable Volume (NHV), the internal volume within a spacecraft or habitat that is available to crew for required activities, as well as layout and accommodations within the volume. NASA needs methods to unobtrusively collect NHV data without impacting crew time. Data required includes metrics such as location and orientation of crew, volume used to complete tasks, internal translation paths, flow of work, and task completion times. In less constrained environments methods exist yet many are obtrusive and require significant post-processing. Examplesused in terrestrial settings include infrared (IR) retro-reflective marker based motion capture, GPS sensor tracking, inertial tracking, and multi-camera methods Due to constraints of space operations many such methods are infeasible. Inertial tracking systems typically rely upon a gravity vector to normalize sensor readings,and traditional IR systems are large and require extensive calibration. However, multiple technologies have not been applied to space operations for these purposes. Two of these include: 3D Radio Frequency Identification Real-Time Localization Systems (3D RFID-RTLS) Depth imaging systems which allow for 3D motion capture and volumetric scanning (such as those using IR-depth cameras like the Microsoft Kinect or Light Detection and Ranging / Light-Radar systems, referred to as LIDAR)
Vos, Gordon A.↗
Virtual Exercise Training Software System
The purpose of this study was to develop and evaluate a virtual exercise training software system (VETSS) capable of providing real-time instruction and exercise feedback during exploration missions. A resistive exercise instructional system was developed using a Microsoft Kinect depth-camera device, which provides markerless 3-D whole-body motion capture at a small form factor and minimal setup effort. It was hypothesized that subjects using the newly developed instructional software tool would perform the deadlift exercise with more optimal kinematics and consistent technique than those without the instructional software. Following a comprehensive evaluation in the laboratory, the system was deployed for testing and refinement in the NASA Extreme Environment Mission Operations (NEEMO) analog.
Vu, L.↗
Object and Facial Recognition in Augmented and Virtual Reality: Investigation into Software, Hardware and Potential Uses
As augmented and virtual reality grows in popularity, and more researchers focus on its development, other fields of technology have grown in the hopes of integrating with the up-and-coming hardware currently on the market. Namely, there has been a focus on how to make an intuitive, hands-free human-computer interaction (HCI) utilizing AR and VR that allows users to control their technology with little to no physical interaction with hardware. Computer vision, which is utilized in devices such as the Microsoft Kinect, webcams and other similar hardware has shown potential in assisting with the development of a HCI system that requires next to no human interaction with computing hardware and software. Object and facial recognition are two subsets of computer vision, both of which can be applied to HCI systems in the fields of medicine, security, industrial development and other similar areas.
object recognition↗
Collision prediction software for radiotherapy treatments
Purpose: This work presents a method of collision predictions for external beam radiotherapy using surface imaging. The present methodology focuses on collision prediction during treatment simulation to evaluate the clearance of a patient’s treatment position and allow for its modification if necessary. Methods: A Kinect camera (Microsoft, Redmond, WA) is used to scan the patient and immobilization devices in the treatment position at the simulator. The surface is reconstructed using the SKANECT software (Occipital, Inc., San Francisco, CA). The treatment isocenter is marked using simulated orthogonal lasers projected on the surface scan. The point cloud of this surface is then shifted to isocenter and converted from Cartesian to cylindrical coordinates. A slab models the treatment couch. A cylinder with a radius equal to the normal distance from isocenter to the collimator plate, and a height defined by the collimator diameter is used to estimate collisions. Points within the cylinder clear through a full gantry rotation with the treatment couch at 0° , while points outside of it collide. The angles of collision are reported. This methodology was experimentally verified using a mannequin positioned in an alpha cradle with both arms up. A planning CT scan of the mannequin was performed, two isocenters were marked in PINNACLE, and this information was exported to AlignRT (VisionRT, London, UK)—a surface imaging system for patient positioning. This was used to ensure accurate positioning of the mannequin in the treatment room, when available. Collision calculations were performed for the two treatment isocenters and the results compared to the collisions detected the room. The accuracy of the Kinect-Skanect surface was evaluated by comparing it to the external surface of the planning CT scan. Results: Experimental verification results showed that the predicted angles of collision matched those recorded in the room within 0.5°, in most cases (largest deviation −1.2°). The accuracy study for the Kinect-Skanect surface showed an average discrepancy between the CT external contour and the surface scan of 2.2 mm. Conclusions: This methodology provides fast and reliable collision predictions using surface imaging. The use of the Kinect-Skanect system allows for a comprehensive modeling of the patient topography including all the relevant anatomy and immobilization devices that may lead to collisions. The use of this tool at the treatment simulation stage may allow therapists to evaluate the clearance of a patient’s treatment position and optimize it before the planning CT scan is performed. This can allow for safer treatments for the patients due to better collision predictions and improved clinical workflow by minimizing replanning and resimulations due to unforeseen clearance issues.
60 APPLIED LIFE SCIENCES↗
Ruggedizing a Commercial Depth Camera for Novel Lunar Exploration.
The novel contribution of this instrument is to take the first depth images on the moon. A commercial Kinect camera from Microsoft has been ruggedized for a CLPS mission to the Lunar South Pole. The 12-megapixel color camera is combined with a 1-megapixel color time-of-flight (ToF) depth sensor. The solid-state depth sensor/LIDAR provides greater resolution, a wider field of view, pixel binning, and reduced power consumption. The high-resolution data collected from the mission can be used to construct a near-field virtual environment of the lunar surface for scientific applications. The depth camera can provide a 360-degree view of the target area by combining ToF data with RGB imagery and rover turning. The unit was evaluated for space flight compliant materials and parts at NASA Ames. The microphone array, RF shield, front face, and outer body parts were removed to reduce mass. Plastic parts were replaced with vacuum-compatible materials; manufactured cables were added to properly interface with the host rover, built by Lunar Outpost. The environmental testing was performed on the Kinect with Random Vibration/Sine Testing (Fig 1a), per GEVS (NASA’s General Environmental Verification Standard for spaceflight launch survival). Thermal Vacuum testing cycled the instrument between expected hot (+ 85 C) and cold survival temperatures, as well as +50 C and -25 C operational temps (Fig 1b). The instrument functioned nominally at the conclusion of vibration and thermal cycling tests. The Azure Kinect is manifested on the Nova-C lander which flies on the Intuitive Machines mission IM-2, landing at the lunar south pole for a mission duration of 14 days (one lunar daylight cycle). The unit will be integrated to the MAPP (Mobile Autonomous Prospecting Platform) rover at Lunar Outpost. The Azure Kinect with ToF feature will improve the resolution of lunar geology data near the south pole and enable ground-based VR experience of details of the lunar surface (Fig 1c).
V. Jha↗
FORK: fine grained occupancy estimatoR using kinect on ARM embedded platforms
Occupancy estimation is very useful for a wide range of smart building applications including energy efficiency, safety, and security. In this demonstration, we present a novel solution called FORK, which uses a Kinect depth sensor for estimating occupancy in real-time. Unlike other camera-based solutions, FORK is much less privacy invasive (even if the sensor is compromised) and it does not require a powerful machine like a Microsoft XBOX or an Intel® Core™ i7 processor to process the depth data. Our system performs the entire depth data processing on a cheaper and lower-power ARM processor, in real-time. In order to do that, FORK uses a novel lightweight human model by leveraging anthropometric properties of human bodies for detecting individuals. We will show how FORK detects, tracks, and counts occupants accurately in real-time.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗