Search NASA⌕ Search

Engineering topics

Suarez, Christopher

Publications and source records attributed to Suarez, Christopher.

6 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Savannah River Site H-Canyon Tunnel Inspection Lidar Mapping Solution - 19477

Over the summer of 2018, the Savannah River National Laboratory (SRNL) formed and hosted a robotics and sensor intern team and tasked them with developing a proof of concept for a modular sensor suite to be deployed in the next H-Canyon Air Exhaust (HCAEX) Tunnel inspection in spring 2019. The developed sensor suite includes a planar Lidar sensor for depth imaging, two Panospheric 4K cameras, and an inertial measurement unit to aid in base localization. The Lidar is actuated to rotate about the vertical axis, which allows for the team to gather 3D mapping data. These rotating planar scans can also be fused with the camera and IMU data to generate colorized internal maps of the tunnel. The supporting software was developed iteratively over the summer and leveraged prior research conducted at the University of Texas at Austin, which facilitated the stitching of Lidar scans, the fusion of the sensor data, and even algorithms to provide in-situ navigation feedback to the operators of the crawler. This software simultaneously represents huge leaps forward in the mapping and degradation measurement abilities of the crawler over past inspection units, while also allowing the operator much greater situational awareness. The improvement in awareness reduces risks of the robot becoming stuck or disabled inside the tunnel, which would jeopardize the success of both this and future inspections. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2019

R and DE Robotic Sensor Intern Team: Sensor Suite Mock Up Testing

Assess sensor suite performance: - Mounted on crawler typical to what would be used in tunnel; - In test bed simulating the tunnel environment. The SuperDroid fiber tethered LT-F crawler is a general-purpose surveillance robot that our team has refurbished as a testing platform for the sensor suite. This crawler was selected because its dimensions are similar to the actual crawler that will be deployed in the field. Crawler preparation included: - Communicating with vendor to resolve software and platform issues; - Configuring a laptop with the crawler control software; - Reconfiguration of communication protocol between computer and crawler; - Resolution of control board checksum errors; - Installation of a mounting fixture on the base; - In progress: addition of lighting needed for total darkness. A solution for hosting the selected sensors onto a single unit that could function standalone or be mounted on the crawler was needed. Sensor mount requirements included: - Host Lidar, panospheric cameras and IMU sensors; - Cable management for rotating Lidar; - House on-board crawler computer; - Method for affixing to crawler; - Robust and vibration proof. The Lidar sensor required a sturdy mount that ensured the axis of rotation be centered with the LiDAR's desired laser path and included a slender profile in order to not block the scanning FOV. The mounting plate holds two 180-degree cameras on either side and the servo on the center. The servo mount is located so the axis of rotation is in the center of the plate. The mount features a set of guides that hold the wires and ensure they wrap around the spool area properly. The sensor box design features thick walls for added strength, holes for mounting the sensor suite to the crawler, notches on the bottom for the different components and holes for cable routing and management. The sensor mounts were designed using CREO and printed in the R and DE Additive Manufacturing Lab. To test the performance of the sensor suite for our application it was desired to design and build a test bed simulating the H-Canyon tunnel environment. Requirements included: - Dimensions similar to the tunnel; - Wall surfaces simulating the eroded tunnel walls; - Complete darkness; - Even and uneven crawler path; - Ability to change the tunnel width to simulate erosion. The HCAEX tunnel changes in height and includes several bends ranging from approximately 30 to 80 degrees, for that reason a test bed capable of easily being changed was needed. The final design includes two sections that can be connected to provide a 16' tunnel or placed at an angle to create a tunnel bend. The test bed features caster wheels for easy movement and has a sliding inner wall that enables tunnel width to be controlled. In order to simulate the tunnel walls without adding a lot of weight to the test bed, sheets of faux stone are to be used on the inner walls. To create a completely dark tunnel, 100% black-out film will be draped over the tunnel structure. Carpet remnants in the lab will enable folds to be introduced in the floor to generate uneven surface data.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2019

R and DE Robotic Sensor Intern Team: Advanced Sensor Suite Prototype

The Department of Energy (DOE) nuclear complex includes many hazardous and challenging environments that must be inspected remotely and routinely for structural integrity evaluation and long-term planning purposes. The H-Canyon Air Exhaust (HCAEX) Tunnel is an example of such an environment where a biannual inspection is currently performed. Presently inspections are performed by teleoperated robotic crawlers which provide low-res video feedback to the structural engineers. Advanced sensors: including Lidar and panospheric hi-res cameras have the potential to provide additional valuable data in future inspections. The primary goal of the sensor suite is to provide an internal 3D map of the HCAEX tunnel. Possible sensors were a stereo camera, a 3D Lidar, or a 2D Lidar that would need to be spun around. The issues with the stereo camera were that it does not have a large field-of-view and that its depth information was not nearly as accurate as even the baseline Lidars. The Hokuyo UTM-30LX-EW shown below provides a 270 deg. FOV with high accuracy and resolution while the largest FOV on a 3D Lidar is 40 deg. This was the reason a 2D Lidar was chosen over the 3D Lidar. Even though the 2D Lidar requires additional components and software to generate a 3D map, its FOV advantage is too great given that the HCAEX tunnel is a relatively confined space. Along with the Lidar, a camera sensor, IMU sensor, pan-tit unit, and on board computer needed to be identified. The two panospheric cameras allow for full 360 deg. FOV. The IMU will give data on the state of the robot inside the tunnel. The computer is used to gather and process data on board and to control the pan-tilt system. Mounts were designed and 3D printed to build the prototype of the sensor suite. It was designed to have the Lidar on top With its full FOV free while having the camera below and as close to together as possible while still leaving much of their FOV visible. The design also managed the cables such that they were unlikely to be damaged if in tension and so that they did not intrude much on the cameras vision. The sensor tree developed for the H-Canyon tunnel inspection project produces a large quantity of camera and Lidar data. a postprocessing pipeline was created to facilitate the analysis of these data. The pipeline follows the following routine: 1) Registration - Salient local features in subsequent scans are identified and used to align the scans With one another. This allows production of a single cohesive map of the tunnel. 2) Sensor Fusion - RGB camera data is 'painted' onto the depth data created by the Lidar. 3) Segmentation - Individual surfaces from within the scene are segmented out separately for individual analysis. 4) Degradation Analysis - Automatic mapping of local deviation from the plane in position or surface normal is performed, as is detection of exposed rebar using Lidar return intensity. 2) Obstacle Detection - Lidar data is also used in real time to detect obstacles in the environment. This could give feedback to the operator to successfully drive in the tunnel. 6) Graphic User Interface - a custom GUI was created to facilitate customer use of the system. The system provides real-time feedback from both the cameras and Lidar. The Lidar point-cloud data is also used for obstacle detection. As the Lidar spins, various algorithms are run to analyze the current 'slice' and obstacles in the environment are determined and registered on a cost-map. A Graphical User Interface (GUI) was developed to allow the user to easily command the crawler to set the rotational speed of the Lidar, perform a scan, and register and save the 3D generated cloud after a scan is done. For the good of the crawler, a critical aspect of the GUI design is to allow the user to cancel a scan any time after it is commanded and before it is saved. The sensor trees depth accuracy was evaluated in comparison to a high end commercial FARO Terrestrial Laser Scanner (TLS) with specifications for millimeter accuracy at distances above 10 m. For the purposes of these tests, the depth measurements produced by the TLS were taken as ground truth. Example test wall panels were scanned with the TLS and postprocessed with its proprietary software, and subsequently scanned with the sensor tree system. The two scans were manually aligned and for each point in the output cloud from the sensor tree, the distance to the nearest ground truth point in the FARO cloud was determined. 98.7% of all produced points were within the specified target range of 6 mm, with an average deviation of 1.75 mm. The test walls used have an overall in-wall depth variation of around 40 mm.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2019

R and DE Robotic Sensor Intern Team: Remote 3D Mapping Overview

The Department of Energy (DOE) nuclear complex includes many hazardous and challenging environments that must be inspected remotely and routinely for structural integrity evaluation and long-term planning purposes. The H-Canyon Air Exhaust (HCAEX) Tunnel biannual inspection is an example of such an environment. Presently inspections are performed by teleoperated robotic crawlers provide low resolution video feedback to the structural engineers. Advanced sensors such as Lidar and panospheric hi-res cameras have the potential to provide additional valuable data in future inspections. UT-Austin Lidar work in support of an H-Canyon deployment began with the DOE EM sponsored H-Canyon Integrated Research Project. The R and DE Robotic Sensor intern team includes two of the UT-Austin Masters students working on Lidar development to facilitate the pulling of university developed solutions to the field. The goal of this project is to develop a suite of sensors that could be used to gather advanced data in future HCAEX tunnel inspections. Of particular interest is the ability to map the tunnel walls at an accuracy that will allow for the comparison of two scans performed at different time periods to estimate the concrete erosion rate. Additionally, the development of the 3D point cloud in the GPS denied environment is the first step in being able to collect and overlay other 3D data such as radiation mapping. Project specific goals include: - Design and develop 3D mapping sensor suite. Merge Lidar point cloud with high res camera images Incorporate Inertial Measurement Unit (IMU) to assist with positioning. - Develop sensor software and user GUI Sensor data collection and integration software User GUI for reach back system. - Test solution on crawler in tunnel test bed Use crawler base similar to H-Canyon planned crawler Design and build test bed simulating tunnel conditions. To facilitate rapid sensor integration, software coding and user GUI development, the Robot Operating System (ROS) was employed as the development platform. ROS is a set of open source software libraries and tools that assist with the building of robot applications. ROS includes drivers for many sensors, state-of-the-art algorithms, and powerful developer tools. Sensors selected for the summer intern solution included assessment as to whether they possessed ROS drivers and associated sample code. Additionally, the ROS 3D Robot Visualizer (rviz) tool has been employed.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2019

R and DE Robotic Sensor Intern Team: Remote 3D Mapping Sensor Suite

The primary goal of the sensor suite is to provide an internal 3D map of the HCAEX tunnel. When looking for a sensor that would provide XYZ point cloud data for mapping the decision was between a stereo camera, a 3D Lidar, or a 2D Lidar that would need to be spun around. The issues with the stereo camera were that it does not have a large field-of-view and that its depth information was not nearly as accurate as even the baseline Lidars. The selection between Lidars is detailed. The Hokuyo UTM-30LX-EW shown provides a 270 deg. FOV with high accuracy and resolution while the largest FOV on a 3D Lidar is 40 deg.. This was the reason a 2D Lidar was chosen over the 3D Lidar. Even though the 2D Lidar requires additional components and software to generate a 3D map, its FOV advantage is too great given that the HCAEX tunnel is a relatively confined space. The rotating planar scan from the 2D Lidar can be stitched into a 3D scan as shown in the graphic below. Along with XYZ data, the Lidar provides return intensity data in color which can be used to distinguish between different materials within the tunnel. To provide visual feedback a camera system needed to be identified. The common solution for this is a high resolution camera with a small FOV mounted on a pan-tilt system. But, given the critical nature of the visual feedback we looked into solutions without the need for moving parts. Two panospheric cameras give a FOV large enough to get a full 360 deg. view.. Camera color data (RGB) can also be combined with the 3D mapping data from the Lidar and overlaid on the map to give the user the ability to see inside the entire length of the tunnel as if they were inside. Situational awareness is required for the crawler in the tunnel in order for it to be able to register the 3D scans to create a final map. For this we procured a Microstrain 3DM-GX5-25 Inertial Measurement Unit (IMU). To perform the Lidar rotation we have two servos driving the pan and tilt. The servo controls and most data processing will be performed via an onboard computer. The sensor components are to be packaged together using 3D printed mounts into a standalone unit.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2019

R and DE Robotic Sensor Intern Team: Sensor Suite Software and User Interface

The sensor tree developed for the H-Canyon tunnel inspection project produces a large quantity of camera and Lidar data. A postprocessing pipeline was created to facilitate the analysis of these data. The pipeline follows the following routine: 1) Registration - Salient local features in subsequent scans are identified and used to align the scans with one another. This allows production of a single cohesive map of the tunnel. 2) Sensor Fusion - RGB camera data is 'painted' onto the depth data created by the Lidar. 3) Segmentation - Individual surfaces from within the scene are segmented out separately for individual analysis. 4) Degradation Analysis - Automatic mapping of local deviation from the plane in position or surface normal is performed, as is detection of exposed rebar using Lidar return intensity. 5) Obstacle Detection - Lidar data is also used in real time to detect obstacles in the environment. This could give feedback to the operator to successfully drive in the tunnel. 6) Graphic User Interface - a custom GUI was created to facilitate customer use of the system. The system provides real-time feedback from both the cameras and Lidar. During alignment, local features are used to recognize points within the walls that are especially unique and noticeable (salient) based on their deviation from the expected surface of the wall. These are used as landmarks to register the clouds, which also informs precise localization of the base at each scan point. After registration, clouds are 'painted' with RGB data from the spherical cameras, as shown below. The painted clouds provide a 3D, colorized model of the environment which improves the realism of the experience for the user. Painting also labels high-resolution color imagery from the 3D cameras with depth values. Following sensor fusion, individual walls and cylindrical duct surfaces are segmented from the scene for individual analysis using a Random Sample Consensus algorithm. This algorithm allows segmentation of planar walls and cylindrical ducts. Once individual walls are identified, each point within the wall can be compared to its neighbors and the wall overall in order to detect local areas with damaged concrete. Automatic rebar detection is also performed using the contrast in Lidar return intensity between iron and concrete. The Lidar point-cloud data is also used for obstacle detection. As the Lidar spins, various algorithms are run to analyze the current 'slice' and obstacles in the environment are determined and registered on a cost-map. A Graphical User Interface (GUI) was developed to allow the user to easily command the crawler to set the rotational speed of the Lidar, perform a scan, and register and save the 3D generated cloud after a scan is done. For the good of the crawler, a critical aspect of the GUI design is to allow the user to cancel a scan any time after it is commanded and before it is saved.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗