https://scholars.lib.ntu.edu.tw/handle/123456789/599001
Title: | Development of an immersive SLAM-based VR system for teleoperation of a mobile manipulator in an unknown environment | Authors: | Kuo C.-Y Huang C.-C Tsai C.-H Shi Y.-S Smith S. SHANA SMITH |
Keywords: | Immersive;Remote mobile manipulator;SLAM;Virtual reality;Visual aids;Cameras;Helmet mounted displays;Image reconstruction;Industrial manipulators;Manipulators;Remote control;Robots;Three dimensional computer graphics;Three dimensional displays;Visual communication;3-D environments;Distance information;Head mounted displays;Human machine interaction system;Mobile manipulator;Remote environment;Simultaneous localization and mapping;Unknown environments | Issue Date: | 2021 | Journal Volume: | 132 | Source: | Computers in Industry | Abstract: | Operating a remote robot in an unknown environment is a challenge. Usually, a camera is attached to the robot to capture the images of the remote scenes. However, it is difficult to perceive a 3D environment using a 2D display. In this study, a real-time simultaneous localization and mapping (SLAM)-based virtual reality (VR) 3D human-machine interaction system is developed to provide users with immersive telepresence to better operate a remote mobile manipulator in an unknown environment. An RGB-depth camera is mounted on the mobile platform to scan and reconstruct the remote environment in real time. A head mounted display is used to display the 3D reconstructed environment, with a virtual copy of the actual robot in it, to provide users the feeling of immersion at the remote site. Visual aids are added in the 3D reconstructed environment to guide users with the direction and distance information. Users can control the remote robot by manipulating the virtual copy of the actual robot in the VR environment, without being constrained in the robot first person view. The system is compared with a video-based teleoperation and a direct on-site operation. Experimental results show that the grasping error and placing threshold of the SLAM-based VR teleoperation are 0.5 cm and 1.5 cm, respectively. The average error of the reconstructed environment is less than 4%. Within the accuracy of the reconstructed environment, the SLAM-based VR teleoperation has a higher grasping success rate and lower operation time, compared to the video-based teleoperation. This study shows a promising application of immersive SLAM-based VR in interactive telerobotic operations in a remote unknown environment. ? 2021 Elsevier B.V. |
URI: | https://www.scopus.com/inward/record.uri?eid=2-s2.0-85111235138&doi=10.1016%2fj.compind.2021.103502&partnerID=40&md5=e1082e71fbb967b57f178ed36c1396dd https://scholars.lib.ntu.edu.tw/handle/123456789/599001 |
ISSN: | 01663615 | DOI: | 10.1016/j.compind.2021.103502 |
Appears in Collections: | 機械工程學系 |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.