https://scholars.lib.ntu.edu.tw/handle/123456789/599001
標題: | Development of an immersive SLAM-based VR system for teleoperation of a mobile manipulator in an unknown environment | 作者: | Kuo C.-Y Huang C.-C Tsai C.-H Shi Y.-S Smith S. SHANA SMITH |
關鍵字: | Immersive;Remote mobile manipulator;SLAM;Virtual reality;Visual aids;Cameras;Helmet mounted displays;Image reconstruction;Industrial manipulators;Manipulators;Remote control;Robots;Three dimensional computer graphics;Three dimensional displays;Visual communication;3-D environments;Distance information;Head mounted displays;Human machine interaction system;Mobile manipulator;Remote environment;Simultaneous localization and mapping;Unknown environments | 公開日期: | 2021 | 卷: | 132 | 來源出版物: | Computers in Industry | 摘要: | Operating a remote robot in an unknown environment is a challenge. Usually, a camera is attached to the robot to capture the images of the remote scenes. However, it is difficult to perceive a 3D environment using a 2D display. In this study, a real-time simultaneous localization and mapping (SLAM)-based virtual reality (VR) 3D human-machine interaction system is developed to provide users with immersive telepresence to better operate a remote mobile manipulator in an unknown environment. An RGB-depth camera is mounted on the mobile platform to scan and reconstruct the remote environment in real time. A head mounted display is used to display the 3D reconstructed environment, with a virtual copy of the actual robot in it, to provide users the feeling of immersion at the remote site. Visual aids are added in the 3D reconstructed environment to guide users with the direction and distance information. Users can control the remote robot by manipulating the virtual copy of the actual robot in the VR environment, without being constrained in the robot first person view. The system is compared with a video-based teleoperation and a direct on-site operation. Experimental results show that the grasping error and placing threshold of the SLAM-based VR teleoperation are 0.5 cm and 1.5 cm, respectively. The average error of the reconstructed environment is less than 4%. Within the accuracy of the reconstructed environment, the SLAM-based VR teleoperation has a higher grasping success rate and lower operation time, compared to the video-based teleoperation. This study shows a promising application of immersive SLAM-based VR in interactive telerobotic operations in a remote unknown environment. ? 2021 Elsevier B.V. |
URI: | https://www.scopus.com/inward/record.uri?eid=2-s2.0-85111235138&doi=10.1016%2fj.compind.2021.103502&partnerID=40&md5=e1082e71fbb967b57f178ed36c1396dd https://scholars.lib.ntu.edu.tw/handle/123456789/599001 |
ISSN: | 01663615 | DOI: | 10.1016/j.compind.2021.103502 |
顯示於: | 機械工程學系 |
在 IR 系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。