Vision-Based Haptic Rendering With Self-Occlusion Resilience Using Shadow Correspondence
Journal
IEEE Robotics and Automation Letters
Journal Volume
9
Journal Issue
9
Start Page
7963
End Page
7970
ISSN
2377-3766
2377-3774
Date Issued
2024-09
Author(s)
Mu-Ting Mao
Abstract
Vision-based haptic feedback provides cost-effective preemptive protection and real-time guidance, enhancing teleoperation with reduced system complexity. However, challenges arise as the instrument approaches target object, leading to occlusion of the point cloud behind the remote instrument, known as the self-occlusion issue. Prior solutions relying on historical point clouds or multiple viewpoints to refill the occluded region encounter adaptability issues for prolonged occlusion and limited space, thus hindering practical implementation. This letter introduces a novel non-refilling-based method for haptic force rendering, leveraging the correspondence between the tool-tip position and the tip position of the shadow-like occluded region. Experimental results demonstrate the proposed method's resilience across self-occlusion and dynamic environments, highlighting its practical applicability in robotic teleoperation.
SDGs
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Type
journal article