Author(s): Cui, SW (Cui, Shaowei); Wang, R (Wang, Rui); Hu, JY (Hu, Jingyi); Wei, JH (Wei, Junhang); Wang, S (Wang, Shuo); Lou, Z (Lou, Zheng)

Source: IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS Volume: 69 Issue: 6 Pages: 6015-6025 DOI: 10.1109/TIE.2021.3090697 Published: JUN 2022

Abstract: In-hand object localization and manipulation has always been a challenging task in robotic community. In this article, we address this problem by vision-based tactile sensing with high-spatial resolution. Specifically, we design a novel tactile sensor based on stereo vision, named GelStereo, which can perceive tactile point cloud with high-spatial resolution (<1 mm). A tactile-based in-hand object localization pipeline composed of saliency detection and probabilistic point-set registration algorithms of the perceived contact point cloud is presented. Furthermore, extensive qualitative and quantitative analyses of perceived tactile point cloud and in-hand localization and insertion experiments of small parts are performed on our robot platform. The experimental results verify the accuracy and robustness of the tactile point cloud sensed by the novel GelStereo tactile sensor and the proposed in-hand object localization pipeline. This novel high-resolution visuotactile sensing technology has predictable application potential in the field of dexterous robotic manipulation.

Accession Number: WOS:000752059600063

Author Identifiers:

Author Web of Science ResearcherID ORCID Number

wang, shuo 0000-0002-1390-9219

Shaowei, Cui 0000-0003-4750-3011

Wei, Junhang 0000-0003-2156-1109

ISSN: 0278-0046

eISSN: 1557-9948

Full Text: https://ieeexplore.ieee.org/document/9464700