Two-stage grasp detection method for robotics using point clouds and deep hierarchical feature learning network

Liu, Xiaofeng; Huang, Congyu; Li, Jie; Wan, Weiwei; Yang, Chenguang

Abstract

When human beings see different objects, they can quickly make correct grasping strategies through brain decisions. However, grasp, as the first step of most manipulation tasks, is still an open issue in robotics. Although many detection methods have been proposed to take RGB-D images or point clouds as input and output grasp candidates, these methods are still limited to algorithm robustness, such as network performance and graspable objects. In this article, a two-stage grasp detection method is proposed, in which we first use point clouds to train the deep hierarchical feature learning network, which can better capture features of grasped points. We also consider the distribution and discrimination of grasps to construct samples. The score of point clouds is related to the quality of the relevant grasp sample. The quality is given by several grasp metrics applied to the grasp samples obtained from the YCB dataset. In the second stage, the network is used to evaluate the grasp candidates sampled from the preprocessed point clouds. The extensive simulation and real-scene experiment show that our grasp detection algorithm achieves satisfactory performance in both single and multiple objects situations. The generalization and scalability of our model also perform well under different conditions.

• Journal Article Type: Article
• Acceptance Date: Jun 25, 2023
• Online Publication Date: Jun 27, 2023
• Publication Date: Apr 30, 2024
• Deposit Date: Aug 22, 2023
• Publicly Available Date: Jun 28, 2025
• Journal: IEEE Transactions on Cognitive and Developmental Systems
• Print ISSN: 2379-8920
• Electronic ISSN: 2379-8939
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• Volume: 16
• Issue: 2
• Pages: 720 - 731
• DOI: https://doi.org/10.1109/tcds.2023.3289987
• Keywords: Artificial Intelligence, Software
• Public URL: https://uwe-repository.worktribe.com/output/10912202