Smaller and faster robotic grasp detection model via knowledge distillation and unequal feature encoding

Nie, Hong; Zhao, Zhou; Chen, Lu; Lu, Zhenyu; Li, Zhuomao; Yang, Jing

Abstract

In order to achieve higher accuracy, the complexity of grasp detection network increases accordingly with complicated model structures and tremendous parameters. Although various light-weight strategies are adopted, directly designing the compact network can be sub-optimal and difficult to strike the balance between accuracy and model size. To solve this problem, we explore a more efficient grasp detection model from two aspects: elaborately designing a light-weight network and performing knowledge distillation on the designed network. Specifically, based on the designed light-weight backbone, the features from RGB and D images with unequal effective grasping information rates are fully utilized and the information compensation strategies are adopted to make the model small enough while maintaining its accuracy. Then, the grasping features contained in the large teacher model are adaptively and effectively learned by our proposed method via knowledge distillation. Experimental results indicate that the proposed method is able to achieve comparable performance (98.9%, 93.1%, 82.3%, and 90.0% on Cornell, Jacquard, GraspNet, and MultiObj datasets, respectively) with more complicate models while reducing the parameters from MBs to KBs. Real-world robotic grasping experiment in an embedded AI computing device also prove the effectiveness of this approach.

• Journal Article Type: Article
• Acceptance Date: Jun 23, 2024
• Online Publication Date: Jul 2, 2024
• Publication Date: 2024-08
• Deposit Date: Sep 13, 2024
• Publicly Available Date: Sep 13, 2024
• Journal: IEEE Robotics and Automation Letters
• Print ISSN: 2377-3766
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• Volume: 9
• Issue: 8
• Pages: 7206-7213
• DOI: https://doi.org/10.1109/lra.2024.3421790
• Public URL: https://uwe-repository.worktribe.com/output/12697379