A novel robot skill learning framework based on bilateral teleoperation

Si, Weiyong; Yue, Tianqi; Guan, Yuan; Wang, Ning; Yang, Chenguang

Abstract

In this paper, a bilateral teleoperation-based robot skill learning framework is developed to transfer multi-step and contact manipulation skills from humans to robots. Robot skill acquisition via bilateral teleoperation provides a solution for human teacher to transfer the manipulation skills to robots in a remotely feasible manner. Besides, the bilateral teleoperation with force feedback allows humans in the loop to monitor and interface with the robot behaviour, hence improving the safety of the robot execution. The dynamic movement primitive (DMP) model is first employed to encode primitive skills, including those for both the translation and orientation. We have been utilized the behaviour tree (BT) to model the sequence of primitive skills. Since each node of the BT represents a single primitive skill, we can reproduce the BT nodes by employing different controllers based on the task requirements. We have evaluated the approach through two robot manipulation tasks, (i) grasping irregular objects with a customized soft suction cup and (ii) wiping whiteboard by a 7-DoF Frank Emika Panda. Results and performance analysis of the experiments are presented subsequently.

• Presentation Conference Type: Conference Paper (published)
• Conference Name: 2022 IEEE 18th International Conference on Automation Science and Engineering (CASE)
• Start Date: Aug 20, 2022
• End Date: Aug 24, 2022
• Acceptance Date: May 26, 2022
• Publication Date: Oct 28, 2022
• Deposit Date: Nov 25, 2022
• Publicly Available Date: Oct 29, 2024
• Publisher: Institute of Electrical and Electronics Engineers (IEEE)
• Series ISSN: 2161-8089
• Book Title: 2022 IEEE 18th International Conference on Automation Science and Engineering (CASE)
• DOI: https://doi.org/10.1109/case49997.2022.9926526
• Keywords: Computer aided software engineering, Force feedback, Dynamics, Grasping, Human in the loop, Safety, Performance analysis
• Public URL: https://uwe-repository.worktribe.com/output/10148479
• Publisher URL: https://ieeexplore.ieee.org/document/9926526
• Related Public URLs: https://ieeexplore.ieee.org/xpl/conhome/9926286/proceeding