A novel robust imitation learning framework for dual-arm object-moving tasks

Wang, Weiyong; Zeng, Chao; Lu, Zhenyu; Yang, Chenguang

Abstract

Drawing inspiration from the mechanism of human skill acquisition, imitation learning has demonstrated remarkable performance. Over recent years, modelbased imitation learning combined with machine learning and control theory has been continuously developed and adapted to unstructured environments. However, most results for dual-arm tasks focus on relatively safe and stable environments, which still lack robustness to generalize skills. In this article, we propose a novel robust imitation learning framework for dual-arm object-moving tasks. During demonstration, we present a shared teleoperation strategy that actively assists the operator in remotely executing dual-arm tasks, aiming to reduce the operational difficulty and stress. During modeling and generalization, we propose a coupled linear parameter-varying dynamical system (CLPV-DS), which possesses the ability to protect and restore states against possible disturbances in the environment while maintaining good tracking accuracy and stability. To address the risk of box slipping caused by disturbances, we further introduce amutual following strategy, enabling the arms to compliantly follow each other while maintaining appropriate contact force. Considering potential obstacles in a complex generalization environment, we introduce a reactive obstacle avoidance strategy in real time that ensures global asymptotic stability. Finally, we verified the effectiveness of the proposed framework through comprehensive testing in both 2-D simulations and real-robot experiments.

Citation

Wang, W., Zeng, C., Lu, Z., & Yang, C. (in press). A novel robust imitation learning framework for dual-arm object-moving tasks. IEEE Transactions on Industrial Electronics, 1-9. https://doi.org/10.1109/tie.2024.3387098

• Journal Article Type: Article
• Acceptance Date: Mar 28, 2024
• Online Publication Date: Apr 30, 2024
• Deposit Date: Jun 12, 2024
• Publicly Available Date: Jun 12, 2024
• Journal: IEEE Transactions on Industrial Electronics
• Print ISSN: 0278-0046
• Electronic ISSN: 1557-9948
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• Pages: 1-9
• DOI: https://doi.org/10.1109/tie.2024.3387098
• Public URL: https://uwe-repository.worktribe.com/output/11984069