Skip to main content

Research Repository

Advanced Search

A novel robust imitation learning framework for dual-arm object-moving tasks

Wang, Weiyong; Zeng, Chao; Lu, Zhenyu; Yang, Chenguang

A novel robust imitation learning framework for dual-arm object-moving tasks Thumbnail


Weiyong Wang

Chao Zeng

Zhenyu Lu


Drawing inspiration from the mechanism of human skill acquisition, imitation learning has demonstrated remarkable performance. Over recent years, modelbased imitation learning combined with machine learning and control theory has been continuously developed and adapted to unstructured environments. However, most results for dual-arm tasks focus on relatively safe and stable environments, which still lack robustness to generalize skills. In this article, we propose a novel robust imitation learning framework for dual-arm object-moving tasks. During demonstration, we present a shared teleoperation strategy that actively assists the operator in remotely executing dual-arm tasks, aiming to reduce the operational difficulty and stress. During modeling and generalization, we propose a coupled linear parameter-varying dynamical system (CLPV-DS), which possesses the ability to protect and restore states against possible disturbances in the environment while maintaining good tracking accuracy and stability. To address the risk of box slipping caused by disturbances, we further introduce amutual following strategy, enabling the arms to compliantly follow each other while maintaining appropriate contact force. Considering potential obstacles in a complex generalization environment, we introduce a reactive obstacle avoidance strategy in real time that ensures global asymptotic stability. Finally, we verified the effectiveness of the proposed framework through comprehensive testing in both 2-D simulations and real-robot experiments.

Journal Article Type Article
Acceptance Date Mar 28, 2024
Online Publication Date Apr 30, 2024
Deposit Date Jun 12, 2024
Publicly Available Date Jun 12, 2024
Journal IEEE Transactions on Industrial Electronics
Print ISSN 0278-0046
Electronic ISSN 1557-9948
Publisher Institute of Electrical and Electronics Engineers
Peer Reviewed Peer Reviewed
Pages 1-9
Public URL


A Novel Robust Imitation Framework For Dual Arm Object Moving Tasks TIE (9.8 Mb)


Copyright Statement
© 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.”

You might also like

Downloadable Citations