A trajectory and force dual-incremental robot skill learning and generalization framework using improved dynamical movement primitives and adaptive neural network control

Lu, Zhenyu; Wang, Ning; Li, Qinchuan; Yang, Chenguang

Abstract

Due to changes in the environment and errors that occurred during skill initialization, the robot's operational skills should be modified to adapt to new tasks. As such, skills learned by the methods with fixed features, such as the classical Dynamical Movement Primitive (DMP), are difficult to use when the using cases are significantly different from the demonstrations. In this work, we propose an incremental robot skill learning and generalization framework including an incremental DMP (IDMP) for robot trajectory learning and an adaptive neural network (NN) control method, which are incrementally updated to enable robots to adapt to new cases. IDMP uses multi-mapping feature vectors to rebuild the forcing function of DMP, which are extended based on the original feature vector. In order to maintain the original skills and represent skill changes in a new task, the new feature vector consists of three parts with different usages. Therefore, the trajectories are gradually changed by expanding the feature and weight vectors, and all transition states are also easily recovered. Then, an adaptive NN controller with performance constraints is proposed to compensate dynamics errors and changed trajectories after using the IDMP. The new controller is also incrementally updated and can accumulate and reuse the learned knowledge to improve the learning efficiency. Compared with other methods, the proposed framework achieves higher tracking accuracy, realizes incremental skill learning and modification, achieves multiple stylistic skills, and is used for obstacle avoidance with different heights, which are verified in three comparative experiments.

Citation

Lu, Z., Wang, N., Li, Q., & Yang, C. (2023). A trajectory and force dual-incremental robot skill learning and generalization framework using improved dynamical movement primitives and adaptive neural network control. Neurocomputing, 521, 146-159. https://doi.org/10.1016/j.neucom.2022.11.076

• Journal Article Type: Article
• Acceptance Date: Nov 21, 2022
• Online Publication Date: Dec 2, 2022
• Publication Date: Feb 7, 2023
• Deposit Date: Dec 2, 2022
• Publicly Available Date: Dec 2, 2022
• Journal: Neurocomputing
• Print ISSN: 0925-2312
• Electronic ISSN: 1872-8286
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 521
• Pages: 146-159
• DOI: https://doi.org/10.1016/j.neucom.2022.11.076
• Keywords: Incremental skill learning and generalization; Learning from demonstration; Dynamic movement primitive(DMP); Adaptive neural network (NN) control; Multiple stylistic skill generalization
• Public URL: https://uwe-repository.worktribe.com/output/10198525
• Publisher URL: https://www.sciencedirect.com/science/article/pii/S0925231222014710