All Outputs (31)

Dynamic movement primitives-based human action prediction and shared control for bilateral robot teleoperation (2024)
Journal Article

This article presents a novel shared-control teleoperation framework that integrates imitation learning and bilateral control to achieve system stability based on a new dynamic movement primitives (DMPs) observer. First, a DMPs-based observer is firs... Read More about Dynamic movement primitives-based human action prediction and shared control for bilateral robot teleoperation.

A novel robust imitation learning framework for dual-arm object-moving tasks (2024)
Journal Article

Drawing inspiration from the mechanism of human skill acquisition, imitation learning has demonstrated remarkable performance. Over recent years, modelbased imitation learning combined with machine learning and control theory has been continuously de... Read More about A novel robust imitation learning framework for dual-arm object-moving tasks.

BioTacTip: A soft biomimetic optical tactile sensor for efficient 3D contact localization and 3D force estimation (2024)
Journal Article

In this letter, we introduce a new soft biomimetic optical tactile sensor based on mimicking the interlocking structure of the epidermal-dermal boundary: the BioTacTip. The primary sensing unit comprises a sharp white tip surrounded by four black cov... Read More about BioTacTip: A soft biomimetic optical tactile sensor for efficient 3D contact localization and 3D force estimation.

A dynamic movement primitives-based tool use skill learning and transfer framework for robot manipulation (2024)
Journal Article

This paper presents a framework for learning and transferring robot tool-use skills based on Dynamic Movement Primitives (DMPs) for robot fine manipulation. DMPs and their enhanced methods are employed to acquire a specific tool-use skill applicable... Read More about A dynamic movement primitives-based tool use skill learning and transfer framework for robot manipulation.

Editorial: Sensing and control for efficient human-robot collaboration (2024)
Journal Article

Tactile-based grasping stability prediction based on human grasp demonstration for robot manipulation (2024)
Journal Article

To minimize irrelevant and redundant information in tactile data and harness the dexterity of human hands. In this paper, we introduce a novel binary classification network with normalized differential convolution (NDConv) layers. Our method leverage... Read More about Tactile-based grasping stability prediction based on human grasp demonstration for robot manipulation.

MechTac: A multifunctional tendon-linked optical tactile sensor for in/out-the-field-of-view perception with deep learning (2023)
Presentation / Conference Contribution

Tactile sensors can be used for motion detection and object perception in robot manipulation. The contact detection within the camera's visual inspection area has been well-developed, but perception outside the field of view of the camera is overlook... Read More about MechTac: A multifunctional tendon-linked optical tactile sensor for in/out-the-field-of-view perception with deep learning.

VERGNet: Visual enhancement guided robotic grasp detection under low-light condition (2023)
Journal Article

Although existing grasp detection methods have achieved encouraging performance under well-light conditions, repetitive experiments have found that the detection performance would deteriorate drastically under low-light conditions. Although supplemen... Read More about VERGNet: Visual enhancement guided robotic grasp detection under low-light condition.

A bio-inspired multi-functional tendon-driven tactile sensor and application in obstacle avoidance using reinforcement learning (2023)
Journal Article

This paper presents a new bio-inspired tactile sensor that is multi-functional and has different sensitivity contact areas. The TacTop area is sensitive and is used for object classification when there is a direct contact. On the other hand, the TacS... Read More about A bio-inspired multi-functional tendon-driven tactile sensor and application in obstacle avoidance using reinforcement learning.

Distributed observer-based prescribed performance control for multi-robot deformable object cooperative teleoperation (2023)
Journal Article

In this paper, a distributed observer-based prescribed performance control method is proposed for using a multi-robot teleoperation system to manipulate a common deformable object. To achieve a stable position-tracking effect and realize the desired... Read More about Distributed observer-based prescribed performance control for multi-robot deformable object cooperative teleoperation.

Visual-tactile robot grasping based on human skill learning from demonstrations using a wearable parallel hand exoskeleton (2023)
Journal Article

The soft fingers and strategic grasping skills enable the human hands to grasp objects in a stable manner. This letter is to model human grasping skills and transfer the learned skills to robots to improve grasping quality and success rate. First, we... Read More about Visual-tactile robot grasping based on human skill learning from demonstrations using a wearable parallel hand exoskeleton.

A constrained framework based on IBLF for robot learning with human supervision (2023)
Journal Article

Dynamical movement primitives (DMPs) method is a useful tool for efficient robotic skills learning from human demonstrations. However, the DMPs method should know the specified constraints of tasks in advance. One flexible solution is to introduce th... Read More about A constrained framework based on IBLF for robot learning with human supervision.

Handheld device design for robotic teleoperation based on multi-sensor fusion (2023)
Presentation / Conference Contribution

Precise leader-follower control is critical for teleop- eration. This paper designs and implements a low-cost leader device for unilateral teleoperation scenario. Monocular vision based on fiducial markers and MEMS Inertial Measurement Unit (IMU) are... Read More about Handheld device design for robotic teleoperation based on multi-sensor fusion.

A gripper-like exoskeleton design for robot grasping demonstration (2023)
Journal Article

Learning from demonstration (LfD) is a practical method for transferring skill knowledge from a human demonstrator to a robot. Several studies have shown the effectiveness of LfD in robotic grasping tasks to improve the success rate of grasping and t... Read More about A gripper-like exoskeleton design for robot grasping demonstration.

Deformation-aware contact-rich manipulation skills learning and compliant control (2023)
Presentation / Conference Contribution

In this paper, we study a vision-based reactive adaptation method for contact-rich manipulation tasks, based on the compliant control and learning from demonstration. For contact-rich tasks, the compliant control method is essential, especially when... Read More about Deformation-aware contact-rich manipulation skills learning and compliant control.

Multi-purpose tactile perception based on deep learning in a new tendon-driven optical tactile sensor (2022)
Presentation / Conference Contribution

In this paper, we create a new tendon-connected multi-functional optical tactile sensor, MechTac, for object perception in the field of view (TacTip) and location of touching points in the blind area of vision (TacSide). In a multi-point touch task,... Read More about Multi-purpose tactile perception based on deep learning in a new tendon-driven optical tactile sensor.

A trajectory and force dual-incremental robot skill learning and generalization framework using improved dynamical movement primitives and adaptive neural network control (2022)
Journal Article

Due to changes in the environment and errors that occurred during skill initialization, the robot's operational skills should be modified to adapt to new tasks. As such, skills learned by the methods with fixed features, such as the classical Dynamic... Read More about A trajectory and force dual-incremental robot skill learning and generalization framework using improved dynamical movement primitives and adaptive neural network control.

A robotic learning and generalization framework for curved surface based on modified DMP (2022)
Journal Article

How to reproduce and generalize the skills acquired by demonstrating is a hot topic for researchers. (1) A compliant continuous drag demonstration system based on discrete admittance model was designed to continuously and smoothly drag or demonstrate... Read More about A robotic learning and generalization framework for curved surface based on modified DMP.

A modified LSTM model for Chinese sign language recognition using leap motion (2022)
Presentation / Conference Contribution

At present, there are about 70 million deaf people using sign language in the world, but for most normal people, it is difficult to understand the meaning of the sign language expression. Therefore, it is of great importance to explore the ways of re... Read More about A modified LSTM model for Chinese sign language recognition using leap motion.

Fixed-time adaptive neural control for robot manipulators with input saturation and disturbance (2022)
Presentation / Conference Contribution

A fixed-time adaptive neural network control scheme is designed for an unknown model manipulator system with input saturation and external environment disturbance, so that the system convergence time can be parameterized and not affected by the initi... Read More about Fixed-time adaptive neural control for robot manipulators with input saturation and disturbance.