Skip to main content

Research Repository

Advanced Search

Outputs (39)

MechTac: A multifunctional tendon-linked optical tactile sensor for in/out-the-field-of-view perception with deep learning (2023)
Conference Proceeding
Lu, Z., Yue, T., Zhao, Z., Si, W., Wang, N., & Yang, C. (2023). MechTac: A multifunctional tendon-linked optical tactile sensor for in/out-the-field-of-view perception with deep learning. In IECON 2023- 49th Annual Conference of the IEEE Industrial Electronics Society. https://doi.org/10.1109/iecon51785.2023.10311762

Tactile sensors can be used for motion detection and object perception in robot manipulation. The contact detection within the camera's visual inspection area has been well-developed, but perception outside the field of view of the camera is overlook... Read More about MechTac: A multifunctional tendon-linked optical tactile sensor for in/out-the-field-of-view perception with deep learning.

A bio-inspired multi-functional tendon-driven tactile sensor and application in obstacle avoidance using reinforcement learning (2023)
Journal Article
Lu, Z., Zhao, Z., Yue, T., Zhu, X., & Wang, N. (in press). A bio-inspired multi-functional tendon-driven tactile sensor and application in obstacle avoidance using reinforcement learning. IEEE Transactions on Cognitive and Developmental Systems, https://doi.org/10.1109/tcds.2023.3297361

This paper presents a new bio-inspired tactile sensor that is multi-functional and has different sensitivity contact areas. The TacTop area is sensitive and is used for object classification when there is a direct contact. On the other hand, the TacS... Read More about A bio-inspired multi-functional tendon-driven tactile sensor and application in obstacle avoidance using reinforcement learning.

Distributed observer-based prescribed performance control for multi-robot deformable object cooperative teleoperation (2023)
Journal Article
Lu, Z., Wang, N., Si, W., & Yang, C. (in press). Distributed observer-based prescribed performance control for multi-robot deformable object cooperative teleoperation. IEEE Transactions on Automation Science and Engineering, https://doi.org/10.1109/tase.2023.3292553

In this paper, a distributed observer-based prescribed performance control method is proposed for using a multi-robot teleoperation system to manipulate a common deformable object. To achieve a stable position-tracking effect and realize the desired... Read More about Distributed observer-based prescribed performance control for multi-robot deformable object cooperative teleoperation.

Handheld device design for robotic teleoperation based on multi-sensor fusion (2023)
Conference Proceeding
Xie, L., Huang, D., Lu, Z., Wang, N., & Yang, C. (2023). Handheld device design for robotic teleoperation based on multi-sensor fusion. In 2023 IEEE International Conference on Mechatronics (ICM). https://doi.org/10.1109/ICM54990.2023.10102054

Precise leader-follower control is critical for teleop- eration. This paper designs and implements a low-cost leader device for unilateral teleoperation scenario. Monocular vision based on fiducial markers and MEMS Inertial Measurement Unit (IMU) are... Read More about Handheld device design for robotic teleoperation based on multi-sensor fusion.

A multimodal human-robot sign language interaction framework applied in social robots (2023)
Journal Article
Li, J., Zhong, J., & Wang, N. (2023). A multimodal human-robot sign language interaction framework applied in social robots. Frontiers in Neuroscience, 17, Article 1168888. https://doi.org/10.3389/fnins.2023.1168888

Deaf-mutes face many difficulties in daily interactions with hearing people through spoken language. Sign language is an important way of expression and communication for deaf-mutes. Therefore, breaking the communication barrier between the deaf-mute... Read More about A multimodal human-robot sign language interaction framework applied in social robots.

A multimodal teleoperation interface for human-robot collaboration (2023)
Conference Proceeding
Si, W., Zhong, T., Wang, N., & Yang, C. (2023). A multimodal teleoperation interface for human-robot collaboration. In 2023 IEEE International Conference on Mechatronics (ICM). https://doi.org/10.1109/ICM54990.2023.10102060

Human-robot collaboration provides an effective approach to combine human intelligence and the autonomy of robots, which can improve the safety and efficiency of the robot. However, developing an intuitive and immersive human-robot interface with mul... Read More about A multimodal teleoperation interface for human-robot collaboration.

Review on human-like robot manipulation using dexterous hands (2023)
Journal Article
Kadalagere Sampath, S., Wang, N., Wu, H., & Yang, C. (2023). Review on human-like robot manipulation using dexterous hands. Cognitive Computation and Systems, 5(1), 14-29. https://doi.org/10.1049/ccs2.12073

In recent years, human hand-based robotic hands or dexterous hands have gained attention due to their enormous capabilities of handling soft materials compared to traditional grippers. Back in the earlier days, the development of a hand model close t... Read More about Review on human-like robot manipulation using dexterous hands.

Human-in-the-loop Learning and Control for Robot Teleoperation (2023)
Book
Yang, C., Luo, J., & Wang, N. (2023). Human-in-the-loop Learning and Control for Robot Teleoperation. Elsevier. https://doi.org/10.1016/C2021-0-02620-1

Human-in-the-loop Learning and Control for Robot Teleoperation presents recent, research progress on teleoperation and robots, including human-robot interaction, learning and control for teleoperation with many extensions on intelligent learning tech... Read More about Human-in-the-loop Learning and Control for Robot Teleoperation.

A trajectory and force dual-incremental robot skill learning and generalization framework using improved dynamical movement primitives and adaptive neural network control (2022)
Journal Article
Lu, Z., Wang, N., Li, Q., & Yang, C. (2023). A trajectory and force dual-incremental robot skill learning and generalization framework using improved dynamical movement primitives and adaptive neural network control. Neurocomputing, 521, 146-159. https://doi.org/10.1016/j.neucom.2022.11.076

Due to changes in the environment and errors that occurred during skill initialization, the robot's operational skills should be modified to adapt to new tasks. As such, skills learned by the methods with fixed features, such as the classical Dynamic... Read More about A trajectory and force dual-incremental robot skill learning and generalization framework using improved dynamical movement primitives and adaptive neural network control.

A robotic learning and generalization framework for curved surface based on modified DMP (2022)
Journal Article
Xue, X., Dong, J., Lu, Z., & Wang, N. (2023). A robotic learning and generalization framework for curved surface based on modified DMP. Robotics and Autonomous Systems, 160, 104323. https://doi.org/10.1016/j.robot.2022.104323

How to reproduce and generalize the skills acquired by demonstrating is a hot topic for researchers. (1) A compliant continuous drag demonstration system based on discrete admittance model was designed to continuously and smoothly drag or demonstrate... Read More about A robotic learning and generalization framework for curved surface based on modified DMP.

A novel robot skill learning framework based on bilateral teleoperation (2022)
Conference Proceeding
Si, W., Yue, T., Guan, Y., Wang, N., & Yang, C. (2022). A novel robot skill learning framework based on bilateral teleoperation. In 2022 IEEE 18th International Conference on Automation Science and Engineering (CASE). https://doi.org/10.1109/case49997.2022.9926526

In this paper, a bilateral teleoperation-based robot skill learning framework is developed to transfer multi-step and contact manipulation skills from humans to robots. Robot skill acquisition via bilateral teleoperation provides a solution for human... Read More about A novel robot skill learning framework based on bilateral teleoperation.

Fixed-time adaptive neural control for robot manipulators with input saturation and disturbance (2022)
Conference Proceeding
Huang, H., Lu, Z., Wang, N., & Yang, C. (2022). Fixed-time adaptive neural control for robot manipulators with input saturation and disturbance. In 2022 27th International Conference on Automation and Computing (ICAC). https://doi.org/10.1109/ICAC55051.2022.9911082

A fixed-time adaptive neural network control scheme is designed for an unknown model manipulator system with input saturation and external environment disturbance, so that the system convergence time can be parameterized and not affected by the initi... Read More about Fixed-time adaptive neural control for robot manipulators with input saturation and disturbance.

Biomimetic force and impedance adaptation based on broad learning system in stable and unstable tasks: Creating an incremental and explainable neural network with functional linkage (2022)
Journal Article
Lu, Z., & Wang, N. (in press). Biomimetic force and impedance adaptation based on broad learning system in stable and unstable tasks: Creating an incremental and explainable neural network with functional linkage. IEEE Robotics and Automation Magazine, 2-13. https://doi.org/10.1109/MRA.2022.3188218

This article presents a novel biomimetic force and impedance adaption framework based on the broad learning system (BLS) for robot control in stable and unstable environments. Different from iterative learning control, the adaptation process is real... Read More about Biomimetic force and impedance adaptation based on broad learning system in stable and unstable tasks: Creating an incremental and explainable neural network with functional linkage.

A novel dynamic movement primitives-based skill learning and transfer framework for multi-tool use (2022)
Conference Proceeding
Lu, Z., Wang, N., Li, M., & Yang, C. (2022). A novel dynamic movement primitives-based skill learning and transfer framework for multi-tool use. . https://doi.org/10.1109/ICCA54724.2022.9831826

Dynamic Movement Primitives (DMPs) is a general method for learning skills from demonstrations. Most previous research on DMP has focused on point to point skill learning and training, and the skills learned are usually generalized based on the same... Read More about A novel dynamic movement primitives-based skill learning and transfer framework for multi-tool use.

Adaptive compliant skill learning for contact-rich manipulation with human in the loop (2022)
Journal Article
Si, W., Guan, Y., & Wang, N. (2022). Adaptive compliant skill learning for contact-rich manipulation with human in the loop. IEEE Robotics and Automation Letters, 7(3), 5834 - 5841. https://doi.org/10.1109/LRA.2022.3159163

It is essential for the robot manipulator to adapt to unexpected events and dynamic environments while executing the physical contact-rich tasks. Although a range of methods have been investigated to enhance the adaptability and generalization capabi... Read More about Adaptive compliant skill learning for contact-rich manipulation with human in the loop.

An adaptive fuzzy control for human-in-the-loop operations with varying communication time delays (2022)
Journal Article
Lu, Z., Guan, Y., & Wang, N. (2022). An adaptive fuzzy control for human-in-the-loop operations with varying communication time delays. IEEE Robotics and Automation Letters, 7(2), 5599-5606. https://doi.org/10.1109/LRA.2022.3158540

Time delay, especially varying time delay, is always an important factor affecting the stability to the human-in-the-loop system. Previous research usually focuses on the performance of the internal signal transmission part, but rarely considers the... Read More about An adaptive fuzzy control for human-in-the-loop operations with varying communication time delays.

A framework for composite layup skill learning and generalizing through teleoperation (2022)
Journal Article
Si, W., Wang, N., Li, Q., & Yang, C. (2022). A framework for composite layup skill learning and generalizing through teleoperation. Frontiers in Neurorobotics, 16, Article 840240. https://doi.org/10.3389/fnbot.2022.840240

In this article, an impedance control-based framework for human-robot composite layup skill transfer was developed, and the human-in-the-loop mechanism was investigated to achieve human-robot skill transfer. Although there are some works on human-rob... Read More about A framework for composite layup skill learning and generalizing through teleoperation.

Incremental motor skill learning and generalization from human dynamic reactions based on dynamic movement primitives and fuzzy logic system (2021)
Journal Article
Lu, Z., Wang, N., Li, M., & Yang, C. (2022). Incremental motor skill learning and generalization from human dynamic reactions based on dynamic movement primitives and fuzzy logic system. IEEE Transactions on Fuzzy Systems, 30(6), 1506-1515. https://doi.org/10.1109/tfuzz.2021.3136933

Different from previous work on single skill learning from human demonstrations, an incremental motor skill learning, generalization and control method based on dynamic movement primitives (DMP) and broad learning system (BLS) is proposed for extract... Read More about Incremental motor skill learning and generalization from human dynamic reactions based on dynamic movement primitives and fuzzy logic system.

A unified parametric representation for robotic compliant skills with adaptation of impedance and force (2021)
Journal Article
Zeng, C., Li, Y., Guo, J., Huang, Z., Wang, N., & Yang, C. (2022). A unified parametric representation for robotic compliant skills with adaptation of impedance and force. IEEE/ASME Transactions on Mechatronics, 27(2), 623-633. https://doi.org/10.1109/tmech.2021.3109160

Robotic compliant manipulation is a very challenging but urgent research spot in the domain of robotics. One difficulty lies in the lack of a unified representation for encoding and learning of compliant profiles. This article aims to introduce a nov... Read More about A unified parametric representation for robotic compliant skills with adaptation of impedance and force.

An improvement of robot stiffness-adaptive skill primitive generalization using the surface electromyography in human–robot collaboration (2021)
Journal Article
Guan, Y., Wang, N., & Yang, C. (2021). An improvement of robot stiffness-adaptive skill primitive generalization using the surface electromyography in human–robot collaboration. Frontiers in Neuroscience, 15, Article 694914. https://doi.org/10.3389/fnins.2021.694914

Learning from Demonstration in robotics has proved its efficiency in robot skill learning. The generalization goals of most skill expression models in real scenarios are specified by humans or associated with other perceptual data. Our proposed frame... Read More about An improvement of robot stiffness-adaptive skill primitive generalization using the surface electromyography in human–robot collaboration.

DMPs-based skill learning for redundant dual-arm robotic synchronized cooperative manipulation (2021)
Journal Article
Lu, Z., Wang, N., & Shi, D. (2022). DMPs-based skill learning for redundant dual-arm robotic synchronized cooperative manipulation. Complex and Intelligent Systems, 8, 2873–2882. https://doi.org/10.1007/s40747-021-00429-3

Dual-arm robot manipulation is applicable to many domains, such as industrial, medical, and home service scenes. Learning from demonstrations (LfD) is a highly effective paradigm for robotic learning, where a robot learns from human actions directly... Read More about DMPs-based skill learning for redundant dual-arm robotic synchronized cooperative manipulation.

A novel iterative identification based on the optimised topology for common state monitoring in wireless sensor networks (2021)
Journal Article
Lu, Z., Wang, N., & Yang, C. (2022). A novel iterative identification based on the optimised topology for common state monitoring in wireless sensor networks. International Journal of Systems Science, 53(1), 25-39. https://doi.org/10.1080/00207721.2021.1936275

Power consumption and data redundancy of wireless sensor networks (WSN) are widely considered for a distributed state monitoring network. For reducing the energy consumption and data amount, we propose a topology optimisation and an iterative paramet... Read More about A novel iterative identification based on the optimised topology for common state monitoring in wireless sensor networks.

Review of the techniques used in motor‐cognitive human‐robot skill transfer (2021)
Journal Article
Guan, Y., Wang, N., & Yang, C. (2021). Review of the techniques used in motor‐cognitive human‐robot skill transfer. Cognitive Computation and Systems, 3(3), 229-252. https://doi.org/10.1049/ccs2.12025

A conventional robot programming method extensively limits the reusability of skills in the developmental aspect. Engineers programme a robot in a targeted manner for the realisation of predefined skills. The low reusability of general-purpose robot... Read More about Review of the techniques used in motor‐cognitive human‐robot skill transfer.

Dynamic movement primitives based cloud robotic skill learning for point and non-point obstacle avoidance (2021)
Journal Article
Lu, Z., & Wang, N. (2021). Dynamic movement primitives based cloud robotic skill learning for point and non-point obstacle avoidance. Assembly Automation, 41(3), 302-311. https://doi.org/10.1108/AA-11-2020-0168

Purpose: Dynamic movement primitives (DMPs) is a general robotic skill learning from demonstration method, but it is usually used for single robotic manipulation. For cloud-based robotic skill learning, the authors consider trajectories/skills change... Read More about Dynamic movement primitives based cloud robotic skill learning for point and non-point obstacle avoidance.

A review on manipulation skill acquisition through teleoperation‐based learning from demonstration (2021)
Journal Article
Si, W., Wang, N., & Yang, C. (2021). A review on manipulation skill acquisition through teleoperation‐based learning from demonstration. Cognitive Computation and Systems, 3(1), 1-16. https://doi.org/10.1049/ccs2.12005

Manipulation skill learning and generalisation have gained increasing attention due to the wide applications of robot manipulators and the spurt of robot learning techniques. Especially, the learning from demonstration method has been exploited widel... Read More about A review on manipulation skill acquisition through teleoperation‐based learning from demonstration.

Composite dynamic movement primitives based on neural networks for human–robot skill transfer (2021)
Journal Article
Si, W., Wang, N., & Yang, C. (in press). Composite dynamic movement primitives based on neural networks for human–robot skill transfer. Neural Computing and Applications, 35, 23283–23293. https://doi.org/10.1007/s00521-021-05747-8

In this paper, composite dynamic movement primitives (DMPs) based on radial basis function neural networks (RBFNNs) are investigated for robots’ skill learning from human demonstrations. The composite DMPs could encode the position and orientation ma... Read More about Composite dynamic movement primitives based on neural networks for human–robot skill transfer.

A constrained DMPs framework for robot skills learning and generalization from human demonstrations (2021)
Journal Article
Lu, Z., Wang, N., & Yang, C. (2021). A constrained DMPs framework for robot skills learning and generalization from human demonstrations. IEEE/ASME Transactions on Mechatronics, 26(6), 3265 - 3275. https://doi.org/10.1109/TMECH.2021.3057022

Dynamical movement primitives (DMPs) model is a useful tool for efficiently robotic learning manipulation skills from human demonstrations and then generalizing these skills to fulfill new tasks. It is improved and applied for the cases with multiple... Read More about A constrained DMPs framework for robot skills learning and generalization from human demonstrations.

Learning compliant robotic movements based on biomimetic motor adaptation (2020)
Journal Article
Zeng, C., Chen, X., Wang, N., & Yang, C. (2021). Learning compliant robotic movements based on biomimetic motor adaptation. Robotics and Autonomous Systems, 135, Article 103668. https://doi.org/10.1016/j.robot.2020.103668

It is one of the great challenges for a robot to learn compliant movements in interaction tasks. The robot can easily acquire motion skills from a human tutor by kinematics demonstration, however, this becomes much more difficult when it comes to the... Read More about Learning compliant robotic movements based on biomimetic motor adaptation.

Neural learning enhanced variable admittance control for human-robot collaboration (2020)
Journal Article
Chen, X., Wang, N., Cheng, H., & Yang, C. (2020). Neural learning enhanced variable admittance control for human-robot collaboration. IEEE Access, 8, 25727-25737. https://doi.org/10.1109/access.2020.2969085

© 2013 IEEE. In this paper, we propose a novel strategy for human-robot impedance mapping to realize an effective execution of human-robot collaboration. The endpoint stiffness of the human arm impedance is estimated according to the configurations o... Read More about Neural learning enhanced variable admittance control for human-robot collaboration.

A framework of hybrid force/motion skills learning for robots (2020)
Journal Article
Wang, N., Chen, C., & Nuovo, A. D. (2021). A framework of hybrid force/motion skills learning for robots. IEEE Transactions on Cognitive and Developmental Systems, 13(1), 162-170. https://doi.org/10.1109/tcds.2020.2968056

Human factors and human-centered design philosophy are highly desired in today's robotics applications such as human-robot interaction (HRI). Several studies showed that endowing robots of human-like interaction skills can not only make them more lik... Read More about A framework of hybrid force/motion skills learning for robots.

A robot learning framework based on adaptive admittance control and generalizable motion modeling with neural network controller (2019)
Journal Article
Wang, N., Chen, C., & Yang, C. (2020). A robot learning framework based on adaptive admittance control and generalizable motion modeling with neural network controller. Neurocomputing, 390, 260-267. https://doi.org/10.1016/j.neucom.2019.04.100

© 2019 Elsevier B.V. Robot learning from demonstration (LfD) enables robots to be fast programmed. This paper presents a novel LfD framework involving a teaching phase, a learning phase and a reproduction phase, and proposes methods in each of these... Read More about A robot learning framework based on adaptive admittance control and generalizable motion modeling with neural network controller.

Temporal patterns in multi-modal social interaction between elderly users and service robot (2019)
Journal Article
Wang, N., Di Nuovo, A., Cangelosi, A., & Jones, R. (2019). Temporal patterns in multi-modal social interaction between elderly users and service robot. Interaction Studies, 20(1), 4-24. https://doi.org/10.1075/is.18042.wan

Social interaction, especially for older people living alone is a challenge currently facing human-robot interaction (HRI). There has been little research on user preference towards HRI interfaces. In this paper, we took both objective observations a... Read More about Temporal patterns in multi-modal social interaction between elderly users and service robot.

A Wave Variable Approach with Multiple Channel Architecture for Teleoperated System (2019)
Journal Article
Luo, J., Liu, C., Wang, N., & Yang, C. (2019). A Wave Variable Approach with Multiple Channel Architecture for Teleoperated System. IEEE Access, 7, 143912-143920. https://doi.org/10.1109/ACCESS.2019.2945674

© 2013 IEEE. Performance of teleoperation can be greatly influenced by time delay in the process of tele-manipulation with respect to accuracy and transparency. Wave variable is an effective algorithm to achieve a good stable capability. However, som... Read More about A Wave Variable Approach with Multiple Channel Architecture for Teleoperated System.

Exploration of muscle fatigue effects in bioinspired robot learning from sEMG signals (2018)
Journal Article
Wang, N., Xu, Y., Ma, H., & Liu, X. (2018). Exploration of muscle fatigue effects in bioinspired robot learning from sEMG signals. Complexity, 2018(49207), https://doi.org/10.1155/2018/4920750

© 2018 Ning Wang et al. To investigate the effects of muscle fatigue on bioinspired robot learning quality in teaching by demonstration (TbD) tasks, in this work, we propose to first identify the emerging muscle fatigue phenomenon of the human demons... Read More about Exploration of muscle fatigue effects in bioinspired robot learning from sEMG signals.

The multi-modal interface of Robot-Era multi-robot services tailored for the elderly (2017)
Journal Article
Di Nuovo, A., Broz, F., Wang, N., Belpaeme, T., Cangelosi, A., Jones, R., …Dario, P. (2018). The multi-modal interface of Robot-Era multi-robot services tailored for the elderly. Intelligent Service Robotics, 11(1), 109-126. https://doi.org/10.1007/s11370-017-0237-6

© 2017, The Author(s). Socially assistive robotic platforms are now a realistic option for the long-term care of ageing populations. Elderly users may benefit from many services provided by robots operating in different environments, such as providin... Read More about The multi-modal interface of Robot-Era multi-robot services tailored for the elderly.

A user-centric design of service robots speech interface for the elderly (2016)
Book Chapter
Wang, N., Broz, F., Di Nuovo, A., Belpaeme, T., & Cangelosi, A. A user-centric design of service robots speech interface for the elderly. In A. Esposito (Ed.), Recent Advances in Nonlinear Speech Processing (275-283). Springer International Publishing Switzerland

The elderly population in the Europe have quickly increased and will keep growing in the coming years. In facing the elder care challenges posed by the amount of seniors staying alone in their own homes, great efforts have been made to develop advanc... Read More about A user-centric design of service robots speech interface for the elderly.

A Discrete-Time Algorithm for Stiffness Extraction from sEMG and Its Application in Antidisturbance Teleoperation (2016)
Journal Article
Liang, P., Yang, C., Wang, N., & Li, R. (2016). A Discrete-Time Algorithm for Stiffness Extraction from sEMG and Its Application in Antidisturbance Teleoperation. Discrete Dynamics in Nature and Society, 2016(689703), https://doi.org/10.1155/2016/6897030

© 2016 Peidong Liang et al. We have developed a new discrete-time algorithm of stiffness extraction from muscle surface electromyography (sEMG) collected from human operator's arms and have applied it for antidisturbance control in robot teleoperatio... Read More about A Discrete-Time Algorithm for Stiffness Extraction from sEMG and Its Application in Antidisturbance Teleoperation.

Extracting and selecting distinctive EEG features for efficient epileptic seizure prediction (2014)
Journal Article
Wang, N., & Lyu, M. R. (2015). Extracting and selecting distinctive EEG features for efficient epileptic seizure prediction. IEEE Journal of Biomedical and Health Informatics, 19(5), 1648-1659. https://doi.org/10.1109/JBHI.2014.2358640

© 2013 IEEE. This paper presents compact yet comprehensive feature representations for the electroencephalogram (EEG) signal to achieve efficient epileptic seizure prediction performance. The initial EEG feature vectors are formed by acquiring the do... Read More about Extracting and selecting distinctive EEG features for efficient epileptic seizure prediction.

Robust speaker recognition using denoised vocal source and vocal tract features (2010)
Journal Article
Wang, N., Ching, P. C., Zheng, N., & Lee, T. (2011). Robust speaker recognition using denoised vocal source and vocal tract features. IEEE Transactions on Audio, Speech and Language Processing, 19(1), 196-205. https://doi.org/10.1109/TASL.2010.2045800

To alleviate the problem of severe degradation of speaker recognition performance under noisy environments because of inadequate and inaccurate speaker-discriminative information, a method of robust feature estimation that can capture both vocal sour... Read More about Robust speaker recognition using denoised vocal source and vocal tract features.