BioTacTip: A soft biomimetic optical tactile sensor for efficient 3D contact localization and 3D force estimation

Li, Haoran; Nam, Saekwang; Lu, Zhenyu; Yang, Chenguang; Psomopoulou, Efi; Lepora, Nathan F.

Abstract

In this letter, we introduce a new soft biomimetic optical tactile sensor based on mimicking the interlocking structure of the epidermal-dermal boundary: the BioTacTip. The primary sensing unit comprises a sharp white tip surrounded by four black cover tips that when subjected to an external force emphasizes the applied direction and contact location, for high-resolution imaging by an internal camera. The sensor design means that we can utilize the tactile images directly as the model input (not requiring marker detection) for computationally efficient reconstruction of 3D external forces, contact geometry, localization and depth, by utilizing an analytic tactile model based on dynamic friction and internal pressure. Indentation and press-and-shear tests confirmed this mechanism, with sub-mm localization and indentation errors, and normal and shear force time series that match measured quantities. The sensor design opens up a new way to instantiate biomimicry in optical tactile sensors that utilizes mechanical processing in the skin.

• Journal Article Type: Article
• Acceptance Date: Apr 5, 2024
• Online Publication Date: Apr 10, 2024
• Publication Date: Jun 30, 2024
• Deposit Date: Jun 12, 2024
• Publicly Available Date: Jun 12, 2024
• Journal: IEEE Robotics and Automation Letters
• Print ISSN: 2377-3766
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• Volume: 9
• Issue: 6
• Pages: 5314-5321
• DOI: https://doi.org/10.1109/lra.2024.3387111
• Keywords: Artificial Intelligence, Control and Optimization, Computer Science Applications, Computer Vision and Pattern Recognition, Mechanical Engineering, Human-Computer Interaction, Biomedical Engineering, Control and Systems Engineering
• Public URL: https://uwe-repository.worktribe.com/output/11928708