Feasibility of keypad input interception in augmented reality environments

Ayodele, Innocent; Nwaeze, Dave; Ojediran, Deborah; Osamor, Jude

Abstract

Augmented reality (AR) technology is one of the rapidly growing solutions that change the way people interact with the digital space (Kidd and Crompton in Mobile learning design. Springer, Singapore, pp. 97–108, 2016). People have raised questions concerning security and privacy stakes as it become more applied in various areas such as gaming, health, and education. It is in the context of keypad input interception in an augmented reality setting, that the following review of the literature has been conducted. To conduct the review, previous works on subjects related to the topic will be reviewed, with emphasis on the limitations of such studies, which will help build the need for the current study. We will also discuss some ethical questions concerning security breach investigation. In this study, it was considered convenient to transform from simple data gathering to live demonstrations and simulations to evaluate the possibility of the interception of a keypad input within an AR context. This study also uses the Python script and Mediapipe along with OpenCV for the application of AR interaction emulation. The researcher was actively operating with a live subject, moving through a range of positions of the user, different lighting conditions and kinds of input which include keypad input and gesture recognition. Looking at the actual and real typing behaviour, one may identify the real-time feasibility of the interception of keypad inputs in an AR environment. Based on the above observations, it is evident that hand position smoothing has a considerable impact on tracking stability, thereby improving the dependability of intercepting AR keypad input. Further, front-facing positions present certain benefits to AR technology since placement in the AR environment is a significant determinant of its feasibility. Adaptive remedies are needed when lighting conditions, which are often overlooked, have a significant influence on tracking accuracy. Various input approaches are reviewed and analysed in this paper with the purpose of gaining information concerning the possibility of incorporating customised input mechanisms in augmented reality. Therefore, based on the analysis of this paper, the interception of keypad inputs within AR environments is accurate and fast. This simulation-based study offers practical insights into AR keypad input interception and the dynamic world of AR interactions. Real-time observations provide glimpses into keypad input interceptions, advocating for the fine-tuning of AR interactions for optimum usability and effectiveness. As AR technology continues to transform across industries, this study prioritises the significance of optimising user interactions and security measures within the growing digital landscape.

• Online Publication Date: Jul 2, 2025
• Publication Date: 2025
• Deposit Date: Jul 2, 2025
• Publicly Available Date: Jul 3, 2026
• Publisher: Springer (part of Springer Nature)
• Pages: 113-140
• Series Title: Lecture Notes in Networks and Systems
• Book Title: Proceedings of Data Analytics and Management
• ISBN: 9789819633517
• DOI: https://doi.org/10.1007/978-981-96-3352-4_8
• Public URL: https://uwe-repository.worktribe.com/output/14667839
• Additional Information: First Online: 2 July 2025; : This research does not require ethical approval and consent to participate.; : Consent has been granted by all authors and there is no conflict.; : There are no competing interests.; Conference Acronym: ICDAM; Conference Name: International Conference on Data Analytics & Management; Conference City: London; Conference Country: United Kingdom; Conference Year: 2024; Conference Start Date: 14 June 2024; Conference End Date: 15 June 2024; Conference Number: 5; Conference ID: icdam2024; Conference URL: https://icdam-conf.com/