Application of region-based video surveillance in smart cities using deep learning

Zahra, Asma; Ghafoor, Mubeen; Munir, Kamran; Ullah, Ata; Ul Abideen, Zain

Abstract

Smart video surveillance helps to build more robust smart city environment. The varied angle cameras act as smart sensors and collect visual data from smart city environment and transmit it for further visual analysis. The transmitted visual data is required to be in high quality for efficient analysis which is a challenging task while transmitting videos on low capacity bandwidth communication channels. In latest smart surveillance cameras, high quality of video transmission is maintained through various video encoding techniques such as high efficiency video coding. However, these video coding techniques still provide limited capabilities and the demand of high-quality based encoding for salient regions such as pedestrians, vehicles, cyclist/motorcyclist and road in video surveillance systems is still not met. This work is a contribution towards building an efficient salient region-based surveillance framework for smart cities. The proposed framework integrates a deep learning-based video surveillance technique that extracts salient regions from a video frame without information loss, and then encodes it in reduced size. We have applied this approach in diverse case studies environments of smart city to test the applicability of the framework. The successful result in terms of bitrate 56.92%, peak signal to noise ratio 5.35 bd and SR based segmentation accuracy of 92% and 96% for two different benchmark datasets is the outcome of proposed work. Consequently, the generation of less computational region-based video data makes it adaptable to improve surveillance solution in Smart Cities.

• Journal Article Type: Article
• Acceptance Date: Aug 19, 2021
• Online Publication Date: Dec 27, 2021
• Publication Date: Dec 27, 2021
• Deposit Date: Dec 27, 2021
• Publicly Available Date: Jan 4, 2022
• Journal: Multimedia Tools and Applications
• Print ISSN: 1380-7501
• Electronic ISSN: 1573-7721
• Publisher: Springer (part of Springer Nature)
• Peer Reviewed: Peer Reviewed
• Volume: 2021
• DOI: https://doi.org/10.1007/s11042-021-11468-w
• Keywords: Computer Networks and Communications; Hardware and Architecture; Media Technology; Software
• Public URL: https://uwe-repository.worktribe.com/output/8442139
• Additional Information: Received: 24 July 2020; Revised: 23 May 2021; Accepted: 19 August 2021; First Online: 27 December 2021; : ; : Authors have no competing interests.