Hierarchical event selection for video storyboards with a case study on snooker video visualization

Parry, Matthew L.; Chung, David H.S.; Griffiths, Iwan W.; Legg, Philip; Chen, Min

Abstract

Video storyboard, which is a form of video visualization, summarizes the major events in a video using illustrative visualization. There are three main technical challenges in creating a video storyboard, (a) event classification, (b) event selection and (c) event illustration. Among these challenges, (a) is highly application-dependent and requires a significant amount of application specific semantics to be encoded in a system or manually specified by users. This paper focuses on challenges (b) and (c). In particular, we present a framework for hierarchical event representation, and an importance-based selection algorithm for supporting the creation of a video storyboard from a video. We consider the storyboard to be an event summarization for the whole video, whilst each individual illustration on the board is also an event summarization but for a smaller time window. We utilized a 3D visualization template for depicting and annotating events in illustrations. To demonstrate the concepts and algorithms developed, we use Snooker video visualization as a case study, because it has a concrete and agreeable set of semantic definitions for events and can make use of existing techniques of event detection and 3D reconstruction in a reliable manner. Nevertheless, most of our concepts and algorithms developed for challenges (b) and (c) can be applied to other application areas. © 2010 IEEE.

Citation

Griffiths, I. W., Chung, D. H., Parry, M. L., Legg, P., & Chen, M. (2011). Hierarchical event selection for video storyboards with a case study on snooker video visualization. IEEE Transactions on Visualization and Computer Graphics, 17(12), 1747-1756. https://doi.org/10.1109/TVCG.2011.208

• Journal Article Type: Article
• Publication Date: Nov 15, 2011
• Deposit Date: Jun 23, 2015
• Publicly Available Date: Nov 15, 2016
• Journal: IEEE Transactions on Visualization and Computer Graphics
• Print ISSN: 1077-2626
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• Volume: 17
• Issue: 12
• Pages: 1747-1756
• DOI: https://doi.org/10.1109/TVCG.2011.208
• Keywords: multimedia visualization, time series data, illustrative visualization
• Public URL: https://uwe-repository.worktribe.com/output/958804
• Publisher URL: http://dx.doi.org/10.1109/TVCG.2011.208
• Additional Information: Additional Information : (c) 2011 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.