Unsupervised learning spatio-temporal features for human activity recognition from RGB-D video data

Chen, Guang; Zhang, Feihu; Giuliani, Manuel; Buckl, Christian; Knoll, Alois

Abstract

Being able to recognize human activities is essential for several applications, including social robotics. The recently developed commodity depth sensors open up newpossibilities of dealingwith this problem. Existing techniques extract hand-tuned features, such as HOG3D or STIP, from video data. They are not adapting easily to new modalities. In addition, as the depth video data is lowquality due to the noise, we face a problem: does the depth video data provide extra information for activity recognition? To address this issue, we propose to use an unsupervised learning approach generally adapted to RGB and depth video data. we further employ the multi kernel learning (MKL) classifier to take into account the combinations of different modalities. We show that the low-quality depth video is discriminative for activity recognition. We also demonstrate that our approach achieves superior performance to the state-of-the-art approaches on two challenging RGB-D activity recognition datasets. © Springer International Publishing 2013.

• Presentation Conference Type: Conference Paper (published)
• Conference Name: Proceedings of the International Conference on Social Robotics 2013 (ICSR 2013)
• Acceptance Date: Oct 27, 2013
• Publication Date: Dec 1, 2013
• Journal: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
• Print ISSN: 0302-9743
• Publisher: Springer Verlag
• Peer Reviewed: Peer Reviewed
• Volume: 8239 LNAI
• Pages: 341-350
• Book Title: Social Robotics
• ISBN: 9783319026749
• DOI: https://doi.org/10.1007/978-3-319-02675-6_34
• Keywords: activity recognitio, unsupervised learning, depth video
• Public URL: https://uwe-repository.worktribe.com/output/926663
• Publisher URL: http://dx.doi.org/10.1007/978-3-319-02675-6_34
• Additional Information: Title of Conference or Conference Proceedings : International Conference on Social Robotics