A structured multi-feature representation for recognizing human action and interaction

Bangli Liu, Zhaojie Ju, Honghai Liu

Research output: Contribution to journalArticlepeer-review

231 Downloads (Pure)


Active research has been carried out for human action recognition using 3D human skeleton joints with the release of cost-efficient RGB-D sensors. However, extracting discriminative features from noisy skeleton sequences to effectively distinguish various human action or interaction categories still remains challenging. This paper proposes a structured multi-feature representation for human action and interaction recognition. Specifically, a novel kernel enhanced bag of semantic words (BSW) is designed to represent the dynamic property of skeleton trajectories. By aggregating BSW with the geometric feature, a GBSW representation is constructed for human action recognition. For human interaction recognition where the cooperation of each subject matters, a GBSWC representation is proposed via combining the GBSW feature with a correlation feature which addresses the intrinsic relationship between interactive persons. Experimental results on several human action and interaction datasets demonstrate the superior performances of the proposed features over the state-of-the-art methods.
Original languageEnglish
Early online date31 Aug 2018
Publication statusEarly online - 31 Aug 2018


Dive into the research topics of 'A structured multi-feature representation for recognizing human action and interaction'. Together they form a unique fingerprint.

Cite this