A new framework of human interaction recognition based on multiple stage probability fusion

Xiaofei Ji, Changhui Wang, Zhaojie Ju

Research output: Contribution to journalArticlepeer-review

295 Downloads (Pure)


Visual-based human interactive behavior recognition is a challenging research topic in computer vision. There exist some important problems in the current interaction recognition algorithms, such as very complex feature representation and inaccurate feature extraction induced by wrong human body segmentation. In order to solve these problems, a novel human interaction recognition method based on multiple stage probability fusion is proposed in this paper. According to the human body’s contact in interaction as a cut-off point, the process of the
interaction can be divided into three stages: start stage, execution stage and end stage. Two persons’ motions are respectively extracted and recognizes in the start stage and the finish stage when there is no contact between those persons. The two persons’ motion is extracted as a whole and recognized in the execution stage. In the recognition process, the final recognition results are
obtained by the weighted fusing these probabilities in different stages. The proposed method not only simplifies the extraction and representation of features, but also avoids the wrong feature extraction caused by occlusion. Experiment results on the UT-interaction dataset demonstrated that the proposed method results in a better performance than other recent interaction recognition methods.
Original languageEnglish
Article number567
JournalApplied Sciences
Issue number6
Publication statusPublished - 1 Jun 2017


Dive into the research topics of 'A new framework of human interaction recognition based on multiple stage probability fusion'. Together they form a unique fingerprint.

Cite this