Gesture recognition based on depth information and convolutional neural network

Du Jiang, Gongfa Li, Guozhang Jiang, Disi Chen, Zhaojie Ju

Research output: Chapter in Book/Report/Conference proceedingConference contribution

304 Downloads (Pure)


Vision-based gesture Recognition accords with natural communication habits of human and can carry out long-distance and non-contact interactions. So it has become a hot direction in human-computer interaction research whose Recognition effect largely depends on the performance of image preprocessing and Recognition algorithms. In this paper, a gesture Recognition method using color image and depth image combined is designed. For the influence of the angle on the same gesture, the skeleton algorithm is optimized based on the layer-by-layer stripping concept. The fast refinement algorithm improves the process of repeated scanning, extracts the key node information in the skeleton map of the hand, and establishes the spatial axis of the hand to determine the gesture direction. The gesture Recognition experiment was performed based on convolutional neural network. The results showed the Recognition accuracy rate was 96.01%, and the robustness and accuracy of the proposed Recognition method were verified.

Original languageEnglish
Title of host publicationProceedings - 2018 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages6
ISBN (Electronic)978-1-5386-6650-0
ISBN (Print)978-1-5386-6651-7
Publication statusPublished - 17 Jan 2019
Event2018 IEEE International Conference on Systems, Man and Cybernetics - Miyazaki, Japan
Duration: 7 Oct 201810 Oct 2018

Publication series

NameIEEE SMC Proceedings Series
ISSN (Print)1062-922X
ISSN (Electronic)2577-1655


Conference2018 IEEE International Conference on Systems, Man and Cybernetics
Abbreviated titleSMC 2018
Internet address


  • Convolutional neural network
  • Depth information
  • Gesture Recognition
  • Hand skeleton extraction


Dive into the research topics of 'Gesture recognition based on depth information and convolutional neural network'. Together they form a unique fingerprint.

Cite this