Using adaptive directed acyclic graph for human in-hand motion identification with hybrid surface electromyography and kinect

Yaxu Xue, Yadong Yu, Kaiyang Yin, Haojie Du*, Pengfei Li, Kejie Dai, Zhaojie Ju

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

The multi-fingered dexterous robotic hand is increasingly used to achieve more complex and sophisticated human-like manipulation tasks on various occasions. This paper proposes a hybrid Surface Electromyography (SEMG) and Kinect-based human in-hand motion (HIM) capture system architecture for recognizing complex motions of the humans by observing the state information between an object and the human hand, then transferring the manipulation skills into bionic multi-fingered robotic hand realizing dexterous in-hand manipulation. First, an Adaptive Directed Acyclic Graph (ADAG) algorithm for recognizing HIMs is proposed and optimized based on the comparison of multi-class support vector machines; second, ten representative complex in-hand motions are demonstrated by ten subjects, and SEMG and Kinect signals are obtained based on a multi-modal data acquisition platform; then, combined with the proposed algorithm framework, a series of data preprocessing algorithms are realized. There is statistical symmetry in similar types of SEMG signals and images, and asymmetry in different types of SEMG signals and images. A detailed analysis and an in-depth discussion are given from the results of the ADAG recognizing HIMs, motion recognition rates of different perceptrons, motion recognition rates of different subjects, motion recognition rates of different multi-class SVM methods, and motion recognition rates of different machine learning methods. The results of this experiment confirm the feasibility of the proposed method, with a recognition rate of 95.10%.

Original languageEnglish
Article number2093
Number of pages18
JournalSymmetry
Volume14
Issue number10
DOIs
Publication statusPublished - 8 Oct 2022

Keywords

  • adaptive directed acyclic graph (ADAG)
  • human in-hand manipulation (HIM)
  • kinect
  • multi-fingered hand
  • surface electromyography (SEMG)

Fingerprint

Dive into the research topics of 'Using adaptive directed acyclic graph for human in-hand motion identification with hybrid surface electromyography and kinect'. Together they form a unique fingerprint.

Cite this