A unified fuzzy framework for human hand motion recognition

Unconstrained human hand motions consisting grasp motions and in-hand manipulations lead to a fundamental challenge that many algorithms have to face in both theoretical and practical development, mainly due to the complexity and dexterity of the human hand. There is no effective solution reported to recognize in-hand manipulations though recognition algorithms have been proposed to recognize grasp motions in constrained scenarios. This paper proposes a novel unified fuzzy framework of a set of recognition algorithms: time clustering, fuzzy active axis Gaussian mixture mode and fuzzy empirical copula, from numerical clustering to data dependency structure in the context of optimally real-time human hand motion recognition. Time clustering is a fuzzy time-modeling approach based on fuzzy clustering and Takagi-Sugeno modeling with numerical value as output; Fuzzy active axis Gaussian mixture model effectively extract abstract Gaussian pattern to represent components of hand gestures with a fast convergence; Fuzzy empirical copula utilizes the dependence structure among the finger joint angles to recognize the motion type. The proposed algorithms have been evaluated on a wide range of scenarios of human hand recognition: a) datasets including 13 grasps and 10 in-hand manipulations; b) single subject and multiple subjects. c) varying training samples. The experimental results have demonstrated that the proposed framework outperforms hidden Markov model and Gaussian mixture model in terms of both effectiveness and efficiency criteria.