A wearable multisensor fusion system for neuroprosthetic hand

A neural interface translating human motor intentions into control commands for prosthetic hands helps amputees restore upper limb function. However, commercial neural interfaces with a few surface electromyography (sEMG) sensors are constrained by limitations, such as low spatiotemporal resolution, limited number of recognizable hand gestures, and sensitivity to arm positions. Multimodal sensor fusion presents a viable approach to overcome these challenges, offering improved accuracy, versatility, and robustness in gesture recognition. In this study, we developed a wearable multisensor fusion system compact enough to be integrated into a prosthetic socket. The fusion probe had dimensions of 38.5× 20.5× 13.5 mm, and the signal acquisition/processing device measured 50× 40 × 15 mm. The fusion system incorporated three types of sensors, capturing muscle movements from morphology (A-mode ultrasound), electrophysiology (sEMG), and kinematics inertial measurement unit (IMU). Gesture recognition experiments were conducted with 20 subjects, including both healthy individuals and amputees, achieving classification accuracies of 94.8% ± 1.1 % and 96.9% ± ~1.3 % for six common gestures, respectively. Furthermore, we proposed a new control strategy based on the characteristics of sensor fusion to enhance the stability of online gesture classification. Practical online testing with amputees wearing prostheses indicated that the designed fusion system had high classification accuracy and stability during gesture recognition. These results demonstrated that the wearable multisensor fusion system is well-suited for integration into prostheses, offering a robust solution for amputees' practical use.