Development of a mixed reality based interface for human robot interaction

Matthew Cousins, Chenguang Yang, Junshen Chen, Wei He, Zhaojie Ju

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This research paper presents a novel interface of programming by demonstration (PbD) for Human-Robot Interaction (HRI). The designed mixed reality (MR) based interface is providing users a more immersive user experience (UX) while teleoperating the robot. The operator's hand gestures are captured and be used to control the robot. Users are able to see their own hands in the virtual environment. Experimental test was carried out with a dual-arm robot to make the robot react to a gesture made by an operator viewing the robot workspace through a virtual reality (VR) headset.
Original languageEnglish
Title of host publication2017 International Conference on Machine Learning and Cybernetics
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages27-34
ISBN (Electronic)978-1-5386-0408-3
ISBN (Print)978-1-5386-0406-9
DOIs
Publication statusPublished - 14 Nov 2017
Event16th International Conference on Machine Learning and Cybernetics: ICMLC 2017 - Ningbo, China
Duration: 9 Jul 201712 Jul 2017

Publication series

NameIEEE ICMLC Proceedings Series
PublisherIEEE
ISSN (Electronic)2160-1348

Conference

Conference16th International Conference on Machine Learning and Cybernetics
Country/TerritoryChina
CityNingbo
Period9/07/1712/07/17

Fingerprint

Dive into the research topics of 'Development of a mixed reality based interface for human robot interaction'. Together they form a unique fingerprint.

Cite this