Skip to main navigation Skip to search Skip to main content

Development of a mixed reality based interface for human robot interaction

  • Matthew Cousins
  • , Chenguang Yang
  • , Junshen Chen
  • , Wei He
  • , Zhaojie Ju

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

    Abstract

    This research paper presents a novel interface of programming by demonstration (PbD) for Human-Robot Interaction (HRI). The designed mixed reality (MR) based interface is providing users a more immersive user experience (UX) while teleoperating the robot. The operator's hand gestures are captured and be used to control the robot. Users are able to see their own hands in the virtual environment. Experimental test was carried out with a dual-arm robot to make the robot react to a gesture made by an operator viewing the robot workspace through a virtual reality (VR) headset.
    Original languageEnglish
    Title of host publication2017 International Conference on Machine Learning and Cybernetics
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages27-34
    ISBN (Electronic)978-1-5386-0408-3
    ISBN (Print)978-1-5386-0406-9
    DOIs
    Publication statusPublished - 14 Nov 2017
    Event16th International Conference on Machine Learning and Cybernetics: ICMLC 2017 - Ningbo, China
    Duration: 9 Jul 2017 → 12 Jul 2017

    Publication series

    NameIEEE ICMLC Proceedings Series
    PublisherIEEE
    ISSN (Electronic)2160-1348

    Conference

    Conference16th International Conference on Machine Learning and Cybernetics
    Country/TerritoryChina
    CityNingbo
    Period9/07/17 → 12/07/17

    Fingerprint

    Dive into the research topics of 'Development of a mixed reality based interface for human robot interaction'. Together they form a unique fingerprint.

    Cite this