Hand detection and location based on improved SSD for space human-robot interaction

Qing Gao; Jinguo Liu; Zhaojie Ju; Lu Zhang; Yangmin Li; Yuwang Liu

doi:10.1007/978-3-319-97586-3_15

Hand detection and location based on improved SSD for space human-robot interaction

Qing Gao, Jinguo Liu, Zhaojie Ju, Lu Zhang, Yangmin Li, Yuwang Liu

School of Computing

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

429 Downloads (Pure)

Abstract

In the astronaut-space robot interaction based on hand gestures, the detection and location of hands are the premise and basis of vision-based hand gesture recognition and hand tracking. In this paper, the SSD (Single Shot Multibox Detector) which is a kind of deep learning model is utilized to detect and locate astronaut’s hands for space human-robot interaction (SHRI) based on hand gestures. First of all, in order to meet the needs of hand detection and location, an improved SSD model is designed to detect hands when they are shown as small targets in images. Then, a platform for SHRI is built and a set of hand gestures for SHRI are designed. Finally, the proposed SSD model is validated experimentally on a homemade hand gesture database for proving the superiority of this improved SSD model to small target hands detection.

Original language	English
Title of host publication	Intelligent Robotics and Applications
Subtitle of host publication	11th International Conference, ICIRA 2018, Newcastle, NSW, Australia, August 9–11, 2018, Proceedings, Part I
Editors	Zhiyong Chen, Alexandre Mendes, Yamin Yan, Shifeng Chen
Publisher	Springer
Pages	164-175
ISBN (Electronic)	978-3-319-97586-3
ISBN (Print)	978-3-319-97585-6
DOIs	https://doi.org/10.1007/978-3-319-97586-3_15
Publication status	Published - Sept 2018
Event	11th International Conference on Intelligent Robotics and Applications - Australia, Newcastle, Australia Duration: 9 Aug 2018 → 11 Aug 2018 http://www.icira2018.org

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer
Volume	10984
ISSN (Print)	0302-9743

Conference

Conference	11th International Conference on Intelligent Robotics and Applications
Abbreviated title	ICIRA 2018
Country/Territory	Australia
City	Newcastle
Period	9/08/18 → 11/08/18
Internet address	http://www.icira2018.org

Access to Document

10.1007/978-3-319-97586-3_15

Hand Detection and Location Based on Improved SSD for Space Human-robot Interaction
The final authenticated version is available online at: https://doi.org/10.1007/978-3-319-97586-3_15.
Accepted author manuscript (Post-print), 556 KB

Cite this

Gao, Q., Liu, J., Ju, Z., Zhang, L., Li, Y., & Liu, Y. (2018). Hand detection and location based on improved SSD for space human-robot interaction. In Z. Chen, A. Mendes, Y. Yan, & S. Chen (Eds.), Intelligent Robotics and Applications: 11th International Conference, ICIRA 2018, Newcastle, NSW, Australia, August 9–11, 2018, Proceedings, Part I (pp. 164-175). (Lecture Notes in Computer Science; Vol. 10984). Springer. https://doi.org/10.1007/978-3-319-97586-3_15

Gao, Qing ; Liu, Jinguo ; Ju, Zhaojie et al. / Hand detection and location based on improved SSD for space human-robot interaction. Intelligent Robotics and Applications: 11th International Conference, ICIRA 2018, Newcastle, NSW, Australia, August 9–11, 2018, Proceedings, Part I. editor / Zhiyong Chen ; Alexandre Mendes ; Yamin Yan ; Shifeng Chen. Springer, 2018. pp. 164-175 (Lecture Notes in Computer Science).

@inproceedings{4f1e290bd5de485a9d6eff7fa9ff723c,

title = "Hand detection and location based on improved SSD for space human-robot interaction",

abstract = "In the astronaut-space robot interaction based on hand gestures, the detection and location of hands are the premise and basis of vision-based hand gesture recognition and hand tracking. In this paper, the SSD (Single Shot Multibox Detector) which is a kind of deep learning model is utilized to detect and locate astronaut{\textquoteright}s hands for space human-robot interaction (SHRI) based on hand gestures. First of all, in order to meet the needs of hand detection and location, an improved SSD model is designed to detect hands when they are shown as small targets in images. Then, a platform for SHRI is built and a set of hand gestures for SHRI are designed. Finally, the proposed SSD model is validated experimentally on a homemade hand gesture database for proving the superiority of this improved SSD model to small target hands detection.",

author = "Qing Gao and Jinguo Liu and Zhaojie Ju and Lu Zhang and Yangmin Li and Yuwang Liu",

year = "2018",

month = sep,

doi = "10.1007/978-3-319-97586-3_15",

language = "English",

isbn = "978-3-319-97585-6",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "164--175",

editor = "Zhiyong Chen and Alexandre Mendes and Yamin Yan and Shifeng Chen",

booktitle = "Intelligent Robotics and Applications",

note = "11th International Conference on Intelligent Robotics and Applications, ICIRA 2018 ; Conference date: 09-08-2018 Through 11-08-2018",

url = "http://www.icira2018.org",

}

Gao, Q, Liu, J, Ju, Z, Zhang, L, Li, Y & Liu, Y 2018, Hand detection and location based on improved SSD for space human-robot interaction. in Z Chen, A Mendes, Y Yan & S Chen (eds), Intelligent Robotics and Applications: 11th International Conference, ICIRA 2018, Newcastle, NSW, Australia, August 9–11, 2018, Proceedings, Part I. Lecture Notes in Computer Science, vol. 10984, Springer, pp. 164-175, 11th International Conference on Intelligent Robotics and Applications, Newcastle, New South Wales, Australia, 9/08/18. https://doi.org/10.1007/978-3-319-97586-3_15

Hand detection and location based on improved SSD for space human-robot interaction. / Gao, Qing; Liu, Jinguo; Ju, Zhaojie et al.
Intelligent Robotics and Applications: 11th International Conference, ICIRA 2018, Newcastle, NSW, Australia, August 9–11, 2018, Proceedings, Part I. ed. / Zhiyong Chen; Alexandre Mendes; Yamin Yan; Shifeng Chen. Springer, 2018. p. 164-175 (Lecture Notes in Computer Science; Vol. 10984).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Hand detection and location based on improved SSD for space human-robot interaction

AU - Gao, Qing

AU - Liu, Jinguo

AU - Ju, Zhaojie

AU - Zhang, Lu

AU - Li, Yangmin

AU - Liu, Yuwang

PY - 2018/9

Y1 - 2018/9

N2 - In the astronaut-space robot interaction based on hand gestures, the detection and location of hands are the premise and basis of vision-based hand gesture recognition and hand tracking. In this paper, the SSD (Single Shot Multibox Detector) which is a kind of deep learning model is utilized to detect and locate astronaut’s hands for space human-robot interaction (SHRI) based on hand gestures. First of all, in order to meet the needs of hand detection and location, an improved SSD model is designed to detect hands when they are shown as small targets in images. Then, a platform for SHRI is built and a set of hand gestures for SHRI are designed. Finally, the proposed SSD model is validated experimentally on a homemade hand gesture database for proving the superiority of this improved SSD model to small target hands detection.

AB - In the astronaut-space robot interaction based on hand gestures, the detection and location of hands are the premise and basis of vision-based hand gesture recognition and hand tracking. In this paper, the SSD (Single Shot Multibox Detector) which is a kind of deep learning model is utilized to detect and locate astronaut’s hands for space human-robot interaction (SHRI) based on hand gestures. First of all, in order to meet the needs of hand detection and location, an improved SSD model is designed to detect hands when they are shown as small targets in images. Then, a platform for SHRI is built and a set of hand gestures for SHRI are designed. Finally, the proposed SSD model is validated experimentally on a homemade hand gesture database for proving the superiority of this improved SSD model to small target hands detection.

U2 - 10.1007/978-3-319-97586-3_15

DO - 10.1007/978-3-319-97586-3_15

M3 - Conference contribution

SN - 978-3-319-97585-6

T3 - Lecture Notes in Computer Science

SP - 164

EP - 175

BT - Intelligent Robotics and Applications

A2 - Chen, Zhiyong

A2 - Mendes, Alexandre

A2 - Yan, Yamin

A2 - Chen, Shifeng

PB - Springer

T2 - 11th International Conference on Intelligent Robotics and Applications

Y2 - 9 August 2018 through 11 August 2018

ER -

Gao Q, Liu J, Ju Z, Zhang L, Li Y, Liu Y. Hand detection and location based on improved SSD for space human-robot interaction. In Chen Z, Mendes A, Yan Y, Chen S, editors, Intelligent Robotics and Applications: 11th International Conference, ICIRA 2018, Newcastle, NSW, Australia, August 9–11, 2018, Proceedings, Part I. Springer. 2018. p. 164-175. (Lecture Notes in Computer Science). Epub 2018 Aug 3. doi: 10.1007/978-3-319-97586-3_15

Hand detection and location based on improved SSD for space human-robot interaction

Abstract

Publication series

Conference

Access to Document

Fingerprint

Cite this