TY - JOUR
T1 - Adjusting eye aspect ratio for strong eye blink detection based on facial landmarks
AU - Dewi, Christine
AU - Chen, Rung Ching
AU - Jiang, Xiaoyi
AU - Yu, Hui
N1 - Funding Information:
This paper was supported by the Ministry of Science and Technology, Taiwan (MOST-110-2927-I-324-50, MOST-110-2221-E-324 -010, MOST-109-2622-E-324 -004) and the EU Horizon 2020 program RISE Project ULTRACEPT under Grant 778062. There was no additional external funding received for this study. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Publisher Copyright:
© Copyright 2022 Dewi et al.
PY - 2022/4/18
Y1 - 2022/4/18
N2 - Blink detection is an important technique in a variety of settings, including facial movement analysis and signal processing. However, automatic blink detection is very challenging because of the blink rate. This research work proposed a real-time method for detecting eye blinks in a video series. Automatic facial landmarks detectors are trained on a real-world dataset and demonstrate exceptional resilience to a wide range of environmental factors, including lighting conditions, face emotions, and head position. For each video frame, the proposed method calculates the facial landmark locations and extracts the vertical distance between the eyelids using the facial landmark positions. Our results show that the recognizable landmarks are sufficiently accurate to determine the degree of eye-opening and closing consistently. The proposed algorithm estimates the facial landmark positions, extracts a single scalar quantity by using Modified Eye Aspect Ratio (Modified EAR) and characterizing the eye closeness in each frame. Finally, blinks are detected by the Modified EAR threshold value and detecting eye blinks as a pattern of EAR values in a short temporal window. According to the results from a typical data set, it is seen that the suggested approach is more efficient than the stateof-the-art technique.
AB - Blink detection is an important technique in a variety of settings, including facial movement analysis and signal processing. However, automatic blink detection is very challenging because of the blink rate. This research work proposed a real-time method for detecting eye blinks in a video series. Automatic facial landmarks detectors are trained on a real-world dataset and demonstrate exceptional resilience to a wide range of environmental factors, including lighting conditions, face emotions, and head position. For each video frame, the proposed method calculates the facial landmark locations and extracts the vertical distance between the eyelids using the facial landmark positions. Our results show that the recognizable landmarks are sufficiently accurate to determine the degree of eye-opening and closing consistently. The proposed algorithm estimates the facial landmark positions, extracts a single scalar quantity by using Modified Eye Aspect Ratio (Modified EAR) and characterizing the eye closeness in each frame. Finally, blinks are detected by the Modified EAR threshold value and detecting eye blinks as a pattern of EAR values in a short temporal window. According to the results from a typical data set, it is seen that the suggested approach is more efficient than the stateof-the-art technique.
KW - blink detections
KW - Dlib
KW - eye aspect ratio
KW - eye blink
KW - facial landmarks
UR - http://www.scopus.com/inward/record.url?scp=85129680312&partnerID=8YFLogxK
U2 - 10.7717/peerj-cs.943
DO - 10.7717/peerj-cs.943
M3 - Article
AN - SCOPUS:85129680312
SN - 2376-5992
VL - 8
JO - PeerJ Computer Science
JF - PeerJ Computer Science
M1 - e943
ER -