Multi-model fusion on real-time drowsiness detection for telemetric robotics tracking applications

Drowsiness of driver is one of the common causes resulting in road crashes. According to the research, there have been twenty percent of the road accidents which are related to the drowsiness of drivers. Nowadays, with the development technology, various approaches are introduced to detect the drowsiness of drivers. In this paper, we propose a multi-model fusion system which is composed of the three models to capture driver's face and detect drowsiness in the real-time for telemetric robotics tracking applications. The sensor device we used is an RGB camera which is mounted in front of driver to obtain the facial image. Then, we combine the results based on the state of the eye blink, yawn and head deviation to determine whether the driver is drowsy. We test our models to obtain the weighting factors in drowsy value. In the experiment, we show that our system has the high accuracy of detection. © 2020 IEEE.