A Vision-Based System for In-Sleep Upper-Body and Head Pose Classification
Journal
Sensors
Journal Volume
22
Journal Issue
5
Date Issued
2022
Author(s)
Abstract
Sleep quality is known to have a considerable impact on human health. Recent research shows that head and body pose play a vital role in affecting sleep quality. This paper presents a deep multi-task learning network to perform head and upper-body detection and pose classification during sleep. The proposed system has two major advantages: first, it detects and predicts upper-body pose and head pose simultaneously during sleep, and second, it is a contact-free home security camera-based monitoring system that can work on remote subjects, as it uses images captured by a home security camera. In addition, a synopsis of sleep postures is provided for analysis and diagnosis of sleep patterns. Experimental results show that our multi-task model achieves an average of 92.5% accuracy on challenging datasets, yields the best performance compared to the other methods, and obtains 91.7% accuracy on the real-life overnight sleep data. The proposed system can be applied reliably to extensive public sleep data with various covering conditions and is robust to real-life overnight sleep data. © 2022 by the authors. Licensee MDPI, Basel, Switzerland.
Subjects
Deep multi-task learning; Head and upper-body detection; Head and upper-body pose classification; Sleep monitoring; Sleep posture
SDGs
Other Subjects
Cameras; Deep learning; Image recognition; Patient monitoring; Body pose; Deep multi-task learning; Head and upper-body detection; Head and upper-body pose classification; Head pose; Pose classifications; Sleep monitoring; Sleep posture; Upper bodies; Sleep research; body position; human; sleep; Humans; Posture; Sleep
Type
journal article