Real-Time Human Movement Retrieval and Assessment With Kinect Sensor
Journal
IEEE Transactions on Cybernetics
Journal Volume
45
Journal Issue
4
Pages
742-753
Date Issued
2015
Author(s)
Abstract
The difficulty of vision-based posture estimation is greatly decreased with the aid of commercial depth camera, such as Microsoft Kinect. However, there is still much to do to bridge the results of human posture estimation and the understanding of human movements. Human movement assessment is an important technique for exercise learning in the field of healthcare. In this paper, we propose an action tutor system which enables the user to interactively retrieve a learning exemplar of the target action movement and to immediately acquire motion instructions while learning it in front of the Kinect. The proposed system is composed of two stages. In the retrieval stage, nonlinear time warping algorithms are designed to retrieve video segments similar to the query movement roughly performed by the user. In the learning stage, the user learns according to the selected video exemplar, and the motion assessment including both static and dynamic differences is presented to the user in a more effective and organized way, helping him/her to perform the action movement correctly. The experiments are conducted on the videos of ten action types, and the results show that the proposed human action descriptor is representative for action video retrieval and the tutor system can effectively help the user while learning action movements. ? 2013 IEEE.
Subjects
Feature extraction; human action; human skeleton; motion assessment; nonlinear time warping; video retrieval
SDGs
Other Subjects
Human actions; Human skeleton; motion assessment; Nonlinear time warping; Video retrieval; Feature extraction; actimetry; algorithm; automated pattern recognition; computer system; devices; human; motor activity; movement (physiology); physiology; procedures; reproducibility; sensitivity and specificity; transducer; video game; Actigraphy; Algorithms; Computer Systems; Humans; Motor Activity; Movement; Pattern Recognition, Automated; Reproducibility of Results; Sensitivity and Specificity; Transducers; Video Games
Type
journal article