PLSOH: An Augmented Reality Based Piano Learning System Using Optical See-Through Head Mounted Display
Date Issued
2015
Date
2015
Author(s)
Chen, Nien-Chi
Abstract
Music learning for beginners is challenging, especially when learning an intricate instrument such as a piano. The most difficult part for beginners at its preliminary stage should be developing the reading ability of sheet music. Once the music score is complicated and confused, beginners may lose self-confidence easily and simply for-get the instructor’s comments from lessons that they have learned before. Therefore, we propose an alternative way to overcome these frustrating problems. Thanks to the well-developed technology of augmented reality, we can create a perceptive learning environment for beginners. By using an optical see through head-mounted display, beginners can see the additional helpful virtual information superimposed on the piano keys. Moreover, there are two modes, such as practice and tutorial videos mode, for users to select by their choice. Most important of all, our system can be applied to not only electronic piano but also traditional piano. The reason is that we use a depth camera to detect whether user presses the correct piano keys by discriminating the depth change of piano keys. The markers in the system is purposely designed for not only feature detection but also improve the memorability of user. Overall, the small-scale user test shows that the PLSOH system can successfully assist beginners who have no prior musical knowledge with 22% accuracy improvement in average. The concept of the system is expected it will have future usage in music education and entertainment in the future.
Subjects
Augmented Reality
Virtual Reality
Depth Image
Optical See Through Head-mounted Display
Music Education
Type
thesis
File(s)![Thumbnail Image]()
Loading...
Name
ntu-104-R02922076-1.pdf
Size
23.32 KB
Format
Adobe PDF
Checksum
(MD5):620d56a0a6004ecfa0d5bd6c04fceabd