Exploring Finger Touch Interface for Enhancing Immersive Multimedia Interactions

Immersive multimedia systems aim to provide users with immersive experiences, and usually adopt touch interface for intuitive and learnable control. However, the layout of touch widgets is usually arranged without considering the spatial relationship between the device and the human body, yielding some widgets hard to be accessed. Therefore, the availability of finger input is sometimes restricted. Furthermore, contemporary touch interface digitizes fingers as simplistic two-dimensional input, offering limited expressivity of finger input. The insufficiencies might degrade the immersivity during multimedia interactions. In this dissertation, we aim to enhance finger touch by considering the ergonomic factors. The additional degree of freedom of our sophisticated body can be captured and formed into extra input expressivity. By understanding the anatomy and motor capability of our body, we can improve the layout design for more reachable interfaces. Also, the additional degree of freedom of our sophisticated body can be captured and formed into extra input expressivity. Different touch user interfaces are addressed, including mobile, wearable, and on-body interfaces. We propose the design guidelines and prototype systems for the addressed finger touch interfaces. Our research results not only benefit the finger touch interface, but also help future designers to design better multimedia system using finger touch input.