Census-based vision for auditory depth image and speech navigation of visually impaired users
Journal
IEEE Transactions on Consumer Electronics
Journal Volume
57
Journal Issue
4
Pages
1883 - 1890
Date Issued
2011-11
Author(s)
Y. Y. Wang
Abstract
In neuroscience and psychology, visual imagery is the subjective experience of seeing in the absence of visual stimulation. Someone may experience touch or sound as a result of visual imagery. In this paper, a new visual image aid which can provide a different way to visualize the image for visually impaired users is proposed. It is done by applying the depth image to an Image-To-Sound Mapping (ITSM) system. The proposed algorithm utilizes a sparse Census transform (SCT) and color segmentation to obtain an illuminationinvariant depth image. The depth image is applied to the ITSM system and then a clear and simple sound output is obtained for constructing a mental image. Moreover, the reliable three-dimensional (3D) data of close objects are extracted and interpreted as a semantic speech output. Experimental results show that visually impaired users can perceive the image easily and without training by adding verbal description to the visually image aid. In good and poor illuminated environments, the performance is 82% and 80% respectively. The performance of our proposed systems was not influenced by various lighting. All subjects also commented that the systems would be potentially useful 1 .
Type
journal article