https://scholars.lib.ntu.edu.tw/handle/123456789/118689
標題: | 階段式即時眼睛特徵擷取及其應用 Real-time Three-stage Eye Feature Extraction and Its Applications |
作者: | 周建男 Chou, Chien-Nan |
關鍵字: | 眼睛特徵擷取;人機互動;Eye Feature Extraction;Human-Computer Interaction | 公開日期: | 2009 | 摘要: | 近年來人機互動模式的多元化發展,提供給使用者許多與以往不同的互動體驗。眼睛是人類接收與傳達資訊的重要感官之一,我們可以藉由觀察眼睛的變化來賦予使用者更貼近其需求的互動方式。本篇論文提出一個可即時偵測並追蹤使用者眼睛特徵點的方法,配合現有的低成本非紅外線視訊攝影機便可準確得到這些特徵點的位置,其中的關鍵技術在於眼睛位於人臉的位置變化差異性不大,因此能透過我們提出基於人臉結構的三階段式偵測法加快搜尋速度並提升穩定性。另一方面,由於系統使用一般的可見光視訊攝影機,不同於紅外光攝影機容易受到環境光的影響,室內、外皆可保有高度的準確性,進而確保此方法在現實生活中的簡易性與可行性。時,為了驗證系統的高效率與準確度,我們提出基於這些特徵點資訊的三種不同類型應用方式:一是計算虹膜中心點與眼角的距離變化判斷眼球的移動方式,配合臉部表情資訊可做為影片自動剪輯的參考依據。二是藉由計算使用者與視訊攝影機之間的相對位置來提供使用者類3D的顯示畫面。三是利用相同資訊藉由校正方法找出使用者注視在螢幕上的位置。 The diversification of the development in human-computer interaction provides users more and more interactive experience which is totally different than usual. As one of the sense organs that serve as a proxy for human attention and intention, we can give users better interaction closer to their need by observing the change of the eyes. This paper proposes a low-cost system, using a non-infrared off-the-shelf webcam, which can extract and track the eye features on the face. For getting a real-time and robust result, we propose a three-stage method based on the low variety in the geometry of faces so that these eye features just need to be searched in the small eye rectangle derived from that. Also, our system works without IR lights which are easily affected by environmental ambient light, and it ensures getting high accuracy outdoors as well as indoors and being easy to set up in real life.eanwhile, we propose three different kinds of applications based on our eye feature tracking system in order to validate the efficiency and potentiality. First, we determine the eye movement by calculating the distance between the inner eye corner and the iris center, which will be one of the cues including facial expression for automatic video summarization. Second, we provide a view-dependent display to single user by tracking the relative location between his/her eyes and the camera. Finally, we estimate the point-of-gaze on the screen after calibrating the relation between these features and the sample dots shown on the screen. |
URI: | http://ntur.lib.ntu.edu.tw//handle/246246/185414 |
顯示於: | 資訊工程學系 |
檔案 | 描述 | 大小 | 格式 | |
---|---|---|---|---|
ntu-98-R96922021-1.pdf | 23.32 kB | Adobe PDF | 檢視/開啟 |
在 IR 系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。