洪一平臺灣大學：資訊工程學研究所王韻雯Wang, Yun-WenYun-WenWang2007-11-262018-07-052007-11-262018-07-052007http://ntur.lib.ntu.edu.tw//handle/246246/53606針對人臉辨識這個問題，本文提出一個從人臉二維影像中擷取人臉特徵方法。此方法即使在頭部轉動變化大時也能夠準確得到人臉特徵的位置。我們利用嵌入隱藏式馬可夫模型來塑造人臉模型，並利用塑造過程的中間產物—狀態分佈序列來擷取長方形的人臉特徵。利用單一嵌入隱藏式馬可夫模型，我們能夠對單一身份固定姿勢下的人臉進行臉部分割、擷取特徵的動作，當頭部轉動變化大時，我們使用人臉影像訓練出多個嵌入隱藏式馬可夫模型，使得我們的方法能夠準確取得 人臉特徵。針對人臉身份識別和人臉身份確認這兩個議題，我們為每一個使用者的每一個特徵建立其外觀子空間，進而利用樣板比對的方法估計特徵相似度。接著再使用Adaboost 演算法將每一個特徵訓練成弱分類器，並合併所有的弱分類器達到結合各特徵的效果。我們利用卡內基美隆大學提供的PIE 人臉資料庫、劍橋大學提供的ORL 人臉資料庫、以及我們實驗室自己拍攝的人臉資料庫上進行人臉辨識的實驗。經由與其他數個方法的比較，我們的方法均獲得較好的辨識率。實驗結果證實在頭部轉動變化大時，我們的方法依然能夠準確的取出人臉特徵，進而在人臉身份比對和人臉身份確認下有較高的準確度。We propose an algorithm for extracting facial features robustly from images for face recognition even under large pose variation. Rectangular facial features are retrieved via the by-products of an embedded Hidden Markov Model (HMM) which decodes an observed face image into a state sequence. While an HMM is able to segment images into features at a fixed pose, multiple HMMs are trained for each individual to robustly extract features under large pose variation. Using the extracted features of each individual, appearance models based on subspaces are constructed for face identification and verification. Then Adaboost is used for feature combination while each weak classifier compared the distance metric of one facial feature. The effectiveness of the proposed approach is validated through empirical studies against numerous methods using the CMU PIE, ORL and our lab’s database. Our experiments demonstrate that the proposed approach is able to extract facial features robustly, thereby rendering superior results in identification and superior performance in verification under large pose variation.1 Introduction . . . . . . . . . . . . . . . . . .. . . . . . . . 1 1.1 Overview of Face Recognition . . . . . . . . . . . . . . . . . . . . . 1 1.1.1 Face . . . . . . . . . . . . . . Identification . . . . . . . . . . . . . . . . . . . . . . . 2 1.1.2 Face Verification . . . . . . . . . . . . . . . . . . . . . . . . 3 1.2 Holistic Approach and Local Feature Approach . . . . . . . . . . . . 3 1.3 Proposed Method . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 1.4 Organization of the thesis . . . . . . . . . . . . . . . . . . . . . . . . 6 2 Relative Work . . . . . . . . . . . . . . . . . .. . . . . . . .7 2.1 Hidden Markov Model . . . . . . . . . . . . . . . . . . . . . . . . . 7 2.2 Embedded Hidden Markov Model . . . . . . . . . . . . . . . . . . . 9 3 Feature Extraction Under Pose Variation . . . . . . . . . . . . . . .12 3.1 Multiple Embedded HMMs . . . . . . . . . . . . . . . . . . . . . . . 12 3.2 Facial Feature Extraction and Subspace Construction . . . . . . . . . 13 3.3 Overview of Training Stage . . . . . . . . . . . . . . . . . . . . . . . 14 3.4 Overview of Testing Stage . . . . . . . . . . . . . . . . . . . . . . . 17 4 Face Recognition – Combination of Boosted Features . . . . . . . . . . . 18 4.1 Feature Combination Methods . . . . . . . . . . . . . . . . . . . . . 18 4.2 Distance Measure with Equal Sum . . . . . . . . . . . . . . . . . . . 20 4.3 Boosted Algorithm . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 4.4 Face Identification and Face Verification . . . . . . . . . . . . . . . . 21 5 Experiments and Results . . . . . . . . . . . . . . . . . .. 23 5.1 Experimental Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 5.1.1 PIE Database . . . . . . . . . . . . . . . . . . . . . . . . . . 24 5.1.2 ORL Database . . . . . . . . . . . . . . . . . . . . . . . . . 25 5.1.3 Our Database . . . . . . . . . . . . . . . . . . . . . . . . . . 25 5.2 Experimental Results and Comparison with other methods . . . . . . 26 5.2.1 PIE Database . . . . . . . . . . . . . . . . . . . . . . . . . . 30 5.2.2 ORL Database . . . . . . . . . . . . . . . . . . . . . . . . . 33 5.2.3 Our Database . . . . . . . . . . . . . . . . . . . . . . . . . . 36 5.2.4 Discussion . . . . . . . . . . . . . . . . . . . . . . . . . . . 38 6 Conclusion and Future Work . . . . . . . . . . . . . . . . . .. . .43 6.1 Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43 6.2 Future Work . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44 Bibliography . . . . . . . . . . . . . . . . . .. . . . . . . 451679826 bytesapplication/pdfen-US人臉身份比對人臉身份確認基於特徵的人臉辨識人臉特徵合併Face IdentificationFace VerificationComponent-based Face RecognitionFacial Feature Combinationthesishttp://ntur.lib.ntu.edu.tw/bitstream/246246/53606/1/ntu-96-R94922035-1.pdf