陳炳宇臺灣大學:資訊工程學研究所黃惟婷Huang, Wei-TingWei-TingHuang2010-06-022018-07-052010-06-022018-07-052008U0001-2207200812335300http://ntur.lib.ntu.edu.tw//handle/246246/184967一般徒手拍攝的影片之中,或多或少會受外力的干擾而造成影片的不規則晃動,對於日益成熟的影片穩定系統雖有不錯的成果,但由於其適用的情況在於影片主題佔據畫面部分較小的情況之下方可得到較完美的結果。換言之,前景的區域大時,或是相對於前景,背景的場景不夠完整時,可能會造成影片在對齊的過程之中參考區域的誤判,造成影片的不連續。 本篇論文針對此情況提出一新的修正技術,目的於確保使用者的拍攝主體頗大時,或是背景常景較不完整時,經過本系統作些適當的修正後也能有其穩定畫面的效果。本系統運用optical flow計算出連續兩個影格之間每個像素相對移動的垂直及水平方向變化量,進而以k-means clustering方式適當地分割出影格畫面中不同移動型態的區塊,繼而針對適切的區塊進行攝影路徑的擷取方可得到較為正確的路徑。藉由取得的攝影路徑,本系統利用些許直線來代替原本的攝影路定以達到畫面的平穩性。本系統針對transform matrix運用了QR decomposition 以幫助我們將位移以及角度旋轉問題分開進行改善,同時影格盡可能保持原有的大小比例。最後以內插第一對影格與最後一對影格間的角度變化以達到畫面轉動的連續性以及其穩定性。由以上的步驟,即可得出一段看起來較為舒適及穩定的影片,甚至像是利用腳架拍攝出來的結果。This thesis presents an approach to post-processing casually captured videos to improvepparent camera movement. A lot of home videos have some problems about the artifactsike hand shaking when capturing without tripod. Video stabilization is an importantechnique to solve this problem. However, the technique does not work very well in someituations such as the larger foreground, incomplete background or other situations,etc. Inhis thesis,we propose a novel method of video stabilization to overcome the situations withhe larger foreground, or the feature points amount of the background is less then of foregroundnd some camera motion such as zoom in and zoom out.his system applies a method, optical flow, to estimate the motion vector of all pixelsetween each pair frames. Then, we use K-means clustering to group the similar motionectors of each frame. To select an adequate segment to estimate the global camera pathf video could obtain one more correct global camera path. After motion vector segmentationnd camera path estimation, we could stitch all of video frames to get a panoramand estimate the range of moving object we can recover by neighbor frames. Based on theackground panorama and moving object recovered range, we could find some new pathshich would lose information less. After the above operations, a full-stabilized video coulde achieved.1 Introduction 1.1 Motivation . . . . . . . . . 2.2 Problem Statement . . . . . . 4.3 Thesis Organization and Overview . . . . . . . . . . . . . 5 Related work . . . . . . . . . . 9.1 Moving Object Detection . . . .9.2 Motion Path Estimation . . . . 10.3 Video Completion . . . . . . . 14 Moving Object Detection 17.1 Motion Segmentation . . . . .. 17.2 Background Detection . . . . . 20 Motion Path Estimation 23.1 Global Path Estimation . . . . 23.2 Motion Path Fitting . . . . . .24 Video Completion 31.1 Dynamic Region Completion . . 31.2 Static Region Completion . . . 34 Result 37 Conclusion and Future Work 45ibliography 46application/pdf10281127 bytesapplication/pdfen-US影片穩定影片修復手震移動物體偵測前景背景分離home videomoving object detectionoptical flowpolylinevideo ROIbackground segmentation考慮具有大範圍移動物體的晃動影片之穩定與修復Full-Frame Video Stabilization with Large Moving Objectthesishttp://ntur.lib.ntu.edu.tw/bitstream/246246/184967/1/ntu-97-R95922037-1.pdf