吳家麟臺灣大學：資訊工程學研究所楊雅婷Yang, Ya-TingYa-TingYang2007-11-262018-07-052007-11-262018-07-052005http://ntur.lib.ntu.edu.tw//handle/246246/54114在視訊壓縮應用中，常因為頻寬的限制必需對於視訊資料在空間或是時間的解析度上有所犧牲。利用降低框速(frame rate)所節省的資料率(bitrate)來維持在空間解析度上的一定畫質，以便於之後利用影像在時間上的關聯性來重建完整的框速；此種節省資料率(bitrate)的方式遠比保留多張畫質不好的畫框(frame)來得有效率。框速轉換(Frame Rate Up-conversion)的應用不僅適用於視訊會議上的壓縮，同時對於慢動作播放特效的需求或是不同播放規格之間的轉換(ex: NTSC vs. PAL)也大有助益。本篇論文為了提昇生成視訊的畫質，提出了一個完整的實作流程，不僅在解碼器(decoder)端去分析視訊影像之內容，同時在編碼器(encoder)端也根據人類視覺系統(Human Vision System)模型動態調整壓縮張數，以大幅增進框速轉換(Frame Rate Up-conversion)後的整體視訊畫質。Frame rate up-conversion (FRUC) is a post-processing tool to convert the frame rate from a lower number to a higher one. It is a useful technique for a lot of practical applications, such as display format conversion, low bitrate video coding and slow motion playback. Unlike traditional approaches, such as frame repetition or linear frame interpolation, motion-compensated frame interpolation (MCFI) technique which takes block motion into account is regarded as a more efficient scheme. By considering the deficiencies in previous works, new criteria and coding schemes for improving motion derivation and interpolation processes are suggested. In addition, adaptive frame skip is fulfilled at the encoder side to maximize the power of MCFI in video coding applications so that the quality of interpolated frames is guaranteed. Experimental results show that our proposal indeed enhances the overall quality, both subjectively and objectively, of the frame rate up-converted video sequence.CHAPTER 1 INTRODUCTION 1 1.1 AN OVERVIEW OF FRAME RATE UP-CONVERSION 2 1.2 MOTIVATION 3 1.3 APPLICATION SCENARIOS OF FRAME RATE UP-CONVERSION (FRUC) 3 1.3.1 Format Conversion 3 1.3.2 Low Bitrate Video Coding 4 1.3.3 Special Effect of Slow Motion Playback 4 1.3.4 A Bit-allocation Policy of Scalable Video Coding 5 1.4 MOTION-COMPENSATED FRAME INTERPOLATION (MCFI) 6 1.5 CONTRIBUTIONS 7 1.6 THESIS ORGANIZATION 8 CHAPTER 2 RELATED WORK 9 2.1 RESAMPLING RATIO OF FRAME RATE CONVERSION 9 2.2 PRIOR WORKS ON FRAME INTERPOLATION 10 2.2.1 Conventional Approaches — Without Taking Motion into Account 10 2.2.2 Contemporary Approaches — With Taking Motion into Account 12 2.2.2.1 Motion Estimation 12 2.2.2.2 Analyzing Motion Information 17 2.2.2.3 Motion Compensated Interpolation 17 2.2.3 An alternative Approach — Fractal Coding 19 2.3 ENCODER-DEPENDENT MCFI 19 CHAPTER 3 SYSTEM FRAMEWORK 21 3.1 INTRODUCTION 21 3.2 OBTAINING MOTION VECTORS OF THE INTERPOLATED FRAME 22 3.3 OVERLAPPED BLOCK BI-DIRECTIONAL MOTION ESTIMATION 23 3.4 MOTION VECTOR SMOOTHING 27 3.5 ADAPTIVE OVERLAPPED BLOCK MOTION COMPENSATED INTERPOLATION 29 3.6 UNCOVERED AND OCCLUDED REGION 30 3.7 1:N UP-CONVERSION 32 3.8 SUMMARY 33 CHAPTER 4 INTEGRATION FRUC WITH MPEG VIDEO CODING 35 4.1 INTRODUCTION 35 4.2 MOTION VECTOR CLASSIFICATION 36 4.3 MULTIPLE REFERENCE FRAMES 38 4.4 ADAPTIVE FRAME SKIP IN THE ENCODER 39 4.5 STRICT BIND MCFI FRAMES WITH P FRAME 42 4.6 COMBINING MCFI SYSTEM WITH SR SYSTEM 43 4.7 SUMMARY 44 CHAPTER 5 EXPERIMENTAL RESULTS 45 5.1 EXPERIMENTAL CONDITION 45 5.2 PERFORMANCE EVALUATION 47 5.2.1 Comparison with Other Approaches 47 5.2.2 Complexity analysis of our proposal 57 5.2.3 Effectiveness of each functional block in the proposed scheme 59 5.2.4 Performance of adaptive frame skip 61 CHAPTER 6 CONCLUSIONS AND FUTURE WORK 67 6.1 CONCLUSIONS 67 6.2 FUTURE RESEARCH DIRECTIONS 68 BIBLIOGRAPHY 71 APPENDIX A ................................................................................................................. 751342452 bytesapplication/pdfen-US框速轉換移動補償畫框內插動態畫面省略Frame Rate Up-ConversionMotion Compensated Frame InterpolationAdaptive Frame Skipthesishttp://ntur.lib.ntu.edu.tw/bitstream/246246/54114/1/ntu-94-R92922003-1.pdf