https://scholars.lib.ntu.edu.tw/handle/123456789/502358
標題: | Occlusion-aware video temporal consistency | 作者: | Yao, C.-H. Chang, C.-Y. SHAO-YI CHIEN |
關鍵字: | Color transfer; Occlusion; Temporal consistency; Video processing | 公開日期: | 2017 | 起(迄)頁: | 777-785 | 來源出版物: | MM 2017 - Proceedings of the 2017 ACM Multimedia Conference | 摘要: | Image color editing techniques such as color transfer, HDR tone mapping, dehazing, and white balance have been widely used and investigated in recent decades. However, naively employing them to videos frame-by-frame often leads to flickering or color inconsistency. To solve it generally, earlier methods rely on temporal filtering or warping from the previous frame, but they still fail in the cases of occlusion and produce blurry results. We introduce a new framework for these challenges: (1) We develop an online keyframe strategy to keep track of the dynamic objects, where more temporal information can be acquired than a single previous frame. (2) To preserve image details, local color affine model is employed. The main concept of this post-processing step is to capture the color transformation from editing algorithms and maintain the detail structures of the raw image simultaneously. Practically, our approach takes a raw video and its per-frame processed version, and generates a temporally consistent output. In addition, we propose a video quality metric to evaluate temporal coherence. Extensive experiments and subjective test are done to show the superiority of the proposed framework with respect to color fidelity, detail preservation, and temporal consistency. © 2017 ACM. |
URI: | https://scholars.lib.ntu.edu.tw/handle/123456789/502358 https://www.scopus.com/inward/record.uri?eid=2-s2.0-85035203092&doi=10.1145%2f3123266.3123363&partnerID=40&md5=036a27cd3ad3c34591b9d416ca4f10ff |
DOI: | 10.1145/3123266.3123363 | SDG/關鍵字: | Color; Demulsification; Video signal processing; Color transfers; Color transformation; Detail preservation; Occlusion; Temporal consistency; Temporal information; Video processing; Video quality metric; Color image processing |
顯示於: | 電機工程學系 |
在 IR 系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。