https://scholars.lib.ntu.edu.tw/handle/123456789/502358
Title: | Occlusion-aware video temporal consistency | Authors: | Yao, C.-H. Chang, C.-Y. SHAO-YI CHIEN |
Keywords: | Color transfer; Occlusion; Temporal consistency; Video processing | Issue Date: | 2017 | Start page/Pages: | 777-785 | Source: | MM 2017 - Proceedings of the 2017 ACM Multimedia Conference | Abstract: | Image color editing techniques such as color transfer, HDR tone mapping, dehazing, and white balance have been widely used and investigated in recent decades. However, naively employing them to videos frame-by-frame often leads to flickering or color inconsistency. To solve it generally, earlier methods rely on temporal filtering or warping from the previous frame, but they still fail in the cases of occlusion and produce blurry results. We introduce a new framework for these challenges: (1) We develop an online keyframe strategy to keep track of the dynamic objects, where more temporal information can be acquired than a single previous frame. (2) To preserve image details, local color affine model is employed. The main concept of this post-processing step is to capture the color transformation from editing algorithms and maintain the detail structures of the raw image simultaneously. Practically, our approach takes a raw video and its per-frame processed version, and generates a temporally consistent output. In addition, we propose a video quality metric to evaluate temporal coherence. Extensive experiments and subjective test are done to show the superiority of the proposed framework with respect to color fidelity, detail preservation, and temporal consistency. © 2017 ACM. |
URI: | https://scholars.lib.ntu.edu.tw/handle/123456789/502358 https://www.scopus.com/inward/record.uri?eid=2-s2.0-85035203092&doi=10.1145%2f3123266.3123363&partnerID=40&md5=036a27cd3ad3c34591b9d416ca4f10ff |
DOI: | 10.1145/3123266.3123363 | SDG/Keyword: | Color; Demulsification; Video signal processing; Color transfers; Color transformation; Detail preservation; Occlusion; Temporal consistency; Temporal information; Video processing; Video quality metric; Color image processing |
Appears in Collections: | 電機工程學系 |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.