Disparity-Guided Light Field Video Synthesis with Temporal Consistency
Journal
Proceedings - 5th International Conference on Multimedia Information Processing and Retrieval, MIPR 2022
ISBN
9781665495486
Date Issued
2022-01-01
Author(s)
Abstract
Light field has great applications in AR/VR. It is particu-larly usefulfor resolving the vergence-accommodation con-flict (VAC) and creating correct depth cues for AR/VR dis-plays. However, the source data, especially light field video, are not widely available yet. To resolve the scarcity is-sue, one may resort to data such as stereo image sequences that are commonly available. In this paper, we propose an end-to-end deep learning framework for synthesizing light field sequences from stereo image sequences. Our frame-work consists of a disparity estimation network, a guided synthesis network, and a refinement network and is able to resolve the flickering issue caused by temporal incon-sistency, an artifact that is commonly seen in synthesized light field videos. Our experimental results are quantitatively and qualitatively better than the results of existing light field synthesis algorithms that were originally developed for static light fields.
Type
conference paper