Light-field Editing Using Patch-based Synthesis
Date Issued
2014
Date
2014
Author(s)
Chen, Ke-Wei
Abstract
We present an approach to light-field editing using patch-based method. We start from
the light-field completion problem, and then apply our method to light-field retargeting
and light-field reshuffling. In our work, we deal with light-field data at multi-view level
rather than raw data level because raw data varies with different light-field cameras.
Given a 4D light-field data, user specifies an object to be removed in a specific view, and
then we transfer the contour of this region to all the other view. After obtaining the 4D
region, we fill the 4D region based on patch-based synthesis. Compared to traditional 2D
image completion by patch-based method, we extend 2D PatchMatch algorithm to 4D
light-field PatchMatch. Our method aims to find the nearest neighbor field by measuring
distances between 4D patches. In other words, we synthesize 4D light-field instead of
independently synthesizing each 2D image. Besides, in order to retain spatial and angular
consistency when we synthesizing target light-field, we introduce the depth map to help
us finding similar patch. We also leverage depth maps to retain view consistency based
on the concept of epipolar plane image (EPI). In our method, we further define a patch
distance function based on color, depth map and EPI, and use the patch distance function
to measure patch similarity. This framework is applied to light-field retargeting and
reshuffling problem based on bidirectional similarity. To our knowledge, it is a first try
on light-field editing. In summary, we propose a method to edit light-field by measuring
4D patch similarity and it is not necessary to have a good depth map. In our experiment,
it works well even if we have only a rough depth maps.
Subjects
光場相機
光場影像
影像修補
影像重組
影像編輯
Type
thesis
File(s)![Thumbnail Image]()
Loading...
Name
ntu-103-R01922043-1.pdf
Size
23.32 KB
Format
Adobe PDF
Checksum
(MD5):0519959087a0ca9c2481eae689612fe6