Coherent Texture Synthesis for Photograph Relighting and Texture Transfer

In this thesis, we present a texture synthesis method for realistic rendering without acquiring the actual reflectance properties. The method is based on the observation that many objects have texture repeatedly laid on different locations of their surface. These samples form a pretty sparse set of BTFs. Our goal is to extract the underlying texture from photographs of the object, and to transfer the texture to other objects under different illuminations. This method is very simple and provides pseudo-BTFs reflectance, using texture synthesis approaches.
The input data is acquired directly from a few of photographs. These photographs contain appearances of the object with different lighting directions at a fixed viewpoint. We use Photometric Stereo to estimate the normal map and the unshaded image in preprocessing. Then, different texture points (texels) are recognized by their pixel values with neighborhood matching, using segmentation and labeling. Therefore, we can transfer the texture to another object and render it under different illumination conditions using these clustered texels.