Continuous and Discontinuous Warping-based Video Motion Correction
Date Issued
2014
Date
2014
Author(s)
Lee, Ken-Yi
Abstract
Videos have lots of fun and become so popular because of the richness of
its content, especially the motions. There are varieties of techniques and applications
designed for processing videos, and one of these techniques can be
called as video motion correction. Video motion correction means to process
videos by changing, removing or preserving motion in a video to create some
applications and effects and get better qualities and user experience.
Most of video motion correction applications follow a three-step framework:
motion estimation, motion compensation and image composition. Depending
on different requirements or goals of applications, motion estimation
can be categorized into dense and sparse motion estimation. Motion compensation
can be divided into object and camera motion compensation. Image
composition can also be divided into continuous and discontinuous warpingbased
image composition. Image composition is highly related to the motion
compensation step. We should also consider the qualities of the composited
result including image distortion, image completeness and information loss
while compensating motion. And the chosen model and method used in image
composition will affect the results of motion compensation.
Several applications can be created based on the video motion correction
framework, such as video stabilization, cinemagraph creation, and video
resizing. For video stabilization, we propose a method to directly stabilize
a video without explicitly estimating camera motion, thus assuming neither
motion models nor dominant motion. The method first extracts robust feature
trajectories from the input video. Optimization is then performed to find a set
of transformations to smooth out these trajectories and stabilize the video. In
addition, the optimization also considers quality of the stabilized video and
selects a video with not only smooth camera motion but also less unfilled area
after stabilization. Experiments show that our method can deal with complicated
videos containing near, large and multiple moving objects. As to cinemagraph
creation, we propose a system to assist users on creating cinemagraphs
from videos with ease. The proposed system relieves users’ burdens
by only asking users to select a frame as the reference frame and draw a rough
mask to identify the region where motion will be preserve. With these simple
inputs, the proposed system automatically produces seamless cinemagraphs
by using motion estimation and image warping. Experiments show that our
method can produce more visually pleasing results than the popular masking
methods. Finally, we propose a layer-based image composition method for
stereoscopic image resizing which can also be considered as two-frame video
resizing. While resizing, we utilize a novel method to preserve disparities
which can be considered as object motion in two-frame video resizing. This
proposed hybrid layer-based method is also a discontinuous warping method
which can be used in video motion correction applications with better results.
And we also extend it to multi-frame video resizing.
We propose different methods in different applications of video motion
correction based on the three-step framework and get better results than other
common methods. We believe that these methods can also be applied on other
video motion correction applications with the similar way.
Subjects
動作
影片處理
Type
thesis
File(s)![Thumbnail Image]()
Loading...
Name
ntu-103-D96922020-1.pdf
Size
23.32 KB
Format
Adobe PDF
Checksum
(MD5):139e205ea38bd1da3fd84a557f4e1b7f