Single and multi-frame video quality enhancement

Contrast enhancement;Artifact reduction;Motion estimation;Energy minimization

Arici, Tarik ; Electrical and Computer Engineering

University:Georgia Institute of Technology

Department:Electrical and Computer Engineering

关键词: Contrast enhancement;    Artifact reduction;    Motion estimation;    Energy minimization;   

Others  :  https://smartech.gatech.edu/bitstream/1853/29722/1/arici_tarik_200908_phd.pdf

美国|英语

来源: SMARTech Repository

【 摘 要 】

With the advance of the LCD technology, video quality is becoming increasingly important. In this thesis, we develop hardware-friendly low-complexity enhancement algorithms. Video quality enhancement methods can be classified into two main categories. Single frame methods are the first category. These methods have generally low computational complexity. Multi-frame methods combine information from more than one frame and require the motion information of objects in the scene to do so.We first concentrate on the contrast-enhancement problem by using both global (frame-wise) and local information derived from the image. We use the image histogram and present a regularization-based histogram modification method to avoid problems that are often created by histogram equalization. Next, we design a compression artifact reduction algorithm that reduces ringing artifacts, which is disturbing especially on large displays. Furthermore, to remove the blurriness in the original video we present a non-iterative diffusion-based sharpening algorithm, which enhances edges in a ringing-aware fashion. The diffusion-based technique works on gradient approximations in a neighborhood individually. This gives more freedom compared to modulating the high-pass filter output that is used to sharpen the edges.Motion estimation enables applications such as motion-compensated noise reduction, frame-rate conversion, de-interlacing, compression, and super-resolution.Motion estimation is an ill-posed problem and therefore requires the use of prior knowledge on motion of objects. Objects have inertia and are usually larger then pixels or a block of pixels in size, which creates spatio-temporal correlation. We design a method that uses temporal redundancy to improve motion-vector search by choosing bias vectors from the previous frame and adaptively penalizes deviations from the bias vectors. This increases the robustness of the motion-vector search. The spatial correlation is more reliable because temporal correlation is difficult to use when the objects move fast or accelerate in time, or have small sizes. Spatial smoothness is not valid across motion boundaries. We investigate using energy minimization for motion estimation and incorporate the spatial smoothness prior into the energy. By formulating the energy minimization iterations for each motion vector as the primal problem, we show that the dual problem is motion segmentation for that specific motion vector.