Weighted local intensity fusion method for variational optical flow estimation

PATTERN RECOGNITION

卷:50

Article

Tu, Zhigang¹  Poppe, Ronald¹  Veltkamp, Remco C.¹ 

[1] Univ Utrecht, Dept Informat & Comp Sci, Utrecht, Netherlands

关键词: Optical flow;    Weighted local intensity fusion;    Large displacement;    Smoothness parameter estimation;    Corrected weighted median filter;   

DOI  :  10.1016/j.patcog.2015.09.002

来源: Elsevier

【 摘 要 】

Estimating a dense motion field of successive video frames is a fundamental problem in image processing. The multi-scale variational optical flow method is a critical technique that addresses this issue. Despite the considerable progress over the past decades, there are still some challenges such as dealing with large displacements and estimating the smoothness parameter. We present a local intensity fusion (LIF) method to tackle these difficulties. By evaluating the local interpolation error in terms of L1 block match on the corresponding set of images, we fuse flow proposals which are obtained from different methods and from different parameter settings integrally under a unified LIF. This approach has two benefits: (1) the incorporated matching information is helpful to recover large displacements; and (2) the obtained optimal fusion solution gives a tradeoff between the data term and the smoothness term. In addition, a selective gradient based weight is introduced to improve the performance of the LIF. Finally, we propose a corrected weighted median filter (CWMF), which applies the motion information to correct errors of the color distance weight to denoise the intermediate flow fields during optimization. Experiments demonstrate the effectiveness of our method. (C) 2015 Elsevier Ltd. All rights reserved.

【 授权许可】

Free