Stable stitching method for stereoscopic panoramic video

CAAI Transactions on Intelligence Technology

article

Zhuo Tan¹  Shenghao Zhang¹  Ronggang Wang¹ 

[1] School of Electronic and Computer Engineering, Peking University Shenzhen Graduate School

关键词: feature extraction;    image segmentation;    video signal processing;    image sensors;    stereo image processing;    image matching;    virtual reality;    cameras;    image sequences;    optical flow field;    previous frame;    generated video;    temporal flicker;    authors;    ODS;    stereoscopic panorama;    eyes;    final panorama;    stable video;    final output videos;    pleasant experience;    impressive stereoscopic viewing experience;    stable stitching method;    stereoscopic panoramic video;    stable method;    omnidirectional stereo format;    traditional image stitching method;    monocular panorama;    left-eye;    right-eye panorama;    B6135 Optical;    image and video signal processing;    C5260B Computer vision and image processing techniques;    C5260D Video signal processing;   

DOI  :  10.1049/trit.2018.0002

学科分类：数学（综合）

来源: Wiley

【 摘 要 】

This paper proposes a stable method of generating a stereoscopic panoramic video with the omnidirectional stereo (ODS) format. Different from the traditional image stitching method which can only be applied to generate a monocular panorama, we adopt an optical flow-based blending method to create two panoramas for binocular vision. In addition, traditional image stitching methods based on seam-finding tend to cause the problem of temporal flicker. We address this problem by restricting the optical flow field of the new frame with its previous frame's optical flow field. Thus, the generated video is stable and out of temporal flicker. There are four key operations in our approach. First, we adopt the ODS format which is the basis of stereoscopic panorama. Second, we do effective exposure compensation, making the brightness of the two eyes' panoramas consistent. Third, we employ an optical flow-based blending method to synthesis the final panorama effectively. Fourth, we take the previous frame's optical flow field as the restriction of the present frame's optical flow field to acquire a stable video. The final output videos can deliver a pleasant and impressive stereoscopic viewing experience to the audience when the audience watches the videos in the virtual reality headset.

【 授权许可】

CC BY|CC BY-ND|CC BY-NC|CC BY-NC-ND