Real-time high-resolution video stabilization using high-frame-rate jitter sensing

ROBOMECH Journal

article

Sushil Raut¹  Kohei Shimasaki¹  Sanjay Singh²  Takeshi Takaki³  Idaku Ishii³ 

[1] Digital Monozukuri (Manufacturing) Education Research Center, Hiroshima University;Cognitive Computing Group, Cyber Physical Systems Area, CSIR-Central Electronics Engineering Research Institute;Department of System Cybernetics, Hiroshima University

关键词: Digital image stabilization;    Feature point tracking;    Motion estimation;    High-speed real-time image stabilization;   

DOI  :  10.1186/s40648-019-0144-z

学科分类：社会科学、人文和艺术（综合）

来源: Springer

【 摘 要 】

In this study, the novel approach of real-time video stabilization system using a high-frame-rate (HFR) jitter sensing device is demonstrated to realize the computationally efficient technique of digital video stabilization for high-resolution image sequences. This system consists of a high-speed camera to extract and track feature points in gray-level $$512\times 496$$ image sequences at 1000 fps and a high-resolution CMOS camera to capture $$2048\times 2048$$ image sequences considering their hybridization to achieve real-time stabilization. The high-speed camera functions as a real-time HFR jitter sensing device to measure an apparent jitter movement of the system by considering two ways of computational acceleration; (1) feature point extraction with a parallel processing circuit module of the Harris corner detection and (2) corresponding hundreds of feature points at the current frame to those in the neighbor ranges at the previous frame on the assumption of small frame-to-frame displacement in high-speed vision. The proposed hybrid-camera system can digitally stabilize the $$2048\times 2048$$ images captured with the high-resolution CMOS camera by compensating the sensed jitter-displacement in real time for displaying to human eyes on a computer display. The experiments were conducted to demonstrate the effectiveness of hybrid-camera-based digital video stabilization such as (a) verification when the hybrid-camera system in the pan direction in front of a checkered pattern, (b) stabilization in video shooting a photographic pattern when the system moved with a mixed-displacement motion of jitter and constant low-velocity in the pan direction, and (c) stabilization in video shooting a real-world outdoor scene when an operator holding hand-held hybrid-camera module while walking on the stairs.

【 授权许可】

CC BY