Moving object detection in the H.264/AVC compressed domain

APSIPA Transactions on Signal and Information Processing

Peter Amon¹  André Kaup²  Andreas Hutter¹  Marcus Laumer² 

[1] Siemens Corporate Technology;Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU)

关键词: Compressed domain;    H.264/AVC;    Segmentation;    Syntax elements;    Object detection;   

DOI  :  10.1017/ATSIP.2016.18

学科分类：计算机科学（综合）

来源: Cambridge University Press

【 摘 要 】

This paper presents a moving object detection algorithm for H.264/AVC video streams that is applied in the compressed domain. The method is able to extract and analyze several syntax elements from any H.264/AVC-compliant bit stream. The number of analyzed syntax elements depends on the mode in which the method operates. The algorithm is able to perform either a spatiotemporal analysis in a single step or a two-step analysis that starts with a spatial analysis of each frame, followed by a temporal analysis of several subsequent frames. Thereby, in each mode either only (sub-)macroblock types and partition modes or, additionally, quantization parameters are analyzed. The evaluation of these syntax elements enables the algorithm to determine a “weight” for each 4×4 block of pixels that indicates the level of motion within this block. A final segmentation after creating these weights segments each frame to foreground and background and hence indicates the positions and sizes of all moving objects. Our experiments show that the algorithm is able to efficiently detect moving objects in the compressed domain and that it is configurable to process a large number of parallel bit streams in real time.

【 授权许可】

Unknown