Frame Error Concealment Using Pixel Correlation in Overlapped Motion Compensation Regions

ETRI Journal

关键词: video restoration;    whole frame loss;    motion estimation;    Frame error concealment;   

Others  :  1185849
DOI  :  10.4218/etrij.09.0108.0323

【 摘 要 】

In low bit-rate video transmission, the payload of a single packet can often contain a whole coded frame due to the high compression ratio in both spatial and temporal domains of most modern video coders. Thus, the loss of a single packet not only causes the loss of a whole frame, but also produces error propagation into subsequent frames. In this paper, we propose a novel whole frame error concealment algorithm which reconstructs the first of the subsequent frames instead of the current lost frame to suppress the effects of error propagation. In the proposed algorithm, we impose a constraint which uses side match distortion (SMD) and overlapped region difference (ORD) to estimate motion vectors between the target reconstructed frame and its reference frame. SMD measures the spatial smoothness connection between a block and its neighboring blocks. ORD is defined as the difference between the correlated pixels which are predicted from one reference pixel. Experimental results show that the proposed algorithm effectively suppresses error propagation and significantly outperforms other conventional techniques in terms of both peak signal-to-noise ratio performance and subjective visual quality.

   

【 参考文献 】

• [1]J. Huang et al., "Performance of a Mixed-Traffic CDMA2000 Wireless Network with Scalable Streaming Video," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 10, Oct. 2003, pp. 973-981.
• [2]M. Naghshineh and M. Willebeek-LeMair, "End-to-End QoS Provisioning in Multimedia Wireless/Mobile Networks Using an Adaptive Framework," IEEE Commun. Mag., vol. 35, no. 11, Nov. 1997, pp. 72-81.
• [3]Y. Wang, J. Ostermann, and Y.Q. Zhang, Video Processing and Communication., Signal Processing Series, NJ: Prentice Hall, 2002.
• [4]Y. Wang and Q.-F. Zhu, "Error Control and Concealment for Video Communication: A Review," Proc. IEEE, vol. 86, no. 5, May 1998, pp. 974-997.
• [5]W.-Y. Kung, C.-S. Kim, and C.-C.J. Kuo, "Spatial and Temporal Error Concealment Techniques for Video Transmission over Noisy Channels," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 7, July 2006, pp. 789-802.
• [6]W. Zeng and B. Liu, "Geometric-Structure-Based Error Concealment with Novel Applications in Block-Based Low-Bit-Rate Coding," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 4, June 1999, pp. 648-665.
• [7]J. Park et al., "Content-Based Adaptive Spatio-Temporal Methods for MPEG-Repair," IEEE Trans. Image Process., vol. 13, no. 8, Aug. 2004, pp. 1066-1077.
• [8]S.-H. Lee, D.-H. Choi, and C.-S. Hwang, "Error Concealment Using Affine Transform for H.263 Coded Video Transmissions," Electron. Lett., vol. 37, no. 4, Feb. 2001, pp. 218-220.
• [9]M. Friebe and A. Kaup, "Fading Techniques for Error Concealment in Block-Based Video Decoding Systems," IEEE Trans. Broadcast., vol. 53, no. 1, Mar. 2007, pp. 286-296.
• [10]L. Tang, "Combined and Iterative Form of Spatial and Temporal Error Concealment for Video Signals," IEEE Trans. Broadcast., vol. 52, no. 2, Sept. 2006, pp. 356-361.
• [11]J. Lu, "Signal Processing for Internet Video Streaming: A Review," Proc. of SPIE Image Video Comm. Process., vol. 3974, Jan. 2000, pp. 246-259.
• [12]S.K. Bandyopadhyay et al., "Frame Loss Error Concealment for H.264/AVC," 73rd MPEG Meeting and 16th JVT Meeting, Joint Video Team of ISO/IEC MPEG and ITU-T VCEG, JVT-P072, July 2005.
• [13]P. Baccichet et al., "Frame Concealment for H.264/AVC Decoders," IEEE Trans. Consumer Electron., vol. 51, no. 1, Feb. 2005, pp. 227-233.
• [14]Y. Wang, Q.-F. Zhu, and L. Shaw, "Maximally Smooth Image Recovery in Transform Coding," IEEE Trans. Commun., vol. 41, no. 10, Oct. 1993, pp. 1544-1551.
• [15]K. Suhring, Ed., JM 12. 2 Reference Software. [Online] Available: http://iphome.hhi.de/suehring/tml/download/
• [16]M. Wien, "Variable Block-Size Transforms for H.264/AVC," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, July 2003, pp. 604-613.
• [17]Z. He, J. Cai, and C.W. Chen, "Joint Source Channel Rate-Distortion Analysis for Adaptive Mode Selection and Rate Control in Wireless Video Coding," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 6, June 2002, pp. 511-523.
• [18]S. Belfiore et al., "Concealment of Whole-Frame Losses for Wireless Low Bit-Rate Video Based on Multiframe Optical Flow Estimation," IEEE Trans. Multimedia, vol. 7, no. 2, Apr. 2005, pp. 316-329.