MH-Net: A Learnable Multi-Hypothesis Network for Compressed Video Sensing

IEEE Access

Yao Zhang¹  Fei Ding¹  Chao Zhou¹  Can Chen¹  Dengyin Zhang² 

[1] College of Telecommunications and Information Engineering, Nanjing University of Posts and Telecommunications, Nanjing, China;Jiangsu Key Laboratory of Broadband Wireless Communication and Internet of Things, Nanjing University of Posts and Telecommunications, Nanjing, China;

关键词: Compressed sensing (CS);    compressed video sensing (CVS);    multi-hypothesis (MH) prediction;    neural networks (NNs);    signal reconstruction;    video signal processing;   

DOI  :  10.1109/ACCESS.2019.2954140

来源: DOAJ

【 摘 要 】

This paper establishes a novel recovery network called MH-Net-a framework for compressed video sensing (CVS) based on recently emerging deep neural networks (DNNs) techniques. MH-Net exploits temporal correlation between frames in the form of multi-hypothesis (MH) prediction, and learns a high-dimensional domain which is more robust for prediction generation. After the MH prediction, a special residual network is used in MH-Net to reconstruct the residuals between the MH prediction and the desired frame from their measurements. The final reconstruction is derived by adding the reconstructed residuals to the MH prediction. Unlike the block-wise reconstruction in existing DNN-based CS architecture, MH-Net builds a mapping from block measurements to a complete frame reconstruction, leading to better reconstruction quality. Benefitting from the DNN's nature, the forward propagation of MH-Net is extremely fast, making it suitable for real-time applications. Experimental results show that MH-Net presents a better recovery performance compared with existing DNN-based recovery methods and traditional iterative recovery algorithms.

【 授权许可】

Unknown