A learning method to optimize depth accuracy and frame rate for Time of Flight camera

2019 International Conference on Advanced Electronic Materials, Computers and Materials Engineering

无线电电子学;计算机科学;材料科学

Chen, Yan^1 ; Qian, Keyuan^2 ; Cheng, Xuanye^3 ; Zhou, Jingkun^1

Department of Electronic Engineering, Tsinghua University, Beijing, China^1

Graduate School at Shenzhen, Tsinghua University, Shenzhen, China^2

SenseTime Research, SenseTime, Shenzhen, China^3

关键词: Capacitive components;    Depth information;    Depth reconstruction;    Electronic component;    Low signal-to-noise ratio;    Lower-power consumption;    Raw measurements;    Time-of-flight cameras;   

Others  :  https://iopscience.iop.org/article/10.1088/1757-899X/563/4/042067/pdf
DOI  :  10.1088/1757-899X/563/4/042067

来源: IOP

【 摘 要 】

Time of Flight cameras attracts increasing attention due to their ability to robustly predict depth values of the scene. The principle of actively emitting modulated signals and receiving sampled signals causes that the artifacts generated by motion blur seriously affect quality of imaging and the power consumption of the light source. The problem of shorter exposure time is that the raw measurements have a lower signal-to-noise ratio. Reducing the four frames of raw measurements for depth reconstruction to two frames can make it difficult to effectively suppress noise from the background infrared signal and capacitive components. However, shorter exposure time and reducing four frames of raw data to two frames will greatly reduce the motion blur of the time-of-flight camera with a higher frame rate and lower power consumption. We propose a method based on deep learning and make it possible to reliably recover the depth information even under extremely low signal-to-noise ratio and the noise of electronic components for alleviating the motion blur problem. The experiment results fully demonstrate the reliability of our solution. Our algorithms and data will be published in the future.