Fusion of Active and Passive Sensors for Fast 3D Capture

Yang, Qingxiong ; Tan, Kar-Han ; Culbertson, Bruce ; Apostolopoulos, John

HP Development Company

关键词: 3D;    Depth;    Sensors;    Time of flight;    Stereo;    Multiview;    real time;    remote collaboration;    human interaction;   

RP-ID  :  HPL-2010-97

学科分类：计算机科学（综合）

美国|英语

来源: HP Labs

【 摘 要 】

We envision a conference room of the future where depth sensing systems are able to capture the 3D position and pose of users, and enable users to interact with digital media and contents being shown on immersive displays. The key technical barrier is that current depth sensing systems are noisy, inaccurate, and unreliable. It is well understood that passive stereo fails in non-textured, featureless portions of a scene. Active sensors on the other hand are more accurate in these regions and tend to be noisy in highly textured regions. We propose a way to synergistically combine the two to create a state-of- the-art depth sensing system which runs in near real time. In contrast the only known previous method for fusion is slow and fails to take advantage of the complementary nature of the two types of sensors.