A New Volumetric Fusion Strategy with Adaptive Weight Field for RGB-D Reconstruction

Sensors

Xinqi Liu¹  Jituo Li¹  Guodong Lu¹ 

[1] Institue of Design Engineering, School of Mechanical Engineering, Zhejiang University, Hangzhou 310027, China;

关键词: volumetric fusion;    RGB-D reconstruction;    texture reconstruction;    data evaluation;   

DOI  :  10.3390/s20154330

来源: DOAJ

【 摘 要 】

High-quality 3D reconstruction results are very important in many application fields. However, current texture generation methods based on point sampling and fusion often produce blur. To solve this problem, we propose a new volumetric fusion strategy which can be embedded in the current online and offline reconstruction framework as a basic module to achieve excellent geometry and texture effects. The improvement comes from two aspects. Firstly, we establish an adaptive weight field to evaluate and adjust the reliability of data from RGB-D images by using a probabilistic and heuristic method. By using this adaptive weight field to guide the voxel fusion process, we can effectively preserve the local texture structure of the mesh, avoid wrong texture problems and suppress the influence of outlier noise on the geometric surface. Secondly, we use a new texture fusion strategy that combines replacement, integration, and fixedness operations to fuse and update voxel texture to reduce blur. Experimental results demonstrate that compared with the classical KinectFusion, our approach can significantly improve the accuracy in geometry and texture clarity, and can achieve equivalent texture reconstruction effects in real-time as the offline reconstruction methods such as intrinsic3d, even better in relief scenes.

【 授权许可】

Unknown