Monocular pedestrian orientation estimation based on deep 2D-3D feedforward

PATTERN RECOGNITION

卷:100

Article

Zhao, Chenchen^1,2  Qian, Yeqiang^1,2  Yang, Ming^1,2 

[1] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200240, Peoples R China

[2] Minist Educ China, Key Lab Syst Control & Informat Proc, Shanghai 200240, Peoples R China

关键词: Information feedforward;    Logic relationship;    Monocular vision;    Orientation estimation;   

DOI  :  10.1016/j.patcog.2019.107182

来源: Elsevier

【 摘 要 】

Accurate pedestrian orientation estimation of autonomous driving helps the ego vehicle obtain the intentions of pedestrians in the related environment, which are the base of safety measures such as collision avoidance and prewarning. However, because of relatively small sizes and high-level deformation of pedestrians, common pedestrian orientation estimation models fail to extract sufficient and comprehensive information from them, thus having their performance restricted, especially monocular ones which fail to obtain depth information of objects and related environment. In this paper, a novel monocular pedestrian orientation estimation model, called FFNet, is proposed. Apart from camera captures, the model adds the 2D and 3D dimensions of pedestrians as two other inputs according to the logic relationship between orientation and them. The 2D and 3D dimensions of pedestrians are determined from the camera captures and further utilized through two feedforward links connected to the orientation estimator. The feedforward links strengthen the logicality and interpretability of the network structure of the proposed model. Experiments show that the proposed model has at least 1.72% AOS increase than most state-of-the-art models after identical training processes. The model also has competitive results in orientation estimation evaluation on KITTI dataset. (C) 2019 Elsevier Ltd. All rights reserved.

【 授权许可】

Free