Distributed radar fusion and recurrent networks for classification of continuous human activities

IET Radar, Sonar & Navigation

Alexander Yarovoy¹  Ronny G. Guendel¹  Francesco Fioranelli¹ 

[1] Microwave Sensing, Signals and Systems (MS3) Group, Faculty of Electrical Engineering, Mathematics and Computer Science Delft University of Technology Delft The Netherlands;

关键词: distributed sensors;    micro Doppler;    radar target recognition;    radar tracking;    signal classification;    ultra wideband radar;   

DOI  :  10.1049/rsn2.12249

来源: DOAJ

【 摘 要 】

Abstract Continuous Human Activity Recognition (HAR) in arbitrary directions is investigated in this paper using a network of five spatially distributed pulsed Ultra‐Wideband radars. While activities performed continuously and in unconstrained trajectories provide a more realistic and natural scenario for HAR, the network of radar sensors is proposed to address the issue of unfavourable or occluded perspectives when using only a single sensor. Different techniques to combine the relevant information from the multiple radars in the network are investigated, focussing on signal level fusion directly applied on Range‐Time maps, and the selection of radar nodes based on location and velocity of the target derived from multilateration processing and tracking. Recurrent Neural Networks with and without bidirectionality are used to classify the activities based on the micro‐Doppler (μD) spectrograms obtained for sensor fusion techniques. To assess classification performances, novel evaluation metrics accounting for the continuous nature of the sequence of activities and inherent imbalances in the dataset are proposed and compared with existing metrics. It is shown that the conventional accuracy metric may not capture all the important aspects for continuous HAR, and the proposed metrics can be considered for a more comprehensive evaluation.

【 授权许可】

Unknown