From Kinect skeleton data to hand gesture recognition with radar

The Journal of Engineering

Francesco Fioranelli¹  Aman Shrestha¹  Julien Le Kernec²  Jiayi Li² 

[1] Communicaiton, Sensing and Imaging Group, School of Engineering, University of Glasgow;School of Information and Electronics, University of Electronic Science and Technology of China;

关键词: support vector machines;    image classification;    gesture recognition;    image sensors;    feature extraction;    image sampling;    radar imaging;    doppler radar;    aperiodic human movements;    hand gestures;    handcrafted features;    simulated md signatures;    kinect skeleton data;    data augmentation;    synthetic minority oversampling technique;    synthetic samples;    support vector machine;    neighbour classifier;    gesture recognition;    man-machine interaction;    remote sensing;    microdoppler effect;   

DOI  :  10.1049/joe.2019.0557

来源: DOAJ

【 摘 要 】

In an era where man-machine interaction increasingly uses remote sensing, gesture recognition through use of the micro-Doppler (mD) effect is an emerging application which has attracted great interest. It is a sensible solution and here the authors show its potential for detecting aperiodic human movements. In this study, the authors classify ten hand gestures with a set of handcrafted features using simulated mD signatures generated from Kinect skeleton data. Data augmentation in the form of synthetic minority oversampling technique has been applied to create synthetic samples and classified with the support vector machine and K-nearest neighbour classifier with classification rate of 71.1 and 51% achieved. Finally, using weights generated by an action pair based one vs. one classification layer improves classification accuracy by 24.7 and 28.4%.

【 授权许可】

Unknown