On parameterizing higher-order motion for behaviour recognition

PATTERN RECOGNITION

卷:112

Article

Sun, Yan^1,2  Hare, Jonathon S.³  Nixon, Mark S.³ 

[1] Shanghai Univ, Sch Comp Engn & Sci, 99 Shangda Rd, Shanghai 200444, Peoples R China

[2] Shanghai Inst Adv Commun & Data Sci, 333 Nanchen Rd, Shanghai 200444, Peoples R China

[3] Univ Southampton, Sch Elect & Comp Sci, Univ Rd, Southampton SO17 1BJ, Hants, England

关键词: Motion analysis;    Higher-order motion;    Acceleration;    Jerk;    Snap;   

DOI  :  10.1016/j.patcog.2020.107710

来源: Elsevier

【 摘 要 】

Human behaviours consist different types of motion; we show how they can be disambiguated into their components in a richer way than that currently possible. Studies on optical flow have concentrated on motion alone without the higher order components: snap, jerk and acceleration. We are the first to show how the acceleration, jerk, snap and their constituent parts can be obtained from image sequences, and can be deployed for analysis, especially of behaviour. We demonstrate the estimation of acceleration in sport, human motion, traffic and in scenes of violent behaviour to demonstrate the wide potential for application of analysis of acceleration. Determining higher order components is suited to the analysis of scenes which contain them: higher order motion is innate to scenes containing acts of violent behaviour, but it is not just for behaviour which contains quickly changing movement: human gait contains acceleration though approaches have yet to consider radial and tangential acceleration, since they concentrate on motion alone. The analysis of synthetic and real-world images illustrates the ability of higher order motion to discriminate different objects under different motion. Then the new approaches are applied in heel strike detection in the analysis of human gait. These results demonstrate that the new approach is ready for developing new applications in behaviour recognition and provides a new basis for future research and applications of higher-order motion analysis. (C) 2020 Elsevier Ltd. All rights reserved.

【 授权许可】

Free