Real-Time Recognition of Action Sequences Using a Distributed Video Sensor Network

Journal of Sensor and Actuator Networks

Rahul Kavi¹ 

[1] Lane Department of Computer Science and Electrical Engineering, West Virginia University, Morgantown, WV 26506, USA; E-Mail

关键词: multimedia sensor network;    information fusion;    camera network;    multi-view;    score-fusion;    activity recognition;   

DOI  :  10.3390/jsan2030486

来源: mdpi

【 摘 要 】

In this paper, we describe how information obtained from multiple views using a network of cameras can be effectively combined to yield a reliable and fast human activity recognition system. First, we present a score-based fusion technique for combining information from multiple cameras that can handle the arbitrary orientation of the subject with respect to the cameras and that does not rely on a symmetric deployment of the cameras. Second, we describe how longer, variable duration, inter-leaved action sequences can be recognized in real-time based on multi-camera data that is continuously streaming in. Our framework does not depend on any particular feature extraction technique, and as a result, the proposed system can easily be integrated on top of existing implementations for view-specific classifiers and feature descriptors. For implementation and testing of the proposed system, we have used computationally simple locality-specific motion information extracted from the spatio-temporal shape of a human silhouette as our feature descriptor. This lends itself to an efficient distributed implementation, while maintaining a high frame capture rate. We demonstrate the robustness of our algorithms by implementing them on a portable multi-camera, video sensor network testbed and evaluating system performance under different camera network configurations.

【 授权许可】

CC BY   
© 2013 by the authors; licensee MDPI, Basel, Switzerland.