学位论文详细信息
Human Action Recognition from Active Acoustics: Physics Modelling for Representation Learning and Inference Using Generative Probabilistic Graphical Models
ultrasound;active acoustics;human action recognition;action recognition;machine learning;deep belief network;hidden Markov model;Electrical Engineering
Murray, Thomas SimmonsAndreou, Andreas G. ;
Johns Hopkins University
关键词: ultrasound;    active acoustics;    human action recognition;    action recognition;    machine learning;    deep belief network;    hidden Markov model;    Electrical Engineering;   
Others  :  https://jscholarship.library.jhu.edu/bitstream/handle/1774.2/37891/MURRAY-DISSERTATION-2015.pdf?sequence=1&isAllowed=y
瑞士|英语
来源: JOHNS HOPKINS DSpace Repository
PDF
【 摘 要 】

This dissertation explores computational methods to address the problem of physics-based modeling and ultimately doing inference from data in multiple modalities where there exists large amounts of low dimensional data complementary to a much smaller set of high dimensional data. In this instance the low dimensional timeseries data are active acoustics from a micro-Doppler sensor that include no or very limited spatial information, and the high dimensional data is RGB-Depth skeleton data from a Microsoft Kinect sensor. The task is that of human action recognition from the active acoustic data. To accomplish this, statistical models, trained simultaneously on both the micro-Doppler modulations induced by human actions and symbolic representations of skeletal poses, are developed. This enables the model to learn correlations between the rich temporal structure of the micro-Doppler modulations and the high-dimensional motion sequences of human action. During runtime, the model then relies purely on the active acoustic data to infer the human action. In order to adapt this methodology to situations not observed in the training data, a physical model of the human body is combined with a physics-based simulation of the Doppler phenomenon to predict the acoustic data for a sequence of skeletal poses and a con gurable sensor geometry. The physics model is then combined with a generative statistical model for human actions to create a generative physics-based model of micro-Doppler modulations for human action.

【 预 览 】
附件列表
Files Size Format View
Human Action Recognition from Active Acoustics: Physics Modelling for Representation Learning and Inference Using Generative Probabilistic Graphical Models 27720KB PDF download
  文献评价指标  
  下载次数:12次 浏览次数:37次