Topic Modeling for Sequences of Temporal Activities

Shen, Zhi-Yong ; Luo, Ping ; Xiong, Yuhong ; Sun, Jun ; Shen, Yi-Dong

HP Development Company

关键词: topic modeling;    LDA;    sequence;    temporal activities;   

RP-ID  :  HPL-2010-160

学科分类：计算机科学（综合）

美国|英语

来源: HP Labs

【 摘 要 】

Temporally-ordered activity sequences are popular in many real-world domains. This paper presents an LDA- style topic model for sequences of temporal activities that captures three features of such sequences: 1) the counts of unique activities, 2) the Markov transition dependence and 3) the absolute or relative timestamp on each activity. In modeling the first two features we propose the concept of global transition probability and distinguish it with local transition probability used in previous work. In modeling the third feature, we employ a continuous time distribution to depict the time range of latent topics. The combination of the global transition probability and the temporal information helps to refine the mixture distribution over topics for temporal sequence analysis. We present results on the data of distributed denial-of-service attack and system call traces, qualitatively and quantitatively showing improved topics, better next activity prediction and sequence clustering.