Fusion of Semantic and Acoustic Approaches for Spoken Document Retrieval

Logan, Beth ; Prasangsit, Patrawadee ; Moreno, Pedro

HP Development Company

关键词: spoken document retrieval;    out-of-vocabulary words;    multimedia indexing;    knowledge management;   

RP-ID  :  HPL-2003-55

学科分类：计算机科学（综合）

美国|英语

来源: HP Labs

【 摘 要 】

Most spoken document retrieval systems use the words derived from a large vocabulary speech recognizer as the internal representation for indexing the document. However, the use of recognition transcripts inherently limits the performance of the system since the size of the dictionary restricts the number of queries for which matches can be found. In this paper we present a new approach to this problem based on combining Probabilistic Latent Semantic Analysis (PLSA) with phonetic indexing. PLSA maps the words in documents and queries into a semantic space in which they can be compared even if they don't share any common words. Combining this semantic distance with acoustic scores gives an improvement of 6-11% relative for OOV queries and 4% relative for all queries on a 75 hour broadcast news indexing task. Notes: To be presented at the ISCA Workshop on Multilingual Spoken Document Retrieval, 4- 5 April 2003, Hong Kong 10 Pages