Associating Relevant Photos to Georeferenced Textual Documents through Rank Aggregation

Terra Cognita 2011.

地球科学;计算机科学

Rui Candeias ; Bruno Martins

Others  :  http://ceur-ws.org/Vol-798/paper12.pdf
PID  :  40844

学科分类：计算机科学（综合）

来源: CEUR

【 摘 要 】

The automatic association of illustrative photos to paragraphs of text is a challenging cross-media retrieval problem with many practical applications. In this paper we propose novel methods to associate photos to textual documents. The proposed methods are based on the recognition and disambiguation of location names in the texts, using them to query Flickr for candidate photos. The best photos are selected with basis on their popularity, on their proximity, on temporal cohesion and on the similarity between the photo's textual descriptions and the text of the document. We specically tested different rank aggregation approaches to select the most relevant photos. A method that uses the CombMNZ algorithm to combine textual similarity, geographic proximity and temporal cohesion obtained the best results.