https://scholars.lib.ntu.edu.tw/handle/123456789/412925
標題: | Video search reranking through random walk over document-level context graph | 作者: | Hsu W.H. Kennedy L.S. WINSTON HSU |
關鍵字: | Multimodal fusion; Power method; Video search | 公開日期: | 2007 | 起(迄)頁: | 971-980 | 來源出版物: | ACM International Multimedia Conference and Exhibition | 摘要: | Multimedia search over distributed sources often result in recurrent images or videos which are manifested beyond the textual modality. To exploit such contextual patterns and keep the simplicity of the keyword-based search, we propose novel reranking methods to leverage the recurrent patterns to improve the initial text search results. The approach, context reranking, is formulated as a random walk problem along the context graph, where video stories are nodes and the edges between them are weighted by multimodal contextual similarities. The random walk is biased with the preference towards stories with higher initial text search scores - a principled way to consider both initial text search results and their implicit contextual relationships. When evaluated on TRECVID 2005 video benchmark, the proposed approach can improve retrieval on the average up to 32% relative to the baseline text search method in terms of story-level Mean Average Precision. In the people-related queries, which usually have recurrent coverage across news sources, we can have up to 40% relative improvement. Most of all, the proposed method does not require any additional input from users (e.g., example images), or complex search models for special queries (e.g., named person search). Copyright 2007 ACM. |
URI: | https://scholars.lib.ntu.edu.tw/handle/123456789/412925 | ISBN: | 9781595937025 | DOI: | 10.1145/1291233.1291446 |
顯示於: | 資訊工程學系 |
在 IR 系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。