Options
Visual concept selection with textual knowledge for understanding activities of daily living and life moment retrieval
Journal
CEUR Workshop Proceedings
Journal Volume
2125
Date Issued
2018
Author(s)
Abstract
This paper presents our approach to the task of ImageCLEFlifelog 2018. Two subtasks, activities of daily living understanding (ADLT) and life moment retrieval (LMRT) are addressed. We attempt to reduce the user involvement during the retrieval stage by using natural language processing technologies. The two subtasks are conducted with dedicated pipelines, while similar methodology is shared. We first obtain visual concepts from the images with a wide range of computer vision tools and propose a concept selection method to prune the noisy concepts with word embeddings in which textual knowledge is inherent. For ADLT, the retrieved images of a given topic are sorted by time, and the frequency and duration are further calculated. For LMRT, the retrieval is based on the ranking of similarity between image concepts and user queries. In terms of the performance, our systems achieve 47.87% of percentage dissimilarity in ADLT and 39.5% of F1@10 in LMRT.
Subjects
Distributed Word Representation
Lifelog
Visual Concept Selection
Description
19th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2018, 10 September 2018 through 14 September 2018
Type
conference paper