LifeConcept: An Interactive Approach for Multimodal Lifelog Retrieval through Concept Recommendation
Journal
LSC 2021 - Proceedings of the 4th Annual Lifelog Search Challenge
Pages
47-51
Date Issued
2021
Author(s)
Abstract
The major challenge in visual lifelog retrieval is the semantic gap between textual queries and visual concepts. This paper presents our work on the Lifelog Search Challenge 2021 (LSC'21), an annual comparative benchmarking activity for comparing approaches to interactive retrieval from multimodal lifelogs. We propose LifeConcept, an interactive lifelog search system that is aimed at accelerating the retrieval process and retrieving more precise results. In this work, we introduce several new features such as the number of people, location cluster, and object with color. Moreover, we obtain visual concepts from the images with computer vision models and propose a concept recommendation method to reduce the semantic gap. In this way, users can efficiently set up the related conditions for their requirements and search the desired images with appropriate query terms based on the suggestion. ? 2021 ACM.
Subjects
image retrieval
interactive system
multimodal retrieval
visual lifelogging
Benchmarking activity
Interactive approach
Interactive retrieval
Number of peoples
Recommendation methods
Retrieval process
Textual query
Visual concept
Semantics
Type
conference paper