|Title:||VidLife: A Dataset for Life Event Extraction from Videos||Authors:||Chu T.-T
|Keywords:||life event extraction;lifelogging;personal knowledge base construction;Data mining;Extraction;Knowledge based systems;Learning systems;Events extractions;Knowledge-base construction;Life event extraction;Life events;Life experiences;Lifelogging;Novel task;Personal knowledge base construction;Video blog;Video-clips;Video cameras||Issue Date:||2021||Start page/Pages:||4436-4444||Source:||International Conference on Information and Knowledge Management, Proceedings||Abstract:||
Filming video blogs, which is shortened to vlog, becomes a popular way for people to record their life experiences in recent years. In this work, we present a novel task that is aimed at extracting life events from videos and constructing personal knowledge bases of individuals. In contrast to most existing researches in the field of computer vision that focus on identifying low-level script-like activities such as moving boxes, our goal is to extract life events where high-level activities like moving into a new house are recorded. The challenges to be tackled include: (1) identifying which objects in a given scene related to the life events of the protagonist we concern, and (2) determining the association between an extracted visual concept and a more high-level description of a video clip. To address the research issues, we construct a video life event extraction dataset VidLife by exploiting videos from the TV series The Big Bang Theory, in which the plot is around the daily lives of several characters. A pilot multitask learning model is proposed to extract life events given video clips and subtitles for storing in the personal knowledge base. ? 2021 ACM.
|Appears in Collections:||資訊工程學系|
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.