https://scholars.lib.ntu.edu.tw/handle/123456789/607399
標題: | VidLife: A Dataset for Life Event Extraction from Videos | 作者: | Chu T.-T Yen A.-Z Ang W.-H Huang H.-H HSIN-HSI CHEN |
關鍵字: | life event extraction;lifelogging;personal knowledge base construction;Data mining;Extraction;Knowledge based systems;Learning systems;Events extractions;Knowledge-base construction;Life event extraction;Life events;Life experiences;Lifelogging;Novel task;Personal knowledge base construction;Video blog;Video-clips;Video cameras | 公開日期: | 2021 | 起(迄)頁: | 4436-4444 | 來源出版物: | International Conference on Information and Knowledge Management, Proceedings | 摘要: | Filming video blogs, which is shortened to vlog, becomes a popular way for people to record their life experiences in recent years. In this work, we present a novel task that is aimed at extracting life events from videos and constructing personal knowledge bases of individuals. In contrast to most existing researches in the field of computer vision that focus on identifying low-level script-like activities such as moving boxes, our goal is to extract life events where high-level activities like moving into a new house are recorded. The challenges to be tackled include: (1) identifying which objects in a given scene related to the life events of the protagonist we concern, and (2) determining the association between an extracted visual concept and a more high-level description of a video clip. To address the research issues, we construct a video life event extraction dataset VidLife by exploiting videos from the TV series The Big Bang Theory, in which the plot is around the daily lives of several characters. A pilot multitask learning model is proposed to extract life events given video clips and subtitles for storing in the personal knowledge base. ? 2021 ACM. |
URI: | https://www.scopus.com/inward/record.uri?eid=2-s2.0-85119203466&doi=10.1145%2f3459637.3482022&partnerID=40&md5=3f252294758a6959b85eb83c605383fb https://scholars.lib.ntu.edu.tw/handle/123456789/607399 |
DOI: | 10.1145/3459637.3482022 |
顯示於: | 資訊工程學系 |
在 IR 系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。