https://scholars.lib.ntu.edu.tw/handle/123456789/607402
標題: | Personal knowledge base construction from multimodal data | 作者: | Yen A.-Z Chang C.-C Huang H.-H HSIN-HSI CHEN |
關鍵字: | Life event extraction;Personal knowledge base construction;Social media;Knowledge based systems;Semantics;Information recalls;Knowledge base;Knowledge-base construction;Multi-modal data;Personal lives;Textual query;Video collections;Visual concept;Learning systems | 公開日期: | 2021 | 起(迄)頁: | 496-500 | 來源出版物: | ICMR 2021 - Proceedings of the 2021 International Conference on Multimedia Retrieval | 摘要: | With the passage of time, people often have misty memories of their past experiences. Information recall support for people by collecting personal lifelogs is emerging. Recently, people tend to record their daily life via filming Video Weblog (VLog), which contains visual and audio data. These large scale multimodal data can be used to support information recall service that enables users to query their past experiences. The challenging issue is the semantic gap between the visual concept and the textual query. In this paper, we aim to extract personal life events from vlogs shared on YouTube and construct a personal knowledge base (PKB) for individuals. A multitask learning model is proposed to extract the components of personal life events, such as subjects, predicates and objects. The evaluation is performed on a video collection from three YouTubers who are English native speakers. Experimental results show our model achieves promising performance. ? 2021 ACM. |
URI: | https://www.scopus.com/inward/record.uri?eid=2-s2.0-85114899546&doi=10.1145%2f3460426.3463589&partnerID=40&md5=1e636d0a5ab652a3e101546cb59d8eae https://scholars.lib.ntu.edu.tw/handle/123456789/607402 |
DOI: | 10.1145/3460426.3463589 |
顯示於: | 資訊工程學系 |
在 IR 系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。