https://scholars.lib.ntu.edu.tw/handle/123456789/412968
標題: | Discovering informative social subgraphs and predicting pairwise relationships from group photos | 作者: | Chen Y.-Y. Hsu W.H. WINSTON HSU |
關鍵字: | face graph; face subgraph mining; social relationship | 公開日期: | 2012 | 起(迄)頁: | 669-678 | 來源出版物: | 20th ACM International Conference on Multimedia | 摘要: | An increasing number of users are contributing the sheer amount of group photos (e.g., for family, classmates, colleagues, etc.) on social media for the purpose of photo sharing and social communication. There arise strong needs for automatically understanding the group types (e.g., family vs. classmates) for recommendation services (e.g., recommending a family-friendly restaurant) and even predicting the pairwise relationships (e.g., mother-child) between the people in the photo for mining implicit social connections. Interestingly, we observe that the group photos are composed of atomic subgroups corresponding to certain social relationships. For this work, we propose a novel framework to (1) connect faces of different attributes and positions as a face graph and (2) discover informative subgraphs to represent social subgroups in group photos. A group photo can be further represented by a bag-of-face-subgraphs (BoFG) - the occurring frequency of social subgroups, which is informative to categorize specific group types or events. We demonstrate the effectiveness of BoFG in recognizing family photos and achieve 30.5% relative improvement over the state-of-the-art low-level features. Moreover, we propose to predict the pairwise relationships (e.g., husband-wife) in a face graph by the co-occurrence information (e.g., co-occurring with a child) in the mined subgraphs. The experiments demonstrate that the informative social subgroups significantly outperform prior work (36% relatively) which considers merely facial attributes for determining pairwise relationships. ? 2012 ACM. |
URI: | https://scholars.lib.ntu.edu.tw/handle/123456789/412968 | ISBN: | 9781450310895 | DOI: | 10.1145/2393347.2393439 |
顯示於: | 資訊工程學系 |
在 IR 系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。