Predicting viewer affective comments based on image content in social media
Journal
ACM International Conference on Multimedia Retrieval 2014
Pages
233-240
Date Issued
2014
Author(s)
Abstract
Visual sentiment analysis is getting increasing attention be- cause of the rapidly growing amount of images in online social interactions and several emerging applications such as online propaganda and advertisement. Recent studies have shown promising progress in analyzing visual affect concepts intended by the media content publisher. In contrast, this paper focuses on predicting what viewer affect concepts will be triggered when the image is perceived by the viewers. For example, given an image tagged with \yummy food," the viewers are likely to comment \delicious" and \hungry," which we refer to as viewer affect concepts (VAC) in this paper. To the best of our knowledge, this is the first work ex- plicitly distinguishing intended publisher affect concepts and induced viewer affect concepts associated with social visual content, and aiming at understanding their correlations. We present around 400 VACs automatically mined from million- scale real user comments associated with images in social media. Furthermore, we propose an automatic visual based approach to predict VACs by first detecting publisher affect concepts in image content and then applying statistical correlations between such publisher affect concepts and the VACs. We demonstrate major benefits of the proposed methods in several real-world tasks - recommending images to invoke certain target VACs among viewers, increasing the accuracy of predicting VACs by 20.1% and finally developing a social assistant tool that may suggest plausible, content- specific and desirable comments when users view new images. Copyright is held by the owner/author(s).
Subjects
Comment assistant; Social multimedia; Viewer affect concept; Visual sentiment analysis
Type
conference paper
File(s)![Thumbnail Image]()
Loading...
Name
ICMR-VAC.pdf
Size
4.63 MB
Format
Adobe PDF
Checksum
(MD5):1d2702f33f12c17b79cc53491646eeea