A comparison between microblog corpus and balanced corpus from linguistic and sentimental perspectives
Journal
AAAI Workshop
Journal Volume
WS-11-05
Pages
68-73
ISBN
9781577355212
Date Issued
2011
Author(s)
Abstract
While microblogging has gained popularity on the Internet, analyzing and processing short messages has become a challenging task in natural language processing. This paper analyzes the differences between Internet short messages (or "microtext") and general articles by comparing the Plurk Corpus and the Sinica Balanced Corpus. Likelihood ratio and the t?ngy? c?c?l?n thesaurus are adopted to analyze the lexical semantics of frequent terms in each corpus. Furthermore, the NTUSD sentiment dictionary is used to compare the sentiment distribution of the two corpora. The result is also applied to sentiment transition analysis.
Type
conference paper