https://scholars.lib.ntu.edu.tw/handle/123456789/489774
標題: | Evaluating Image-Inspired Poetry Generation. | 作者: | Wu, Chao-Chung Song, Ruihua Sakai, Tetsuya Cheng, Wen-Feng Xie, Xing SHOU-DE LIN |
關鍵字: | AI-based creation; Evaluation; Image; Natural language generation; Poetry generation | 公開日期: | 2019 | 卷: | 11838 LNAI | 起(迄)頁: | 539-551 | 來源出版物: | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) | 摘要: | Creative natural language generation, such as poetry generation, writing lyrics, and storytelling, is appealing but difficult to evaluate. We take the application of image-inspired poetry generation as a showcase and investigate two problems in evaluation: (1) how to evaluate the generated text when there are no ground truths, and (2) how to evaluate nondeterministic systems that output different texts given the same input image. Regarding the first problem, we first design a judgment tool to collect ratings of a few poems for comparison with the inspiring image shown to assessors. We then propose a novelty measurement that quantifies how different a generated text is compared to a known corpus. Regarding the second problem, we experiment with different strategies to approximate evaluating multiple trials of output poems. We also use a measure for quantifying the diversity of different texts generated in response to the same input image, and discuss their merits. © 2019, Springer Nature Switzerland AG. |
URI: | https://scholars.lib.ntu.edu.tw/handle/123456789/489774 https://www.scopus.com/inward/record.uri?eid=2-s2.0-85075561188&doi=10.1007%2f978-3-030-32233-5_42&partnerID=40&md5=d4f3fe27d0ec29af9090b1990557177a |
ISSN: | 03029743 | DOI: | 10.1007/978-3-030-32233-5_42 | SDG/關鍵字: | Artificial intelligence; Computer science; Computers; Evaluation; First designs; Ground truth; Image; Input image; Natural language generation; Nondeterministic systems; Poetry generation; Natural language processing systems |
顯示於: | 資訊工程學系 |
在 IR 系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。