https://scholars.lib.ntu.edu.tw/handle/123456789/559417
標題: | What does this word mean? Explaining contextualized embeddings with natural language definition | 作者: | Chang, T.-Y. YUN-NUNG CHEN |
公開日期: | 2020 | 來源出版物: | EMNLP-IJCNLP 2019 - 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing, Proceedings of the Conference | 摘要: | Contextualized word embeddings have boosted many NLP tasks compared with traditional static word embeddings. However, the word with a specific sense may have different contextualized embeddings due to its various contexts. To further investigate what contextualized word embeddings capture, this paper analyzes whether they can indicate the corresponding sense definitions and proposes a general framework that is capable of explaining word meanings given contextualized word embeddings for better interpretation. The experiments show that both ELMo and BERT embeddings can be well interpreted via a readable textual form, and the findings may benefit the research community for a better understanding of what the embeddings capture1. © 2019 Association for Computational Linguistics |
URI: | https://www.scopus.com/inward/record.url?eid=2-s2.0-85084308987&partnerID=40&md5=893bcac1a01caedac87864d25d2cfec6 https://scholars.lib.ntu.edu.tw/handle/123456789/559417 |
SDG/關鍵字: | Embeddings; Natural languages; Research communities; Word meaning; Natural language processing systems |
顯示於: | 資訊工程學系 |
在 IR 系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。