https://scholars.lib.ntu.edu.tw/handle/123456789/636198
標題: | Improving Textless Spoken Language Understanding with Discrete Units as Intermediate Target | 作者: | Wu, Guan Wei Lin, Guan Ting Li, Shang Wen HUNG-YI LEE |
關鍵字: | Self-Supervised Learning | Spoken Language Understanding | Textless NLP | 公開日期: | 1-一月-2023 | 卷: | 2023-August | 來源出版物: | Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH | 摘要: | Spoken Language Understanding (SLU) is a task that aims to extract semantic information from spoken utterances. Previous research has made progress in end-to-end SLU by using paired speech-text data, such as pre-trained Automatic Speech Recognition (ASR) models or paired text as intermediate targets. However, acquiring paired transcripts is expensive and impractical for unwritten languages. On the other hand, Textless SLU extracts semantic information from speech without utilizing paired transcripts. However, the absence of intermediate targets and training guidance for textless SLU often leads to suboptimal performance. In this work, inspired by the content-disentangled discrete units from self-supervised speech models, we proposed to use discrete units as intermediate guidance to improve textless SLU performance. Our method surpasses the baseline method on five SLU benchmark corpora. Additionally, we find that unit guidance facilitates few-shot learning and enhances noise robustness. |
URI: | https://scholars.lib.ntu.edu.tw/handle/123456789/636198 | ISSN: | 2308457X | DOI: | 10.21437/Interspeech.2023-1718 |
顯示於: | 電機工程學系 |
在 IR 系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。