https://scholars.lib.ntu.edu.tw/handle/123456789/607151
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.author | Yang S.-W | en_US |
dc.contributor.author | HUNG-YI LEE et al. | en_US |
dc.creator | Yang S.-W;Chi P.-H;Chuang Y.-S;Lai C.-I.J;Lakhotia K;Lin Y.Y;Liu A.T;Shi J;Chang X;Lin G.-T;Huang T.-H;Tseng W.-C;Lee K.-T;Liu D.-R;Huang Z;Dong S;Li S.-W;Watanabe S;Mohamed A;Lee H.-Y. | - |
dc.date.accessioned | 2022-04-25T06:42:28Z | - |
dc.date.available | 2022-04-25T06:42:28Z | - |
dc.date.issued | 2021 | - |
dc.identifier.issn | 2308457X | - |
dc.identifier.uri | https://www.scopus.com/inward/record.uri?eid=2-s2.0-85119172130&doi=10.21437%2fInterspeech.2021-1775&partnerID=40&md5=c0544332855c4f5d60a2d48455cc8099 | - |
dc.identifier.uri | https://scholars.lib.ntu.edu.tw/handle/123456789/607151 | - |
dc.description.abstract | Self-supervised learning (SSL) has proven vital for advancing research in natural language processing (NLP) and computer vision (CV). The paradigm pretrains a shared model on large volumes of unlabeled data and achieves state-of-the-art (SOTA) for various tasks with minimal adaptation. However, the speech processing community lacks a similar setup to systematically explore the paradigm. To bridge this gap, we introduce Speech processing Universal PERformance Benchmark (SUPERB). SUPERB is a leaderboard to benchmark the performance of a shared model across a wide range of speech processing tasks with minimal architecture changes and labeled data. Among multiple usages of the shared model, we especially focus on extracting the representation learned from SSL for its preferable re-usability. We present a simple framework to solve SUPERB tasks by learning task-specialized lightweight prediction heads on top of the frozen shared model. Our results demonstrate that the framework is promising as SSL representations show competitive generalizability and accessibility across SUPERB tasks. We release SUPERB as a challenge with a leaderboard1 and a benchmark toolkit2 to fuel the research in representation learning and general speech processing. Copyright ? 2021 ISCA. | - |
dc.relation.ispartof | Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH | - |
dc.subject | Benchmark | - |
dc.subject | Evaluation | - |
dc.subject | Model generalization | - |
dc.subject | Representation learning | - |
dc.subject | Self-supervised learning | - |
dc.subject | Speech | - |
dc.subject | Benchmarking | - |
dc.subject | Learning algorithms | - |
dc.subject | Natural language processing systems | - |
dc.subject | Speech communication | - |
dc.subject | Supervised learning | - |
dc.subject | Large volumes | - |
dc.subject | Performance | - |
dc.subject | Shared model | - |
dc.subject | State of the art | - |
dc.subject | Unlabeled data | - |
dc.subject | Speech processing | - |
dc.title | SUPERB: Speech processing Universal PERformance Benchmark | en_US |
dc.type | conference paper | en |
dc.identifier.doi | 10.21437/Interspeech.2021-1775 | - |
dc.identifier.scopus | 2-s2.0-85119172130 | - |
dc.relation.pages | 3161-3165 | - |
dc.relation.journalvolume | 4 | - |
item.cerifentitytype | Publications | - |
item.fulltext | no fulltext | - |
item.openairecristype | http://purl.org/coar/resource_type/c_5794 | - |
item.openairetype | conference paper | - |
item.grantfulltext | none | - |
crisitem.author.dept | Electrical Engineering | - |
crisitem.author.dept | Intel-NTU Connected Context Computing Center | - |
crisitem.author.dept | Communication Engineering | - |
crisitem.author.dept | Computer Science and Information Engineering | - |
crisitem.author.dept | Networking and Multimedia | - |
crisitem.author.dept | Center for Artificial Intelligence and Advanced Robotics | - |
crisitem.author.dept | Master's Program in Smart Medicine and Health Informatics (SMARTMHI) | - |
crisitem.author.orcid | 0000-0002-9654-5747 | - |
crisitem.author.parentorg | College of Electrical Engineering and Computer Science | - |
crisitem.author.parentorg | Others: University-Level Research Centers | - |
crisitem.author.parentorg | Others: International Research Centers | - |
crisitem.author.parentorg | College of Electrical Engineering and Computer Science | - |
crisitem.author.parentorg | College of Electrical Engineering and Computer Science | - |
crisitem.author.parentorg | College of Electrical Engineering and Computer Science | - |
crisitem.author.parentorg | Others: University-Level Research Centers | - |
crisitem.author.parentorg | International College | - |
顯示於: | 電機工程學系 |
在 IR 系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。