https://scholars.lib.ntu.edu.tw/handle/123456789/635593
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.author | Hsu, Po Chun | en_US |
dc.contributor.author | Liu, Da Rong | en_US |
dc.contributor.author | Liu, Andy T. | en_US |
dc.contributor.author | HUNG-YI LEE | en_US |
dc.date.accessioned | 2023-09-21T09:36:40Z | - |
dc.date.available | 2023-09-21T09:36:40Z | - |
dc.date.issued | 2023-01-01 | - |
dc.identifier.issn | 23299290 | - |
dc.identifier.uri | https://scholars.lib.ntu.edu.tw/handle/123456789/635593 | - |
dc.description.abstract | Autoregressive neural vocoders have achieved outstanding performance and are widely used in speech synthesis tasks such as text-to-speech and voice conversion. An autoregressive vocoder predicts a sample at some time step conditioned on those at previous time steps. Though it can generate highly natural human speech, the iterative generation inevitably makes the synthesis time proportional to the utterance length, leading to low efficiency. Many works were dedicated to generating the whole speech time sequence in parallel and then proposed GAN-based, flow-based, and score-based vocoders. This paper proposed a new thought for the autoregressive generation. Instead of iteratively predicting samples in a time sequence, the proposed model performs frequency-wise autoregressive generation (FAR) and bit-wise autoregressive generation (BAR) to synthesize speech. In FAR, a speech utterance is first split into different frequency subbands. The proposed model generates a subband conditioned on the previously generated one. A full-band speech can then be reconstructed from these generated subbands. Similarly, in BAR, an 8-bit quantized signal is generated iteratively from the first bit. By redesigning the autoregressive method to compute in domains other than the time domain, the number of iterations in the proposed model is no longer proportional to the utterance's length but to the number of subbands/bits. The inference efficiency is hence significantly increased. Besides, a post-filter is employed to sample audio signals from output posteriors, and its training objective is designed based on the characteristics of the proposed autoregressive methods. The experimental results show that the proposed model can synthesize speech faster than real-time without GPU acceleration. Compared with the baseline autoregressive and non-autoregressive vocoders, the proposed model achieves better MUSHRA results and shows good generalization ability while synthesizing 44 kHz speech or utterances from unseen speakers. | en_US |
dc.relation.ispartof | IEEE/ACM Transactions on Audio Speech and Language Processing | en_US |
dc.subject | autoregressive model | neural network | neural speech synthesis | vocoder | en_US |
dc.title | Parallel Synthesis for Autoregressive Speech Generation | en_US |
dc.type | journal article | en |
dc.identifier.doi | 10.1109/TASLP.2023.3301212 | - |
dc.identifier.scopus | 2-s2.0-85166771617 | - |
dc.identifier.url | https://api.elsevier.com/content/abstract/scopus_id/85166771617 | - |
dc.relation.journalvolume | 31 | en_US |
dc.relation.pageend | 3111 | en_US |
item.openairetype | journal article | - |
item.openairecristype | http://purl.org/coar/resource_type/c_6501 | - |
item.fulltext | no fulltext | - |
item.grantfulltext | none | - |
item.cerifentitytype | Publications | - |
crisitem.author.dept | Electrical Engineering | - |
crisitem.author.dept | Intel-NTU Connected Context Computing Center | - |
crisitem.author.dept | Communication Engineering | - |
crisitem.author.dept | Computer Science and Information Engineering | - |
crisitem.author.dept | Networking and Multimedia | - |
crisitem.author.dept | Center for Artificial Intelligence and Advanced Robotics | - |
crisitem.author.dept | Master's Program in Smart Medicine and Health Informatics (SMARTMHI) | - |
crisitem.author.orcid | 0000-0002-9654-5747 | - |
crisitem.author.parentorg | College of Electrical Engineering and Computer Science | - |
crisitem.author.parentorg | Others: University-Level Research Centers | - |
crisitem.author.parentorg | Others: International Research Centers | - |
crisitem.author.parentorg | College of Electrical Engineering and Computer Science | - |
crisitem.author.parentorg | College of Electrical Engineering and Computer Science | - |
crisitem.author.parentorg | College of Electrical Engineering and Computer Science | - |
crisitem.author.parentorg | Others: University-Level Research Centers | - |
crisitem.author.parentorg | International College | - |
顯示於: | 電機工程學系 |
在 IR 系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。