https://scholars.lib.ntu.edu.tw/handle/123456789/638619
標題: | Personalized Lightweight Text-To-Speech: Voice Cloning with Adaptive Structured Pruning | 作者: | Huang, Sung Feng Chen, Chia Ping Chen, Zhi Sheng Tsai, Yu Pao HUNG-YI LEE |
關鍵字: | few-shot | personalized TTS | structured pruning | trainable pruning | Voice cloning | 公開日期: | 1-一月-2023 | 來源出版物: | ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings | 摘要: | Personalized TTS is an exciting and highly desired application that allows users to train their TTS voice using only a few recordings. However, TTS training typically requires many hours of recording and a large model, making it unsuitable for deployment on mobile devices. To overcome this limitation, related works typically require fine-Tuning a pre-Trained TTS model to preserve its ability to generate high-quality audio samples while adapting to the target speaker's voice. This process is commonly referred to as "voice cloning."Although related works have achieved significant success in changing the TTS model's voice, they are still required to fine-Tune from a large pre-Trained model, resulting in a significant size for the voice-cloned model. In this paper, we propose applying trainable structured pruning to voice cloning. By training the structured pruning masks with voice-cloning data, we can produce a unique pruned model for each target speaker. Our experiments demonstrate that using learnable structured pruning, we can compress the model size to 7 times smaller while achieving comparable voice-cloning performance. |
URI: | https://scholars.lib.ntu.edu.tw/handle/123456789/638619 | ISBN: | 978-1-7281-6327-7 | ISSN: | 15206149 | DOI: | 10.1109/ICASSP49357.2023.10097178 |
顯示於: | 電機工程學系 |
在 IR 系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。