https://scholars.lib.ntu.edu.tw/handle/123456789/428031
Title: | Unsupervised Iterative Deep Learning of Speech Features and Acoustic Tokens with Applications to Spoken Term Detection | Authors: | Cheng-Tao Chung Cheng-Yu Tsai Chia-Hsiang Liu LIN-SHAN LEE |
Keywords: | Acoustic tokens; DNN; HMM; unsupervised learning | Issue Date: | 2017 | Journal Volume: | 25 | Journal Issue: | 10 | Start page/Pages: | 1914 - 1928 | Source: | IEEE/ACM Transactions on Audio Speech and Language Processing | Abstract: | In this paper, we aim to automatically discover high-quality frame-level speech features and acoustic tokens directly from unlabeled speech data. A multigranular acoustic tokenizer (MAT) was proposed for automatic discovery of multiple sets of acoustic tokens from the given corpus. Each acoustic token set is specified by a set of hyperparameters describing the model configuration. These different sets of acoustic tokens carry different characteristics for the given corpus and the language behind and, thus, can be mutually reinforced. The multiple sets of token labels are then used as the targets of a multitarget deep neural network (MDNN) trained on frame-level acoustic features. Bottleneck features extracted from the MDNN are then used as the feedback input to the MAT and the MDNN itself in the next iteration. The multigranular acoustic token sets and the frame-level speech features can be iteratively optimized in the iterative deep learning framework. We call this framework the MAT deep neural network. The results were evaluated using the metrics and corpora defined in the Zero Resource Speech Challenge organized at Interspeech 2015, and improved performance was obtained with a set of experiments of query-by-example spoken term detection on the same corpora. Visualization for the discovered tokens against the English phonemes was also shown. © 2017 IEEE. |
URI: | https://scholars.lib.ntu.edu.tw/handle/123456789/428031 https://www.scopus.com/inward/record.uri?eid=2-s2.0-85028944404&doi=10.1109%2fTASLP.2017.2729024&partnerID=40&md5=ee3e6adc834fae4778558d65a0a3ed4b |
ISSN: | 23299290 | DOI: | 10.1109/TASLP.2017.2729024 | SDG/Keyword: | Acoustics; Deep neural networks; Feature extraction; Hidden Markov models; Markov processes; Measurements; Neural networks; Speech; Speech processing; Speech recognition; Unsupervised learning; Acoustic features; Automatic discovery; Bottleneck features; Hyperparameters; Learning frameworks; Model configuration; Query-by example; Spoken term detections; Deep learning |
Appears in Collections: | 電機工程學系 |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.