Recognition of highly imbalanced code-mixed bilingual speech with frame-level language detection based on blurred posteriorgram
Journal
ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
Pages
4873-4876
ISSN
15206149
Date Issued
2012-03
Author(s)
Abstract
In this work, we proposed a new framework for recognition of highly imbalanced code-mixed bilingual speech using an additional frame-level language detector in the conventional recognition system. Blurred posteriorgram features (BPFs) are also proposed to be used in the language detector. The approach was evaluated with real spontaneous lectures offered at National Taiwan University. The highly imbalanced language distribution in code-mixed speech makes the task difficult. Preliminary experimental results showed not only very good performance improvement, but the improvement is complementary to that brought by better acoustic models, whether due to better adaptation approach or increased training data. The code-mixed bilingual speech is frequently used in the daily lives of many people in the globalized world today.
Event(s)
2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012
Subjects
ASR
code-mixing
multilingual
Type
conference paper