iBet uBet web content aggregator. Adding the entire web to your favor.
iBet uBet web content aggregator. Adding the entire web to your favor.



Link to original content: https://www.isca-archive.org/iscslp_2008/hu08c_iscslp.html
ISCA Archive - Utilization of Huge Written Text Corpora for Conversational Speech Recognition
ISCA Archive ISCSLP 2008
ISCA Archive ISCSLP 2008

Utilization of Huge Written Text Corpora for Conversational Speech Recognition

Xin-Hui Hu, Hirofumi Yamamoto, Jin-Song Zhang, Keiji Yasuda, You-Zheng Wu, Hideki Kashioka

In this paper, we propose a new sentence selection method using large written text corpora to augment the language model of conversational speech recognition in order to resolve the insufficiency of in-domain training data coverage in conversational speech recognition. In the proposed method, the large written text corpora are clustered by an entropybased method. Clusters similar to the target development set are selected automatically. Next, utterances are selected and mixed with the original conversational training corpus, and language models for conversational speech recognition are built. In our experiments, a different speech style test set that is not covered by original conversational training data is used for evaluation. The perplexity of the test set was reduced from 249.6 to 210.8, and the word recognition accuracy was improved by approximately 5% by using our method. Index Terms: data collection, �raining data coverage,� language model, conversational speech recognition.