Comparing HMM, Maximum Entropy, and Conditional Random Fields for Disfluency Detection

TitleComparing HMM, Maximum Entropy, and Conditional Random Fields for Disfluency Detection
Publication TypeConference Paper
Year of Publication2005
AuthorsLiu, Y., Shriberg E., Stolcke A., & Harper M. P.
Published inProceedings of the 9th European Conference on Speech Communication and Technology (Interspeech 2005-Eurospeech 2005)
Page(s)3313-3316
Other Numbers1498
Abstract

Automatic detection of disfluencies in spoken language is important for making speech recognition output more readable, and for aiding downstream language processing modules. We compare a generative hidden Markov model (HMM)-based approach and two conditional models - a maximum entropy (Maxent) model and a conditional random field (CRF) - for detecting disfluencies in speech. The conditional modeling approaches provide a more principled way to model correlated features. In particular, the CRF approach directly detects the reparandum regions, and thus avoids the use of ad-hoc heuristic rules. We evaluate performance of these three models across two different corpora (conversational speech and broadcast news) and for two types of transcriptions (human transcriptions and recognition output). Overall we find that the conditional modeling approaches (Maxent and CRF) tend to outperform (with one exception) the HMM approach. Effects of speaking style, word recognition errors, and future directions are also discussed.

Bibliographic Notes

Proceedings of the 9th European Conference on Speech Communication and Technology (Interspeech 2005-Eurospeech 2005), Lisboa, Portugal, pp. 3313-3316

Abbreviated Authors

Y. Liu, E. Shriberg, A. Stolcke, and M. Harper

ICSI Research Group

Speech

ICSI Publication Type

Article in conference proceedings