Publication Details
Title: Links Between Markov Models and Multilayer Perceptrons
Author: H. Bourlard and C. J. Wellekens
Group: ICSI Technical Reports
Date: November 1988
PDF: http://www.icsi.berkeley.edu/pubs/techreports/tr-88-008.pdf
Overview:
Hidden Markov models are widely used for automatic speech recognition. They inherently incorporate the sequential character of speech signal and are statistically trained. However, the a priori choice of a model topology limits the flexibility of the HMM's. Another drawback of these models is their weak discriminating power. Multilayer perceptrons are now promising tools in the connectionist approach for classification problems and have already been successfully tested on speech recognition problems. However, the sequential nature of the speech signal remains difficult to handle in that kind of machine. In this paper, a discriminant hidden Markov model is defined and it is shown how a particular multilayer perceptron with contextual and extra feedback input units can be considered as a general form of such Markov models. Relations with other recurrent networks commonly used in speech recognition are also pointed out.
Bibliographic Information:
ICSI Technical Report TR-88-008
Bibliographic Reference:
H. Bourlard and C. J. Wellekens. Links Between Markov Models and Multilayer Perceptrons. ICSI Technical Report TR-88-008, November 1988
Author: H. Bourlard and C. J. Wellekens
Group: ICSI Technical Reports
Date: November 1988
PDF: http://www.icsi.berkeley.edu/pubs/techreports/tr-88-008.pdf
Overview:
Hidden Markov models are widely used for automatic speech recognition. They inherently incorporate the sequential character of speech signal and are statistically trained. However, the a priori choice of a model topology limits the flexibility of the HMM's. Another drawback of these models is their weak discriminating power. Multilayer perceptrons are now promising tools in the connectionist approach for classification problems and have already been successfully tested on speech recognition problems. However, the sequential nature of the speech signal remains difficult to handle in that kind of machine. In this paper, a discriminant hidden Markov model is defined and it is shown how a particular multilayer perceptron with contextual and extra feedback input units can be considered as a general form of such Markov models. Relations with other recurrent networks commonly used in speech recognition are also pointed out.
Bibliographic Information:
ICSI Technical Report TR-88-008
Bibliographic Reference:
H. Bourlard and C. J. Wellekens. Links Between Markov Models and Multilayer Perceptrons. ICSI Technical Report TR-88-008, November 1988