Publication Details
Title: Probability Estimation by Feed-Forward Networks in Continuous Speech Recognition
Author: S. Renals, N. Morgan, and H. Bourlard
Group: ICSI Technical Reports
Date: August 1991
PDF: ftp://ftp.icsi.berkeley.edu/pub/techreports/1991/tr-91-030.pdf
Overview:
We review the use of feed-forward networks as estimators of probability densities in hidden Markov modeling. In this paper we are mostly concerned with radial basis functions (RBF) networks. We note the isomorphism of RBF networks to tied mixture density estimators; additionally we note that RBF networks are trained to estimate posteriors rather than the likelihoods estimated by tied mixture density estimators. We show how the neural network training should be modified to resolve this mismatch. We also discuss problems with discriminative training, particularly the problem of dealing with unlabeled training data and the mismatch between model and data priors.
Bibliographic Information:
ICSI Technical Report TR-91-030
Bibliographic Reference:
S. Renals, N. Morgan, and H. Bourlard. Probability Estimation by Feed-Forward Networks in Continuous Speech Recognition. ICSI Technical Report TR-91-030, August 1991
Author: S. Renals, N. Morgan, and H. Bourlard
Group: ICSI Technical Reports
Date: August 1991
PDF: ftp://ftp.icsi.berkeley.edu/pub/techreports/1991/tr-91-030.pdf
Overview:
We review the use of feed-forward networks as estimators of probability densities in hidden Markov modeling. In this paper we are mostly concerned with radial basis functions (RBF) networks. We note the isomorphism of RBF networks to tied mixture density estimators; additionally we note that RBF networks are trained to estimate posteriors rather than the likelihoods estimated by tied mixture density estimators. We show how the neural network training should be modified to resolve this mismatch. We also discuss problems with discriminative training, particularly the problem of dealing with unlabeled training data and the mismatch between model and data priors.
Bibliographic Information:
ICSI Technical Report TR-91-030
Bibliographic Reference:
S. Renals, N. Morgan, and H. Bourlard. Probability Estimation by Feed-Forward Networks in Continuous Speech Recognition. ICSI Technical Report TR-91-030, August 1991