Publication Details
Title: Precise n-gram Probabilities from Stochastic Context-free Grammars
Author: A. Stolcke and J. Segal
Group: ICSI Technical Reports
Date: January 1994
PDF: ftp://ftp.icsi.berkeley.edu/pub/techreports/1994/tr-94-007.pdf
Overview:
We present an algorithm for computing n-gram probabilities from stochastic context-free grammars, a procedure that can alleviate some of the standard problems associated with n-grams (estimation from sparse data, lack of linguistic structure, among others). The method operates via the computation of substring expectations, which in turn is accomplished by solving systems of linear equations derived from the grammar. We discuss efficient implementation of the algorithm and report our practical experience with it.
Bibliographic Information:
ICSI Technical Report TR-94-007
Bibliographic Reference:
A. Stolcke and J. Segal. Precise n-gram Probabilities from Stochastic Context-free Grammars. ICSI Technical Report TR-94-007, January 1994
Author: A. Stolcke and J. Segal
Group: ICSI Technical Reports
Date: January 1994
PDF: ftp://ftp.icsi.berkeley.edu/pub/techreports/1994/tr-94-007.pdf
Overview:
We present an algorithm for computing n-gram probabilities from stochastic context-free grammars, a procedure that can alleviate some of the standard problems associated with n-grams (estimation from sparse data, lack of linguistic structure, among others). The method operates via the computation of substring expectations, which in turn is accomplished by solving systems of linear equations derived from the grammar. We discuss efficient implementation of the algorithm and report our practical experience with it.
Bibliographic Information:
ICSI Technical Report TR-94-007
Bibliographic Reference:
A. Stolcke and J. Segal. Precise n-gram Probabilities from Stochastic Context-free Grammars. ICSI Technical Report TR-94-007, January 1994