SciELO - Scientific Electronic Library Online

 
vol.35 número2Discrete event control of time-varying plantsA method solving an inverse problem with unknown parameters from two sets of relative measurements índice de autoresíndice de materiabúsqueda de artículos
Home Pagelista alfabética de revistas  

Servicios Personalizados

Articulo

Indicadores

  • No hay articulos citadosCitado por SciELO

Links relacionados

  • En proceso de indezaciónCitado por Google
  • No hay articulos similaresSimilares en SciELO
  • En proceso de indezaciónSimilares en Google

Bookmark


Latin American applied research

versión impresa ISSN 0327-0793

Resumen

PIANTANIDA, J. P.  y  ESTIENNE, C. F.. A new estimator based on maximum entropy. Lat. Am. appl. res. [online]. 2005, vol.35, n.2, pp. 143-147. ISSN 0327-0793.

In this paper, we propose a new formulation of the classical Good-Turing estimator for n-gram language models. The new approach is based on defining a dynamic model for language production. Instead of assuming a fixed probability distribution of occurrence of an n-gram on the whole text, we propose a maximum entropy approximation of a time varying distribution. This approximation led us to a new distribution, which in turn is used to calculate expectations of the Good-Turing estimator. This defines a new estimator that we call Maximum Entropy Good-Turing estimator. In contrast to the classical Good-Turing estimator, the new formulation needs neither expectations approximations nor windowing or other smoothing techniques. It also contains the well known discounting estimators as special cases. Performance is evaluated both in terms of perplexity and word error rate in an N-best rescoring task. Also comparison to other classical estimators is performed. In all cases our approach performs significantly better than classical estimators.

Palabras llave : Languaje Models; Maximum Entropy; Good-Turing Estimation.

        · texto en Inglés     · pdf en Inglés