SciELO - Scientific Electronic Library Online

vol.14 issue2Analysis of linguistic style in patient and therapist during therapeutic conversation in change episodes using the Linguistic In-quir y and Word Count (LIWC)Discourse analysis of a patient: contrast between the analysis on the narrati on level and on the word level using the computerized dictionary author indexsubject indexarticles search
Home Pagealphabetic serial listing  

Services on Demand




  • Have no cited articlesCited by SciELO

Related links

  • Have no similar articlesSimilars in SciELO


Subjetividad y procesos cognitivos

On-line version ISSN 1852-7310


VENEGAS, René. Evaluation of narative text and presentation text summaries using Latent Semantic Analysis. Subj. procesos cogn. [online]. 2010, vol.14, n.2, pp.333-349. ISSN 1852-7310.

The objective of this study is to identify a method for the automatic evaluation of the summaries developed from narrative and expository Spanish texts. In order to fulfill this task evaluation of 373 summaries carried out by three teachers is correlated with the results delivered by latent semantic analysis. Scores assigned by the latent semantic analysis are obtained through three methods: 1) Comparison of the summaries with the source text, 2) Comparison of the summaries with a consensuated one, 3) Comparison of the summaries with three summaries developed by three evaluators. The most relevant results include: a) a high correlation between assessments by the evaluators (:0.63), b) a high correlation between the computational methods used (:0.62) and c) a positive medium-high average correlation between assessments undertaken by the teachers and the latent semantic analysis in the second and third method (;0.53 in both cases and types of texts). Both methods presented greater average correlation with testers when the texts evaluated were predominantly narratives (;0.59 and 0.45 respectively).

Keywords : Latent semantic analysis; Automated summary evaluation; Holistic evaluation; Narrative and expository texts; Brief summaries.

        · abstract in Spanish     · text in Spanish     · Spanish ( pdf )


Creative Commons License All the contents of this journal, except where otherwise noted, is licensed under a Creative Commons Attribution License