Probability distribution in a quantitative linguistic problem

• Autor(a) principal: Calderón,F.
• Data de Publicação: 2009
• Outros Autores: Curilef,S., Ladrón de Guevara,M. L.
• Tipo de documento: Artigo
• Idioma: eng
• Título da fonte: Brazilian Journal of Physics
• Texto Completo: http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0103-97332009000400028
• topic: Probability distribution; Zipf law; Binder cumulants

In the present contribution, we propose a possible way to discuss the distributions of words in a given text. We have devoted our study to discuss some relevant properties observed in Spanish texts of Latin-American writers. We start analyzing the appearance of distributions of the frequency of occurrence in the Zipf perspective. We identify two regions of behavior separated by a special point. In order to correctly define such a point, we work beyond the Zipf law, defining other probability distribution that takes the frequency of repetition of a particular word among other different words into account. At this point, we take the linguistic problem to a statistical level. We make an effort to characterize the point of separation between two regions, via the Binder cumulant of fourth order, as it is made in the characterization of critical points in phase transitions of physical systems.