Elamur Research⌕
☰
home / papers / 2012 / Multifractal analysis of sentence lengths in English literary texts

Multifractal analysis of sentence lengths in English literary texts

Paper · 2012 · Iwona Grabska-Gradzinska, Andrzej Kulig, Jarosław Kwapien et al.

Summary

The paper asks whether the rhythm of sentence lengths in English fiction has fractal or multifractal structure, meaning nonlinear long-range dependence rather than only linear correlation. The authors took 30 literary books from Project Gutenberg. They converted each book into a sequence of sentence lengths counted in words, preserving the original order. Sentence boundaries were full stops, colons, semicolons, question marks and exclamation marks; commas were ignored. The main tool was MFDFA, and WTMM served as a cross-check. Shuffled versions of each series acted as surrogates to separate genuine multifractality from artifacts caused by heavy tails or nonstationarity.

Each text was placed in one of four groups: no fractal scaling, monofractal, spurious multifractal-like behaviour at small scales, or genuinely multifractal. Most books were not multifractal, and some showed no scaling at all. Only a handful qualified as true multifractals. This tempers the broader claims about the fractal nature of language and shows how carefully such signals must be read.

Key points

  • The corpus has 30 English books, which the paper attributes to 17 authors. They include 5 by Dickens, 4 by Austen, and 3 each by Joyce, Conan Doyle and Twain. Single works come from Wilde, Christie, Melville, Carroll, Darwin, Shelley, Stoker and others.
  • The shortest signal is Alice in Wonderland. The longest are Ulysses and Bleak House.
  • Sentence-length distributions can be leptokurtic, so the Rényi parameter q was limited to −3…3.
  • A text counted as multifractal if its singularity spectrum f(α) was clearly wider than about 0.1. The authors say this threshold comes from their own experience.
  • Results from MFDFA and WTMM agreed more closely as the evidence for multifractality grew stronger.
  • Only the genuinely multifractal example showed a power-law stretch in its autocorrelation function.
  • Twain's and Conan Doyle's books had fairly stable fractal properties from one book to another, whereas Austen's books differed among themselves.

Interesting ideas

  • I1. Every text is compared against a shuffled copy of itself, and multifractality counts only if it clearly exceeds what the shuffled copy shows. This kind of null baseline exposes effects that come merely from the value distribution.
  • I2. A primary method is paired with a weaker independent one, and confidence rises when the two agree. The weaker method alone is avoided because it is unreliable on short inputs.
  • I3. Results are sorted into four outcome classes rather than a yes/no verdict, one of which is an explicit "looks positive but is spurious" class. This keeps borderline artifacts from being counted as successes.
  • I4. Sentence units are cut at colons and semicolons as well as terminal punctuation, on the view that each unit carries a distinct piece of information, while commas are deliberately excluded.
  • I5. The range of moments is restricted when the data are heavy-tailed, since extreme values would otherwise dominate the statistics.

For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

  • I1 (learn): Evaluations could be rerun on inputs with shuffled sentences or clauses, so that any gain that survives the shuffle is flagged as not depending on discourse order.
  • I2 (learn): Silver labels from witness parsers could be weighted by cross-method agreement, and a witness known to be weak on short sentences could be given less trust there.
  • I3 (learn): Self-induced repair rules could be judged with a similar graded outcome set, which would separate rules that truly help from ones that only appear helpful on easy cases.
  • I4 (tokens): The sentence splitter could expose a configurable segmentation level, with clause-like chunks at ";" and ":", for downstream steps that want smaller information units.
  • I5 (learn): When computing aggregate metrics over corpora with very long sentences, robust or clipped statistics could stop a few outliers from distorting parser comparisons.

Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.

Cite

Cite as Iwona Grabska-Gradzinska, Andrzej Kulig, Jarosław Kwapien, Paweł Oswi\kecimka and Stanisław Drozdz. 2012. Multifractal analysis of sentence lengths in English literary texts. arXiv:1212.3171 · AWERProcedia Information Technology & Computer Science 03, 1700, 2013.

The paper itself, not this page. BibTeX from the library's record of the work. DOI 10.48550/arxiv.1212.3171 · arXiv 1212.3171

@misc{grabskagradzinska2012multifractal,
  title = {{Multifractal analysis of sentence lengths in English literary texts}},
  author = {Iwona Grabska-Gradzinska, Andrzej Kulig, Jaroslaw Kwapien, Pawel Oswikecimka and Stanislaw Drozdz},
  year = {2012},
  doi = {10.48550/arxiv.1212.3171},
  eprint = {1212.3171},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.1212.3171}
}

References

28 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. M.H. Christiansen, N. Chater, Language as shaped by the brain, Behav. Brain Sci. vol. 31, pp. 489-509 (2008) find
  2. J. Kwapień, S. Drożdż, Physical approach to complex systems, Phys. Rep. vol. 515, pp. 115-226 (2012) find
  3. R. Ferrer-i-Cancho, R.V. Solé, Two regimes in the frequency of words and the origins of complex lexicons: Zipf’s law revisited, J. Quant. Ling. vol. 8, pp. 165-173 (2001) find
  4. L. Lü, Z.-K. Zhang, T. Zhou, Scaling laws in human language, preprint arXiv:1202.2903 (2012) ↗
  5. B. Corominas-Murtra, J. Fortuny, R.V. Solé, Emergence of Zipfs law in the evolution of communication, Phys. Rev. E vol. 83, no. 036115 (2011) find
  6. M.E.J. Newman, Power laws, Pareto distributions and Zipf’s law, Cont. Phys. vol. 45, pp. 323-351 (2005) find
  7. S.K. Baek, S. Bernhardsson, P. Minnhagen, Zipf’s law unzipped, New J. Phys. vol. 4, no. 043004 (2011) find
  8. I. Grabska-Gradzińska, A. Kulig, J. Kwapień, S. Drożdż, Complex network analysis of literary and scientific texts, Int. J. Mod. Phys. Vol. 23, no. 7 (2012) find
  9. C.G. Nevill-Manning, I.H. Witten, Identifying hierarchical structure in sequences: a linear-time algorithm, J. Artif. Intell. Res. vol. 7, pp. 67-82 (1997) find
  10. W. Ebeling, T. Pöschel, Entropy and long range correlations in literary English, Europhys. Lett. vol.26, pp.241-246 (1994) find
  11. J.M. Hausdorff, P.L. Purdon, C.-K. Peng, Z. Ladin, J.Y. Wei, A.L. Goldberger, Fractal dynamics of human gait: stability of long-range correlations in stride interval fluctuations, J. Appl. Physiol. vol. 80, pp. 1448-1457 (1996) find
  12. M.P. Paulus, M.A. Geyer, D.L. Braff, Long-range correlations in choice sequences of schizophrenic patients, Schi. Res. vol. 35, pp. 69-75 (1999) find
  13. K. Linkenkaer-Hansen, V.V. Nikouline, J.M. Palva, R.J. Ilmoniemi, Long-range temporal correlations and scaling behavior in human brain oscillations, J. Neurosci. vol. 21, pp. 1370-1377 (2001) find
  14. K. Torre, R. Balasubramaniam, N. Rheaume, L. Lemoine, H.N. Zelaznik, Long-range correlation properties in motor timing are individual and task specific, Psychon. Bull. Rev. vol. 18, pp. 339-346 (2011) find
  15. J. Gillet, M. Ausloos, A comparison of natural (English) and artificial (esperanto) languages. A multifractal method based analysis, preprint arXiv:0801.2510 (2008) ↗
  16. W. Ebeling, A. Neiman, Long-range correlations between letters and sentences in texts, Physica A vol. 215, pp. 233-241 (1995) find
  17. L. Hřebiček, Persistence and other aspects of sentence-length series, J. Quant. Ling. vol. 4, pp. 105-109 (1997) find
  18. M.A. Montemurro, P.A. Pury, Long-range correlations in literary corpora, Fractals vol. 10, pp. 451-461 (2002) find
  19. S.S. Melnyk, O.V. Usatenko, V.A. Yampol’skii, Competition between two kinds of correlations in literary texts, Phys. Rev. E vol. 72, no. 026140 (2005) find
  20. G. Sahin, M. Erentürk, A. Hacinliyan, Detrended fluctuation analysis in natural languages using non-corpus parametrization, Chaos Solit. Fract. vol. 41, pp. 198-205 (2009) find
  21. J. Bhan, S. Kim, J. Kim, Y. Kwon, S. Yang, K. Lee, "Long-range correlations in Korean literary corpora, Chaos Solit. Fract. vol. 29, pp. 69-81 (2006) find
  22. C.-K. Peng, S.V. Buldyrev, S. Havlin, M. Simons, H.E. Stanley, A.L. Goldberger, Mosaic organization of DNA nucleotides, Phys. Rev. E vol. 49, pp. 1685-1689 (1994) find
  23. A.N. Pavlov, W. Ebeling, L. Molgedey, A.R. Ziganshin, V.S. Anishchenko, Scaling features of texts, images and time series, Physica A vol. 300, pp. 310-324 (2001) find
  24. J.W. Kantelhardt, S.A. Zschiegner, E. Koscielny-Bunde, S. Havlin, A. Bunde, H.E. Stanley, Multifractal detrended fluctuation analysis of nonstationary time series, Physica A vol. 316, pp. 87-114 (2002) find
  25. A. Arneodo, E. Bacry, J.F. Muzy, The thermodynamics of fractals revisited with wavelets, Physica A vol. 213-275, pp. 232 (1995) find
  26. P. Oświęcimka, J. Kwapień, S. Drożdż, Wavelet versus detrended fluctuation analysis of multifractal structures, Phys. Rev. E vol. 74, no. 016103 (2006) find
  27. T.C. Halsey, M.H. Jensen, L.P. Kadanoff, I. Procaccia, B.I. Shraiman, Fractal measures and their singularities: the characterization of strange sets, Phys. Rev. A vol. 33, pp. 1141-1151 (1986) find
  28. S. Drożdż, J. Kwapień, P. Oświęcimka, R. Rak, Quantitative features of multifractal subtleties in time series, EPL vol. 88, no. 60003 (2009) find

Updated

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/grabska-gradzinska-2012-multifractal-analysis-sentence-lengths-english/