A Simple Text Analytics Model To Assist Literary Criticism: comparative approach and example on James Joyce against Shakespeare and the Bible
Paper · 2017 · Renato Fabbri and Luis Henrique Garcia
Summary
The paper proposes a deliberately minimal text-analytics workflow to support literary criticism. It is designed so that programmers and humanities scholars can both follow and extend it. The idea is to place a target author's books in a shared measurement space alongside reference literature. Here the references are Shakespeare's complete works (Project Gutenberg) and the King James Bible, divided into its 80 individual books. Each book is reduced to about 20 simple statistics:
- mean sizes and counts of sentences, tokens, stopwords, punctuation and known words;
- the depth of WordNet synsets for known words.
These statistics are z-scored, and all books are projected together with PCA. As a validation case the authors analyse five works by James Joyce. Ulysses and Finnegans Wake form a cluster far from everything else. Dubliners and A Portrait sit close to Bible books, and Stephen Hero falls between the two groups. The authors read this as quantitative support for the view that Joyce's style leaves meaning gaps for the reader to fill. The method is fast, fully scripted and public, and the reference set is easy to swap.
Key points
- Reference corpus:
- Shakespeare: 36 plays plus 2 poetry batches.
- King James Bible: 39 Old Testament, 14 Apocrypha and 27 New Testament books.
- Joyce: Stephen Hero, Dubliners, Portrait, Ulysses and Finnegans Wake.
- Toolchain and code: Python, NLTK, Numpy and Matplotlib; scripts are in a public git repository. The whole run takes a few minutes.
- PCA components: the first three explain about 40.25%, 14.32% and 11.91% of the variance. Three components were kept instead of the usual two.
- POS tagging deliberately avoided: the authors argue that modernist authors bend vocabulary and syntax, which makes taggers unreliable on such texts.
- Surprising results:
- Ulysses and Finnegans Wake have deeper (more specific) synsets, landing near Shakespeare. This contradicts the authors' abstraction hypothesis.
- Dubliners has more unknown words than Ulysses.
- Known-word fractions separate Joyce's works better than the principal components do.
- Shakespeare's books occupy a narrower region than the Bible's, and the two collections are cleanly separable on PC1–PC2.
Interesting ideas
- I1. Judge a text by placing it in a fixed reference cloud of well-understood corpora rather than in isolation, so distances become interpretable.
- I2. Use the share of tokens found in a lexicon, computed both over all tokens and over content words only, as a cheap signal of how unconventional a text's vocabulary is.
- I3. Treat WordNet hypernym depth as a measure of how specific versus generic the vocabulary is, giving each text a concreteness profile.
- I4. Write down expectations before running the numbers, then openly report where results contradict them (such as the synset-depth surprise).
- I5. Choose transparent features and z-score them before PCA, so that no single measure dominates and every axis stays explainable to non-specialists.
For Mova
How these ideas could serve Mova, our small open language model — its files, stages and tests:
- I1 (learn): Keep a frozen set of reference texts and project new silver-data batches onto the same feature space to spot batches that drift away from known-good material.
- I2 (tokens): Compute this rate per sentence and flag low-coverage input as a warning that tagger and lemma output may be unreliable, before any parsing happens.
- I3 (world): Store synset depth on entities in the world graph so readers can tell vague mentions ("thing", "creature") from specific ones when resolving references or ranking answers.
- I4 (learn): Record predicted outcomes before each evaluation run, so unexpected results surface as explicit findings alongside the negative controls instead of being rationalised afterwards.
- I5 (answer): Use z-scored, named diagnostic features when comparing reader performance across test sets, so differences remain explainable rather than buried in opaque scores.
📚 Shelves 7 Computer Science · 9,086 works Artificial Intelligence · 8,889 works Arts and Humanities · 9,296 works Language and Linguistics · 9,206 works Social Sciences · 744 works General Social Sciences · 87 works Literature and Literary Theory · 340 works
Cite
Cite as Renato Fabbri and Luis Henrique Garcia. 2017. A Simple Text Analytics Model To Assist Literary Criticism: comparative approach and example on James Joyce against Shakespeare and the Bible. arXiv:1710.09233 · Anais do XX ENMC - Encontro Nacional de Modelagem Computacional e VIII ECTM - Encontro de Ciências e Tecnologia de Materiais, Nova Friburgo, RJ - 16 a 19 Outubro 2017.
@misc{fabbri2017simple,
title = {{A Simple Text Analytics Model To Assist Literary Criticism: comparative approach and example on James Joyce against Shakespeare and the Bible}},
author = {Renato Fabbri and Luis Henrique Garcia},
year = {2017},
doi = {10.48550/arxiv.1710.09233},
eprint = {1710.09233},
archivePrefix = {arXiv},
url = {https://doi.org/10.48550/arxiv.1710.09233}
}References
- Bloom, H. (1998). Shakespeare: The invention of the human. Riverhead Trade (Paperbacks). find
- Fabbri, R., Ferreira, L.H.G. (2017). Public git repository with the scripts and corpora for the quantitative analysis to support literary criticism. From https://github.com/ttm/joyce ↗
- Fellbaum, C. (2010). WordNet. In Theory and applications of ontology: computer applications (pp. 231-243). Springer Netherlands. find
- Norton, D. (2000). A history of the English Bible as literature. Cambridge University Press. ↗
- Richards, I. A. (2003). Principles of literary criticism. Routledge. ↗
- Shakespeare, W. (1994). The Complete Works of William Shakespeare. The Project Gutenberg. find
- Text mining. (2017, July 31). In Wikipedia, The Free Encyclopedia. Retrieved 02:02, August 10, 2017, from https://en.wikipedia.org/w/index.php?title=Text_mining&oldid=793168242 ↗
- Anais do XX ENMC – Encontro Nacional de Modelagem Computacional e VIII ECTM – Encontro de Ciências e Tecnologia de Materiais, Nova Friburgo, RJ – 16 a 19 Outubro 2017 find
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/papers/fabbri-2017-simple-text-analytics-model-assist/