William Bialek
William Bialek has 2 papers in our library, in 2007–2025, most of them on Language models & pretraining, English.
OpenAlex · ORCID · Wikidata · h-index 73 · 305 works · 29,811 citations OpenAlex, 2026-10-14
Affiliations
Fields, topics and concepts
📚 Shelves 8The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksComputer Science · 2 worksEconomics and Econometrics · 1 workEconomics, Econometrics and Finance · 1 workPhysics and Astronomy · 1 workStatistical and Nonlinear Physics · 1 workArts and Humanities · 1 workLanguage and Linguistics · 1 work
🧭 Topics 2Research subjects and languages the work is about.English · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
2000s
Papers
- Toward a statistical mechanics of four letter words (2007 · 74 citations)
The paper asks whether English spelling, which looks highly combinatorial and rule-bound, can be described by a simple model that uses only pairwise statistics between letter positions. - Large language models and the entropy of English (2025)
The authors use modern LLMs to revisit Shannon's guessing game and ask how far back in a text the useful predictive information extends.
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/william-bialek/