Li Kevin Wenliang
Li Kevin Wenliang has 2 papers in our library, in 2022–2023, most of them on Language models & pretraining, Efficient models & compression; often with Anian Ruoss, Elliot Catt, Gregoire Deletang.
OpenAlex · ORCID · h-index 8 · 25 works · 333 citations OpenAlex, 2026-10-14
2 works in our library · 126 citations in our library · ⭐ Paper Star rank #3964
Affiliations
🎓University College LondonLondon ·
United Kingdom2018–2026 · 10 papers🔬Gatsby Computational Neuroscience UnitLondon ·
United Kingdom2018–2026 · 5 papers🏢Google DeepMindLondon ·
United Kingdom2024–2026 · 5 papers
Topics
Language models & pretraining1 Efficient models & compression1
Works by year
2020s
Papers
- Language Modeling Is Compression (2023 · 89 citations)
The paper revisits the old equivalence between prediction and lossless compression and uses it to evaluate large pretrained models. - Neural Networks and the Chomsky Hierarchy (2022 · 66 citations)
The authors investigate whether the theory of computation, specifically the Chomsky hierarchy, can predict where the ability of neural networks to generalize out of distribution ends.
Co-authors here
- Anian Ruoss ×2
- Elliot Catt ×2
- Gregoire Deletang ×2
- Joel Veness ×2
- Jordi Grau-Moya ×2
- Marcus Hutter ×2
- Tim Genewein ×2
- Paul-Ambroise Duquenne
Cited by
This page in Markdown → https://md.research.elamur.ai/free/en/authors/li-kevin-wenliang/