🔗 Who cites «Byte Pair Encoding is Suboptimal for Language Model Pretraining»

136 papers of our library cite it (of the 140,884 whose bibliographies we read) · 20 with a page here, the most cited first · ← the paper

1. BloombergGPT: A Large Language Model for FinanceShijie Wu, Ozan Irsoy, Steven Lu, et al.2023 · 608 citations
2. Charformer: Fast Character Transformers via Gradient-based Subword TokenizationYi Tay, Vinh Q. Tran, Sebastian Ruder, et al.2021 · 179 citations
3. Do All Languages Cost the Same? Tokenization in the Era of Commercial Language ModelsOrevaoghene Ahia, Sachin Kumar, Hila Gonen, et al.2023 · 164 citations
4. Canine: Pre-training an Efficient Tokenization-Free Encoder for Language RepresentationJonathan H. Clark, Dan Garrette, Iulia Turc, et al.2022 · 156 citations
5. Superbizarre Is Not Superb: Derivational Morphology Improves BERT's Interpretation of Complex WordsValentin, Hofmann2021 · 101 citations
6. Tokenization Is More Than CompressionCraig W Schmidt, Varshini Reddy, Haoran Zhang, et al.2024 · 66 citations
7. Evaluating Various Tokenizers for Arabic Text ClassificationZaid Alyafeai, Maged S. Al-shaibani, Mustafa Ghaleb, et al.2021 · 66 citations
8. Tokenization counts: the impact of tokenization on arithmetic in frontier LLMsAaditya K. Singh, DJ Strouse2024 · 53 citations
9. Counting the Bugs in ChatGPT's Wugs: A Multilingual Investigation into the Morphological Capabilities of a Large Language ModelLeonie Weissweiler, Valentin Hofmann, Anjali Kantharuban2023 · 47 citations
10. Prediction of Arabic Legal Rulings using Large Language ModelsAdel Ammar, Anis Koubaa, Bilel Benjdira, et al.2023 · 27 citations
11. The Impact of Token Granularity on the Predictive Power of Language Model SurprisalByung-Doh Oh, William Schuler2025 · 12 citations
12. Exploring Tokenization Strategies and Vocabulary Sizes for Enhanced Arabic Language ModelsMohamed Taher Alrefaie, Nour Eldin Morsy, Nada Samir2024 · 5 citations
13. Kuwain 1.5B: An Arabic SLM via Language InjectionKhalil Hennara, Sara Chrouf, Mohamed Motaism Hamed, et al.2025 · 4 citations
14. MoVoC: Morphology-Aware Subword Construction for Ge'ez Script LanguagesHailay Kidu Teklehaymanot, Dren Fazlija, Wolfgang Nejdl2025 · 4 citations
15. MoVoC: Morphology-Aware Subword Construction for Geez Script LanguagesHailay Kidu Teklehaymanot, Dren Fazlija, Wolfgang Nejdl2025 · 4 citations
16. Do Diacritics Matter? Evaluating the Impact of Arabic Diacritics on Tokenization and LLM BenchmarksGo Inoue, Bashar Alhafni, Nizar Habash, et al.2026 · 3 citations
17. Morphemes Without Borders: Evaluating Root-Pattern Morphology in Arabic Tokenizers and LLMsYara Alakeel, Chatrine Qwaider, Hanan Aldarmaki, et al.2026 · 1 citation
18. Morphemes without Borders: Evaluating Root–Pattern Morphology in Arabic Tokenizers and LLMsYara Yousif Alakeel, Chatrine Qwaider, Hanan Aldarmaki, et al.2026 · 1 citation
19. AI Corpus Linguist: More than a Year of ExperienceJiří Milička, Tomáš Machálek2026
20. The Impact of Tokenization Algorithms on Hungarian Language Model PerformanceMátyás Osváth, Máté Norbert Molnár, Roland Gunics, et al.2026

116 more papers of our library cite it; they have no page here yet.

This page in Markdown → https://md.research.elamur.ai/free/en/papers/bostrom-2020-byte-pair-encoding-is-suboptimal/cited-by/