Samson Tan
Samson Tan has 2 papers in our library, in 2021–2023, most of them on Tokenization & segmentation; often with Arun Raja, Benoît Sagot, Chenglei Si.
OpenAlex · ORCID · h-index 9 · 25 works · 1,003 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 226 citations in our library · 2 more in our library without a page yet · ⭐ Paper Star rank #3915
Affiliations
🏢AmazonSeattle ·
United States2022–2024 · 8 papers🎓National University of SingaporeSingapore ·
Singapore2020–2022 · 7 papers🎓Nanyang Technological UniversitySingapore ·
Singapore2020–2021 · 4 papers🏢SalesforceSan Francisco ·
United States2020–2022 · 3 papers
Topics
Tokenization & segmentation (1)
Works by year
2020s
Papers
- Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP (2021 · 89 citations)
This is a survey paper by the BigScience Workshop tokenization working group. The authors examine which units of text NLP models should operate on: words, subwords, characters, bytes, or even pixels. The paper offers no new data and no method of its own. Instead, it connects research from the pre-neural and neural… - NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation (2023 · 84 citations)
Data augmentation is used both to stress-test NLP models and to make their training data more diverse. Most existing perturbation tools offer a narrow, largely English set of edits that are rarely matched to a specific task. NL-Augmenter addresses this with an open, community-built Python library. It grew out of the…
Also in our library
Co-authors here
- Arun Raja
- Benoît Sagot
- Chenglei Si
- Colin Raffel
- Elizabeth Salesky
- Jascha Sohl-Dickstein
- Manan Dey
- Saad Mahamood
- Sabrina J. Mielke
- Sebastian Gehrmann
- Simon Mille
- Varun Gangal
Cited by
This page in Markdown → https://md.research.elamur.ai/free/en/authors/samson-tan/