Stas Bekman
Stas Bekman has 2 papers in our library, in 2022–2023, most of them on Language models & pretraining, Multilingual & cross-lingual NLP, GPU & parallel computing; often with Lucile Saulnier, Thomas Wang, Alexander M. Rush.
OpenAlex · ORCID · Wikidata · h-index 6 · 19 works · 1,385 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 1,881 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #5795
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksComputer Vision and Pattern Recognition · 1 workInformation Systems · 1 workArtificial Intelligence · 1 workArts and Humanities · 1 workLanguage and Linguistics · 1 work
🧭 Topics 4Research subjects and languages the work is about.Vision & language · 1 workGPU & parallel computing · 1 workLanguage models & pretraining · 1 workMultilingual & cross-lingual NLP · 1 work
Works by year
2020s
Papers
- OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents (2023 · 197 citations)
High-performing vision-language systems such as Flamingo and KOSMOS-1 learn from web pages in which pictures and prose alternate. - What Language Model to Train if You Have One Million GPU Hours? (2022 · 73 citations)
The BigScience collaboration had a fixed allowance of roughly one million A100 GPU-hours to build BLOOM, a massively multilingual model with more than 100B parameters.
All works
- BLOOM: A 176B-Parameter Open-Access Multilingual Language Model ↗arXiv:2211.05100 · no summary yetBigScience Workshop et al.2022 · 1,606 citations
- OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text DocumentsConference on Neural Information Processing Systems (NeurIPS)Hugo Laurençon, Lucile Saulnier, Leo Tronchon, et al.2023 · 197 citations
- What Language Model to Train if You Have One Million GPU Hours?arXiv:2210.15424Teven Le Scao, Thomas Wang, Daniel Hesslow, et al.2022 · 73 citations
Co-authors here
- Lucile Saulnier ×2
- Thomas Wang ×2
- Alexander M. Rush
- Amanpreet Singh
- Anton Lozhkov
- Colin Raffel
- Daniel Hesslow
- Douwe Kiela
- Hady Elsahar
- Hugo Laurençon
- Jason Phang
- Leo Tronchon
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/stas-bekman/