Marc Marone
Marc Marone has 2 papers in our library, in 2024–2025, most of them on Language models & pretraining, Multilingual & cross-lingual NLP; often with Benjamin Van Durme, Dawn Lawrie, Orion Weller.
OpenAlex · h-index 7 · 24 works · 369 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 631 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #6750
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 2Research subjects and languages the work is about.Multilingual & cross-lingual NLP · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- mmBERT: A Modern Multilingual Encoder with Annealed Language Learning (2025 · 59 citations)
Multilingual encoder-only models have seen little progress in recent years, and XLM-R remains the default choice despite being more than six years old. - “According to . . . “: Prompting Language Models Improves Quoting from Pre-Training Data (2024 · 46 citations)
Large language models often invent facts even though they were trained on reliable text. The authors test whether a simple cue in the prompt, such as "According to Wikipedia", can make a model reproduce more material it memorized during pre-training. To measure this, they introduce QUIP-Score (Quoted Information…
All works
- StarCoder: may the source be with you! ↗arXiv:2305.06161 · no summary yetRaymond Li et al.2023 · 732 citations
- mmBERT: A Modern Multilingual Encoder with Annealed Language LearningarXiv:2509.06888Marc Marone, Orion Weller, William Fleshman, et al.2025 · 59 citations
- “According to . . . “: Prompting Language Models Improves Quoting from Pre-Training DataConference of the European Chapter of the Association for Computational Linguistics (EACL)Orion Weller, Marc Marone, Nathaniel Weir, et al.2024 · 46 citations
Co-authors here
Venues
- Conference of the European Chapter of the Association for Computational Linguistics (EACL): EACL 2024
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/marc-marone/