Matthias Samwald
Matthias Samwald has 2 papers in our library, in 2022–2023, most of them on Language models & pretraining, Evaluation & benchmarks, Reasoning; often with Simon Ott, Jan Brauner.
OpenAlex · ORCID · Wikidata · h-index 35 · 223 works · 6,067 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 1,406 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #6069
Affiliations
Fields, topics and concepts
📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksDecision Sciences · 1 workArts and Humanities · 1 workStatistics, Probability and Uncertainty · 1 workLanguage and Linguistics · 1 work
🧭 Topics 3Research subjects and languages the work is about.Evaluation & benchmarks · 1 workLanguage models & pretraining · 1 workReasoning · 1 work
💡 Concepts 1Key ideas and methods explained on our concept pages.Artificial intelligence · 1 work
Works by year
2020s
Papers
- Mapping global dynamics of benchmark creation and saturation in artificial intelligence (2022 · 93 citations)
Benchmarks not only measure progress in AI but also set its direction. At the same time, many of them quickly reach saturation or are barely used. The authors proposed a way to concisely map the emergence, use, and saturation of benchmarks across entire fields. To do this, they took a Papers With Code dump and built… - ThoughtSource: A central hub for large language model reasoning data (2023 · 68 citations)
Large language models often stumble on multi-step reasoning, and their decision process is hard to inspect.
All works
- BLOOM: A 176B-Parameter Open-Access Multilingual Language Model ↗arXiv:2211.05100 · no summary yetBigScience Workshop et al.2022 · 1,606 citations
- Evaluating the Robustness of Neural Language Models to Input Perturbations ↗Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yetMilad Moradi, Matthias Samwald2021 · 115 citations
- Mapping global dynamics of benchmark creation and saturation in artificial intelligenceNature CommunicationsSimon Ott, Adriano Barbosa-Silva, Kathrin Blagec, et al.2022 · 93 citations
- ThoughtSource: A central hub for large language model reasoning dataScientific DataSimon Ott, Konstantin Hebenstreit, Valentin Lievin, et al.2023 · 68 citations
Co-authors here
Venues
- Nature Communications: Nature Communications 2022
- Scientific Data: Scientific Data 2023
- Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/matthias-samwald/