Benedikt Stroebl
Benedikt Stroebl has 2 papers in our library, in 2024–2026, most of them on Language models & pretraining; often with Arvind Narayanan, Chris Wendler, Robert West.
OpenAlex · h-index 2 · 14 works · 14 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 121 times in our library · 5 more in our library without a page yet · ⭐ Paper Stars ranking: #8724
Affiliations
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksComputer Science · 2 worksArts and Humanities · 1 workLanguage and Linguistics · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- AI Agents That Matter (2024 · 55 citations)
Benchmarks steer the development of LLM-based agents. The Princeton authors argue that current evaluation habits reward topping leaderboards rather than building systems that work in practice. They identify four problems: - Localized Cultural Knowledge is Conserved and Controllable in Large Language Models (2026 · 7 citations)
Large language models (LLMs) often answer non-English prompts as if the user lived in an English-speaking, largely American setting, even when they hold the relevant local knowledge.
All works
- AI Agents That MatterarXiv:2407.01502Sayash Kapoor, Benedikt Stroebl, Zachary S. Siegel, et al.2024 · 55 citations
- CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmark ↗arXiv:2409.11363 · no summary yetZachary S. Siegel et al.2024 · 39 citations
- The Limits of Inference Scaling Through Resampling ↗arXiv:2411.17501 · no summary yetBenedikt Stroebl, Sayash Kapoor, Arvind Narayanan2024 · 21 citations
- Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluation ↗arXiv:2510.11977 · no summary yetSayash Kapoor et al.2025 · 11 citations
- Localized Cultural Knowledge is Conserved and Controllable in Large Language ModelsFindings of the Association for Computational LinguisticsVeniamin Veselovsky, Berke Argın, Benedikt Stroebl, et al.2026 · 7 citations
- Safety Degradation in AI Agents ↗arXiv (Cornell University) · no summary yetCheng Yu et al.2025 · 2 citations
- Information Retrieval Induced Safety Degradation in AI Agents ↗neural information processing systems · no summary yetCheng Yu et al.2025
Co-authors here
Venues
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2026
- neural information processing systems
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/benedikt-stroebl/