Jan Brauner
Jan Brauner has 2 papers in our library, in 2022–2023, most of them on Evaluation & benchmarks; often with Matthias Samwald, Owain Evans, Simon Ott.
OpenAlex · ORCID · Wikidata · h-index 19 · 41 works · 3,051 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 468 times in our library · 3 more in our library without a page yet · ⭐ Paper Stars ranking: #6514
Affiliations
Fields, topics and concepts
📚 Shelves 9The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksArtificial Intelligence · 2 worksDecision Sciences · 1 workComputer Vision and Pattern Recognition · 1 workStatistics, Probability and Uncertainty · 1 workPsychology · 1 workSocial Psychology · 1 workSocial Sciences · 1 workSociology and Political Science · 1 work
🧭 Topics 1Research subjects and languages the work is about.Evaluation & benchmarks · 1 work
💡 Concepts 1Key ideas and methods explained on our concept pages.Artificial intelligence · 1 work
Works by year
2020s
Papers
- Mapping global dynamics of benchmark creation and saturation in artificial intelligence (2022 · 93 citations)
Benchmarks not only measure progress in AI but also set its direction. At the same time, many of them quickly reach saturation or are barely used. The authors proposed a way to concisely map the emergence, use, and saturation of benchmarks across entire fields. To do this, they took a Papers With Code dump and built… - How to Catch an AI Liar: Lie Detection in Black-Box LLMs by Asking Unrelated Questions (2023 · 30 citations)
This work addresses detecting when a large language model gives a false answer even though it demonstrably knows the correct one.
All works
- Managing extreme AI risks amid rapid progress ↗Science · no summary yetYoshua Bengio et al.2024 · 382 citations
- Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training ↗arXiv:2401.05566 · no summary yetEvan Hubinger et al.2024 · 123 citations
- Mapping global dynamics of benchmark creation and saturation in artificial intelligenceNature CommunicationsSimon Ott, Adriano Barbosa-Silva, Kathrin Blagec, et al.2022 · 93 citations
- Question Decomposition Improves the Faithfulness of Model-Generated Reasoning ↗arXiv (Cornell University) · no summary yetAnsh Radhakrishnan et al.2023 · 74 citations
- How to Catch an AI Liar: Lie Detection in Black-Box LLMs by Asking Unrelated QuestionsarXiv:2309.15840Lorenzo Pacchiardi, Alex J. Chan, Soren Mindermann, et al.2023 · 30 citations
Co-authors here
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/jan-brauner/