Matthew Rahtz
Matthew Rahtz has 3 papers in our library, in 2023–2024, most of them on Language models & pretraining, Evaluation & benchmarks, Interpretability; often with Janos Kramar, Tom Lieberum, Vladimir Mikulik.
OpenAlex · h-index 7 · 14 works · 2,335 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 3,507 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #7554
Affiliations
Fields, topics and concepts
📚 Shelves 8The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 3 worksComputer Science · 3 worksArts and Humanities · 2 worksLanguage and Linguistics · 2 worksEngineering · 1 workSafety Research · 1 workSafety, Risk, Reliability and Quality · 1 workSocial Sciences · 1 work
🧭 Topics 3Research subjects and languages the work is about.Interpretability · 1 workLanguage models & pretraining · 1 workEvaluation & benchmarks · 1 work
💡 Concepts 1Key ideas and methods explained on our concept pages.Scaling laws · 1 work
Works by year
2020s
Papers
- Does Circuit Analysis Interpretability Scale? Evidence from Multiple Choice Capabilities in Chinchilla (2023 · 58 citations)
Circuit analysis has mostly been demonstrated on small networks, such as two-layer attention-only transformers or the 117M GPT-2. - The Hydra Effect: Emergent Self-repair in Language Model Computations (2023 · 49 citations)
The paper asks how far ablation can be trusted for working out which parts of a large language model drive its predictions. - Evaluating Frontier Models for Dangerous Capabilities (2024 · 36 citations)
Popular benchmarks measure broad skills such as coding or maths, and most safety tests check whether a model refuses harmful requests.
All works
- Gemma 2: Improving Open Language Models at a Practical Size ↗arXiv:2408.00118 · no summary yetGemma Team et al.2024 · 1,302 citations
- Does Circuit Analysis Interpretability Scale? Evidence from Multiple Choice Capabilities in ChinchillaarXiv:2307.09458Tom Lieberum, Matthew Rahtz, Janos Kramar, et al.2023 · 58 citations
- The Hydra Effect: Emergent Self-repair in Language Model ComputationsarXiv:2307.15771Thomas McGrath, Matthew Rahtz, Janos Kramar, et al.2023 · 49 citations
- Evaluating Frontier Models for Dangerous CapabilitiesarXiv:2403.13793Mary Phuong, Matthew Aitchison, Elliot Catt, et al.2024 · 36 citations
Co-authors here
- Janos Kramar ×2
- Tom Lieberum ×2
- Vladimir Mikulik ×2
- Elliot Catt
- Geoffrey Irving
- Mary Phuong
- Matthew Aitchison
- Neel Nanda
- Rohin Shah
- Shane Legg
- Thomas McGrath
- Yannis Assael
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/matthew-rahtz/