Tom Conerly
Tom Conerly has 2 papers in our library, in 2022, most of them on Language models & pretraining, Interpretability; often with Ben Mann, Dawn Drain, Nelson Elhage.
OpenAlex · h-index 7 · 8 works · 1,298 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 2,945 times in our library · 3 more in our library without a page yet · ⭐ Paper Stars ranking: #3594
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 1 workInterpretability · 1 work
💡 Concepts 2Key ideas and methods explained on our concept pages.Few-shot learning · 1 workScaling laws · 1 work
Works by year
2020s
Papers
- In-context Learning and Induction Heads (2022 · 475 citations)
The authors from Anthropic search for the internal mechanism of transformer language models that is responsible for in-context learning. - Scaling Laws and Interpretability of Learning from Repeated Data (2022 · 91 citations)
Large language models often see the same data several times. Sometimes this is done deliberately, to upweight high-quality sources, and sometimes it results from incomplete deduplication. The authors from Anthropic investigate why even a small fraction of repeated data harms models so severely. They train a family of…
All works
- Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback ↗arXiv:2204.05862 · no summary yetYuntao Bai et al.2022 · 1,778 citations
- Language Models (Mostly) Know What They Know ↗arXiv:2207.05221 · no summary yetSaurav Kadavath et al.2022 · 827 citations
- In-context Learning and Induction HeadsarXiv:2209.11895Catherine Olsson, Nelson Elhage, Neel Nanda, et al.2022 · 475 citations
- Predictability and Surprise in Large Generative Models ↗arXiv:2202.07785 · no summary yetDeep Ganguli et al.2022 · 268 citations
- Scaling Laws and Interpretability of Learning from Repeated DataarXiv:2205.10487Danny Hernandez, Tom Brown, Tom Conerly, et al.2022 · 91 citations
Co-authors here
- Ben Mann ×2
- Dawn Drain ×2
- Nelson Elhage ×2
- Nova DasSarma ×2
- Tom Henighan ×2
- Amanda Askell
- Anna Chen
- Catherine Olsson
- Danny Hernandez
- Neel Nanda
- Nicholas Joseph
- Scott Johnston
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/tom-conerly/