Scott Johnston
Scott Johnston has 2 papers in our library, in 2022–2023, most of them on Language models & pretraining, Interpretability; often with Zac Hatfield-Dodds, Amanda Askell, Ben Mann.
OpenAlex · ORCID · h-index 10 · 25 works · 467 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 400 citations in our library · ⭐ Paper Star rank #3182
Affiliations
Topics
Language models & pretraining (1) Interpretability (1)
Works by year
2020s
Papers
- Towards Understanding Sycophancy in Language Models (2023 · 354 citations)
The paper looks at sycophancy: AI assistants telling users what they seem to want to hear instead of what is accurate. - Scaling Laws and Interpretability of Learning from Repeated Data (2022 · 62 citations)
Large language models often see the same data several times. Sometimes this is done deliberately, to upweight high-quality sources, and sometimes it results from incomplete deduplication. The authors from Anthropic investigate why even a small fraction of repeated data harms models so severely. They train a family of…
Co-authors here
- Zac Hatfield-Dodds ×2
- Amanda Askell
- Ben Mann
- Danny Hernandez
- Dawn Drain
- Esin Durmus
- Samuel R. Bowman
- Tom Brown
- Tom Henighan
- Tomasz Korbak
Cited by
This page in Markdown → https://md.research.elamur.ai/free/en/authors/scott-johnston/