Nova DasSarma
Nova DasSarma has 2 papers in our library, in 2022, most of them on Language models & pretraining, Interpretability; often with Ben Mann, Dawn Drain, Nelson Elhage.
OpenAlex · h-index 13 · 14 works · 1,690 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 3,936 times in our library · 6 more in our library without a page yet · ⭐ Paper Stars ranking: #3593
Affiliations
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 1 workInterpretability · 1 work
💡 Concepts 2Key ideas and methods explained on our concept pages.Few-shot learning · 1 workScaling laws · 1 work
Works by year
2020s
Papers
- In-context Learning and Induction Heads (2022 · 475 citations)
The authors from Anthropic search for the internal mechanism of transformer language models that is responsible for in-context learning. - Scaling Laws and Interpretability of Learning from Repeated Data (2022 · 91 citations)
Large language models often see the same data several times. Sometimes this is done deliberately, to upweight high-quality sources, and sometimes it results from incomplete deduplication. The authors from Anthropic investigate why even a small fraction of repeated data harms models so severely. They train a family of…
All works
- Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback ↗arXiv:2204.05862 · no summary yetYuntao Bai et al.2022 · 1,778 citations
- Language Models (Mostly) Know What They Know ↗arXiv:2207.05221 · no summary yetSaurav Kadavath et al.2022 · 827 citations
- In-context Learning and Induction HeadsarXiv:2209.11895Catherine Olsson, Nelson Elhage, Neel Nanda, et al.2022 · 475 citations
- A General Language Assistant as a Laboratory for Alignment ↗arXiv:2112.00861 · no summary yetAmanda Askell et al.2021 · 432 citations
- Predictability and Surprise in Large Generative Models ↗arXiv:2202.07785 · no summary yetDeep Ganguli et al.2022 · 268 citations
- Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training ↗arXiv:2401.05566 · no summary yetEvan Hubinger et al.2024 · 123 citations
- Scaling Laws and Interpretability of Learning from Repeated DataarXiv:2205.10487Danny Hernandez, Tom Brown, Tom Conerly, et al.2022 · 91 citations
- Specific versus General Principles for Constitutional AI ↗arXiv (Cornell University) · no summary yetSandipan Kundu et al.2023 · 28 citations
Co-authors here
- Ben Mann ×2
- Dawn Drain ×2
- Nelson Elhage ×2
- Tom Conerly ×2
- Tom Henighan ×2
- Amanda Askell
- Anna Chen
- Catherine Olsson
- Danny Hernandez
- Neel Nanda
- Nicholas Joseph
- Scott Johnston
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/nova-dassarma/