David Bau
David Bau has 3 papers in our library, in 2023–2026, most of them on Interpretability; often with Arnab Sen Sharma, Jiuding Sun, Koyena Pal.
OpenAlex · ORCID · Wikidata · h-index 32 · 106 works · 13,913 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 1,328 times in our library · 7 more in our library without a page yet · ⭐ Paper Stars ranking: #7253
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 3 worksComputer Science · 3 worksArtificial Intelligence · 3 worksLanguage and Linguistics · 3 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Interpretability · 1 work
Works by year
2020s
Papers
- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State (2023 · 49 citations)
The paper asks whether a transformer's internal state for one token carries information about tokens beyond the immediate next one, specifically positions t+2 and later. Working with GPT-J-6B, the authors compare three ways of reading that information out of a single hidden state taken at one layer and one position. - Locating and Editing Factual Associations in Mamba (2024 · 18 citations)
Studies of transformer LMs have found that factual recall is concentrated in particular modules at specific token positions, and that one rank-one weight change can overwrite a stored fact. - The Quest for the Right Mediator: Surveying Mechanistic Interpretability for NLP Through the Lens of Causal Mediation Analysis (2026 · 7 citations)
Research on mechanistic interpretability (MI) of language models is fragmented. Studies use bespoke evaluations, lack a shared theoretical basis, and rarely define the elementary causal units that make up a "mechanism." This survey, published in Computational Linguistics, treats MI as recovering causal graphs that…
All works
- Network Dissection: Quantifying Interpretability of Deep Visual Representations ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetDavid Anthony Bau et al.2017 · 1,396 citations
- Locating and Editing Factual Associations in GPT ↗arXiv:2202.05262 · no summary yetKevin Meng et al.2022 · 1,124 citations
- Erasing Concepts from Diffusion Models ↗IEEE/CVF International Conference on Computer Vision (ICCV) · no summary yetRohit Gandikota et al.2023 · 277 citations
- Function Vectors in Large Language Models ↗arXiv:2310.15213 · no summary yetEric Todd et al.2023 · 127 citations
- Linearity of Relation Decoding in Transformer Language Models ↗arXiv:2308.09124 · no summary yetEvan Hernandez et al.2023 · 82 citations
- Future Lens: Anticipating Subsequent Tokens from a Single Hidden StateConference on Computational Natural Language Learning (CoNLL)Koyena Pal, Jiuding Sun, Andrew Yuan, et al.2023 · 49 citations
- Locating and Editing Factual Associations in MambaarXiv:2404.03646Arnab Sen Sharma, David Atkinson, David Bau2024 · 18 citations
- Machine Unlearning Doesn't Do What You Think: Lessons for Generative AI Policy, Research, and Practice ↗SSRN Electronic Journal · no summary yetA. Feder Cooper et al.2025 · 12 citations
- The Quest for the Right Mediator: Surveying Mechanistic Interpretability for NLP Through the Lens of Causal Mediation AnalysisComputational LinguisticsAaron Mueller, Jannik Brinkmann, Millicent Li, et al.2026 · 7 citations
- Shared Lexical Task Representations Explain Behavioral Variability In LLMs ↗arXiv (Cornell University) · no summary yetZhuonan Yang et al.2026
Co-authors here
Venues
- Computational Linguistics: Computational Linguistics 2026
- Conference on Computational Natural Language Learning (CoNLL): CoNLL 2023
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
- IEEE/CVF International Conference on Computer Vision (ICCV)
- SSRN Electronic Journal
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/david-bau/