Koyena Pal
Koyena Pal has 2 papers in our library, in 2023–2026, most of them on Interpretability; often with David Bau, Jiuding Sun, Aaron Mueller.
OpenAlex · ORCID · h-index 3 · 12 works · 29 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 45 times in our library · ⭐ Paper Stars ranking: #7660
Affiliations
🎓Northeastern UniversityBoston ·
United States2023–2026 · 7 papers🏢Fidelity InvestmentsBoston ·
United States2026 · 1 paper
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 1Research subjects and languages the work is about.Interpretability · 1 work
Works by year
2020s
Papers
- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State (2023 · 49 citations)
The paper asks whether a transformer's internal state for one token carries information about tokens beyond the immediate next one, specifically positions t+2 and later. Working with GPT-J-6B, the authors compare three ways of reading that information out of a single hidden state taken at one layer and one position. - The Quest for the Right Mediator: Surveying Mechanistic Interpretability for NLP Through the Lens of Causal Mediation Analysis (2026 · 7 citations)
Research on mechanistic interpretability (MI) of language models is fragmented. Studies use bespoke evaluations, lack a shared theoretical basis, and rarely define the elementary causal units that make up a "mechanism." This survey, published in Computational Linguistics, treats MI as recovering causal graphs that…
Co-authors here
Venues
- Computational Linguistics: Computational Linguistics 2026
- Conference on Computational Natural Language Learning (CoNLL): CoNLL 2023
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/koyena-pal/