Javier Ferrando
Javier Ferrando has 2 papers in our library, in 2024, most of them on Language models & pretraining, Interpretability; often with Arianna Bisazza, Elena Voita, Gabriele Sarti.
OpenAlex · h-index 7 · 16 works · 115 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 100 times in our library · ⭐ Paper Stars ranking: #7651
Affiliations
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 2 worksInterpretability · 1 work
Works by year
2020s
Papers
- A Primer on the Inner Workings of Transformer-based Language Models (2024 · 72 citations)
This survey addresses a gap in interpretability research. Insights into how language models work internally have accumulated quickly but remain scattered. Earlier NLP surveys centred mostly on encoder models such as BERT. Ferrando, Sarti, Bisazza and Costa-jussà (UPC, University of Groningen, FAIR Meta) instead give… - Information Flow Routes: Automatically Interpreting Language Models at Scale (2024 · 43 citations)
Mechanistic interpretability usually finds circuits through activation patching. That approach depends on hand-built prompt templates with contrastive counterparts and needs many forward passes, so it does not scale to large models or arbitrary inputs. Ferrando and Voita represent a Transformer's computation as a…
Co-authors here
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/javier-ferrando/