Adam Pearce
Adam Pearce has 2 papers in our library, in 2019–2024, most of them on Language models & pretraining; often with Andy Coenen, Ann Yuan, Avi Caciularu.
OpenAlex · ORCID · Wikidata · h-index 10 · 18 works · 1,032 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 283 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #4627
Affiliations
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
2010s
Papers
- Visualizing and Measuring the Geometry of BERT (2019 · 349 citations)
The paper asks how BERT internally organizes the linguistic knowledge that makes it so easy to fine-tune. It combines visualizations with quantitative tests. For syntax, the Google Brain authors build "attention probes". For each token pair, they gather the attention values from every head and layer of BERT-base into… - Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Models (2024 · 84 citations)
Researchers often want to know what a large language model has encoded in its intermediate hidden states. Existing tools have drawbacks. Probes require supervised training on fixed label sets. Vocabulary projections such as Logit Lens become unreliable in early layers. Most methods return only token probabilities…
All works
- Visualizing and Measuring the Geometry of BERTarXiv:1906.02715Andy Coenen, Emily Reif, Ann Yuan, et al.2019 · 349 citations
- Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language ModelsarXiv:2401.06102Asma Ghandeharioun, Avi Caciularu, Adam Pearce, et al.2024 · 84 citations
- Auditing language models for hidden objectives ↗arXiv (Cornell University) · no summary yetMarks, Samuel et al.2025 · 19 citations
Co-authors here
- Andy Coenen
- Ann Yuan
- Avi Caciularu
- Been Kim
- Emily Reif
- Fernanda Viegas
- Lucas Dixon
- Martin Wattenberg
- Mor Geva
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/adam-pearce/