Katherine M. Collins
Katherine M. Collins has 2 papers in our library, in 2023–2025, most of them on Language models & pretraining, Evaluation & benchmarks; often with Joshua B. Tenenbaum, Lionel Wong, Adrian Weller.
OpenAlex · ORCID · Wikidata · h-index 11 · 57 works · 1,622 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 47 times in our library · 6 more in our library without a page yet · ⭐ Paper Stars ranking: #9803
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksArtificial Intelligence · 2 worksInformation Systems · 1 workArts and Humanities · 1 workLanguage and Linguistics · 1 work
🧭 Topics 2Research subjects and languages the work is about.Evaluation & benchmarks · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- Evaluating Language Models for Mathematics through Interactions (2023 · 40 citations)
Standard LLM benchmarks compare a single model output with a fixed reference answer. That approach says little about how useful a model is when a person works with it over several turns. The authors argue that assistant-style use needs interactive evaluation. They test this on informal proofs of undergraduate… - On Benchmarking Human-Like Intelligence in Machines (2025 · 7 citations)
This perspective paper argues that widely used AI benchmarks cannot reliably show whether a model reasons in a human-like way.
All works
- Evaluating Language Models for Mathematics through InteractionsarXiv:2306.01694Katherine M. Collins, Albert Q. Jiang, Simon Frieder, et al.2023 · 40 citations
- Measuring and Mitigating (Over)reliance to Build Human-Compatible AI ↗Proceedings of the AAAI/ACM Conference on AI Ethics and Society · no summary yetLujain Ibrahim et al.2026 · 7 citations
- On Benchmarking Human-Like Intelligence in MachinesOpen MindLance Ying, Katherine M. Collins, Lionel Wong, et al.2025 · 7 citations
- Cognitive offloading and the speedup illusion in human-AI interaction ↗arXiv (Cornell University) · no summary yetSunny Yu et al.2026 · 1 citation
- The efficiency-gain illusion: People underestimate the rate of AI use and overestimate its benefits on simple tasks ↗no summary yetSunny Yu et al.2026 · 1 citation
- Understanding the Division of Cognitive Effort in Human-AI Interactions ↗no summary yetSunny Yu et al.2026
- Understanding When People use AI on Different Cognitive Tasks ↗no summary yetSunny Yu et al.2026
- Understanding Subjectivity through the Lens of Motivational Context in Model-Generated Image Satisfaction ↗arXiv (Cornell University) · no summary yetSenjuti Dutta et al.2024
Co-authors here
- Joshua B. Tenenbaum ×2
- Lionel Wong ×2
- Adrian Weller
- Albert Q. Jiang
- Ilia Sucholutsky
- Miri Zilka
- Ryan Liu
- Simon Frieder
- Thomas L. Griffiths
- Thomas Lukasiewicz
- Tianmin Shu
- Wenda Li
Venues
- Open Mind: Open Mind 2025
- Proceedings of the AAAI/ACM Conference on AI Ethics and Society
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/katherine-m-collins/