Eileen Pan
Eileen Pan has 2 papers in our library, in 2020–2025, most of them on Language models & pretraining, Question answering, Evaluation & benchmarks; often with Di Jin, Maartje Ter Hoeve, Peter Szolovits.
OpenAlex · ORCID · h-index 5 · 6 works · 789 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 510 times in our library · ⭐ Paper Stars ranking: #3565
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 workInformation Systems · 1 work
🧭 Topics 4Research subjects and languages the work is about.Question answering · 1 workEvaluation & benchmarks · 1 workLanguage models & pretraining · 1 workReasoning · 1 work
Works by year
2020s
Papers
- What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Exams (2020 · 567 citations)
The paper argues that open-domain QA benchmarks either reward surface matching against spans or only need school-level knowledge, so they say little about hard real-world reasoning. - Analyzing Dialectical Biases in LLMs for Knowledge and Reasoning Benchmarks (2025 · 6 citations)
The paper asks whether LLMs answer simple knowledge and reasoning questions less accurately when the questions are written in non-"standard" English dialects rather than Standard American English (SAE), and which grammatical features cause the gap.
Co-authors here
Venues
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2025
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/eileen-pan/