Jackson Petty
Jackson Petty has 4 papers in our library, in 2023–2026, most of them on Language models & pretraining, Evaluation & benchmarks, Reasoning; often with Michael Y. Hu, Tal Linzen, William Merrill.
OpenAlex · h-index 5 · 27 works · 84 citations OpenAlex, 2026-10-14
📄 4 works in our library · 🔗 Cited 1,073 times in our library · 3 more in our library without a page yet · ⭐ Paper Stars ranking: #2364
Affiliations
Fields, topics and concepts
📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 4 worksArts and Humanities · 4 worksComputer Science · 4 worksLanguage and Linguistics · 4 worksInformation Systems · 1 workMathematics · 1 workComputer Vision and Pattern Recognition · 1 work
🧭 Topics 3Research subjects and languages the work is about.Evaluation & benchmarks · 1 workLanguage models & pretraining · 2 worksReasoning · 1 work
💡 Concepts 1Key ideas and methods explained on our concept pages.Artificial intelligence · 1 work
Works by year
2020s
Papers
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark (2023 · 1,018 citations)
GPQA addresses a gap in scalable oversight research: testing how people can check AI answers that they cannot verify themselves requires questions that are correct, answerable by real specialists, and still out of reach for capable outsiders who can search the web. - How Abstract Is Linguistic Generalization in Large Language Models? Experiments with Argument Structure (2023 · 29 citations)
The paper asks whether pre-trained transformer LLMs encode how syntactic contexts relate to one another, beyond knowing which words fit a single context. - Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases (2025 · 9 citations)
Transformer language models need far more data than humans. This paper asks which properties of a formal language make it a useful warm-up before natural-language training, a setup the authors call pre-pretraining. They propose two criteria, drawing on the Chomsky hierarchy and on circuit complexity. First, the… - RELIC: Evaluating Complex Reasoning via the Recognition of Languages In-Context (2026)
LLMs increasingly have to solve tasks by retrieving and combining many pieces of information from their context.
All works
- GPQA: A Graduate-Level Google-Proof Q&A BenchmarkarXiv:2311.12022David Rein, Betty Li Hou, Asa Cooper Stickland, et al.2023 · 1,018 citations
- (QA)²: Question Answering with Questionable Assumptions ↗Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetNajoung Kim et al.2023 · 39 citations
- How Abstract Is Linguistic Generalization in Large Language Models? Experiments with Argument StructureTransactions of the Association for Computational Linguistics (TACL)Michael Wilson, Jackson Petty, Robert Frank2023 · 29 citations
- Debate Helps Supervise Unreliable Experts ↗arXiv (Cornell University) · no summary yetJulian Michael et al.2023 · 28 citations
- Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic BiasesAnnual Meeting of the Association for Computational Linguistics (ACL)Michael Y. Hu, Jackson Petty, Chuan Shi, et al.2025 · 9 citations
- Evaluating In-Context Translation with Synchronous Context-Free Grammar Transduction ↗arXiv:2604.07320 · no summary yetJackson Petty, Jaulie Goe, Tal Linzen2026 · 1 citation
- RELIC: Evaluating Complex Reasoning via the Recognition of Languages In-ContextTransactions of the Association for Computational Linguistics (TACL)Jackson Petty, Michael Y. Hu, Wentao Wang, et al.2026
Co-authors here
- Michael Y. Hu ×2
- Tal Linzen ×2
- William Merrill ×2
- Chuan Shi
- Julian Michael
- Michael Wilson
- Richard Yuanzhe Pang
- Robert Frank
- Samuel R. Bowman
- Shauli Ravfogel
- Wentao Wang
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL) ×2: ACL 2025
- Transactions of the Association for Computational Linguistics (TACL) ×2: Transactions of the Association for Computational Linguistics (TACL) 2026, Transactions of the Association for Computational Linguistics (TACL) 2023
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/jackson-petty/