Michael Y. Hu
Michael Y. Hu has 2 papers in our library, in 2025–2026, most of them on Language models & pretraining, Reasoning; often with Jackson Petty, Tal Linzen, William Merrill.
OpenAlex · ORCID · Wikidata · h-index 65 · 462 works · 17,800 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 15 times in our library · 3 more in our library without a page yet · ⭐ Paper Stars ranking: #10055
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 1 workReasoning · 1 work
Works by year
2020s
Papers
- Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases (2025 · 9 citations)
Transformer language models need far more data than humans. This paper asks which properties of a formal language make it a useful warm-up before natural-language training, a setup the authors call pre-pretraining. They propose two criteria, drawing on the Chomsky hierarchy and on circuit complexity. First, the… - RELIC: Evaluating Complex Reasoning via the Recognition of Languages In-Context (2026)
LLMs increasingly have to solve tasks by retrieving and combining many pieces of information from their context.
All works
- Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic BiasesAnnual Meeting of the Association for Computational Linguistics (ACL)Michael Y. Hu, Jackson Petty, Chuan Shi, et al.2025 · 9 citations
- Latent State Models of Training Dynamics ↗arXiv (Cornell University) · no summary yetMichael Y. Hu et al.2023 · 7 citations
- RELIC: Evaluating Complex Reasoning via the Recognition of Languages In-ContextTransactions of the Association for Computational Linguistics (TACL)Jackson Petty, Michael Y. Hu, Wentao Wang, et al.2026
- Always Learning, Always Mixing: Efficient and Simple Data Mixing All The Time ↗arXiv (Cornell University) · no summary yetMichael Y. Hu et al.2026
- Neural Neural Scaling Laws ↗arXiv (Cornell University) · no summary yetMichael Y. Hu et al.2026
Co-authors here
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2025
- Transactions of the Association for Computational Linguistics (TACL): Transactions of the Association for Computational Linguistics (TACL) 2026
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/michael-y-hu/