James L. McClelland
James L. McClelland has 3 papers in our library, in 2013–2022, most of them on Language models & pretraining, Reasoning; often with Andrew Lampinen, Antonia Creswell, Felix Hill.
OpenAlex · ORCID · Wikidata · h-index 105 · 413 works · 81,529 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 476 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #2028
Affiliations
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 3 worksComputer Science · 3 worksArts and Humanities · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 2 worksReasoning · 1 work
Works by year
2020s
2010s
Papers
- Exact solutions to the nonlinear dynamics of learning in deep linear neural networks (2013 · 1,027 citations)
Why deep networks train slowly, stall on long plateaus and then suddenly improve, and benefit from certain initializations has lacked a quantitative explanation. - Can language models learn from explanations in context? (2022 · 295 citations)
Large language models can pick up new tasks from a handful of in-context examples. The authors test whether adding explanations to those examples, as people do when teaching, also helps models. They took 40 difficult tasks and subtasks from BIG-bench. For each, one author wrote post-answer explanations for 15 sampled… - Language models show human-like content effects on reasoning tasks (2022 · 162 citations)
Ideally, abstract reasoning should not depend on what a problem is about. Yet people reason better when a problem's meaning agrees with the logically correct answer. Psychologists call these "content effects." This paper asks whether large language models, whose expectations come from human-written text, blend…
All works
- Exact solutions to the nonlinear dynamics of learning in deep linear neural networksarXiv:1312.6120Andrew M. Saxe, James L. McClelland, Surya Ganguli2013 · 1,027 citations
- Can language models learn from explanations in context?Findings of the Association for Computational LinguisticsAndrew Lampinen, Ishita Dasgupta, Stephanie Chan, et al.2022 · 295 citations
- Language models show human-like content effects on reasoning tasksarXiv:2207.07051Ishita Dasgupta, Andrew K. Lampinen, Stephanie C. Y. Chan, et al.2022 · 162 citations
- Data Distributional Properties Drive Emergent In-Context Learning in Transformers ↗arXiv:2205.05055 · no summary yetStephanie C. Y. Chan et al.2022 · 158 citations
- Placing language in an integrated understanding system: Next steps toward human-level performance in neural language models ↗Proceedings of the National Academy of Sciences · no summary yetJames L. McClelland et al.2020 · 104 citations
Co-authors here
Venues
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2022
- Proceedings of the National Academy of Sciences
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/james-l-mcclelland/