Hugh Leather
Hugh Leather has 2 papers in our library, in 2024, most of them on Language models & pretraining, Evaluation & benchmarks, Reasoning; often with Baptiste Rozière, Gabriel Synnaeve, Alex Gu.
OpenAlex · ORCID · Wikidata · h-index 22 · 94 works · 1,764 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 129 times in our library · ⭐ Paper Stars ranking: #7661
Affiliations
Fields, topics and concepts
📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksArts and Humanities · 1 workArtificial Intelligence · 2 worksInformation Systems · 2 worksComputer Science Applications · 1 workLanguage and Linguistics · 1 workHardware and Architecture · 1 work
🧭 Topics 3Research subjects and languages the work is about.Evaluation & benchmarks · 1 workReasoning · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- CRUXEval: A Benchmark for Code Reasoning, Understanding and Execution (2024 · 122 citations)
Code language models are usually judged on HumanEval or MBPP. Those benchmarks test whether a model can write short programs from a natural-language description, but they do not test whether it understands what a piece of code does when it runs. CRUXEval fills that gap. It has 800 short Python functions, each paired… - Meta Large Language Model Compiler: Foundation Models of Compiler Optimization (2024 · 16 citations)
General-purpose code LLMs see very little assembly or compiler IR during training, so they handle optimization poorly and often produce broken code.
Co-authors here
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/hugh-leather/