Brian Lester
Brian Lester has 3 papers in our library, in 2021–2022, most of them on Language models & pretraining; often with Noah Constant, Rami Al-Rfou, Adams Wei Yu.
No OpenAlex profile matched yet.
📄 3 works in our library · 🔗 Cited 3,395 times in our library · ⭐ Paper Stars ranking: #511
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 3 worksArts and Humanities · 3 worksComputer Science · 3 worksLanguage and Linguistics · 3 works
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
💡 Concepts 2Key ideas and methods explained on our concept pages.Fine-tuning · 1 workFew-shot learning · 1 work
Works by year
2020s
Papers
- The Power of Scale for Parameter-Efficient Prompt Tuning (2021 · 4,287 citations)
The paper examines how to adapt a large pretrained language model to specific tasks without changing its weights. - Finetuned Language Models Are Zero-Shot Learners (2021 · 1,954 citations)
Large language models such as GPT-3 perform well when the prompt contains a few examples. Without examples, that is, in the zero-shot setting, their quality drops noticeably. The authors from Google Research propose instruction tuning: a pretrained model is fine-tuned on a mixture of tasks, each formulated as an… - SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer (2022 · 306 citations)
Prompt tuning adapts a frozen pre-trained model by learning only a short sequence of soft prompt tokens for each task.
Co-authors here
- Noah Constant ×2
- Rami Al-Rfou ×2
- Adams Wei Yu
- Andrew M. Dai
- Daniel Cer
- Jason Wei
- Kelvin Guu
- Maarten Bosma
- Nan Du
- Quoc Viet Le
- Tu Vu
- Vincent Zhao
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2022
- Conference on Empirical Methods in Natural Language Processing (EMNLP): EMNLP 2021
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/brian-lester/