Raphael Gontijo Lopes
Raphael Gontijo Lopes has 2 papers in our library, in 2022, most of them on Language models & pretraining; often with Aitor Lewkowycz, Ali Farhadi, Ari S. Morcos.
OpenAlex · h-index 11 · 13 works · 1,706 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 520 times in our library · 4 more in our library without a page yet · ⭐ Paper Stars ranking: #3851
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 1 workArts and Humanities · 1 workLanguage and Linguistics · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time (2022 · 507 citations)
When fine-tuning a large pre-trained network, the usual practice is to run a hyperparameter sweep, keep the single run that does best on held-out validation data, and throw the others away. - Language Model Cascades (2022 · 89 citations)
The paper addresses how to reason about the many ad hoc ways large language models are chained or repeatedly queried.
All works
- Robust fine-tuning of zero-shot models ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetMitchell Wortsman et al.2022 · 519 citations
- Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timearXiv:2203.05482Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, et al.2022 · 507 citations
- Naive-Student: Leveraging Semi-Supervised Learning in Video Sequences for Urban Scene Segmentation ↗Lecture notes in computer science · no summary yetLiang-Chieh Chen et al.2020 · 161 citations
- End-to-end Audio Visual Scene-aware Dialog Using Multimodal Attention-based Video Features ↗IEEE International Conference on Acoustics Speech and Signal Processing · no summary yetChiori Hori et al.2019 · 128 citations
- Language Model CascadesarXiv:2207.10342David Dohan, Winnie Xu, Aitor Lewkowycz, et al.2022 · 89 citations
- Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7 ↗arXiv (Cornell University) · no summary yetHuda Alamri et al.2018 · 28 citations
Co-authors here
- Aitor Lewkowycz
- Ali Farhadi
- Ari S. Morcos
- Charles Sutton
- David Dohan
- Gabriel Ilharco
- Henryk Michalewski
- Jacob Austin
- Jascha Sohl-dickstein
- Kevin P. Murphy
- Ludwig Schmidt
- Mitchell Wortsman
Venues
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
- IEEE International Conference on Acoustics Speech and Signal Processing
- Lecture notes in computer science
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/raphael-gontijo-lopes/