Lili Yu
Lili Yu has 2 papers in our library, in 2023–2024, most of them on Language models & pretraining, Vision & language; often with Luke Zettlemoyer, Omer Levy, Alexis Conneau.
OpenAlex · ORCID · h-index 10 · 50 works · 495 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 202 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #7453
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Vision & language · 1 workLanguage models & pretraining · 1 work
💡 Concepts 1Key ideas and methods explained on our concept pages.Scaling laws · 1 work
Works by year
2020s
Papers
- Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model (2024 · 83 citations)
Generative models usually handle text with next-token prediction and images with diffusion. Combining the two typically means either attaching a separate diffusion model to a language model or quantizing images into discrete tokens, which loses information. Transfusion trains a single transformer on mixed text–image… - Scaling Laws for Generative Mixed-Modal Language Models (2023 · 45 citations)
Single generative models can treat images, speech, code and text as token streams. It is unclear, however, whether added scale overcomes the interference that arises when several modalities share one network. The authors ran more than 250 training experiments covering seven modalities: Text, Image, Image-Text…
All works
- Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal ModelarXiv:2408.11039Chunting Zhou, Lili Yu, Arun Babu, et al.2024 · 83 citations
- Byte Latent Transformer: Patches Scale Better Than Tokens ↗Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetArtidoro Pagnoni et al.2025 · 73 citations
- Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning ↗arXiv (Cornell University) · no summary yetLili Yu et al.2023 · 58 citations
- Scaling Laws for Generative Mixed-Modal Language ModelsarXiv:2301.03728Armen Aghajanyan, Lili Yu, Alexis Conneau, et al.2023 · 45 citations
Co-authors here
- Luke Zettlemoyer ×2
- Omer Levy ×2
- Alexis Conneau
- Armen Aghajanyan
- Arun Babu
- Chunting Zhou
- Jacob Kahn
- Karen Hambardzumyan
- Kushal Tirumala
- Michihiro Yasunaga
- Naman Goyal
- Stephen Roller
Venues
- Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/lili-yu/