Vladislav Lialin
Vladislav Lialin has 2 papers in our library, in 2023; often with Anna Rumshisky.
OpenAlex · h-index 4 · 29 works · 111 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 125 times in our library · ⭐ Paper Stars ranking: #4640
Affiliations
Concepts, shelves and topics
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 works
Works by year
2020s
Papers
- Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuning (2023 · 128 citations)
Language models have grown far faster than single-GPU memory, so full fine-tuning of multibillion-parameter models is out of reach for most practitioners. - ReLoRA: High-Rank Training Through Low-Rank Updates (2023 · 74 citations)
Pre-training large language models requires a great deal of memory and compute. Parameter-efficient fine-tuning methods such as LoRA cut these costs, but on their own they cannot pre-train a model well, because each LoRA adapter can only make a low-rank change. ReLoRA addresses this by repeatedly merging the LoRA…
Co-authors here
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/vladislav-lialin/