Weijia Li
Weijia Li has 2 papers in our library, in 2025–2026, most of them on Language models & pretraining, Vision & language, Efficient models & compression; often with Conghui He, Linfeng Zhang, Qintong Zhang.
OpenAlex · ORCID · h-index 5 · 15 works · 71 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 22 times in our library · ⭐ Paper Stars ranking: #7959
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 3Research subjects and languages the work is about.Language models & pretraining · 2 worksVision & language · 1 workEfficient models & compression · 1 work
Works by year
2020s
Papers
- Stop Looking for “Important Tokens” in Multimodal Language Models: Duplication Matters More (2025 · 44 citations)
Vision tokens make up most of the input to multimodal LLMs, which makes inference expensive. Most training-free pruning methods score each token's "importance" from attention maps and drop the low scorers. The authors argue this approach has four weaknesses. It treats scores as fixed even after other tokens are… - RoZO: Geometry-Aware Zeroth-Order Fine-Tuning on Low-Rank Adapters for Black-Box Large Language Models (2026 · 1 citation)
Fine-tuning large language models with back-propagation needs a lot of memory, because activations must be stored.
Co-authors here
Venues
- Conference of the European Chapter of the Association for Computational Linguistics (EACL): EACL 2026
- Conference on Empirical Methods in Natural Language Processing (EMNLP): EMNLP 2025
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/weijia-li/