Shwai He
Shwai He has 2 papers in our library, in 2023–2024, most of them on Language models & pretraining; often with Tianyi Zhou, Dacheng Tao, Jianzong Wang.
OpenAlex · h-index 4 · 10 works · 95 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 66 times in our library · ⭐ Paper Stars ranking: #7317
Affiliations
🎓University of Maryland, College ParkCollege Park ·
United States2023–2025 · 5 papers🎓Fudan UniversityShanghai ·
China2023–2024 · 2 papers
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning (2024 · 60 citations)
Selecting a small, high-quality subset of instruction data can make LLM instruction tuning cheaper and better. - MerA: Merging Pretrained Adapters For Few-Shot Learning (2023 · 11 citations)
Adapter tuning trains only small bottleneck modules inside a frozen pretrained language model. These modules start from random weights, so they tend to underperform when only a handful of labeled examples are available. AdapterFusion reuses previously trained adapters, but its attention-style composition layers add…
Co-authors here
- Tianyi Zhou ×2
- Dacheng Tao
- Jianzong Wang
- Li Shen
- Liang Ding
- Ming Li
- Ning Cheng
- Run-Ze Fan
- Yong Zhang
- Zhitao Li
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/shwai-he/