Yonggan Fu
Yonggan Fu has 2 papers in our library, in 2024–2026, most of them on Language models & pretraining; often with Yingyan Celine Lin, Ameya Sunil Mahabaleshwarkar, Jan Kautz.
OpenAlex · ORCID · h-index 16 · 84 works · 832 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 189 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #7811
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 workInformation Systems · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- Hymba: A Hybrid-head Architecture for Small Language Models (2024 · 50 citations)
Small language models must balance accuracy against memory and speed. Transformers recall context well, but their compute cost and KV cache grow quickly with sequence length. State space models such as Mamba run cheaply but recall poorly. Earlier hybrids stacked the two layer types one after another, so a weak layer… - Think Hard Only When Needed: A Hybrid Best-of-N and Beam Search for Efficient Test-Time Compute (2026)
Test-time compute lets small language models reason better by spending extra inference effort, but the two standard strategies have opposite costs.
All works
- Small Language Models are the Future of Agentic AI ↗arXiv:2506.02153 · no summary yetPeter Belcak et al.2025 · 92 citations
- Hymba: A Hybrid-head Architecture for Small Language ModelsarXiv:2411.13676Xin Dong, Yonggan Fu, Shizhe Diao, et al.2024 · 50 citations
- Think Hard Only When Needed: A Hybrid Best-of-N and Beam Search for Efficient Test-Time ComputeFindings of the Association for Computational LinguisticsHyewon Suh, Chaojian Li, Cheng-Jhih Shih, et al.2026
- PROBE: PROcess-Based BEnchmark for Hallucination Detection ↗Findings of the Association for Computational Linguistics: ACL 2026 · no summary yetYu Zhang et al.2026
Co-authors here
- Yingyan Celine Lin ×2
- Ameya Sunil Mahabaleshwarkar
- Jan Kautz
- Shizhe Diao
- Xin Dong
- Yoshi Suhara
- Zheng Wang
- Zijia Chen
Venues
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2026
- Findings of the Association for Computational Linguistics: ACL 2026
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/yonggan-fu/