Junhong Wu
Junhong Wu has 3 papers in our library, in 2023–2025, most of them on Language models & pretraining, Speech & spoken language; often with Jiajun Zhang, Jianghao Chen, Yangyifan Xu.
OpenAlex · ORCID · h-index 16 · 48 works · 891 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 49 times in our library · ⭐ Paper Stars ranking: #7680
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 3 worksComputer Science · 3 worksArtificial Intelligence · 3 worksLanguage and Linguistics · 3 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 3 worksSpeech & spoken language · 1 work
Works by year
2020s
Papers
- BLSP: Bootstrapping Language-Speech Pre-training via Behavior Alignment of Continuation Writing (2023 · 32 citations)
Text-trained large language models struggle to take speech as input. Cascaded systems that feed ASR output into an LLM keep the two components separate, and end-to-end speech LLMs depend on speech instruction data, which is rare. The authors first show that training an adapter only to reproduce transcripts makes the… - LADM: Long-context Training Data Selection with Attention-based Dependency Measurement for LLMs (2025 · 12 citations)
Extending LLMs to long inputs usually relies on continual pre-training with long documents. However, there has been no reliable way to judge whether a long sample actually contains meaningful long-range connections or is just loosely joined text. The authors first show that this matters. Llama2-7B trained on 32K… - Hit the Sweet Spot! Span-Level Ensemble for Large Language Models (2025 · 11 citations)
Combining several large language models can exploit their complementary strengths, but current ensembling works at two awkward granularities.
Co-authors here
- Jiajun Zhang ×3
- Jianghao Chen ×2
- Yangyifan Xu ×2
- Chen Wang
- Chengqing Zong
- Minpeng Liao
- Yuchen Liu
- Zhongqiang Huang
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2025
- International Conference on Computational Linguistics (COLING): COLING 2025
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/junhong-wu/