🧑‍🔬 Shaohan Huang — all works

26 works · ← Shaohan Huang

1. LayoutLM: Pre-training of Text and Layout for Document Image UnderstandingarXiv:1912.13318Yiheng Xu, Minghao Li, Lei Cui, et al.2019 · 896 citations
2. Neural Document Summarization by Jointly Learning to Score and Select SentencesAnnual Meeting of the Association for Computational Linguistics (ACL)Qingyu Zhou, Nan Yang, Furu Wei, et al.2018 · 450 citations
3. Language Is Not All You Need: Aligning Perception with Language ModelsConference on Neural Information Processing Systems (NeurIPS)Shaohan Huang, Li Dong, Wenhui Wang, et al.2023 · 330 citations
4. MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers ↗Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · no summary yetWenhui Wang et al.2021 · 311 citations
5. Kosmos-2: Grounding Multimodal Large Language Models to the WorldarXiv:2306.14824Zhiliang Peng, Wenhui Wang, Li Dong, et al.2023 · 286 citations
6. Retentive Network: A Successor to Transformer for Large Language ModelsarXiv:2307.08621Yutao Sun, Li Dong, Shaohan Huang, et al.2023 · 265 citations
7. DocBank: A Benchmark Dataset for Document Layout Analysis ↗Proceedings of the 28th International Conference on Computational Linguistics · no summary yetMinghao Li et al.2020 · 254 citations
8. PromptBERT: Improving BERT Sentence Embeddings with Prompts ↗Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · no summary yetTing Jiang et al.2022 · 198 citations
9. Language Generation with Multi-Hop Reasoning on Commonsense Knowledge Graph ↗Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · no summary yetHaozhe Ji et al.2020 · 145 citations
10. Scaling Sentence Embeddings with Large Language ModelsFindings of the Association for Computational LinguisticsTing Jiang, Shaohan Huang, Zhongzhi Luan, et al.2024 · 127 citations
11. XLM-E: Cross-lingual Language Model Pre-training via ELECTRAAnnual Meeting of the Association for Computational Linguistics (ACL)Zewen Chi, Shaohan Huang, Li Dong, et al.2022 · 127 citations
12. LongNet: Scaling Transformers to 1,000,000,000 Tokens ↗arXiv:2307.02486 · no summary yetJiayu Ding et al.2023 · 123 citations
13. A Length-Extrapolatable TransformerAnnual Meeting of the Association for Computational Linguistics (ACL)Yutao Sun, Li Dong, Barun Patra, et al.2023 · 118 citations
14. THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption ↗Findings of the Association for Computational Linguistics: ACL 2022 · no summary yetTianyu Chen et al.2022 · 107 citations
15. mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs ↗Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yetZewen Chi et al.2021 · 91 citations
16. Calibrating LLM-Based EvaluatorLanguage Resources and Evaluation Conference (LREC)Yuxuan Liu, Tianchi Yang, Shaohan Huang, et al.2024 · 71 citations
17. Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models ↗arXiv:2402.13064 · no summary yetHaoran Li et al.2024 · 65 citations
18. Reasoning with Exploration: An Entropy Perspective ↗arXiv:2506.14758 · no summary yetDaixuan Cheng et al.2025 · 63 citations
19. Instruction Pre-Training: Language Models are Supervised Multitask LearnersConference on Empirical Methods in Natural Language Processing (EMNLP)Daixuan Cheng, Yuxian Gu, Shaohan Huang, et al.2024 · 59 citations
20. On-Policy Context Distillation for Language Models ↗arXiv:2602.12275 · no summary yetTianzhu Ye et al.2026 · 36 citations
21. Adapting Large Language Models to Domains via Reading Comprehension ↗arXiv:2309.09530 · no summary yetDaixuan Cheng, Shaohan Huang, Furu Wei2023 · 33 citations
22. Dictionary-Guided Editing Networks for Paraphrase Generation ↗arXiv:1806.08077 · no summary yetShaohan Huang et al.2018 · 29 citations
23. SPPO: Sequence-Level PPO for Long-Horizon Reasoning TasksAnnual Meeting of the Association for Computational Linguistics (ACL)Tianyi Wang, Yixia Li, Long Li, et al.2026 · 8 citations
24. Towards Stable and Effective Reinforcement Learning for Mixture-of-ExpertsAnnual Meeting of the Association for Computational Linguistics (ACL)Di Zhang, Xun Wu, Shaohan Huang, et al.2026 · 1 citation
25. Learning to Refine: Self-Refinement of Parallel Reasoning in LLMsFindings of the Association for Computational LinguisticsQibin Wang, Pu Zhao, Shaohan Huang, et al.2026
26. Shorten After You're Right: Lazy Length Penalties for Reasoning RL ↗Findings of the Association for Computational Linguistics: ACL 2026 · no summary yetDanlong Yuan et al.2026

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/shaohan-huang/works/