🧑‍🔬 Furu Wei — all works

97 works · ← Furu Wei

1. Swin Transformer V2: Scaling Up Capacity and Resolution ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetZe Liu et al.2022 · 2,584 citations
2. Oscar: Object-Semantics Aligned Pre-training for Vision-Language TasksLecture notes in computer scienceXiujun Li, Xi Yin, Chunyuan Li, et al.2020 · 1,877 citations
3. Unified Language Model Pre-training for Natural Language Understanding and GenerationarXiv:1905.03197Li Dong, Nan Yang, Wenhui Wang, et al.2019 · 1,422 citations
4. Learning Sentiment-Specific Word Embedding for Twitter Sentiment ClassificationAnnual Meeting of the Association for Computational Linguistics (ACL)Duyu Tang, Furu Wei, Nan Yang, et al.2014 · 1,346 citations
5. Adaptive Recursive Neural Network for Target-dependent Twitter Sentiment ClassificationAnnual Meeting of the Association for Computational Linguistics (ACL)Li Dong, Furu Wei, Chuanqi Tan, et al.2014 · 1,217 citations
6. VL-BERT: Pre-training of Generic Visual-Linguistic RepresentationsarXiv:1908.08530Weijie Su, Xizhou Zhu, Yue Cao, et al.2019 · 1,066 citations
7. A whole-slide foundation model for digital pathology from real-world data ↗Nature · no summary yetHanwen Xu et al.2024 · 904 citations
8. LayoutLM: Pre-training of Text and Layout for Document Image UnderstandingarXiv:1912.13318Yiheng Xu, Minghao Li, Lei Cui, et al.2019 · 896 citations
9. Gated Self-Matching Networks for Reading Comprehension and Question AnsweringAnnual Meeting of the Association for Computational Linguistics (ACL)Wenhui Wang, Nan Yang, Furu Wei, et al.2017 · 833 citations
10. LayoutLMv3: Pre-training for Document AI with Unified Text and Image MaskingACM International Conference on Multimedia (ACM MM)Yupan Huang, Tengchao Lv, Lei Cui, et al.2022 · 778 citations
11. TrOCR: Transformer-Based Optical Character Recognition with Pre-trained Models ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetMinghao Li et al.2021 · 668 citations
12. LayoutLMv2: Multi-modal Pre-training for Visually-rich Document UnderstandingAnnual Meeting of the Association for Computational Linguistics (ACL)Yang Xu, Yiheng Xu, Tengchao Lv, et al.2021 · 627 citations
13. Text Embeddings by Weakly-Supervised Contrastive Pre-trainingarXiv:2212.03533Liang Wang, Nan Yang, Xiaolong Huang, et al.2022 · 598 citations
14. Image as a Foreign Language: BEIT Pretraining for Vision and Vision-Language Tasks ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetWenhui Wang et al.2023 · 575 citations
15. Knowledge Neurons in Pretrained Transformers ↗Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetDamai Dai et al.2022 · 568 citations
16. HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document SummarizationAnnual Meeting of the Association for Computational Linguistics (ACL)Xingxing Zhang, Furu Wei, Ming Zhou2019 · 451 citations
17. Neural Document Summarization by Jointly Learning to Score and Select SentencesAnnual Meeting of the Association for Computational Linguistics (ACL)Qingyu Zhou, Nan Yang, Furu Wei, et al.2018 · 450 citations
18. Improving Text Embeddings with Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Liang Wang, Nan Yang, Xiaolong Huang, et al.2024 · 437 citations
19. Recognizing Named Entities in TweetsAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaohua Liu, Shaodian Zhang, Furu Wei, et al.2011 · 436 citations
20. UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-TrainingarXiv:2002.12804Hangbo Bao, Li Dong, Furu Wei, et al.2020 · 395 citations
21. VLMo: Unified Vision-Language Pre-Training with Mixture-Of-Modality-Experts ↗neural information processing systems · no summary yetHangbo Bao et al.2022 · 385 citations
22. Query2doc: Query Expansion with Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Liang Wang, Nan Yang, Furu Wei2023 · 354 citations
23. Multilingual E5 Text Embeddings: A Technical ReportarXiv:2402.05672Liang Wang, Nan Yang, Xiaolong Huang, et al.2024 · 346 citations
24. Selective Encoding for Abstractive Sentence SummarizationAnnual Meeting of the Association for Computational Linguistics (ACL)Qingyu Zhou, Nan Yang, Furu Wei, et al.2017 · 330 citations
25. MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers ↗Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · no summary yetWenhui Wang et al.2021 · 311 citations
26. Kosmos-2: Grounding Multimodal Large Language Models to the WorldarXiv:2306.14824Zhiliang Peng, Wenhui Wang, Li Dong, et al.2023 · 286 citations
27. InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-TrainingarXiv:2007.07834Zewen Chi, Li Dong, Furu Wei, et al.2020 · 275 citations
28. Reinforced Mnemonic Reader for Machine Reading Comprehension ↗arXiv:1705.02798 · no summary yetMinghao Hu et al.2017 · 273 citations
29. Retrieve, Rerank and Rewrite: Soft Template Based Neural SummarizationAnnual Meeting of the Association for Computational Linguistics (ACL)Ziqiang Cao, Wenjie Li, Sujian Li, et al.2018 · 270 citations
30. Retentive Network: A Successor to Transformer for Large Language ModelsarXiv:2307.08621Yutao Sun, Li Dong, Shaohan Huang, et al.2023 · 265 citations
31. Fine-Tuning LLaMA for Multi-Stage Text RetrievalInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Xueguang Ma, Liang Wang, Nan Yang, et al.2023 · 257 citations
32. Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-OptimizersFindings of the Association for Computational LinguisticsDamai Dai, Yutao Sun, Li Dong, et al.2023 · 257 citations
33. InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training ↗Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetZewen Chi et al.2021 · 256 citations
34. Ranking with Recursive Neural Networks and Its Application to Multi-Document Summarization ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetZiqiang Cao et al.2015 · 255 citations
35. DocBank: A Benchmark Dataset for Document Layout Analysis ↗Proceedings of the 28th International Conference on Computational Linguistics · no summary yetMinghao Li et al.2020 · 254 citations
36. Self-Attention Attribution: Interpreting Information Interactions Inside Transformer ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetYaru Hao et al.2021 · 243 citations
37. BERT-of-Theseus: Compressing BERT by Progressive Module ReplacingConference on Empirical Methods in Natural Language Processing (EMNLP)Canwen Xu, Wangchunshu Zhou, Tao Ge, et al.2020 · 240 citations
38. Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought PromptingarXiv:2305.07004Haoyang Huang, Tianyi Tang, Dongdong Zhang, et al.2023 · 224 citations
39. Visualizing and Understanding the Effectiveness of BERTConference on Empirical Methods in Natural Language Processing (EMNLP)Yaru Hao, Li Dong, Furu Wei, et al.2019 · 222 citations
40. Neural Latent Extractive Document SummarizationConference on Empirical Methods in Natural Language Processing (EMNLP)Xingxing Zhang, Mirella Lapata, Furu Wei, et al.2018 · 220 citations
41. DiT: Self-supervised Pre-training for Document Image Transformer ↗ACM International Conference on Multimedia (ACM MM) · no summary yetJunlong Li et al.2022 · 214 citations
42. PromptBERT: Improving BERT Sentence Embeddings with Prompts ↗Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · no summary yetTing Jiang et al.2022 · 198 citations
43. Neural Open Information ExtractionAnnual Meeting of the Association for Computational Linguistics (ACL)Lei Cui, Furu Wei, Ming Zhou2018 · 188 citations
44. Generative Representational Instruction TuningarXiv:2402.09906Niklas Muennighoff, Hongjin Su, Liang Wang, et al.2024 · 172 citations
45. Fluency Boost Learning and Inference for Neural Grammatical Error Correction ↗Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetTao Ge, Furu Wei, Ming Zhou2018 · 163 citations
46. Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Tianyi Tang, Wenyang Luo, Haoyang Huang, et al.2024 · 156 citations
47. Language Generation with Multi-Hop Reasoning on Commonsense Knowledge Graph ↗Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · no summary yetHaozhe Ji et al.2020 · 145 citations
48. MiniLLM: On-Policy Distillation of Large Language ModelsarXiv:2306.08543Yuxian Gu, Li Dong, Furu Wei, et al.2023 · 144 citations
49. Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-CollaborationarXiv:2307.05300Zhenhailong Wang, Shaoguang Mao, Wenshan Wu, et al.2023 · 140 citations
50. BERT-based Lexical Substitution ↗Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · no summary yetWangchunshu Zhou et al.2019 · 140 citations
51. Augmenting Language Models with Long-Term Memory ↗arXiv:2306.07174 · no summary yetWeizhi Wang et al.2023 · 135 citations
52. Controllable Natural Language Generation with Contrastive PrefixesFindings of the Association for Computational LinguisticsJing Qian, Li Dong, Yelong Shen, et al.2022 · 130 citations
53. XLM-E: Cross-lingual Language Model Pre-training via ELECTRAAnnual Meeting of the Association for Computational Linguistics (ACL)Zewen Chi, Shaohan Huang, Li Dong, et al.2022 · 127 citations
54. Reaching Human-level Performance in Automatic Grammatical Error Correction: An Empirical Study ↗arXiv:1807.01270 · no summary yetTao Ge, Furu Wei, Ming Zhou2018 · 127 citations
55. CLIP Models are Few-Shot Learners: Empirical Studies on VQA and Visual Entailment ↗Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetHaoyu Song et al.2022 · 120 citations
56. A Length-Extrapolatable TransformerAnnual Meeting of the Association for Computational Linguistics (ACL)Yutao Sun, Li Dong, Barun Patra, et al.2023 · 118 citations
57. In-context Autoencoder for Context Compression in a Large Language Model ↗arXiv:2307.06945 · no summary yetTao Ge et al.2023 · 114 citations
58. THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption ↗Findings of the Association for Computational Linguistics: ACL 2022 · no summary yetTianyu Chen et al.2022 · 107 citations
59. Learning to Retrieve In-Context Examples for Large Language ModelsConference of the European Chapter of the Association for Computational Linguistics (EACL)Liang Wang, Nan Yang, Furu Wei2024 · 106 citations
60. SimLM: Pre-training with Representation Bottleneck for Dense Passage RetrievalAnnual Meeting of the Association for Computational Linguistics (ACL)Liang Wang, Nan Yang, Xiaolong Huang, et al.2023 · 106 citations
61. Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq GenerationFindings of the Association for Computational LinguisticsHeming Xia, Tao Ge, Peiyi Wang, et al.2023 · 103 citations
62. XFUND: A Benchmark Dataset for Multilingual Visually Rich Form Understanding ↗Findings of the Association for Computational Linguistics: ACL 2022 · no summary yetYiheng Xu et al.2022 · 101 citations
63. LayoutReader: Pre-training of Text and Layout for Reading Order Detection ↗Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yetZilong Wang et al.2021 · 101 citations
64. WavLLM: Towards Robust and Adaptive Speech Large Language Model ↗Findings of the Association for Computational Linguistics: EMNLP 2024 · no summary yetShujie Hu et al.2024 · 98 citations
65. mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs ↗Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yetZewen Chi et al.2021 · 91 citations
66. Attention-Guided Answer Distillation for Machine Reading Comprehension ↗Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · no summary yetMinghao Hu et al.2018 · 87 citations
67. MathScale: Scaling Instruction Tuning for Mathematical Reasoning ↗arXiv:2403.02884 · no summary yetZhengyang Tang et al.2024 · 83 citations
68. Chain-of-Dictionary Prompting Elicits Translation in Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Hongyuan Lu, Haoran Yang, Haoyang Huang, et al.2024 · 81 citations
69. Calibrating LLM-Based EvaluatorLanguage Resources and Evaluation Conference (LREC)Yuxuan Liu, Tianchi Yang, Shaohan Huang, et al.2024 · 71 citations
70. Language Models as Inductive ReasonersConference of the European Chapter of the Association for Computational Linguistics (EACL)Zonglin Yang, Li Dong, Xinya Du, et al.2024 · 70 citations
71. Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models ↗arXiv:2402.13064 · no summary yetHaoran Li et al.2024 · 65 citations
72. Reasoning with Exploration: An Entropy Perspective ↗arXiv:2506.14758 · no summary yetDaixuan Cheng et al.2025 · 63 citations
73. Improving Grammatical Error Correction with Machine Translation Pairs ↗Findings of the Association for Computational Linguistics: EMNLP 2020 · no summary yetWangchunshu Zhou et al.2020 · 63 citations
74. Syllogistic Reasoning for Legal Judgment Analysis ↗Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · no summary yetWentao Deng et al.2023 · 60 citations
75. Instruction Pre-Training: Language Models are Supervised Multitask LearnersConference on Empirical Methods in Natural Language Processing (EMNLP)Daixuan Cheng, Yuxian Gu, Shaohan Huang, et al.2024 · 59 citations
76. Formality Style Transfer with Hybrid Textual Annotations ↗arXiv:1903.06353 · no summary yetRuochen Xu, Tao Ge, Furu Wei2019 · 54 citations
77. PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise TrainingarXiv:2309.10400Dawei Zhu, Nan Yang, Liang Wang, et al.2023 · 52 citations
78. LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Models ↗arXiv:2404.01230 · no summary yetYadong Zhang et al.2024 · 44 citations
79. Towards Thinking-Optimal Scaling of Test-Time Compute for LLM ReasoningConference on Neural Information Processing Systems (NeurIPS)Wenkai Yang, Shuming Ma, Yankai Lin, et al.2025 · 43 citations
80. LongEmbed: Extending Embedding Models for Long Context RetrievalConference on Empirical Methods in Natural Language Processing (EMNLP)Dawei Zhu, Liang Wang, Nan Yang, et al.2024 · 37 citations
81. On-Policy Context Distillation for Language Models ↗arXiv:2602.12275 · no summary yetTianzhu Ye et al.2026 · 36 citations
82. Adapting Large Language Models to Domains via Reading Comprehension ↗arXiv:2309.09530 · no summary yetDaixuan Cheng, Shaohan Huang, Furu Wei2023 · 33 citations
83. Dictionary-Guided Editing Networks for Paraphrase Generation ↗arXiv:1806.08077 · no summary yetShaohan Huang et al.2018 · 29 citations
84. Autoregressive Speech Synthesis without Vector QuantizationAnnual Meeting of the Association for Computational Linguistics (ACL)Lingwei Meng, Long Zhou, Shujie Liu, et al.2025 · 25 citations
85. Sequence-to-sequence Pre-training with Data Augmentation for Sentence Rewriting ↗arXiv:1909.06002 · no summary yetYi Zhang et al.2019 · 24 citations
86. Chain-of-Reasoning: Towards Unified Mathematical Reasoning in Large Language Models via a Multi-Paradigm PerspectiveAnnual Meeting of the Association for Computational Linguistics (ACL)Yiyao Yu, Yuxiang Zhang, Dongdong Zhang, et al.2025 · 23 citations
87. MMLU-CF: A Contamination-free Multi-task Language Understanding BenchmarkAnnual Meeting of the Association for Computational Linguistics (ACL)Qihao Zhao, Yangyu Huang, Tengchao Lv, et al.2025 · 21 citations
88. Preference Optimization for Reasoning with Pseudo FeedbackarXiv:2411.16345Fangkai Jiao, Geyang Guo, Xingxing Zhang, et al.2024 · 15 citations
89. Examining False Positives under Inference Scaling for Mathematical ReasoningConference on Empirical Methods in Natural Language Processing (EMNLP)Yu Wang, Nan Yang, Liang Wang, et al.2025 · 9 citations
90. ALYMPICS: LLM Agents Meet Game TheoryInternational Conference on Computational Linguistics (COLING)Shaoguang Mao, Yuzhe Cai, Yan Xia, et al.2025 · 7 citations
91. ShifCon: Enhancing Non-Dominant Language Capabilities with a Shift-based Multilingual Contrastive FrameworkAnnual Meeting of the Association for Computational Linguistics (ACL)Hengyuan Zhang, Chenming Shang, Sizhe Wang, et al.2025 · 6 citations
92. When an Image is Worth 1,024 x 1,024 Words: A Case Study in Computational Pathology ↗arXiv (Cornell University) · no summary yetWenhui Wang et al.2023 · 5 citations
93. Rectified Sparse Attention for Efficient Long-Sequence GenerationFindings of the Association for Computational LinguisticsYutao Sun, Tianzhu Ye, Li Dong, et al.2026 · 1 citation
94. Towards Stable and Effective Reinforcement Learning for Mixture-of-ExpertsAnnual Meeting of the Association for Computational Linguistics (ACL)Di Zhang, Xun Wu, Shaohan Huang, et al.2026 · 1 citation
95. Learning to Refine: Self-Refinement of Parallel Reasoning in LLMsFindings of the Association for Computational LinguisticsQibin Wang, Pu Zhao, Shaohan Huang, et al.2026
96. Two Pathways to Truthfulness: On the Intrinsic Encoding of LLM HallucinationsAnnual Meeting of the Association for Computational Linguistics (ACL)Wen Luo, Guangyue Peng, Wei Li, et al.2026
97. Shorten After You're Right: Lazy Length Penalties for Reasoning RL ↗Findings of the Association for Computational Linguistics: ACL 2026 · no summary yetDanlong Yuan et al.2026

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/furu-wei/works/