🧑‍🔬 Li Dong — all works

29 works · ← Li Dong

1. Oscar: Object-Semantics Aligned Pre-training for Vision-Language TasksLecture notes in computer scienceXiujun Li, Xi Yin, Chunyuan Li, et al.2020 · 1,877 citations
2. Unified Language Model Pre-training for Natural Language Understanding and GenerationarXiv:1905.03197Li Dong, Nan Yang, Wenhui Wang, et al.2019 · 1,422 citations
3. Long Short-Term Memory-Networks for Machine ReadingConference on Empirical Methods in Natural Language Processing (EMNLP)Jianpeng Cheng, Li Dong, Mirella Lapata2016 · 1,313 citations
4. Adaptive Recursive Neural Network for Target-dependent Twitter Sentiment ClassificationAnnual Meeting of the Association for Computational Linguistics (ACL)Li Dong, Furu Wei, Chuanqi Tan, et al.2014 · 1,217 citations
5. Language to Logical Form with Neural AttentionAnnual Meeting of the Association for Computational Linguistics (ACL)Li Dong, Mirella Lapata2016 · 955 citations
6. Knowledge Neurons in Pretrained Transformers ↗Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetDamai Dai et al.2022 · 568 citations
7. Coarse-to-Fine Decoding for Neural Semantic Parsing ↗Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetLi Dong, Mirella Lapata2018 · 518 citations
8. UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-TrainingarXiv:2002.12804Hangbo Bao, Li Dong, Furu Wei, et al.2020 · 395 citations
9. Language Is Not All You Need: Aligning Perception with Language ModelsConference on Neural Information Processing Systems (NeurIPS)Shaohan Huang, Li Dong, Wenhui Wang, et al.2023 · 330 citations
10. MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers ↗Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · no summary yetWenhui Wang et al.2021 · 311 citations
11. Kosmos-2: Grounding Multimodal Large Language Models to the WorldarXiv:2306.14824Zhiliang Peng, Wenhui Wang, Li Dong, et al.2023 · 286 citations
12. Learning to Paraphrase for Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP)Li Dong, Jonathan Mallinson, Siva Reddy, et al.2017 · 286 citations
13. InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-TrainingarXiv:2007.07834Zewen Chi, Li Dong, Furu Wei, et al.2020 · 275 citations
14. Retentive Network: A Successor to Transformer for Large Language ModelsarXiv:2307.08621Yutao Sun, Li Dong, Shaohan Huang, et al.2023 · 265 citations
15. Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-OptimizersFindings of the Association for Computational LinguisticsDamai Dai, Yutao Sun, Li Dong, et al.2023 · 257 citations
16. InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training ↗Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetZewen Chi et al.2021 · 256 citations
17. Self-Attention Attribution: Interpreting Information Interactions Inside Transformer ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetYaru Hao et al.2021 · 243 citations
18. Visualizing and Understanding the Effectiveness of BERTConference on Empirical Methods in Natural Language Processing (EMNLP)Yaru Hao, Li Dong, Furu Wei, et al.2019 · 222 citations
19. Data-to-text Generation with Entity ModelingAnnual Meeting of the Association for Computational Linguistics (ACL)Ratish Puduppully, Li Dong, Mirella Lapata2019 · 181 citations
20. MiniLLM: On-Policy Distillation of Large Language ModelsarXiv:2306.08543Yuxian Gu, Li Dong, Furu Wei, et al.2023 · 144 citations
21. Controllable Natural Language Generation with Contrastive PrefixesFindings of the Association for Computational LinguisticsJing Qian, Li Dong, Yelong Shen, et al.2022 · 130 citations
22. XLM-E: Cross-lingual Language Model Pre-training via ELECTRAAnnual Meeting of the Association for Computational Linguistics (ACL)Zewen Chi, Shaohan Huang, Li Dong, et al.2022 · 127 citations
23. A Length-Extrapolatable TransformerAnnual Meeting of the Association for Computational Linguistics (ACL)Yutao Sun, Li Dong, Barun Patra, et al.2023 · 118 citations
24. Confidence Modeling for Neural Semantic Parsing ↗Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetLi Dong, Chris Quirk, Mirella Lapata2018 · 105 citations
25. mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs ↗Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yetZewen Chi et al.2021 · 91 citations
26. Language Models as Inductive ReasonersConference of the European Chapter of the Association for Computational Linguistics (EACL)Zonglin Yang, Li Dong, Xinya Du, et al.2024 · 70 citations
27. EDDA: An Encoder-Decoder Data Augmentation Framework for Zero-Shot Stance DetectionLanguage Resources and Evaluation Conference (LREC)Daijun Ding, Li Dong, Zhichao Huang, et al.2024 · 9 citations
28. Rectified Sparse Attention for Efficient Long-Sequence GenerationFindings of the Association for Computational LinguisticsYutao Sun, Tianzhu Ye, Li Dong, et al.2026 · 1 citation
29. Towards Stable and Effective Reinforcement Learning for Mixture-of-ExpertsAnnual Meeting of the Association for Computational Linguistics (ACL)Di Zhang, Xun Wu, Shaohan Huang, et al.2026 · 1 citation

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/li-dong/works/