Elamur Research⌕
☰
home / authors / Illia Polosukhin / cited by / page 3

Who cites Illia Polosukhin

18,396 citations of their works from 18,005 papers of our library (of the 140,884 whose bibliographies we read) · 1,116 with a page here, the most cited first · page 3 of 12 · 201–300 · ← Illia Polosukhin

1 2 3 4 … 12

  1. OCR-free Document Understanding TransformerGeewook Kim, Teakgyu Hong, Moonbin Yim, et al.2021 · 580 citations
  2. Towards a Human-like Open-Domain ChatbotDaniel Adiwardana, Minh-Thang Luong, David R. So, et al.2020 · 573 citations
  3. Multilingual Universal Sentence Encoder for Semantic RetrievalYinfei Yang, Daniel Cer, Amin Ahmad, et al.2020 · 571 citations
  4. PhoBERT: Pre-trained language models for VietnameseDat Quoc Nguyen, Anh Tuan Nguyen2020 · 571 citations
  5. AudioLM: a Language Modeling Approach to Audio GenerationZalan Borsos, Raphael Marinier, Damien Vincent, et al.2022 · 570 citations
  6. Leveraging Pre-trained Checkpoints for Sequence Generation TasksSascha Rothe, Shashi Narayan, Aliaksei Severyn2019 · 562 citations
  7. Plug and Play Language Models: A Simple Approach to Controlled Text GenerationSumanth Dathathri, Andrea Madotto, Janice Lan, et al.2019 · 562 citations
  8. Subword Regularization: Improving Neural Network Translation Models with Multiple Subword CandidatesTaku Kudo2018 · 561 citations
  9. Galactica: A Large Language Model for ScienceRoss Taylor, Marcin Kardas, Guillem Cucurull, et al.2022 · 558 citations
  10. Neural Legal Judgment Prediction in EnglishIlias Chalkidis, Ion Androutsopoulos, Nikolaos Aletras2019 · 558 citations
  11. gpt-oss-120b & gpt-oss-20b Model CardOpenAI: Sandhini Agarwal, Lama Ahmad, Jason Ai, et al.2025 · 555 citations
  12. Massively Multilingual Neural Machine Translation in the Wild: Findings and ChallengesNaveen Arivazhagan, Ankur Bapna, Orhan Firat, et al.2019 · 555 citations
  13. Neural Text Summarization: A Critical EvaluationWojciech Kryscinski, Nitish Shirish Keskar, Bryan McCann, et al.2019 · 555 citations
  14. The Best of Both Worlds: Combining Recent Advances in Neural Machine TranslationMia Xu Chen, Orhan Firat, Ankur Bapna, et al.2018 · 552 citations
  15. XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual GeneralizationJunjie Hu, Sebastian Ruder, Aditya Siddhant, et al.2020 · 551 citations
  16. How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and DetectionBiyang Guo, Xin Zhang, Ziyuan Wang, et al.2023 · 549 citations
  17. Deterministic Non-Autoregressive Neural Sequence Modeling by Iterative RefinementJason Lee, Elman Mansimov, Kyunghyun Cho2018 · 547 citations
  18. Reducing Transformer Depth on Demand with Structured DropoutAngela Fan, Edouard Grave, Armand Joulin2019 · 546 citations
  19. Document Ranking with a Pretrained Sequence-to-Sequence ModelRodrigo Nogueira, Zhiying Jiang, Ronak Pradeep, et al.2020 · 538 citations
  20. The BEA-2019 Shared Task on Grammatical Error CorrectionChristopher Bryant, Mariano Felice, Øistein E. Andersen, et al.2019 · 530 citations
  21. Simple, Scalable Adaptation for Neural Machine TranslationAnkur Bapna, Orhan Firat2019 · 524 citations
  22. The Natural Language Decathlon: Multitask Learning as Question AnsweringBryan McCann, Nitish Shirish Keskar, Caiming Xiong, et al.2018 · 523 citations
  23. DeCLUTR: Deep Contrastive Learning for Unsupervised Textual RepresentationsJohn Giorgi, Osvald Nitski, Bo Wang, et al.2021 · 513 citations
  24. Baichuan 2: Open Large-scale Language ModelsAiyuan Yang, Bin Xiao, Bingning Wang, et al.2023 · 512 citations
  25. MLS: A Large-Scale Multilingual Dataset for Speech ResearchVineel Pratap, Qiantong Xu, Anuroop Sriram, et al.2020 · 510 citations
  26. TabFact: A Large-scale Dataset for Table-based Fact VerificationWenhu Chen, Hongmin Wang, Jianshu Chen, et al.2019 · 508 citations
  27. Marian: Fast Neural Machine Translation in C++Marcin Junczys-Dowmunt, Roman Grundkiewicz, Tomasz Dwojak, et al.2018 · 506 citations
  28. OpenAssistant Conversations — Democratizing Large Language Model AlignmentAndreas Köpf, Yannic Kilcher, Dimitri von Rütte, et al.2023 · 505 citations
  29. Multilingual Machine Translation with Large Language Models: Empirical Results and AnalysisWenhao Zhu, Hongyi Liu, Qingxiu Dong, et al.2024 · 503 citations
  30. FLAT: Chinese NER Using Flat-Lattice TransformerXiaonan Li, Hang Yan, Xipeng Qiu, et al.2020 · 503 citations
  31. Sparse, Dense, and Attentional Representations for Text RetrievalYi Luan, Jacob Eisenstein, Kristina Toutanova, et al.2021 · 500 citations
  32. Neural Text Generation with Unlikelihood TrainingSean Welleck, Ilia Kulikov, Stephen Roller, et al.2019 · 498 citations
  33. Sentence Encoders on STILTs: Supplementary Training on Intermediate Labeled-data TasksJason Phang, Thibault Févry, Samuel R. Bowman2018 · 490 citations
  34. Phi-4 Technical ReportMarah Abdin, Jyoti Aneja, Harkirat Behl, et al.2024 · 489 citations
  35. REPLUG: Retrieval-Augmented Black-Box Language ModelsWeijia Shi, Sewon Min, Michihiro Yasunaga, et al.2023 · 482 citations
  36. DeeBERT: Dynamic Early Exiting for Accelerating BERT InferenceJi Xin, Raphael Tang, Jaejun Lee, et al.2020 · 480 citations
  37. ToTTo: A Controlled Table-To-Text Generation DatasetAnkur Parikh, Xuezhi Wang, Sebastian Gehrmann, et al.2020 · 479 citations
  38. ColBERTv2: Effective and Efficient Retrieval via Lightweight Late InteractionKeshav Santhanam, Omar Khattab, Jon Saad-Falcon, et al.2022 · 477 citations
  39. Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timeMitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, et al.2022 · 474 citations
  40. GLaM: Efficient Scaling of Language Models with Mixture-of-ExpertsNan Du, Yanping Huang, Andrew M. Dai, et al.2021 · 474 citations
  41. Inference-Time Intervention: Eliciting Truthful Answers from a Language ModelKenneth Li, Oam Patel, Fernanda Viegas, et al.2023 · 473 citations
  42. Improving Massively Multilingual Neural Machine Translation and Zero-Shot TranslationBiao Zhang, Philip Williams, Ivan Titov, et al.2020 · 472 citations
  43. Data Augmentation using Pre-trained Transformer ModelsVarun Kumar, Ashutosh Choudhary, Eunah Cho2020 · 468 citations
  44. Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERTShijie Wu, Mark Dredze2019 · 466 citations
  45. Masked Autoencoders Are Scalable Vision LearnersKaiming He, Xinlei Chen, Saining Xie, et al.2021 · 463 citations
  46. CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-XQinkai Zheng, Xiao Xia, Xu Zou, et al.2023 · 462 citations
  47. Hierarchical Transformers for Multi-Document SummarizationYang Liu, Mirella Lapata2019 · 462 citations
  48. From Zero to Hero: On the Limitations of Zero-Shot Language Transfer with Multilingual TransformersAnne Lauscher, Vinit Ravishankar, Ivan Vulić, et al.2020 · 461 citations
  49. Defending Against Neural Fake NewsRowan Zellers, Ari Holtzman, Hannah Rashkin, et al.2019 · 461 citations
  50. SimVLM: Simple Visual Language Model Pretraining with Weak SupervisionZirui Wang, Jiahui Yu, Adams Wei Yu, et al.2021 · 459 citations
  51. Are All Languages Created Equal in Multilingual BERT?Shijie Wu, Mark Dredze2020 · 458 citations
  52. Graph-to-Sequence Learning using Gated Graph Neural NetworksDaniel Beck, Gholamreza Haffari, Trevor Cohn2018 · 456 citations
  53. LinkBERT: Pretraining Language Models with Document LinksMichihiro Yasunaga, Jure Leskovec, Percy Liang2022 · 452 citations
  54. OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning FrameworkPeng Wang, An Yang, Rui Men, et al.2022 · 452 citations
  55. ProphetNet: Predicting Future N-gram for Sequence-to-SequencePre-trainingWeizhen Qi, Yu Yan, Yeyun Gong, et al.2020 · 451 citations
  56. Meta-Learning for Low-Resource Neural Machine TranslationJiatao Gu, Yong Wang, Yun Chen, et al.2018 · 451 citations
  57. CogView: Mastering Text-to-Image Generation via TransformersMing Ding, Zhuoyi Yang, Wenyi Hong, et al.2021 · 446 citations
  58. HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document SummarizationXingxing Zhang, Furu Wei, Ming Zhou2019 · 446 citations
  59. Context-Aware Neural Machine Translation Learns Anaphora ResolutionElena Voita, Pavel Serdyukov, Rico Sennrich, et al.2018 · 446 citations
  60. FinGPT: Open-Source Financial Large Language ModelsHongyang Yang, Xiao-Yang Liu, Christina Dan Wang2023 · 445 citations
  61. GeDi: Generative Discriminator Guided Sequence GenerationBen Krause, Akhilesh Deepak Gotmare, Bryan McCann, et al.2021 · 444 citations
  62. How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language ModelsPhillip Rust, Jonas Pfeiffer, Ivan Vulić, et al.2021 · 444 citations
  63. Masked Language Model ScoringJulian Salazar, Davis Liang, Toan Q. Nguyen, et al.2020 · 444 citations
  64. Mathematical Capabilities of ChatGPTSimon Frieder, Luca Pinchetti, Alexis Chevalier, et al.2023 · 443 citations
  65. Has Machine Translation Achieved Human Parity? A Case for Document-level EvaluationSamuel Läubli, Rico Sennrich, Martin Volk2018 · 443 citations
  66. Pretrained Transformers Improve Out-of-Distribution RobustnessDan Hendrycks, Xiaoyuan Liu, Eric Wallace, et al.2020 · 442 citations
  67. ShareGPT4V: Improving Large Multi-Modal Models with Better CaptionsLin Chen, Jinsong Li, Xiaoyi Dong, et al.2023 · 441 citations
  68. Measuring Coding Challenge Competence With APPSDan Hendrycks, Steven Basart, Saurav Kadavath, et al.2021 · 438 citations
  69. Fast Lexically Constrained Decoding with Dynamic Beam Allocation for Neural Machine TranslationMatt Post, David Vilar2018 · 437 citations
  70. The Falcon Series of Open Language ModelsEbtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 436 citations
  71. MuST-C: a Multilingual Speech Translation CorpusMattia A. Di Gangi, Roldano Cattoni, Luisa Bentivogli, et al.2019 · 436 citations
  72. oLMpics — On what Language Model Pre-training CapturesAlon Talmor, Yanai Elazar, Yoav Goldberg, et al.2019 · 432 citations
  73. Unsupervised Statistical Machine TranslationMikel Artetxe, Gorka Labaka, Eneko Agirre2018 · 432 citations
  74. Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot FlyNora Kassner, Hinrich Schütze2020 · 431 citations
  75. Analyzing the Structure of Attention in a Transformer Language ModelJesse Vig, Yonatan Belinkov2019 · 430 citations
  76. Experience Grounds LanguageYonatan Bisk, Ari Holtzman, Jesse Thomason, et al.2020 · 429 citations
  77. Sequicity: Simplifying Task-oriented Dialogue Systems with Single Sequence-to-Sequence ArchitecturesWenqiang Lei, Xisen Jin, Min-Yen Kan, et al.2018 · 426 citations
  78. Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware SamplingSebastian Hofstatter, Sheng-Chieh Lin, Jheng-Hong Yang, et al.2021 · 425 citations
  79. Controllable Abstractive SummarizationAngela Fan, David Grangier, Michael Auli2018 · 423 citations
  80. Security and Privacy Challenges of Large Language Models: A SurveyBadhan Chandra Das, M. Hadi Amini, Yanzhao Wu2024 · 422 citations
  81. Diffusion-LM Improves Controllable Text GenerationXiang Lisa Li, John Thickstun, Ishaan Gulrajani, et al.2022 · 421 citations
  82. Ethical and social risks of harm from Language ModelsLaura Weidinger, John Mellor, Maribeth Rauh, et al.2021 · 421 citations
  83. Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied AgentsWenlong Huang, Pieter Abbeel, Deepak Pathak, et al.2022 · 420 citations
  84. Template-Based Named Entity Recognition Using BARTLeyang Cui, Yu Wu, Jian Liu, et al.2021 · 420 citations
  85. ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual LearningViet Dac Lai, Nghia Ngo, Amir Pouran Ben Veyseh, et al.2023 · 418 citations
  86. Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality MetricsArtidoro Pagnoni, Vidhisha Balachandran, Yulia Tsvetkov2021 · 417 citations
  87. Pay Less Attention with Lightweight and Dynamic ConvolutionsFelix Wu, Angela Fan, Alexei Baevski, et al.2019 · 416 citations
  88. 75 Languages, 1 Model: Parsing Universal Dependencies UniversallyDan Kondratyuk, Milan Straka2019 · 415 citations
  89. Kimi k1.5: Scaling Reinforcement Learning with LLMsKimi Team, Angang Du, Bofei Gao, et al.2025 · 413 citations
  90. High Fidelity Neural Audio CompressionAlexandre Defossez, Jade Copet, Gabriel Synnaeve, et al.2022 · 412 citations
  91. Are Sixteen Heads Really Better than One?Paul Michel, Omer Levy, Graham Neubig2019 · 412 citations
  92. Document-Level Neural Machine Translation with Hierarchical Attention NetworksLesly Miculicich, Dhananjay Ram, Nikolaos Pappas, et al.2018 · 411 citations
  93. A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health SupportAshish Sharma, Adam Miner, David Atkins, et al.2020 · 408 citations
  94. Multi-Turn Response Selection for Chatbots with Deep Attention Matching NetworkXiangyang Zhou, Lu Li, Daxiang Dong, et al.2018 · 408 citations
  95. Automatic Detection of Generated Text is Easiest when Humans are FooledDaphne Ippolito, Daniel Duckworth, Chris Callison-Burch, et al.2019 · 406 citations
  96. Training data-efficient image transformers & distillation through attentionHugo Touvron, Matthieu Cord, Matthijs Douze, et al.2020 · 405 citations
  97. The FineWeb Datasets: Decanting the Web for the Finest Text Data at ScaleGuilherme Penedo, Hynek Kydlíček, Loubna Ben allal, et al.2024 · 404 citations
  98. Generating Sentences by Editing PrototypesKelvin Guu, Tatsunori B. Hashimoto, Yonatan Oren, et al.2017 · 404 citations
  99. Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question AnsweringShamane Siriwardhana, Rivindu Weerasekera, Elliott Wen, et al.2023 · 403 citations
  100. Yi: Open Foundation Models by 01.AIAlex Young, Bei Chen, Chao Li, et al.2024 · 402 citations

1 2 3 4 … 12

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/illia-polosukhin/cited-by/page/3/