Elamur Research⌕
☰
home / papers / Attention Is All You Need / cited by / page 5

Who cites «Attention Is All You Need»

16,413 papers of our library cite it (of the 140,884 whose bibliographies we read) · 993 with a page here, the most cited first · page 5 of 10 · 401–500 · ← the paper

1 … 4 5 6 … 10

  1. InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-TrainingZewen Chi, Li Dong, Furu Wei, et al.2020 · 269 citations
  2. An Explanation of In-context Learning as Implicit Bayesian InferenceSang Michael Xie, Aditi Raghunathan, Percy Liang, et al.2021 · 268 citations
  3. Attention is Not Only a Weight: Analyzing Transformers with Vector NormsGoro Kobayashi, Tatsuki Kuribayashi, Sho Yokoi, et al.2020 · 268 citations
  4. Injecting Numerical Reasoning Skills into Language ModelsMor Geva, Ankit Gupta, Jonathan Berant2020 · 268 citations
  5. Zero-Shot Stance Detection: A Dataset and Model using Generalized Topic RepresentationsEmily Allaway, Kathleen McKeown2020 · 268 citations
  6. ConveRT: Efficient and Accurate Conversational Representations from TransformersMatthew Henderson, Iñigo Casanueva, Nikola Mrkšić, et al.2020 · 267 citations
  7. LongLoRA: Efficient Fine-tuning of Long-Context Large Language ModelsYukang Chen, Shengju Qian, Haotian Tang, et al.2023 · 265 citations
  8. CUAD: An Expert-Annotated NLP Dataset for Legal Contract ReviewDan Hendrycks, Collin Burns, Anya Chen, et al.2021 · 265 citations
  9. IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language UnderstandingBryan Wilie, Karissa Vincentio, Genta Indra Winata, et al.2020 · 265 citations
  10. Towards Understanding and Mitigating Social Biases in Language ModelsPaul Pu Liang, Chiyu Wu, Louis-Philippe Morency, et al.2021 · 263 citations
  11. Selective Attention for Context-aware Neural Machine TranslationSameen Maruf, André F. T. Martins, Gholamreza Haffari2019 · 263 citations
  12. Condenser: a Pre-training Architecture for Dense RetrievalLuyu Gao, Jamie Callan2021 · 261 citations
  13. Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic ParsingXi Victoria Lin, Richard Socher, Caiming Xiong2020 · 261 citations
  14. Unicoder: A Universal Language Encoder by Pre-training with Multiple Cross-lingual TasksHaoyang Huang, Yaobo Liang, Nan Duan, et al.2019 · 261 citations
  15. TLDR: Extreme Summarization of Scientific DocumentsIsabel Cachola, Kyle Lo, Arman Cohan, et al.2020 · 260 citations
  16. Automatic Machine Translation Evaluation in Many Languages via Zero-Shot ParaphrasingBrian Thompson, Matt Post2020 · 259 citations
  17. Fairseq S2T: Fast Speech-to-Text Modeling with FairseqChanghan Wang, Yun Tang, Xutai Ma, et al.2020 · 259 citations
  18. On Extractive and Abstractive Neural Document Summarization with Transformer Language ModelsJonathan Pilault, Raymond Li, Sandeep Subramanian, et al.2020 · 259 citations
  19. How Can We Accelerate Progress Towards Human-like Linguistic Generalization?Tal Linzen2020 · 257 citations
  20. SUMBT: Slot-Utterance Matching for Universal and Scalable Belief TrackingHwaran Lee, Jinsik Lee, Tae-Yoon Kim2019 · 257 citations
  21. LexGLUE: A Benchmark Dataset for Legal Language Understanding in EnglishIlias Chalkidis; Abhik Jana; Dirk Hartung; Michael Bommarito; Ion Androutsopoulos; Daniel Martin Katz;, Nikolaos Aletras2021 · 256 citations
  22. Multilingual is not enough: BERT for FinnishAntti Virtanen, Jenna Kanerva, Rami Ilo, et al.2019 · 256 citations
  23. Quoref: A Reading Comprehension Dataset with Questions Requiring Coreferential ReasoningPradeep Dasigi, Nelson F. Liu, Ana Marasovic, et al.2019 · 256 citations
  24. Fine-Tuning LLaMA for Multi-Stage Text RetrievalXueguang Ma, Liang Wang, Nan Yang, et al.2023 · 254 citations
  25. DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI ScaleSamyam Rajbhandari, Conglong Li, Zhewei Yao, et al.2022 · 254 citations
  26. TAPEX: Table Pre-training via Learning a Neural SQL ExecutorQian Liu, Bei Chen, Jiaqi Guo, et al.2021 · 254 citations
  27. Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-OptimizersDamai Dai, Yutao Sun, Li Dong, et al.2023 · 252 citations
  28. Societal Biases in Language Generation: Progress and ChallengesEmily Sheng, Kai-Wei Chang, Prem Natarajan, et al.2021 · 252 citations
  29. NULI at SemEval-2019 Task 6: Transfer Learning for Offensive Language Detection using Bidirectional TransformersPing Liu, Wen Li, Liang Zou2019 · 252 citations
  30. Personality Traits in Large Language ModelsGreg Serapio-Garcia, Mustafa Safdari, Clement Crepy, et al.2023 · 251 citations
  31. Survey of Low-Resource Machine TranslationBarry Haddow, Rachel Bawden, Antonio Valerio Miceli Barone, et al.2022 · 251 citations
  32. ILDC for CJPE: Indian Legal Documents Corpus for Court Judgment Prediction and ExplanationVijit Malik, Rishabh Sanjay, Shubham Kumar Nigam, et al.2021 · 251 citations
  33. Event Extraction as Multi-turn Question AnsweringFayuan Li, Weihua Peng, Yuguang Chen, et al.2020 · 250 citations
  34. Measuring Faithfulness in Chain-of-Thought ReasoningTamera Lanham, Anna Chen, Ansh Radhakrishnan, et al.2023 · 249 citations
  35. LeanDojo: Theorem Proving with Retrieval-Augmented Language ModelsKaiyu Yang, Aidan M. Swope, Alex Gu, et al.2023 · 248 citations
  36. Parameter-efficient Multi-task Fine-tuning for Transformers via Shared HypernetworksRabeeh Karimi Mahabadi, Sebastian Ruder, Mostafa Dehghani, et al.2021 · 248 citations
  37. Interpreting Pretrained Contextualized Representations via Reductions to Static EmbeddingsRishi Bommasani, Kelly Davis, Claire Cardie2020 · 248 citations
  38. Reasoning with Sarcasm by Reading In-BetweenYi Tay, Anh Tuan Luu, Siu Cheung Hui, et al.2018 · 247 citations
  39. DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT ModelsBoxin Wang, Weixin Chen, Hengzhi Pei, et al.2023 · 246 citations
  40. SocialIQA: Commonsense Reasoning about Social InteractionsMaarten Sap, Hannah Rashkin, Derek Chen, et al.2019 · 246 citations
  41. Hallucinations in Large Multilingual Translation ModelsNuno M. Guerreiro, Duarte M. Alves, Jonas Waldendorf, et al.2023 · 244 citations
  42. Structured Denoising Diffusion Models in Discrete State-SpacesJacob Austin, Daniel D. Johnson, Jonathan Ho, et al.2021 · 244 citations
  43. Knowledge-Grounded Dialogue Generation with Pre-trained Language ModelsXueliang Zhao, Wei Wu, Can Xu, et al.2020 · 244 citations
  44. Taskmaster-1: Toward a Realistic and Diverse Dialog DatasetBill Byrne, Karthik Krishnamoorthi, Chinnadhurai Sankar, et al.2019 · 244 citations
  45. MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence FrontiersKrishna Pillutla, Swabha Swayamdipta, Rowan Zellers, et al.2021 · 243 citations
  46. Automatic Detection of Machine Generated Text: A Critical SurveyGanesh Jawahar, Muhammad Abdul-Mageed, Laks Lakshmanan V.S.2020 · 243 citations
  47. Synthetic Data Generation with Large Language Models for Text Classification: Potential and LimitationsZhuoyan Li, Hangxiao Zhu, Zhuoran Lu, et al.2023 · 242 citations
  48. CLUE: A Chinese Language Understanding Evaluation BenchmarkLiang Xu, Hai Hu, Xuanwei Zhang, et al.2020 · 242 citations
  49. Training Neural Machine Translation to Apply Terminology ConstraintsGeorgiana Dinu, Prashant Mathur, Marcello Federico, et al.2019 · 242 citations
  50. MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing BenchmarkHaoran Li, Abhinav Arora, Shuohui Chen, et al.2021 · 239 citations
  51. Analysing Lexical Semantic Change with Contextualised Word RepresentationsMario Giulianelli, Marco Del Tredici, Raquel Fernández2020 · 239 citations
  52. RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL ParsersBailin Wang, Richard Shin, Xiaodong Liu, et al.2020 · 239 citations
  53. Classification and Clustering of Arguments with Contextualized Word EmbeddingsNils Reimers, Benjamin Schiller, Tilman Beck, et al.2019 · 239 citations
  54. “Transforming” Delete, Retrieve, Generate Approach for Controlled Text Style TransferAkhilesh Sudhakar, Bhargav Upadhyay, Arjun Maheswaran2019 · 239 citations
  55. Multimodal Few-Shot Learning with Frozen Language ModelsMaria Tsimpoukelli, Jacob Menick, Serkan Cabi, et al.2021 · 238 citations
  56. Perceiver: General Perception with Iterative AttentionAndrew Jaegle, Felix Gimeno, Andrew Brock, et al.2021 · 238 citations
  57. COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge GraphsJena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, et al.2020 · 235 citations
  58. Generative Language Modeling for Automated Theorem ProvingStanislas Polu, Ilya Sutskever2020 · 235 citations
  59. BlenderBot 3: a deployed conversational agent that continually learns to responsibly engageKurt Shuster, Jing Xu, Mojtaba Komeili, et al.2022 · 234 citations
  60. Self-Guided Contrastive Learning for BERT Sentence RepresentationsTaeuk Kim, Kang Min Yoo, Sang-goo Lee2021 · 234 citations
  61. Politeness Transfer: A Tag and Generate ApproachAman Madaan, Amrith Setlur, Tanmay Parekh, et al.2020 · 234 citations
  62. Dialog State Tracking: A Neural Reading Comprehension ApproachShuyang Gao, Abhishek Sethi, Sanchit Agarwal, et al.2019 · 233 citations
  63. Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human SupervisionZhiqing Sun, Yikang Shen, Qinhong Zhou, et al.2023 · 232 citations
  64. Breaking Through the 80% Glass Ceiling: Raising the State of the Art in Word Sense Disambiguation by Incorporating Knowledge Graph InformationMichele Bevilacqua, Roberto Navigli2020 · 232 citations
  65. A Study of Reinforcement Learning for Neural Machine TranslationLijun Wu, Fei Tian, Tao Qin, et al.2018 · 232 citations
  66. Classical Structured Prediction Losses for Sequence to Sequence LearningSergey Edunov, Myle Ott, Michael Auli, et al.2018 · 232 citations
  67. Detecting Hallucinated Content in Conditional Neural Sequence GenerationChunting Zhou, Graham Neubig, Jiatao Gu, et al.2021 · 229 citations
  68. AlBERTo: Italian BERT Language Understanding Model for NLP Challenging Tasks Based on TweetsMarco Polignano, Pierpaolo Basile, Marco de Gemmis, et al.2019 · 228 citations
  69. Neural CRF Model for Sentence Alignment in Text SimplificationChao Jiang, Mounica Maddela, Wuwei Lan, et al.2020 · 227 citations
  70. Findings of the Third Shared Task on Multimodal Machine TranslationLoïc Barrault, Fethi Bougares, Lucia Specia, et al.2018 · 227 citations
  71. TrustLLM: Trustworthiness in Large Language ModelsYue Huang, Lichao Sun, Haoran Wang, et al.2024 · 226 citations
  72. What learning algorithm is in-context learning? Investigations with linear modelsEkin Akyürek, Dale Schuurmans, Jacob Andreas, et al.2022 · 224 citations
  73. BLEU might be Guilty but References are not InnocentMarkus Freitag, David Grangier, Isaac Caswell2020 · 223 citations
  74. The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling ObjectivesElena Voita, Rico Sennrich, Ivan Titov2019 · 222 citations
  75. Reasoning Over Semantic-Level Graph for Fact CheckingWanjun Zhong, Jingjing Xu, Duyu Tang, et al.2020 · 221 citations
  76. Steering Language Models With Activation EngineeringAlexander Matt Turner, Lisa Thiergart, Gavin Leech, et al.2023 · 220 citations
  77. Transformer Memory as a Differentiable Search IndexYi Tay, Vinh Q. Tran, Mostafa Dehghani, et al.2022 · 220 citations
  78. NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding ModelsChankyu Lee, Rajarshi Roy, Mengyao Xu, et al.2024 · 219 citations
  79. Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' AlignmentYang Liu; Yuanshun Yao; Jean-Francois Ton; Xiaoying Zhang; Ruocheng Guo; Hao Cheng; Yegor Klochkov; Muhammad Faaiz Taufiq;, Hang Li2023 · 219 citations
  80. Multilingual Translation from Denoising Pre-TrainingYuqing Tang, Chau Tran, Xian Li, et al.2021 · 219 citations
  81. Head-Driven Phrase Structure Grammar Parsing on Penn TreebankJunru Zhou, Hai Zhao2019 · 219 citations
  82. Unsupervised Question Decomposition for Question AnsweringEthan Perez, Patrick Lewis, Wen-tau Yih, et al.2020 · 218 citations
  83. Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language ModelsNeha Sengupta, Sunil Kumar Sahu, Bokang Jia, et al.2023 · 217 citations
  84. Factual Error Correction for Abstractive Summarization ModelsMeng Cao, Yue Dong, Jiapeng Wu, et al.2020 · 217 citations
  85. Distilling Reasoning Capabilities into Smaller Language ModelsKumar Shridhar, Alessandro Stolfo, Mrinmaya Sachan2023 · 216 citations
  86. Structured Pruning Learns Compact and Accurate ModelsMengzhou Xia, Zexuan Zhong, Danqi Chen2022 · 216 citations
  87. YiSi - a Unified Semantic MT Quality Evaluation and Estimation Metric for Languages with Different Levels of Available ResourcesChi-kiu Lo2019 · 216 citations
  88. Measuring Association Between Labels and Free-Text RationalesSarah Wiegreffe, Ana Marasović, Noah A. Smith2021 · 215 citations
  89. AlpaGasus: Training A Better Alpaca with Fewer DataLichang Chen, Shiyang Li, Jun Yan, et al.2023 · 214 citations
  90. Don't Say That! Making Inconsistent Dialogue Unlikely with Unlikelihood TrainingMargaret Li, Stephen Roller, Ilia Kulikov, et al.2020 · 214 citations
  91. Data-Driven Sentence Simplification: Survey and BenchmarkFernando Alva-Manchego, Carolina Scarton, Lucia Specia2020 · 213 citations
  92. Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4Hanmeng Liu, Ruoxi Ning, Zhiyang Teng, et al.2023 · 212 citations
  93. MADLAD-400: A Multilingual And Document-Level Large Audited DatasetSneha Kudugunta, Isaac Caswell, Biao Zhang, et al.2023 · 211 citations
  94. Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times?Byung-Doh Oh, William Schuler2023 · 211 citations
  95. LLM2Vec: Large Language Models Are Secretly Powerful Text EncodersParishad BehnamGhader, Vaibhav Adlakha, Marius Mosbach, et al.2024 · 209 citations
  96. Reinforced Self-Training (ReST) for Language ModelingCaglar Gulcehre, Tom Le Paine, Srivatsan Srinivasan, et al.2023 · 209 citations
  97. Logical Natural Language Generation from Open-Domain TablesWenhu Chen, Jianshu Chen, Yu Su, et al.2020 · 209 citations
  98. Compressing Context to Enhance Inference Efficiency of Large Language ModelsYucheng Li, Bo Dong, Frank Guerin, et al.2023 · 208 citations
  99. Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine TranslationHaoran Xu, Amr Sharaf, Yunmo Chen, et al.2024 · 207 citations
  100. Ring Attention with Blockwise Transformers for Near-Infinite ContextHao Liu, Matei Zaharia, Pieter Abbeel2023 · 207 citations

1 … 4 5 6 … 10

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/vaswani-2017-attention-all-need/cited-by/page/5/