🧑‍🔬 Omer Levy — all works

97 works · ← Omer Levy

1. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionAnnual Meeting of the Association for Computational Linguistics (ACL)Mike Lewis, Yinhan Liu, Naman Goyal, et al.2020 · 12,856 citations
2. RoBERTa: A Robustly Optimized BERT Pretraining ApproacharXiv:1907.11692Yinhan Liu, Myle Ott, Naman Goyal, et al.2019 · 9,837 citations
3. GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language UnderstandingEMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLPAlex Wang, Amanpreet Singh, Julian Michael, et al.2018 · 7,276 citations
4. SpanBERT: Improving Pre-training by Representing and Predicting SpansTransactions of the Association for Computational Linguistics (TACL)Mandar Joshi, Danqi Chen, Yinhan Liu, et al.2019 · 2,616 citations
5. SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding SystemsarXiv:1905.00537Alex Wang, Yada Pruksachatkun, Nikita Nangia, et al.2019 · 2,227 citations
6. What Does BERT Look at? An Analysis of BERT's Attention ↗Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · no summary yetKevin Clark et al.2019 · 2,049 citations
7. Neural Word Embedding as Implicit Matrix Factorization ↗neural information processing systems · no summary yetOmer Levy, Yoav Goldberg2014 · 1,737 citations
8. Improving Distributional Similarity with Lessons Learned from Word EmbeddingsTransactions of the Association for Computational Linguistics (TACL)Omer Levy, Yoav Goldberg, Ido Dagan2015 · 1,626 citations
9. Annotation Artifacts in Natural Language Inference DataConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Suchin Gururangan, Swabha Swayamdipta, Omer Levy, et al.2018 · 1,615 citations
10. Dependency-Based Word Embeddings ↗Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · no summary yetOmer Levy, Yoav Goldberg2014 · 1,414 citations
11. word2vec Explained: deriving Mikolov et al.'s negative-sampling word-embedding method ↗arXiv (Cornell University) · no summary yetYoav Goldberg, Omer Levy2014 · 1,342 citations
12. code2vec: Learning Distributed Representations of Code ↗arXiv:1803.09473 · no summary yetUri Alon et al.2018 · 1,280 citations
13. LIMA: Less Is More for Alignment ↗arXiv:2305.11206 · no summary yetChunting Zhou et al.2023 · 1,022 citations
14. Transformer Feed-Forward Layers Are Key-Value Memories ↗Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yetMor Geva et al.2021 · 811 citations
15. Zero-Shot Relation Extraction via Reading ComprehensionConference on Computational Natural Language Learning (CoNLL)Omer Levy, Minjoon Seo, Eunsol Choi, et al.2017 · 806 citations
16. Linguistic Regularities in Sparse and Explicit Word RepresentationsConference on Computational Natural Language Learning (CoNLL)Omer Levy, Yoav Goldberg2014 · 798 citations
17. Mask-Predict: Parallel Decoding of Conditional Masked Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Marjan Ghazvininejad, Omer Levy, Yinhan Liu, et al.2019 · 684 citations
18. Shared computational principles for language processing in humans and deep language models ↗Nature Neuroscience · no summary yetAriel Goldstein et al.2022 · 494 citations
19. BERT for Coreference Resolution: Baselines and AnalysisConference on Empirical Methods in Natural Language Processing (EMNLP)Mandar Joshi, Omer Levy, Luke Zettlemoyer, et al.2019 · 490 citations
20. Generalization through Memorization: Nearest Neighbor Language Models ↗arXiv:1911.00172 · no summary yetUrvashi Khandelwal et al.2019 · 464 citations
21. Emergent linguistic structure in artificial neural networks trained by self-supervision ↗Proceedings of the National Academy of Sciences · no summary yetChristopher D. Manning et al.2020 · 461 citations
22. Are Sixteen Heads Really Better than One?arXiv:1905.10650Paul Michel, Omer Levy, Graham Neubig2019 · 435 citations
23. Unnatural Instructions: Tuning Language Models with (Almost) No Human LaborAnnual Meeting of the Association for Computational Linguistics (ACL)Or Honovich, Thomas Scialom, Omer Levy, et al.2023 · 366 citations
24. Do Supervised Distributional Methods Really Learn Lexical Inference Relations?Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)Omer Levy, Steffen Remus, Chris Biemann, et al.2015 · 325 citations
25. Ultra-Fine Entity Typing ↗Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetEunsol Choi et al.2018 · 310 citations
26. Jointly Predicting Predicates and Arguments in Neural Semantic Role LabelingAnnual Meeting of the Association for Computational Linguistics (ACL)Luheng He, Kenton Lee, Omer Levy, et al.2018 · 285 citations
27. Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generation ↗neural information processing systems · no summary yetYuval Kirstain et al.2023 · 232 citations
28. Blockwise Self-Attention for Long Document Understanding ↗Findings of the Association for Computational Linguistics: EMNLP 2020 · no summary yetJiezhong Qiu et al.2020 · 219 citations
29. Deep RNNs Encode Soft Hierarchical SyntaxAnnual Meeting of the Association for Computational Linguistics (ACL)Terra Blevins, Omer Levy, Luke Zettlemoyer2018 · 179 citations
30. SCROLLS: Standardized CompaRison Over Long Language SequencesConference on Empirical Methods in Natural Language Processing (EMNLP)Uri Shaham, Elad Segal, Maor Ivgi, et al.2022 · 165 citations
31. Training on Synthetic Noise Improves Robustness to Natural Noise in Machine TranslationWorkshop on Noisy User-generated TextVladimir Karpukhin, Omer Levy, Jacob Eisenstein, et al.2019 · 160 citations
32. Instruction Induction: From Few Examples to Natural Language Task Descriptions ↗arXiv:2205.10782 · no summary yetOr Honovich et al.2022 · 148 citations
33. A Simple Word Embedding Model for Lexical Substitution ↗Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing · no summary yetOren Melamud, Omer Levy, Ido Dagan2015 · 142 citations
34. Self-Alignment with Instruction BacktranslationarXiv:2308.06259Xian Li, Ping Yu, Chunting Zhou, et al.2023 · 139 citations
35. ZeroSCROLLS: A Zero-Shot Benchmark for Long Text UnderstandingFindings of the Association for Computational LinguisticsUri Shaham, Maor Ivgi, Avia Efrat, et al.2023 · 132 citations
36. Aligned Cross Entropy for Non-Autoregressive Machine Translation ↗arXiv (Cornell University) · no summary yetMarjan Ghazvininejad et al.2020 · 131 citations
37. How to Train BERT with an Academic Budget ↗Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yetPeter Izsak, Moshe Berchansky, Omer Levy2021 · 130 citations
38. Named Entity Disambiguation for Noisy Text ↗Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017) · no summary yetYotam Eshel et al.2017 · 129 citations
39. Few-Shot Question Answering by Pretraining Span Selection ↗Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · no summary yetOri Ram et al.2021 · 121 citations
40. Transformer Language Models without Positional Encodings Still Learn Positional Information ↗arXiv:2203.16634 · no summary yetAdi Haviv et al.2022 · 111 citations
41. Coreference Resolution without Span RepresentationsAnnual Meeting of the Association for Computational Linguistics (ACL)Yuval Kirstain, Ori Ram, Omer Levy2021 · 109 citations
42. Simulating Action Dynamics with Neural Process Networks ↗arXiv:1711.05313 · no summary yetAntoine Bosselut et al.2017 · 102 citations
43. A Strong Baseline for Learning Cross-Lingual Word Embeddings from Sentence Alignments ↗Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers · no summary yetOmer Levy, Anders Søgaard, Yoav Goldberg2017 · 98 citations
44. A General Path-Based Representation for Predicting Program Properties ↗arXiv:1803.09544 · no summary yetUri Alon et al.2018 · 89 citations
45. Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model ↗arXiv:2408.11039 · no summary yetChunting Zhou et al.2024 · 83 citations
46. The Excitement Open Platform for Textual Inferences ↗Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations · no summary yetBernardo Magnini et al.2014 · 72 citations
47. Semi-Autoregressive Training Improves Mask-Predict Decoding ↗arXiv (Cornell University) · no summary yetMarjan Ghazvininejad, Omer Levy, Luke Zettlemoyer2020 · 70 citations
48. The Turking Test: Can Language Models Understand Instructions? ↗arXiv:2010.11982 · no summary yetAvia Efrat, Omer Levy2020 · 69 citations
49. Branch-Solve-Merge Improves Large Language Model Evaluation and Generation ↗arXiv:2310.15123 · no summary yetSwarnadeep Saha et al.2023 · 68 citations
50. Improving Transformer Models by Reordering their Sublayers ↗Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · no summary yetOfir Press, Noah A. Smith, Omer Levy2020 · 68 citations
51. pair2vec: Compositional Word-Pair Embeddings for Cross-Sentence Inference ↗Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · no summary yetMandar Joshi et al.2019 · 66 citations
52. Learning to Retrieve Passages without Supervision ↗Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetOri Ram et al.2022 · 65 citations
53. Focused Entailment Graphs for Open IE Propositions ↗Proceedings of the Eighteenth Conference on Computational Natural Language Learning · no summary yetOmer Levy, Ido Dagan, Jacob Goldberger2014 · 60 citations
54. Thinking ahead: spontaneous prediction in context as a keystone of language in humans and machines ↗bioRxiv (Cold Spring Harbor Laboratory) · no summary yetAriel Goldstein et al.2020 · 56 citations
55. Recognizing Partial Textual Entailment ↗Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · no summary yetOmer Levy et al.2013 · 56 citations
56. Structural Language Models of Code ↗arXiv:1910.00577 · no summary yetUri Alon et al.2019 · 55 citations
57. Annotating Relation Inference in Context via Question Answering ↗Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · no summary yetOmer Levy, Ido Dagan2016 · 49 citations
58. Scaling Laws for Generative Mixed-Modal Language ModelsarXiv:2301.03728Armen Aghajanyan, Lili Yu, Alexis Conneau, et al.2023 · 45 citations
59. Recurrent Additive Networks ↗arXiv (Cornell University) · no summary yetKenton Lee, Omer Levy, Luke Zettlemoyer2017 · 40 citations
60. Long Short-Term Memory as a Dynamically Computed Element-wise Weighted Sum ↗Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · no summary yetOmer Levy et al.2018 · 36 citations
61. Models In a Spelling Bee: Language Models Implicitly Learn the Character Composition of Tokens ↗Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetItay Itzhak, Omer Levy2022 · 34 citations
62. LMentry: A Language Model Benchmark of Elementary Language Tasks ↗Findings of the Association for Computational Linguistics: ACL 2023 · no summary yetAvia Efrat, Or Honovich, Omer Levy2023 · 33 citations
63. Causes and Cures for Interference in Multilingual Translation ↗Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetUri Shaham et al.2023 · 28 citations
64. LSTMs Exploit Linguistic Attributes of Data ↗Proceedings of the Third Workshop on Representation Learning for NLP · no summary yetNelson F. Liu et al.2018 · 26 citations
65. Vision Transformers with Mixed-Resolution Tokenization ↗IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · no summary yetTomer Ronen, Omer Levy, Avram Golbert2023 · 25 citations
66. Correspondence between the layered structure of deep language models and temporal structure of natural language processing in the human brain ↗bioRxiv (Cold Spring Harbor Laboratory) · no summary yetAriel Goldstein et al.2022 · 22 citations
67. Simple Local Attentions Remain Competitive for Long-Context Tasks ↗Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetWenhan Xiong et al.2022 · 22 citations
68. Breaking Character: Are Subwords Good Enough for MRLs After All? ↗arXiv (Cornell University) · no summary yetOmri Keren et al.2022 · 21 citations
69. Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length ↗neural information processing systems · no summary yetXuezhe Ma et al.2024 · 20 citations
70. Neural Machine Translation without Embeddings ↗Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetUri Shaham, Omer Levy2021 · 20 citations
71. A Few More Examples May Be Worth Billions of Parameters ↗Findings of the Association for Computational Linguistics: EMNLP 2022 · no summary yetYuval Kirstain et al.2022 · 19 citations
72. Cryptonite: A Cryptic Crossword Benchmark for Extreme Ambiguity in Language ↗Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yetAvia Efrat et al.2021 · 19 citations
73. Temporal structure of natural language processing in the human brain corresponds to layered hierarchy of large language models ↗Nature Communications · no summary yetAriel Goldstein et al.2025 · 17 citations
74. Learning to Exploit Structured Resources for Lexical Inference ↗Proceedings of the Nineteenth Conference on Computational Natural Language Learning · no summary yetVered Shwartz et al.2015 · 17 citations
75. Understanding Large-Scale Software – A Hierarchical View ↗IEEE/ACM International Conference on Program Comprehension (ICPC) · no summary yetOmer Levy, Dror G. Feitelson2019 · 15 citations
76. Understanding large-scale software systems – structure and flows ↗Empirical Software Engineering · no summary yetOmer Levy, Dror G. Feitelson2021 · 14 citations
77. ParaShoot: A Hebrew Question Answering DatasetOmri Keren, Omer LevyModern Hebrew · 13 citations
78. Branch-Solve-Merge Improves Large Language Model Evaluation and Generation ↗Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · no summary yetSwarnadeep Saha et al.2024 · 11 citations
79. What Do You Get When You Cross Beam Search with Nucleus Sampling? ↗Proceedings of the Third Workshop on Insights from Negative Results in NLP · no summary yetUri Shaham, Omer Levy2022 · 11 citations
80. Structural Language Models for Any-Code Generation. ↗arXiv (Cornell University) · no summary yetUri Alon et al.2019 · 10 citations
81. UKP-BIU: Similarity and Entailment Metrics for Student Response Analysis ↗Second Joint Conference on Lexical and Computational Semantics (*SEM), Volume 2: Proceedings of the Seventh International Workshop on Semantic Evaluation (SemEval 2013) · no summary yetOmer Levy et al.2013 · 8 citations
82. Can Latent Alignments Improve Autoregressive Machine Translation? ↗Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetAdi Haviv, Lior Vassertail, Omer Levy2021 · 7 citations
83. Altogether: Image Captioning via Re-aligning Alt-text ↗Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · no summary yetHu Xu et al.2024 · 6 citations
84. How Optimal is Greedy Decoding for Extractive Question Answering? ↗arXiv (Cornell University) · no summary yetOr Castel et al.2021 · 4 citations
85. Modeling Extractive Sentence Intersection via Subtree Entailment ↗Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers · no summary yetOmer Levy et al.2016 · 4 citations
86. Teaching Machines to Learn by Metaphors ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetOmer Levy, Shaul Markovitch4 citations
87. Proposition Knowledge Graphs ↗Proceedings of the First AHA!-Workshop on Information Discovery in Text · no summary yetGabriel Stanovsky, Omer Levy, Ido Dagan2014 · 3 citations
88. X&Fuse: Fusing Visual Information in Text-to-Image Generation ↗arXiv (Cornell University) · no summary yetYuval Kirstain, Omer Levy, Adam Polyak2023 · 1 citation
89. Keep Guessing? When Considering Inference Scaling, Mind the Baselines ↗Findings of the Association for Computational Linguistics: NAACL 2025 · no summary yetGal Yona et al.2025
90. Reflective Writing and Well-being:An interdisciplinary perspective ↗University of Groningen research database (University of Groningen / Centre for Information Technology) · no summary yetFerdinand Lewis et al.2023
91. Are Mutually Intelligible Languages Easier to Translate? ↗arXiv (Cornell University) · no summary yetAvital Friedland, Jonathan Zeltser, Omer Levy2022
92. A Simple Baseline for Beam Search Reranking ↗arXiv (Cornell University) · no summary yetLior Vassertail, Omer Levy2022
93. Reconsidering Cross-lingual Word Embeddings. ↗no summary yetOmer Levy, Anders Søgaard, Yoav Goldberg2016
94. tributed Representations of Words and Phrases and their Compositionality ” by ↗no summary yetYoav Goldberg et al.2014
95. Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence Teaching Machines to Learn by Metaphors ↗no summary yetOmer Levy, Shaul Markovitch2013
96. The Joint Student Response Analysis and 8th Recognizing ↗no summary yetTorsten Zesch et al.2013
97. Arvind Kumar, Business Client Group, Intel Corporation ↗no summary yetOmer Levy, Business Client Group, Intel Corporation2012

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/omer-levy/works/