🧑‍🔬 Iz Beltagy — all works

26 works · ← Iz Beltagy

1. Longformer: The Long-Document TransformerarXiv:2004.05150Iz Beltagy, Matthew E. Peters, Arman Cohan2020 · 3,880 citations
2. SciBERT: A Pretrained Language Model for Scientific TextConference on Empirical Methods in Natural Language Processing (EMNLP)Iz Beltagy, Kyle Lo, Arman Cohan2019 · 3,582 citations
3. Don't Stop Pretraining: Adapt Language Models to Domains and Tasks ↗Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · no summary yetSuchin Gururangan et al.2020 · 3,079 citations
4. BLOOM: A 176B-Parameter Open-Access Multilingual Language Model ↗arXiv:2211.05100 · no summary yetBigScience Workshop et al.2022 · 1,606 citations
5. SPECTER: Document-level Representation Learning using Citation-informed TransformersAnnual Meeting of the Association for Computational Linguistics (ACL)Arman Cohan, Sergey Feldman, Iz Beltagy, et al.2020 · 697 citations
6. ScispaCy: Fast and Robust Models for Biomedical Natural Language ProcessingBioNLP Shared Task WorkshopMark Neumann, Daniel King, Iz Beltagy, et al.2019 · 680 citations
7. OLMo: Accelerating the Science of Language Models ↗Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetDirk Groeneveld et al.2024 · 429 citations
8. Construction of the Literature Graph in Semantic ScholarConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Waleed Ammar, Dirk Groeneveld, Chandra Bhagavatula, et al.2018 · 400 citations
9. A Dataset of Information-Seeking Questions and Answers Anchored in Research PapersConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Pradeep Dasigi, Kyle Lo, Iz Beltagy, et al.2021 · 384 citations
10. Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research ↗Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetLuca Soldaini et al.2024 · 341 citations
11. How Far Can Camels Go? Exploring the State of Instruction Tuning on Open ResourcesConference on Neural Information Processing Systems (NeurIPS)Yizhong Wang, Hamish Ivison, Pradeep Dasigi, et al.2023 · 317 citations
12. SciREX: A Challenge Dataset for Document-Level Information ExtractionAnnual Meeting of the Association for Computational Linguistics (ACL)Sarthak Jain, Madeleine van Zuylen, Hannaneh Hajishirzi, et al.2020 · 220 citations
13. Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2arXiv:2311.10702Hamish Ivison, Yizhong Wang, Valentina Pyatkin, et al.2023 · 207 citations
14. PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document SummarizationAnnual Meeting of the Association for Computational Linguistics (ACL)Wen Xiao, Iz Beltagy, Giuseppe Carenini, et al.2022 · 205 citations
15. Pretrained Language Models for Sequential Sentence Classification ↗Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · no summary yetArman Cohan et al.2019 · 172 citations
16. Few-Shot Self-Rationalization with Natural Language PromptsFindings of the Association for Computational LinguisticsAna Marasovic, Iz Beltagy, Doug Downey, et al.2022 · 134 citations
17. The Semantic Scholar Open Data Platform ↗arXiv (Cornell University) · no summary yetRodney Kinney et al.2023 · 126 citations
18. CDLM: Cross-Document Language ModelingFindings of the Association for Computational LinguisticsAvi Caciularu, Arman Cohan, Iz Beltagy, et al.2021 · 106 citations
19. MultiVerS: Improving scientific claim verification with weak supervision and full-document context ↗Findings of the Association for Computational Linguistics: NAACL 2022 · no summary yetDavid Wadden et al.2022 · 98 citations
20. SciFact-Open: Towards open-domain scientific claim verificationFindings of the Association for Computational LinguisticsDavid Wadden, Kyle Lo, Bailey Kuehl, et al.2022 · 94 citations
21. MS^2: Multi-Document Summarization of Medical Studies ↗Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yetJay DeYoung et al.2021 · 84 citations
22. What Language Model to Train if You Have One Million GPU Hours? ↗arXiv:2210.15424 · no summary yetTeven Le Scao et al.2022 · 73 citations
23. What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization? ↗arXiv:2204.05832 · no summary yetThomas Wang et al.2022 · 62 citations
24. Z-ICL: Zero-Shot In-Context Learning with Pseudo-Demonstrations ↗Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetXinxi Lyu et al.2023 · 56 citations
25. Paloma: A Benchmark for Evaluating Language Model FitConference on Neural Information Processing Systems (NeurIPS)Ian Magnusson, Akshita Bhagia, Valentin Hofmann, et al.2023 · 42 citations
26. Source-Aware Training Enables Knowledge Attribution in Language ModelsarXiv:2404.01019Muhammad Khalifa, David Wadden, Emma Strubell, et al.2024 · 21 citations

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/iz-beltagy/works/