🧑‍🔬 Rotem Dror

🏛️ Affiliations

🎓University of HaifaHaifa · Israel2023–2026 · 14 papersEmployment since 2023 · Assistant Professor, Information Systemscurrent🎓Technion – Israel Institute of TechnologyHaifa · Israel2016–2020 · 15 papers🎓University of PennsylvaniaPhiladelphia · United States2021–2023 · 9 papersEmployment · Postdoctoral Researcher, Computer and Information Science

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine.

🧭 Fields, topics and concepts

Of its works in our library, with the number of works on each.

📅 Works by year

2020s

📄 Papers

The most cited first (OpenAlex and our library).

1. A Statistical Analysis of Summarization Evaluation Metrics Using Resampling Methods (2021 · 117 citations)
   Automatic summarization metrics are usually judged by how well their scores correlate with human quality ratings.
2. The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs (2025 · 52 citations)
   Researchers increasingly use LLMs instead of people to label data or evaluate model outputs. There is no accepted, statistically grounded way to decide whether this substitution is justified. Common checks such as F1, kappa or correlation have no clear pass/fail threshold and cannot show that an LLM beats a human.…

All works

10 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them.

1. The Hitchhiker's Guide to Testing Statistical Significance in Natural Language Processing ↗Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetRotem Dror et al.2018 · 607 citations
2. Deep Dominance - How to Properly Compare Deep Neural Models ↗Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · no summary yetRotem Dror, Segev Shlomov, Roi Reichart2019 · 162 citations
3. A Statistical Analysis of Summarization Evaluation Metrics Using Resampling MethodsTransactions of the Association for Computational Linguistics (TACL)Daniel Deutsch, Rotem Dror, Dan Roth2021 · 117 citations
4. Replicability Analysis for Natural Language Processing: Testing Significance with Multiple Datasets ↗Transactions of the Association for Computational Linguistics · no summary yetRotem Dror et al.2017 · 98 citations
5. On the Limitations of Reference-Free Evaluations of Generated Text ↗Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · no summary yetDaniel Deutsch, Rotem Dror, Dan Roth2022 · 69 citations
6. Re-Examining System-Level Correlations of Automatic Summarization Evaluation Metrics ↗Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetDaniel Deutsch, Rotem Dror, Dan Roth2022 · 54 citations
7. The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Nitay Calderon, Roi Reichart, Rotem Dror2025 · 52 citations
8. RESIN-11: Schema-guided Event Prediction for 11 Newsworthy Scenarios ↗Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: System Demonstrations · no summary yetXinya Du et al.2022 · 38 citations
9. Zero-Shot On-the-Fly Event Schema Induction ↗Findings of the Association for Computational Linguistics: EACL 2023 · no summary yetRotem Dror, Haoyu Wang, Dan Roth2023 · 32 citations
10. Human-in-the-loop Schema Induction ↗Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations) · no summary yetTianyi Zhang et al.2023 · 22 citations

🤝 Co-authors here

4 co-authors with a page, the most papers together first.

• Dan Roth
• Daniel Deutsch
• Nitay Calderon
• Roi Reichart

Venues

Where their works here were published, the most works first, with the editions of those that have a page.

• Annual Meeting of the Association for Computational Linguistics (ACL) ×4: ACL 2025
• Transactions of the Association for Computational Linguistics (TACL) ×2: Transactions of the Association for Computational Linguistics (TACL) 2021
• Findings of the Association for Computational Linguistics: EACL 2023
• Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
• Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: System Demonstrations
• Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing

🔗 Cited by

Papers of our library cite their works 568 times (of the 149,439 papers whose bibliographies we read); 73 citing papers with a page here →.

Updated 30 October 2026

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/rotem-dror/