Who cites «The Effectiveness of LLMs as Annotators: A Comparative Overview and Empirical Analysis of Direct Representation»
- LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation TasksarXiv:2406.18403Anna Bavaresco, Raffaella Bernardi, Leonardo Bertolazzi, et al.2024 · 141 citations
- The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Nitay Calderon, Roi Reichart, Rotem Dror2025 · 52 citations
- M-MAD: Multidimensional Multi-Agent Debate for Advanced Machine Translation EvaluationAnnual Meeting of the Association for Computational Linguistics (ACL)Zhaopeng Feng, Jiayuan Su, Jiamei Zheng, et al.2025 · 24 citations
- “Seeing the Big through the Small”: Can LLMs Approximate Human Judgment Distributions on NLI from a Few Explanations?Findings of the Association for Computational LinguisticsBeiduo Chen, Xinpeng Wang, Siyao Peng, et al.2024 · 18 citations
- A Rose by Any Other Name: LLM-Generated Explanations Are Good Proxies for Human Explanations to Collect Label Distributions on NLIFindings of the Association for Computational LinguisticsBeiduo Chen, Siyao Peng, Anna Korhonen, et al.2025 · 9 citations
- Analysis of LLM as a grammatical feature tagger for African American EnglishFindings of the Association for Computational LinguisticsRahul Porwal, Alice Rozet, Jotsna Gowda, et al.2025 · 4 citations
- How Long Reasoning Chains Influence LLMs' Judgment of Answer FactualityAnnual Meeting of the Association for Computational Linguistics (ACL)Minzhu Tu, Shiyu Ni, Keping Bi2026 · 3 citations
- Beyond English and Evasion: A Human-Annotated Multi-Domain Benchmark for High-Stakes LLM Safety Evaluation in ChineseWorkshop on the Role of Resources in the Age of Large Language ModelsWajdi Zaghouani, Kholoud Khalil Aldous, Yicheng Gao2026 · 2 citations
- SynthLLM: An LLM-based Scalable Synthetic Data Generation Pipeline for Low-Resource LanguagesLanguage Resources and Evaluation Conference (LREC)Solmaz Panahi, Vasudevan Nedumpozhimana, John Kelleher2026 · 1 citation
- Actors, Frames and Arguments: A Multi-Decade Computational Analysis of Climate Discourse in Financial News using Large Language ModelsFindings of the Association for Computational LinguisticsRuiran Su, Markus Leippold, Janet B. Pierrehumbert2026
- Annotating Indian Regional Biases using Large Language Models: Evaluation and AnalysisJoint Conference on Lexical and Computational Semantics (*SEM)Debasmita Panda, Akash Anil, Neelesh Kumar Shukla2026
- Challenging the Myth: A Research Arc on LLMs as Human SimulacraBig Picture v2: Crafting a Research NarrativeSimon Münker, Achim Rettinger, Damian Trilling2026
- GSI:detect - A Perspectivist Approach to Gender Stereotypes Identification in Italianedition of NLPerspectivesDavide Testa, Sofia Brenna, Manuela Speranza, et al.2026
- Human vs LLM in Conversational Repair Annotation: A New Resource and Comparative StudyLanguage Resources and Evaluation Conference (LREC)Anh Ngo, Nicolas Rollet, Catherine Pelachaud, et al.2026
- LLMs as annotators of credibility assessment in Danish asylum decisions: evaluating classification performance and errors beyond aggregated metricsLinguistic Annotation Workshop (LAW)Galadrielle Humblot-Renaux, Mohammad N. S. Jahromi, Rohat Bakuri-Jørgensen, et al.2026
- Quality and Appropriateness of Large Text Datasets for Irish NLPSIGUL Joint Workshop with ELE, EURALI, and DCLRL: Towards Inclusivity and Equality: Language Resources and Technologies for Under-Resourced and Endangered LanguagesAbigail Walsh, Mark Andrade, Jane Lauren Adkins, et al.2026
- Task Assignment meets Annotator Modeling: Human-LLM Collaborative Annotation with ConstraintsAnnual Meeting of the Association for Computational Linguistics (ACL)Kei Moriyama, Kouta Nakayama, Yukino Baba2026
- LLM Analysis of 150+ years of German Parliamentary Debates on Migration Reveals Shift from Post-War Solidarity to Anti-Solidarity in the Last DecadearXiv:2509.07274Aida Kostikova, Ole Putz, Steffen Eger, et al.2025
This page in Markdown → https://md.research.elamur.ai/free/en/papers/pavlovic-2024-effectiveness-llms-annotators-comparative-overview/cited-by/