Nitay Calderon
Nitay Calderon has 3 papers in our library, in 2025–2026, most of them on Language models & pretraining; often with Roi Reichart, Idan Szpektor, Orgad Keller.
OpenAlex · h-index 6 · 45 works · 116 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 40 times in our library · ⭐ Paper Stars ranking: #7157
Affiliations
Fields, topics and concepts
📚 Shelves 10The field of science this work belongs to (OpenAlex fields).Social Sciences · 2 worksDecision Sciences · 1 workArtificial Intelligence · 2 worksComputer Science · 2 worksArts and Humanities · 1 workLanguage and Linguistics · 1 workLaw · 1 workPolitical Science and International Relations · 1 workStatistics, Probability and Uncertainty · 1 workSafety Research · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works
Works by year
2020s
Papers
- The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs (2025 · 52 citations)
Researchers increasingly use LLMs instead of people to label data or evaluate model outputs. There is no accepted, statistically grounded way to decide whether this substitution is justified. Common checks such as F1, kappa or correlation have no clear pass/fail threshold and cannot show that an LLM beats a human.… - Are LLMs Better than Reported? Detecting Label Errors and Mitigating Their Effect on Model Performance (2025 · 27 citations)
Benchmark labels are often treated as ground truth, yet both expert and crowd annotation introduce mistakes. - LIBERTy: A Causal Framework for Benchmarking Concept-Based Explanations of LLMs with Structural Counterfactuals (2026)
Judging whether a concept-based explanation of an LLM is faithful requires the true causal effect of a concept, such as gender or experience, on the model's output.
Co-authors here
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2025
- Conference on Empirical Methods in Natural Language Processing (EMNLP): EMNLP 2025
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2026
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/nitay-calderon/