Benjamin Roth
Benjamin Roth has 6 papers in our library, in 2015–2026, most of them on Language models & pretraining, Reasoning, Knowledge graphs & ontologies; often with Yuxi Xia, Andreas Stephan, Andrew McCallum.
OpenAlex · ORCID · Wikidata · h-index 18 · 108 works · 1,521 citations OpenAlex, 2026-10-14
📄 6 works in our library · 🔗 Cited 162 times in our library · 4 more in our library without a page yet · ⭐ Paper Stars ranking: #4886
Affiliations
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 6 worksArts and Humanities · 6 worksComputer Science · 6 worksLanguage and Linguistics · 6 works
🧭 Topics 3Research subjects and languages the work is about.Knowledge graphs & ontologies · 1 workLanguage models & pretraining · 3 worksReasoning · 2 works
💡 Concepts 2Key ideas and methods explained on our concept pages.Distributional semantics · 1 workKnowledge graph · 1 work
Works by year
2020s
2010s
Papers
- Compositional Vector Space Models for Knowledge Base Completion (2015 · 281 citations)
The paper addresses knowledge base completion (KB completion), that is, automatically inferring missing triple facts from those already present in the graph. - From Calculation to Adjudication: Examining LLM judges on Mathematical Reasoning Tasks (2024 · 13 citations)
LLM-as-a-judge is usually validated by measuring agreement with human ratings on open-ended tasks such as summarization, and that agreement is inherently subjective. - Influences on LLM Calibration: A Study of Response Agreement, Loss Functions, and Prompt Styles (2025 · 11 citations)
LLMs often express confidence that does not match how often they are actually right. Earlier calibration methods were usually tested on only a few models and prompt formats. This paper runs a controlled comparison across 12 LLMs from five model families (2B–72B parameters), four prompt styles (Verbalized, Zero-shot… - Agree, Disagree, Explain: Decomposing Human Label Variation in NLI through the Lens of Explanations (2026 · 3 citations)
NLI datasets often contain conflicting labels for the same premise–hypothesis pair. Earlier work with the LiTEx taxonomy studied only one kind of variation: annotators who pick the same label but justify it differently. This paper extends LiTEx to cases where the labels themselves diverge. One trained annotator… - Explaining Generalization of AI-Generated Text Detectors Through Linguistic Analysis (2026 · 2 citations)
Fine-tuned classifiers that flag machine-written text score almost perfectly on data resembling their training material. Their accuracy falls, however, when the prompt, the generating model, or the domain changes. Earlier studies documented these drops but rarely explained them. - Compact Example-Based Explanations for Language Models (2026)
Influence estimation methods score how much each training document shaped a language model's output, but people can only inspect a handful of examples.
All works
- Compositional Vector Space Models for Knowledge Base CompletionAnnual Meeting of the Association for Computational Linguistics (ACL)Arvind Neelakantan, Benjamin Roth, Andrew McCallum2015 · 281 citations
- Joint Aspect and Polarity Classification for Aspect-based Sentiment Analysis with End-to-End Neural Networks ↗Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · no summary yetMartin Schmitt et al.2018 · 150 citations
- Multilingual Relation Extraction using Compositional Universal Schema ↗Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetPatrick Verga et al.2016 · 139 citations
- Evaluating neural network explanation methods using hybrid documents and morphosyntactic agreement ↗Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetNina Poerner, Hinrich Schütze, Benjamin Roth2018 · 105 citations
- From Calculation to Adjudication: Examining LLM judges on Mathematical Reasoning TasksarXiv:2409.04168Andreas Stephan, Dawei Zhu, Matthias Aßenmacher, et al.2024 · 13 citations
- Influences on LLM Calibration: A Study of Response Agreement, Loss Functions, and Prompt StylesAnnual Meeting of the Association for Computational Linguistics (ACL)Yuxi Xia, Pedro Henrique Luz De Araujo, Klim Zaporojets, et al.2025 · 11 citations
- Agree, Disagree, Explain: Decomposing Human Label Variation in NLI through the Lens of ExplanationsFindings of the Association for Computational LinguisticsPingjun Hong, Beiduo Chen, Siyao Peng, et al.2026 · 3 citations
- Explaining Generalization of AI-Generated Text Detectors Through Linguistic AnalysisConference of the European Chapter of the Association for Computational Linguistics (EACL)Yuxi Xia, Kinga Stańczak, Benjamin Roth2026 · 2 citations
- Data Centric Domain Adaptation for Historical Text with OCR Errors ↗arXiv:2107.00927 · no summary yetLuisa Marz et al.2021 · 1 citation
- Compact Example-Based Explanations for Language ModelsFindings of the Association for Computational LinguisticsLoris Schoenegger, Benjamin Roth2026
Co-authors here
- Yuxi Xia ×2
- Andreas Stephan
- Andrew McCallum
- Arvind Neelakantan
- Barbara Plank
- Beiduo Chen
- Dawei Zhu
- Marie-Catherine de Marneffe
- Matthias Aßenmacher
- Pingjun Hong
- Siyao Peng
- Xiaoyu Shen
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL) ×3: ACL 2025, ACL 2015
- Findings of the Association for Computational Linguistics ×2: Findings of the Association for Computational Linguistics 2026 ×2
- Conference of the European Chapter of the Association for Computational Linguistics (EACL): EACL 2026
- Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
- Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/benjamin-roth/