Tommaso Fornaciari
Tommaso Fornaciari has 3 papers in our library, in 2021–2023, most of them on Evaluation & benchmarks; often with Alexandra Uma, Barbara Plank, Massimo Poesio.
OpenAlex · ORCID · h-index 15 · 39 works · 829 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 259 times in our library · ⭐ Paper Stars ranking: #3641
Affiliations
Concepts, shelves and topics
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 3 worksArts and Humanities · 3 worksComputer Science · 3 worksLanguage and Linguistics · 3 worksDecision Sciences · 1 workStatistics, Probability and Uncertainty · 1 work
🧭 Topics 1Research subjects and languages the work is about.Evaluation & benchmarks · 1 work
Works by year
2020s
Papers
- We Need to Consider Disagreement in Evaluation (2021 · 185 citations)
This position paper questions the usual NLP practice of scoring predictions against a single aggregated "gold standard." The authors argue that this assumption breaks down because many items allow several valid labels and because annotators often disagree. - Beyond Black & White: Leveraging Annotator Disagreement via Soft-Label Multi-Task Learning (2021 · 143 citations)
Supervised NLP models usually train against a single "correct" label per item, even though human annotators often disagree. - SemEval-2023 Task 11: Learning with Disagreements (LeWiDi) (2023 · 100 citations)
Annotators of subjective NLP tasks such as hate speech or offensiveness detection often disagree, and merging their labels into one "gold" answer misrepresents the data.
Co-authors here
- Alexandra Uma ×3
- Barbara Plank ×3
- Massimo Poesio ×3
- Dirk Hovy ×2
- Silviu Paun ×2
- Valerio Basile ×2
- Dina Almanea
- Elisa Leonardelli
- Gavin Abercrombie
- Michael Fell
- Verena Rieser
Venues
- Conference of the North American Chapter of the Association for Computational Linguistics (NAACL): NAACL 2021
- International Workshop on Semantic Evaluation (SemEval): SemEval 2023
- Proceedings of the 1st Workshop on Benchmarking: Past, Present and Future
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/tommaso-fornaciari/