Daniel Loureiro
Daniel Loureiro has 2 papers in our library, in 2019–2022, most of them on Language models & pretraining, Word sense disambiguation, Historical linguistics & language change; often with Alípio Jorge, Francesco Barbieri, Jose Camacho-Collados.
current affiliationCardiff University · Cardiff United Kingdom
OpenAlex · ORCID · h-index 11 · 35 works · 709 citations OpenAlex, 2026-10-14
2 works in our library · 155 citations in our library · ⭐ Paper Star rank #2902
Affiliations
🎓Cardiff UniversityCardiff ·
United Kingdom2022–2023 · 6 papers🔬INESC TECPorto ·
Portugal2018–2022 · 12 papers🎓Universidade do PortoPorto ·
Portugal2018–2022 · 10 papers🏢SnapLos Angeles ·
United States2022 · 3 papers🎓Grupo de Investigação em Engenharia e Computação Inteligente para a Inovação e o DesenvolvimentoPorto ·
Portugal2011 · 2 papers
Topics
Language models & pretraining2Word sense disambiguation1Historical linguistics & language change1
Works by year
2020s
2010s
Papers
- TimeLMs: Diachronic Language Models from Twitter (2022 · 331 citations)
Pre-trained language models are usually frozen at a single point in time. On Twitter, topics shift quickly, so models such as BERT or RoBERTa lack knowledge of later events like COVID-19, and evaluation data may overlap with pre-training corpora. TimeLMs addresses this with a series of Twitter-specialised… - Language Modelling Makes Sense: Propagating Representations through WordNet for Full-Coverage Word Sense Disambiguation (2019 · 189 citations)
Word Sense Disambiguation (WSD) has been hard to improve. Annotated data such as SemCor covers only a small part of WordNet, so earlier systems that used contextual embeddings had to fall back on the most frequent sense (MFS) for many words. Loureiro and Jorge build sense-level embeddings from BERT that cover every…
Co-authors here
Cited by
This page in Markdown → https://md.research.elamur.ai/free/en/authors/daniel-loureiro/